[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:14:54.358865  2025 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.250.126:42487
I20260709 13:14:54.360627  2025 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:14:54.361934  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:54.380482  2034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:54.380474  2032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:54.380607  2031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:54.381981  2025 server_base.cc:1061] running on GCE node
I20260709 13:14:55.620142  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:55.620422  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:55.620654  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783602895620630 us; error 0 us; skew 500 ppm
I20260709 13:14:55.621577  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:55.628712  2025 webserver.cc:533] Webserver started at http://127.1.250.126:34475/ using document root <none> and password file <none>
I20260709 13:14:55.629724  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:55.629982  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:55.630462  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:55.636456  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/master-0-root/instance:
uuid: "2c0bf169d6b64fa789f5aa349235569d"
format_stamp: "Formatted at 2026-07-09 13:14:55 on dist-test-slave-g4pn"
I20260709 13:14:55.645011  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:14:55.650725  2040 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:55.651988  2025 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:14:55.652357  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/master-0-root
uuid: "2c0bf169d6b64fa789f5aa349235569d"
format_stamp: "Formatted at 2026-07-09 13:14:55 on dist-test-slave-g4pn"
I20260709 13:14:55.652748  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:55.718432  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:55.720086  2025 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:14:55.720572  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:55.797463  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.126:42487
I20260709 13:14:55.797596  2091 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.126:42487 every 8 connection(s)
I20260709 13:14:55.806385  2092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:55.832136  2092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d: Bootstrap starting.
I20260709 13:14:55.838972  2092 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:55.841141  2092 log.cc:826] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d: Log is configured to *not* fsync() on all Append() calls
I20260709 13:14:55.846215  2092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d: No bootstrap required, opened a new log
I20260709 13:14:55.867743  2092 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0bf169d6b64fa789f5aa349235569d" member_type: VOTER }
I20260709 13:14:55.868335  2092 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:55.868547  2092 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0bf169d6b64fa789f5aa349235569d, State: Initialized, Role: FOLLOWER
I20260709 13:14:55.869655  2092 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0bf169d6b64fa789f5aa349235569d" member_type: VOTER }
I20260709 13:14:55.870144  2092 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:55.870401  2092 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:55.870702  2092 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:55.874850  2092 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0bf169d6b64fa789f5aa349235569d" member_type: VOTER }
I20260709 13:14:55.875651  2092 leader_election.cc:304] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c0bf169d6b64fa789f5aa349235569d; no voters: 
I20260709 13:14:55.877784  2092 leader_election.cc:290] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:55.878077  2095 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:55.881121  2095 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [term 1 LEADER]: Becoming Leader. State: Replica: 2c0bf169d6b64fa789f5aa349235569d, State: Running, Role: LEADER
I20260709 13:14:55.882133  2095 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0bf169d6b64fa789f5aa349235569d" member_type: VOTER }
I20260709 13:14:55.883373  2092 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:55.894930  2097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c0bf169d6b64fa789f5aa349235569d. Latest consensus state: current_term: 1 leader_uuid: "2c0bf169d6b64fa789f5aa349235569d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0bf169d6b64fa789f5aa349235569d" member_type: VOTER } }
I20260709 13:14:55.896443  2096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c0bf169d6b64fa789f5aa349235569d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0bf169d6b64fa789f5aa349235569d" member_type: VOTER } }
I20260709 13:14:55.897310  2096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:55.897316  2097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:55.900499  2105 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:55.912521  2105 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:55.922135  2025 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:55.933132  2105 catalog_manager.cc:1383] Generated new cluster ID: 9b9d8e5377584140934abf502370c3e0
I20260709 13:14:55.933468  2105 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:55.957677  2105 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:55.959281  2105 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:55.974974  2105 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d: Generated new TSK 0
I20260709 13:14:55.976015  2105 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:55.989712  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:55.998829  2114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:56.000921  2115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:56.006774  2025 server_base.cc:1061] running on GCE node
W20260709 13:14:56.006955  2117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:56.007963  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:56.008160  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:56.008394  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783602896008355 us; error 0 us; skew 500 ppm
I20260709 13:14:56.009011  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:56.013777  2025 webserver.cc:533] Webserver started at http://127.1.250.65:37541/ using document root <none> and password file <none>
I20260709 13:14:56.014405  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:56.014660  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:56.014953  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:56.016129  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/ts-0-root/instance:
uuid: "5dff3be607a343a09879ab364fc8bbc5"
format_stamp: "Formatted at 2026-07-09 13:14:56 on dist-test-slave-g4pn"
I20260709 13:14:56.022483  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.004s
I20260709 13:14:56.027302  2122 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:56.028172  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:14:56.028486  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/ts-0-root
uuid: "5dff3be607a343a09879ab364fc8bbc5"
format_stamp: "Formatted at 2026-07-09 13:14:56 on dist-test-slave-g4pn"
I20260709 13:14:56.028795  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:56.051239  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:56.052616  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:56.055788  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:56.060670  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:56.060909  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:56.061311  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:56.061519  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:56.176004  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.65:46037
I20260709 13:14:56.176059  2184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.65:46037 every 8 connection(s)
I20260709 13:14:56.184023  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:56.194208  2189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:56.196002  2190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:56.205799  2192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:56.207762  2185 heartbeater.cc:344] Connected to a master server at 127.1.250.126:42487
I20260709 13:14:56.208235  2185 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:56.209275  2185 heartbeater.cc:507] Master 127.1.250.126:42487 requested a full tablet report, sending...
I20260709 13:14:56.210959  2025 server_base.cc:1061] running on GCE node
I20260709 13:14:56.211859  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:56.212096  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:56.212292  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783602896212269 us; error 0 us; skew 500 ppm
I20260709 13:14:56.212875  2057 ts_manager.cc:194] Registered new tserver with Master: 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037)
I20260709 13:14:56.213025  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:56.216099  2057 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53612
I20260709 13:14:56.218873  2025 webserver.cc:533] Webserver started at http://127.1.250.66:39521/ using document root <none> and password file <none>
I20260709 13:14:56.219712  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:56.219995  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:56.220360  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:56.221650  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/ts-1-root/instance:
uuid: "069c6281111e43e7807aa8d79455e075"
format_stamp: "Formatted at 2026-07-09 13:14:56 on dist-test-slave-g4pn"
I20260709 13:14:56.227236  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:14:56.231794  2197 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:56.232672  2025 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:14:56.232987  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/ts-1-root
uuid: "069c6281111e43e7807aa8d79455e075"
format_stamp: "Formatted at 2026-07-09 13:14:56 on dist-test-slave-g4pn"
I20260709 13:14:56.233361  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:56.257305  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:56.259245  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:56.262131  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:56.265807  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:56.266011  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:56.266342  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:56.266489  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:56.360405  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.66:38913
I20260709 13:14:56.360785  2259 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.66:38913 every 8 connection(s)
I20260709 13:14:56.367218  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:56.376989  2263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:56.378331  2264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:56.384214  2260 heartbeater.cc:344] Connected to a master server at 127.1.250.126:42487
I20260709 13:14:56.384766  2260 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:56.386071  2260 heartbeater.cc:507] Master 127.1.250.126:42487 requested a full tablet report, sending...
I20260709 13:14:56.387853  2025 server_base.cc:1061] running on GCE node
I20260709 13:14:56.388921  2057 ts_manager.cc:194] Registered new tserver with Master: 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
W20260709 13:14:56.390108  2266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:56.391100  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:56.391336  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:56.391192  2057 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53616
I20260709 13:14:56.391549  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783602896391531 us; error 0 us; skew 500 ppm
I20260709 13:14:56.392261  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:56.395133  2025 webserver.cc:533] Webserver started at http://127.1.250.67:43407/ using document root <none> and password file <none>
I20260709 13:14:56.395910  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:56.396179  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:56.396473  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:56.397755  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/ts-2-root/instance:
uuid: "8193261563944939bd4415fc6bdbc26d"
format_stamp: "Formatted at 2026-07-09 13:14:56 on dist-test-slave-g4pn"
I20260709 13:14:56.402714  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:14:56.406280  2271 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:56.407236  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:14:56.407601  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/ts-2-root
uuid: "8193261563944939bd4415fc6bdbc26d"
format_stamp: "Formatted at 2026-07-09 13:14:56 on dist-test-slave-g4pn"
I20260709 13:14:56.408027  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602894180814-2025-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:56.435779  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:56.437044  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:56.438653  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:56.441587  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:56.441815  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:56.442070  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:56.442255  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:56.541819  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.67:33499
I20260709 13:14:56.541913  2333 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.67:33499 every 8 connection(s)
I20260709 13:14:56.558694  2334 heartbeater.cc:344] Connected to a master server at 127.1.250.126:42487
I20260709 13:14:56.559089  2334 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:56.559861  2334 heartbeater.cc:507] Master 127.1.250.126:42487 requested a full tablet report, sending...
I20260709 13:14:56.561918  2057 ts_manager.cc:194] Registered new tserver with Master: 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:56.562379  2025 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015549207s
I20260709 13:14:56.563278  2057 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53618
I20260709 13:14:56.618484  2057 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53632:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:56.622900  2057 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:56.726604  2146 tablet_service.cc:1511] Processing CreateTablet for tablet 784c999e56664bf4b0fcbe69b49d79f1 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:56.726435  2147 tablet_service.cc:1511] Processing CreateTablet for tablet bc8b4dc00c29444eb72b4ed19f635638 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:56.725536  2149 tablet_service.cc:1511] Processing CreateTablet for tablet 9d18f750daf54046b754cedcf567f17d (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:56.730665  2147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8b4dc00c29444eb72b4ed19f635638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.731694  2148 tablet_service.cc:1511] Processing CreateTablet for tablet bf3cf95e60ac400ab8f77e071b0fd766 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:56.733448  2150 tablet_service.cc:1511] Processing CreateTablet for tablet 82f2d80b0beb4310bc3c6fa4452c130e (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:56.736797  2149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d18f750daf54046b754cedcf567f17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.737973  2145 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba5caf0251f47f6a916d0647d23d612 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:56.739527  2145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba5caf0251f47f6a916d0647d23d612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.741760  2150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f2d80b0beb4310bc3c6fa4452c130e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.743348  2144 tablet_service.cc:1511] Processing CreateTablet for tablet 3b6eb66be8ec478ba3c38f3cc395c30e (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:56.744865  2144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b6eb66be8ec478ba3c38f3cc395c30e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.747421  2146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 784c999e56664bf4b0fcbe69b49d79f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.752249  2148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf3cf95e60ac400ab8f77e071b0fd766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.751814  2143 tablet_service.cc:1511] Processing CreateTablet for tablet 05ce6f31309e4aa9b9b59ecc88bee223 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:56.760774  2299 tablet_service.cc:1511] Processing CreateTablet for tablet 82f2d80b0beb4310bc3c6fa4452c130e (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:56.763731  2298 tablet_service.cc:1511] Processing CreateTablet for tablet 9d18f750daf54046b754cedcf567f17d (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:56.768069  2299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f2d80b0beb4310bc3c6fa4452c130e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.767333  2143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ce6f31309e4aa9b9b59ecc88bee223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.775854  2294 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba5caf0251f47f6a916d0647d23d612 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:56.775972  2293 tablet_service.cc:1511] Processing CreateTablet for tablet 3b6eb66be8ec478ba3c38f3cc395c30e (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:56.767620  2296 tablet_service.cc:1511] Processing CreateTablet for tablet bc8b4dc00c29444eb72b4ed19f635638 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:56.778285  2297 tablet_service.cc:1511] Processing CreateTablet for tablet bf3cf95e60ac400ab8f77e071b0fd766 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:56.782337  2295 tablet_service.cc:1511] Processing CreateTablet for tablet 784c999e56664bf4b0fcbe69b49d79f1 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:56.782621  2298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d18f750daf54046b754cedcf567f17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.789556  2142 tablet_service.cc:1511] Processing CreateTablet for tablet 43e3527afa7745958ef70c96bf1c93e4 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:56.782079  2292 tablet_service.cc:1511] Processing CreateTablet for tablet 05ce6f31309e4aa9b9b59ecc88bee223 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:56.808202  2297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf3cf95e60ac400ab8f77e071b0fd766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.812404  2296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8b4dc00c29444eb72b4ed19f635638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.816883  2142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e3527afa7745958ef70c96bf1c93e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.818995  2294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba5caf0251f47f6a916d0647d23d612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.831032  2293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b6eb66be8ec478ba3c38f3cc395c30e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.834825  2292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ce6f31309e4aa9b9b59ecc88bee223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.862555  2295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 784c999e56664bf4b0fcbe69b49d79f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.875227  2352 tablet_bootstrap.cc:492] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5: Bootstrap starting.
I20260709 13:14:56.877553  2291 tablet_service.cc:1511] Processing CreateTablet for tablet 43e3527afa7745958ef70c96bf1c93e4 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:56.884086  2291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e3527afa7745958ef70c96bf1c93e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.914862  2218 tablet_service.cc:1511] Processing CreateTablet for tablet 05ce6f31309e4aa9b9b59ecc88bee223 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:56.916265  2218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ce6f31309e4aa9b9b59ecc88bee223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.908876  2220 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba5caf0251f47f6a916d0647d23d612 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:56.928179  2220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba5caf0251f47f6a916d0647d23d612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.933923  2219 tablet_service.cc:1511] Processing CreateTablet for tablet 3b6eb66be8ec478ba3c38f3cc395c30e (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:56.935158  2222 tablet_service.cc:1511] Processing CreateTablet for tablet bc8b4dc00c29444eb72b4ed19f635638 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
W20260709 13:14:56.941131  2104 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:56.927992  2221 tablet_service.cc:1511] Processing CreateTablet for tablet 784c999e56664bf4b0fcbe69b49d79f1 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:56.944474  2217 tablet_service.cc:1511] Processing CreateTablet for tablet 43e3527afa7745958ef70c96bf1c93e4 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:56.926296  2223 tablet_service.cc:1511] Processing CreateTablet for tablet bf3cf95e60ac400ab8f77e071b0fd766 (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:56.952509  2225 tablet_service.cc:1511] Processing CreateTablet for tablet 82f2d80b0beb4310bc3c6fa4452c130e (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:56.954283  2224 tablet_service.cc:1511] Processing CreateTablet for tablet 9d18f750daf54046b754cedcf567f17d (DEFAULT_TABLE table=test-workload [id=33da1da768a64c3a93f2923182d8007a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:56.979027  2222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8b4dc00c29444eb72b4ed19f635638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.001113  2221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 784c999e56664bf4b0fcbe69b49d79f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.026957  2353 tablet_bootstrap.cc:492] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d: Bootstrap starting.
I20260709 13:14:57.036456  2224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d18f750daf54046b754cedcf567f17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.039342  2219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b6eb66be8ec478ba3c38f3cc395c30e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.042435  2225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f2d80b0beb4310bc3c6fa4452c130e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.061045  2354 tablet_bootstrap.cc:492] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075: Bootstrap starting.
I20260709 13:14:57.058843  2217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e3527afa7745958ef70c96bf1c93e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.067386  2223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf3cf95e60ac400ab8f77e071b0fd766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.066310  2352 tablet_bootstrap.cc:654] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.072202  2353 tablet_bootstrap.cc:654] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.094960  2354 tablet_bootstrap.cc:654] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.110430  2352 tablet_bootstrap.cc:492] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5: No bootstrap required, opened a new log
I20260709 13:14:57.111435  2352 ts_tablet_manager.cc:1403] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5: Time spent bootstrapping tablet: real 0.240s	user 0.012s	sys 0.010s
I20260709 13:14:57.115692  2352 raft_consensus.cc:359] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:14:57.116513  2352 raft_consensus.cc:385] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.116818  2352 raft_consensus.cc:740] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.120131  2352 consensus_queue.cc:260] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:14:57.131846  2353 tablet_bootstrap.cc:492] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d: No bootstrap required, opened a new log
I20260709 13:14:57.133605  2353 ts_tablet_manager.cc:1403] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d: Time spent bootstrapping tablet: real 0.111s	user 0.007s	sys 0.027s
I20260709 13:14:57.131963  2354 tablet_bootstrap.cc:492] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075: No bootstrap required, opened a new log
I20260709 13:14:57.137727  2354 ts_tablet_manager.cc:1403] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075: Time spent bootstrapping tablet: real 0.077s	user 0.024s	sys 0.017s
I20260709 13:14:57.139128  2185 heartbeater.cc:499] Master 127.1.250.126:42487 was elected leader, sending a full tablet report...
I20260709 13:14:57.149202  2353 raft_consensus.cc:359] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.153777  2353 raft_consensus.cc:385] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.150441  2352 ts_tablet_manager.cc:1434] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.014s
I20260709 13:14:57.155293  2352 tablet_bootstrap.cc:492] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5: Bootstrap starting.
I20260709 13:14:57.159080  2353 raft_consensus.cc:740] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.160871  2353 consensus_queue.cc:260] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.161249  2354 raft_consensus.cc:359] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.162122  2354 raft_consensus.cc:385] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.162473  2354 raft_consensus.cc:740] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.165741  2352 tablet_bootstrap.cc:654] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.169782  2354 consensus_queue.cc:260] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.177179  2260 heartbeater.cc:499] Master 127.1.250.126:42487 was elected leader, sending a full tablet report...
I20260709 13:14:57.179736  2354 ts_tablet_manager.cc:1434] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.002s
I20260709 13:14:57.180857  2354 tablet_bootstrap.cc:492] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075: Bootstrap starting.
I20260709 13:14:57.182305  2361 raft_consensus.cc:493] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.182858  2361 raft_consensus.cc:515] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.184546  2334 heartbeater.cc:499] Master 127.1.250.126:42487 was elected leader, sending a full tablet report...
W20260709 13:14:57.185964  2186 tablet.cc:2406] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:14:57.189101  2361 leader_election.cc:290] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:57.198637  2352 tablet_bootstrap.cc:492] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5: No bootstrap required, opened a new log
I20260709 13:14:57.199360  2352 ts_tablet_manager.cc:1403] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.000s
I20260709 13:14:57.201884  2353 ts_tablet_manager.cc:1434] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d: Time spent starting tablet: real 0.068s	user 0.016s	sys 0.010s
I20260709 13:14:57.202930  2353 tablet_bootstrap.cc:492] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d: Bootstrap starting.
I20260709 13:14:57.205413  2352 raft_consensus.cc:359] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.206286  2352 raft_consensus.cc:385] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.206578  2352 raft_consensus.cc:740] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.207378  2352 consensus_queue.cc:260] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.213820  2354 tablet_bootstrap.cc:654] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.218806  2352 ts_tablet_manager.cc:1434] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:14:57.224702  2352 tablet_bootstrap.cc:492] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5: Bootstrap starting.
I20260709 13:14:57.231957  2353 tablet_bootstrap.cc:654] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.243006  2352 tablet_bootstrap.cc:654] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.243901  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ce6f31309e4aa9b9b59ecc88bee223" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5" is_pre_election: true
I20260709 13:14:57.250651  2353 tablet_bootstrap.cc:492] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d: No bootstrap required, opened a new log
I20260709 13:14:57.250665  2354 tablet_bootstrap.cc:492] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075: No bootstrap required, opened a new log
I20260709 13:14:57.252171  2354 ts_tablet_manager.cc:1403] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.006s
W20260709 13:14:57.252173  2200 leader_election.cc:343] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.252403  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ce6f31309e4aa9b9b59ecc88bee223" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8193261563944939bd4415fc6bdbc26d" is_pre_election: true
I20260709 13:14:57.253701  2353 ts_tablet_manager.cc:1403] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.009s
W20260709 13:14:57.254681  2199 leader_election.cc:343] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.255122  2199 leader_election.cc:304] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069c6281111e43e7807aa8d79455e075; no voters: 5dff3be607a343a09879ab364fc8bbc5, 8193261563944939bd4415fc6bdbc26d
I20260709 13:14:57.255983  2354 raft_consensus.cc:359] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.256440  2362 raft_consensus.cc:2749] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:57.256771  2354 raft_consensus.cc:385] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.257297  2354 raft_consensus.cc:740] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.257169  2353 raft_consensus.cc:359] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.258126  2353 raft_consensus.cc:385] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.258836  2353 raft_consensus.cc:740] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.258134  2354 consensus_queue.cc:260] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.259649  2353 consensus_queue.cc:260] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.263520  2354 ts_tablet_manager.cc:1434] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:14:57.264703  2354 tablet_bootstrap.cc:492] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075: Bootstrap starting.
I20260709 13:14:57.264832  2353 ts_tablet_manager.cc:1434] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:14:57.265823  2353 tablet_bootstrap.cc:492] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d: Bootstrap starting.
I20260709 13:14:57.272140  2354 tablet_bootstrap.cc:654] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.278586  2352 tablet_bootstrap.cc:492] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5: No bootstrap required, opened a new log
I20260709 13:14:57.279160  2352 ts_tablet_manager.cc:1403] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.010s
I20260709 13:14:57.282795  2352 raft_consensus.cc:359] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.283583  2352 raft_consensus.cc:385] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.283934  2352 raft_consensus.cc:740] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.284842  2352 consensus_queue.cc:260] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.286443  2358 raft_consensus.cc:493] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.287431  2353 tablet_bootstrap.cc:654] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.287281  2358 raft_consensus.cc:515] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.297066  2358 leader_election.cc:290] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:57.299144  2358 raft_consensus.cc:493] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.300531  2358 raft_consensus.cc:515] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.318233  2352 ts_tablet_manager.cc:1434] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.003s
I20260709 13:14:57.320199  2352 tablet_bootstrap.cc:492] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5: Bootstrap starting.
I20260709 13:14:57.326805  2354 tablet_bootstrap.cc:492] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075: No bootstrap required, opened a new log
I20260709 13:14:57.329105  2354 ts_tablet_manager.cc:1403] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.037s
I20260709 13:14:57.321188  2358 leader_election.cc:290] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:57.337126  2352 tablet_bootstrap.cc:654] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.344707  2354 raft_consensus.cc:359] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.345783  2354 raft_consensus.cc:385] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.346171  2354 raft_consensus.cc:740] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.347368  2354 consensus_queue.cc:260] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.351212  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075" is_pre_election: true
I20260709 13:14:57.353547  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8b4dc00c29444eb72b4ed19f635638" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075" is_pre_election: true
I20260709 13:14:57.354187  2235 raft_consensus.cc:2468] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 0.
W20260709 13:14:57.355652  2124 leader_election.cc:343] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.356514  2124 leader_election.cc:304] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 5dff3be607a343a09879ab364fc8bbc5; no voters: 
I20260709 13:14:57.357388  2358 raft_consensus.cc:2804] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:57.357723  2358 raft_consensus.cc:493] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.358044  2358 raft_consensus.cc:3060] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.358846  2353 tablet_bootstrap.cc:492] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d: No bootstrap required, opened a new log
I20260709 13:14:57.359447  2353 ts_tablet_manager.cc:1403] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.019s
I20260709 13:14:57.362290  2352 tablet_bootstrap.cc:492] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5: No bootstrap required, opened a new log
I20260709 13:14:57.362738  2352 ts_tablet_manager.cc:1403] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.009s
I20260709 13:14:57.363983  2358 raft_consensus.cc:515] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.364539  2354 ts_tablet_manager.cc:1434] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:14:57.364426  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8193261563944939bd4415fc6bdbc26d" is_pre_election: true
I20260709 13:14:57.364614  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8b4dc00c29444eb72b4ed19f635638" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8193261563944939bd4415fc6bdbc26d" is_pre_election: true
I20260709 13:14:57.365414  2308 raft_consensus.cc:2468] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 0.
I20260709 13:14:57.366215  2358 leader_election.cc:290] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 election: Requested vote from peers 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:57.367034  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8b4dc00c29444eb72b4ed19f635638" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:14:57.367551  2235 raft_consensus.cc:3060] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.368582  2352 raft_consensus.cc:359] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.369531  2352 raft_consensus.cc:385] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:14:57.370420  2124 leader_election.cc:343] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.370440  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8b4dc00c29444eb72b4ed19f635638" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:14:57.371066  2124 leader_election.cc:304] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5; no voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d
I20260709 13:14:57.371340  2308 raft_consensus.cc:3060] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.372707  2358 raft_consensus.cc:2749] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:57.374109  2235 raft_consensus.cc:2468] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 1.
I20260709 13:14:57.374220  2353 raft_consensus.cc:359] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.374992  2353 raft_consensus.cc:385] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.375273  2353 raft_consensus.cc:740] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.375322  2124 leader_election.cc:304] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 5dff3be607a343a09879ab364fc8bbc5; no voters: 
I20260709 13:14:57.376263  2358 raft_consensus.cc:2804] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:57.376223  2353 consensus_queue.cc:260] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.376783  2358 raft_consensus.cc:697] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 LEADER]: Becoming Leader. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Running, Role: LEADER
I20260709 13:14:57.377943  2358 consensus_queue.cc:237] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.378700  2353 ts_tablet_manager.cc:1434] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.007s
I20260709 13:14:57.383054  2308 raft_consensus.cc:2468] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 1.
I20260709 13:14:57.383206  2354 tablet_bootstrap.cc:492] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075: Bootstrap starting.
I20260709 13:14:57.369903  2352 raft_consensus.cc:740] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.384771  2352 consensus_queue.cc:260] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.386997  2352 ts_tablet_manager.cc:1434] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 13:14:57.388132  2352 tablet_bootstrap.cc:492] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5: Bootstrap starting.
I20260709 13:14:57.394704  2352 tablet_bootstrap.cc:654] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.397586  2353 tablet_bootstrap.cc:492] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d: Bootstrap starting.
I20260709 13:14:57.399298  2056 catalog_manager.cc:5697] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "5dff3be607a343a09879ab364fc8bbc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:57.402891  2354 tablet_bootstrap.cc:654] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.406713  2353 tablet_bootstrap.cc:654] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.406728  2352 tablet_bootstrap.cc:492] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5: No bootstrap required, opened a new log
I20260709 13:14:57.407342  2352 ts_tablet_manager.cc:1403] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:14:57.410418  2352 raft_consensus.cc:359] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.411154  2352 raft_consensus.cc:385] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.411442  2352 raft_consensus.cc:740] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.412185  2352 consensus_queue.cc:260] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.414666  2352 ts_tablet_manager.cc:1434] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:57.415620  2352 tablet_bootstrap.cc:492] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5: Bootstrap starting.
I20260709 13:14:57.426220  2354 tablet_bootstrap.cc:492] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075: No bootstrap required, opened a new log
I20260709 13:14:57.427572  2354 ts_tablet_manager.cc:1403] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.015s
I20260709 13:14:57.431628  2352 tablet_bootstrap.cc:654] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.433326  2359 raft_consensus.cc:493] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.434273  2359 raft_consensus.cc:515] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.436735  2353 tablet_bootstrap.cc:492] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d: No bootstrap required, opened a new log
I20260709 13:14:57.438024  2359 leader_election.cc:290] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:14:57.442785  2353 ts_tablet_manager.cc:1403] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d: Time spent bootstrapping tablet: real 0.063s	user 0.022s	sys 0.003s
I20260709 13:14:57.446238  2354 raft_consensus.cc:359] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.448155  2354 raft_consensus.cc:385] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.449129  2354 raft_consensus.cc:740] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.446791  2353 raft_consensus.cc:359] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.451031  2353 raft_consensus.cc:385] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.451568  2358 raft_consensus.cc:493] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.451845  2353 raft_consensus.cc:740] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.452536  2352 tablet_bootstrap.cc:492] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5: No bootstrap required, opened a new log
I20260709 13:14:57.452069  2358 raft_consensus.cc:515] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:14:57.451124  2354 consensus_queue.cc:260] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.456439  2353 consensus_queue.cc:260] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.458151  2354 ts_tablet_manager.cc:1434] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:14:57.459384  2354 tablet_bootstrap.cc:492] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075: Bootstrap starting.
I20260709 13:14:57.462446  2353 ts_tablet_manager.cc:1434] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:14:57.464320  2353 tablet_bootstrap.cc:492] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d: Bootstrap starting.
I20260709 13:14:57.466902  2358 leader_election.cc:290] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:14:57.469303  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8193261563944939bd4415fc6bdbc26d" is_pre_election: true
I20260709 13:14:57.469849  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075" is_pre_election: true
W20260709 13:14:57.470832  2124 leader_election.cc:343] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.471511  2352 ts_tablet_manager.cc:1403] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5: Time spent bootstrapping tablet: real 0.056s	user 0.004s	sys 0.016s
W20260709 13:14:57.471539  2124 leader_election.cc:343] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.472045  2124 leader_election.cc:304] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5; no voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d
I20260709 13:14:57.472795  2358 raft_consensus.cc:2749] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:57.475325  2352 raft_consensus.cc:359] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.476038  2352 raft_consensus.cc:385] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.476325  2352 raft_consensus.cc:740] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.477048  2352 consensus_queue.cc:260] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.483784  2353 tablet_bootstrap.cc:654] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.479497  2352 ts_tablet_manager.cc:1434] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:14:57.488225  2352 tablet_bootstrap.cc:492] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5: Bootstrap starting.
I20260709 13:14:57.496943  2354 tablet_bootstrap.cc:654] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.497426  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784c999e56664bf4b0fcbe69b49d79f1" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075" is_pre_election: true
I20260709 13:14:57.498660  2235 raft_consensus.cc:2468] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 0.
I20260709 13:14:57.503079  2273 leader_election.cc:304] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:14:57.505146  2359 raft_consensus.cc:2804] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:57.505525  2359 raft_consensus.cc:493] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.505852  2359 raft_consensus.cc:3060] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.512902  2359 raft_consensus.cc:515] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.515067  2359 leader_election.cc:290] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:14:57.516775  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784c999e56664bf4b0fcbe69b49d79f1" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5" is_pre_election: true
I20260709 13:14:57.517648  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784c999e56664bf4b0fcbe69b49d79f1" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:14:57.518044  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784c999e56664bf4b0fcbe69b49d79f1" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:14:57.518935  2235 raft_consensus.cc:3060] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:57.520668  2274 leader_election.cc:343] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:57.525385  2274 leader_election.cc:343] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.526945  2352 tablet_bootstrap.cc:654] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.531404  2235 raft_consensus.cc:2468] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 1.
I20260709 13:14:57.534080  2354 tablet_bootstrap.cc:492] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075: No bootstrap required, opened a new log
I20260709 13:14:57.534739  2353 tablet_bootstrap.cc:492] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d: No bootstrap required, opened a new log
I20260709 13:14:57.534677  2273 leader_election.cc:304] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d; no voters: 5dff3be607a343a09879ab364fc8bbc5
I20260709 13:14:57.535405  2353 ts_tablet_manager.cc:1403] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d: Time spent bootstrapping tablet: real 0.071s	user 0.033s	sys 0.013s
I20260709 13:14:57.536041  2359 raft_consensus.cc:2804] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:57.537848  2352 tablet_bootstrap.cc:492] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5: No bootstrap required, opened a new log
I20260709 13:14:57.537892  2354 ts_tablet_manager.cc:1403] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.002s
I20260709 13:14:57.538578  2352 ts_tablet_manager.cc:1403] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.004s
I20260709 13:14:57.539214  2353 raft_consensus.cc:359] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.540316  2353 raft_consensus.cc:385] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.540766  2353 raft_consensus.cc:740] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.541179  2354 raft_consensus.cc:359] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:14:57.541994  2354 raft_consensus.cc:385] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.542321  2354 raft_consensus.cc:740] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.543388  2362 raft_consensus.cc:493] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.543123  2354 consensus_queue.cc:260] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:14:57.543996  2362 raft_consensus.cc:515] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.547472  2362 leader_election.cc:290] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:57.542543  2352 raft_consensus.cc:359] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.549264  2352 raft_consensus.cc:385] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.549157  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8193261563944939bd4415fc6bdbc26d" is_pre_election: true
I20260709 13:14:57.549844  2352 raft_consensus.cc:740] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.549543  2353 consensus_queue.cc:260] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.550024  2308 raft_consensus.cc:2468] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 0.
I20260709 13:14:57.551813  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5" is_pre_election: true
I20260709 13:14:57.552342  2388 raft_consensus.cc:493] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.552444  2159 raft_consensus.cc:2468] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 0.
I20260709 13:14:57.551187  2199 leader_election.cc:304] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:14:57.554391  2362 raft_consensus.cc:2804] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:57.554759  2362 raft_consensus.cc:493] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.554194  2352 consensus_queue.cc:260] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.555132  2362 raft_consensus.cc:3060] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.555294  2359 raft_consensus.cc:697] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Becoming Leader. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:14:57.552800  2388 raft_consensus.cc:515] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.556416  2359 consensus_queue.cc:237] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.557861  2352 ts_tablet_manager.cc:1434] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:14:57.560330  2352 tablet_bootstrap.cc:492] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5: Bootstrap starting.
I20260709 13:14:57.563717  2388 leader_election.cc:290] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:14:57.566625  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5" is_pre_election: true
I20260709 13:14:57.567540  2159 raft_consensus.cc:2468] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 0.
I20260709 13:14:57.569849  2274 leader_election.cc:304] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:14:57.568711  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075" is_pre_election: true
W20260709 13:14:57.571794  2273 leader_election.cc:343] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.573019  2388 raft_consensus.cc:2804] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:57.573419  2388 raft_consensus.cc:493] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.573730  2388 raft_consensus.cc:3060] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.577008  2354 ts_tablet_manager.cc:1434] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075: Time spent starting tablet: real 0.039s	user 0.001s	sys 0.006s
I20260709 13:14:57.583983  2388 raft_consensus.cc:515] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.586107  2354 tablet_bootstrap.cc:492] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075: Bootstrap starting.
I20260709 13:14:57.590915  2388 leader_election.cc:290] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:14:57.586812  2353 ts_tablet_manager.cc:1434] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d: Time spent starting tablet: real 0.051s	user 0.025s	sys 0.009s
I20260709 13:14:57.592272  2353 tablet_bootstrap.cc:492] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d: Bootstrap starting.
I20260709 13:14:57.587327  2362 raft_consensus.cc:515] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.592418  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075"
W20260709 13:14:57.593953  2273 leader_election.cc:343] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.594797  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:14:57.595330  2159 raft_consensus.cc:3060] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.595680  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:14:57.596249  2308 raft_consensus.cc:3060] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.596436  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:14:57.597030  2160 raft_consensus.cc:3060] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.603222  2159 raft_consensus.cc:2468] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 1.
I20260709 13:14:57.607546  2362 leader_election.cc:290] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 1 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:57.608060  2274 leader_election.cc:304] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5, 8193261563944939bd4415fc6bdbc26d; no voters: 069c6281111e43e7807aa8d79455e075
I20260709 13:14:57.595319  2055 catalog_manager.cc:5697] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8193261563944939bd4415fc6bdbc26d (127.1.250.67). New cstate: current_term: 1 leader_uuid: "8193261563944939bd4415fc6bdbc26d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:57.609611  2388 raft_consensus.cc:2804] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:57.606777  2352 tablet_bootstrap.cc:654] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.604373  2160 raft_consensus.cc:2468] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 1.
I20260709 13:14:57.617300  2353 tablet_bootstrap.cc:654] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.617581  2200 leader_election.cc:304] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 5dff3be607a343a09879ab364fc8bbc5; no voters: 
I20260709 13:14:57.605611  2308 raft_consensus.cc:2468] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 1.
I20260709 13:14:57.618382  2362 raft_consensus.cc:2804] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:57.618901  2362 raft_consensus.cc:697] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 1 LEADER]: Becoming Leader. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:14:57.619226  2358 raft_consensus.cc:493] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.610150  2388 raft_consensus.cc:697] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Becoming Leader. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:14:57.619663  2358 raft_consensus.cc:515] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.619777  2362 consensus_queue.cc:237] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.620440  2388 consensus_queue.cc:237] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.623402  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e3527afa7745958ef70c96bf1c93e4" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8193261563944939bd4415fc6bdbc26d" is_pre_election: true
I20260709 13:14:57.624114  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e3527afa7745958ef70c96bf1c93e4" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075" is_pre_election: true
W20260709 13:14:57.624769  2124 leader_election.cc:343] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.622339  2358 leader_election.cc:290] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
W20260709 13:14:57.625735  2124 leader_election.cc:343] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.626240  2124 leader_election.cc:304] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5; no voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d
I20260709 13:14:57.627573  2354 tablet_bootstrap.cc:654] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.628228  2358 raft_consensus.cc:2749] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:57.634411  2352 tablet_bootstrap.cc:492] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5: No bootstrap required, opened a new log
I20260709 13:14:57.634989  2352 ts_tablet_manager.cc:1403] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5: Time spent bootstrapping tablet: real 0.075s	user 0.017s	sys 0.000s
I20260709 13:14:57.638326  2352 raft_consensus.cc:359] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.639209  2352 raft_consensus.cc:385] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.639519  2352 raft_consensus.cc:740] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.640242  2352 consensus_queue.cc:260] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.641187  2353 tablet_bootstrap.cc:492] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d: No bootstrap required, opened a new log
I20260709 13:14:57.641678  2353 ts_tablet_manager.cc:1403] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.006s
I20260709 13:14:57.650688  2352 ts_tablet_manager.cc:1434] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:14:57.653614  2055 catalog_manager.cc:5697] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069c6281111e43e7807aa8d79455e075 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "069c6281111e43e7807aa8d79455e075" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:57.658684  2354 tablet_bootstrap.cc:492] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075: No bootstrap required, opened a new log
I20260709 13:14:57.659271  2354 ts_tablet_manager.cc:1403] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.009s
I20260709 13:14:57.644747  2353 raft_consensus.cc:359] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:14:57.660204  2353 raft_consensus.cc:385] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.660696  2353 raft_consensus.cc:740] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.661645  2353 consensus_queue.cc:260] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:14:57.663020  2354 raft_consensus.cc:359] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.663786  2354 raft_consensus.cc:385] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.664207  2353 ts_tablet_manager.cc:1434] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.003s
I20260709 13:14:57.664152  2354 raft_consensus.cc:740] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.663921  2056 catalog_manager.cc:5697] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8193261563944939bd4415fc6bdbc26d (127.1.250.67). New cstate: current_term: 1 leader_uuid: "8193261563944939bd4415fc6bdbc26d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:57.665517  2353 tablet_bootstrap.cc:492] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d: Bootstrap starting.
I20260709 13:14:57.665246  2354 consensus_queue.cc:260] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.670490  2352 tablet_bootstrap.cc:492] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5: Bootstrap starting.
I20260709 13:14:57.674769  2353 tablet_bootstrap.cc:654] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.674943  2358 raft_consensus.cc:493] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.675437  2358 raft_consensus.cc:515] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.678192  2358 leader_election.cc:290] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:57.680912  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b6eb66be8ec478ba3c38f3cc395c30e" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075" is_pre_election: true
I20260709 13:14:57.681049  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b6eb66be8ec478ba3c38f3cc395c30e" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8193261563944939bd4415fc6bdbc26d" is_pre_election: true
I20260709 13:14:57.681669  2235 raft_consensus.cc:2468] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 0.
I20260709 13:14:57.682868  2124 leader_election.cc:304] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 5dff3be607a343a09879ab364fc8bbc5; no voters: 
I20260709 13:14:57.683670  2358 raft_consensus.cc:2804] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:57.683802  2124 leader_election.cc:343] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.684232  2358 raft_consensus.cc:493] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.684602  2358 raft_consensus.cc:3060] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.685416  2352 tablet_bootstrap.cc:654] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.683329  2354 ts_tablet_manager.cc:1434] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:14:57.692975  2354 tablet_bootstrap.cc:492] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075: Bootstrap starting.
I20260709 13:14:57.700094  2358 raft_consensus.cc:515] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.703841  2369 raft_consensus.cc:493] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.705148  2358 leader_election.cc:290] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 election: Requested vote from peers 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:57.704465  2369 raft_consensus.cc:515] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.708088  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b6eb66be8ec478ba3c38f3cc395c30e" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:14:57.708088  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b6eb66be8ec478ba3c38f3cc395c30e" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:14:57.710100  2235 raft_consensus.cc:3060] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:57.710263  2124 leader_election.cc:343] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.712915  2352 tablet_bootstrap.cc:492] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5: No bootstrap required, opened a new log
I20260709 13:14:57.713464  2352 ts_tablet_manager.cc:1403] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.003s
I20260709 13:14:57.717016  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075" is_pre_election: true
I20260709 13:14:57.718735  2352 raft_consensus.cc:359] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.719478  2352 raft_consensus.cc:385] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.716607  2369 leader_election.cc:290] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:57.719777  2352 raft_consensus.cc:740] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.718806  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8193261563944939bd4415fc6bdbc26d" is_pre_election: true
I20260709 13:14:57.720592  2352 consensus_queue.cc:260] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
W20260709 13:14:57.721773  2124 leader_election.cc:343] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.722393  2235 raft_consensus.cc:2468] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 1.
W20260709 13:14:57.722471  2124 leader_election.cc:343] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.722994  2124 leader_election.cc:304] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5; no voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d
I20260709 13:14:57.724576  2354 tablet_bootstrap.cc:654] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.725466  2369 raft_consensus.cc:2749] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:57.726085  2124 leader_election.cc:304] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 5dff3be607a343a09879ab364fc8bbc5; no voters: 8193261563944939bd4415fc6bdbc26d
I20260709 13:14:57.727109  2369 raft_consensus.cc:2804] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:57.727684  2369 raft_consensus.cc:697] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 1 LEADER]: Becoming Leader. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Running, Role: LEADER
I20260709 13:14:57.728770  2369 consensus_queue.cc:237] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.731841  2353 tablet_bootstrap.cc:492] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d: No bootstrap required, opened a new log
I20260709 13:14:57.732336  2353 ts_tablet_manager.cc:1403] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.014s
I20260709 13:14:57.735654  2353 raft_consensus.cc:359] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.736382  2353 raft_consensus.cc:385] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.736682  2353 raft_consensus.cc:740] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.737496  2353 consensus_queue.cc:260] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.739099  2352 ts_tablet_manager.cc:1434] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:14:57.742375  2353 ts_tablet_manager.cc:1434] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:14:57.743441  2353 tablet_bootstrap.cc:492] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d: Bootstrap starting.
I20260709 13:14:57.752058  2354 tablet_bootstrap.cc:492] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075: No bootstrap required, opened a new log
I20260709 13:14:57.752601  2354 ts_tablet_manager.cc:1403] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.013s
I20260709 13:14:57.755610  2354 raft_consensus.cc:359] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.756405  2354 raft_consensus.cc:385] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.756757  2354 raft_consensus.cc:740] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.756551  2055 catalog_manager.cc:5697] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "5dff3be607a343a09879ab364fc8bbc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:57.758105  2354 consensus_queue.cc:260] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.760118  2353 tablet_bootstrap.cc:654] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.760689  2354 ts_tablet_manager.cc:1434] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:14:57.761747  2354 tablet_bootstrap.cc:492] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075: Bootstrap starting.
I20260709 13:14:57.768348  2354 tablet_bootstrap.cc:654] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.786482  2369 consensus_queue.cc:1048] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:57.790333  2354 tablet_bootstrap.cc:492] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075: No bootstrap required, opened a new log
I20260709 13:14:57.790891  2354 ts_tablet_manager.cc:1403] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.008s
I20260709 13:14:57.793785  2354 raft_consensus.cc:359] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.794445  2354 raft_consensus.cc:385] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.794865  2354 raft_consensus.cc:740] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.795739  2353 tablet_bootstrap.cc:492] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d: No bootstrap required, opened a new log
I20260709 13:14:57.795555  2354 consensus_queue.cc:260] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.796198  2353 ts_tablet_manager.cc:1403] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.022s
I20260709 13:14:57.797578  2354 ts_tablet_manager.cc:1434] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:14:57.798446  2354 tablet_bootstrap.cc:492] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075: Bootstrap starting.
I20260709 13:14:57.798993  2353 raft_consensus.cc:359] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.799754  2353 raft_consensus.cc:385] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.800076  2353 raft_consensus.cc:740] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.801127  2353 consensus_queue.cc:260] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.803206  2353 ts_tablet_manager.cc:1434] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:57.804191  2353 tablet_bootstrap.cc:492] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d: Bootstrap starting.
I20260709 13:14:57.807624  2354 tablet_bootstrap.cc:654] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.810698  2353 tablet_bootstrap.cc:654] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.820443  2354 tablet_bootstrap.cc:492] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075: No bootstrap required, opened a new log
I20260709 13:14:57.821226  2354 ts_tablet_manager.cc:1403] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 13:14:57.825349  2354 raft_consensus.cc:359] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.826503  2354 raft_consensus.cc:385] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.826982  2354 raft_consensus.cc:740] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.827891  2354 consensus_queue.cc:260] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.831717  2354 ts_tablet_manager.cc:1434] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:14:57.831883  2353 tablet_bootstrap.cc:492] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d: No bootstrap required, opened a new log
I20260709 13:14:57.832286  2353 ts_tablet_manager.cc:1403] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.007s
I20260709 13:14:57.836439  2353 raft_consensus.cc:359] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.837178  2353 raft_consensus.cc:385] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.837459  2353 raft_consensus.cc:740] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.838022  2370 consensus_queue.cc:1048] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:57.838142  2353 consensus_queue.cc:260] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.840260  2353 ts_tablet_manager.cc:1434] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:14:57.857652  2388 raft_consensus.cc:493] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.858168  2388 raft_consensus.cc:515] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:14:57.860576  2388 leader_election.cc:290] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:14:57.861438  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5" is_pre_election: true
I20260709 13:14:57.861768  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075" is_pre_election: true
I20260709 13:14:57.862131  2160 raft_consensus.cc:2468] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 0.
I20260709 13:14:57.862550  2235 raft_consensus.cc:2468] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 0.
I20260709 13:14:57.863340  2274 leader_election.cc:304] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:14:57.864169  2388 raft_consensus.cc:2804] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:57.864471  2388 raft_consensus.cc:493] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.864740  2388 raft_consensus.cc:3060] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.869622  2388 raft_consensus.cc:515] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:14:57.871542  2388 leader_election.cc:290] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:14:57.872403  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:14:57.872720  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:14:57.873003  2160 raft_consensus.cc:3060] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.873389  2235 raft_consensus.cc:3060] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.880121  2160 raft_consensus.cc:2468] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 1.
I20260709 13:14:57.880121  2235 raft_consensus.cc:2468] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 1.
I20260709 13:14:57.881239  2388 raft_consensus.cc:493] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.881928  2273 leader_election.cc:304] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:14:57.881735  2388 raft_consensus.cc:515] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.882833  2359 raft_consensus.cc:2804] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:57.883324  2359 raft_consensus.cc:697] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Becoming Leader. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:14:57.883988  2388 leader_election.cc:290] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:14:57.884204  2359 consensus_queue.cc:237] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:14:57.885507  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ce6f31309e4aa9b9b59ecc88bee223" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5" is_pre_election: true
I20260709 13:14:57.886126  2160 raft_consensus.cc:2468] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 0.
I20260709 13:14:57.886363  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ce6f31309e4aa9b9b59ecc88bee223" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075" is_pre_election: true
I20260709 13:14:57.887099  2235 raft_consensus.cc:2468] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 0.
I20260709 13:14:57.887418  2274 leader_election.cc:304] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:14:57.888751  2388 raft_consensus.cc:2804] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:57.889261  2388 raft_consensus.cc:493] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.889592  2388 raft_consensus.cc:3060] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.895545  2388 raft_consensus.cc:515] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.894968  2055 catalog_manager.cc:5697] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8193261563944939bd4415fc6bdbc26d (127.1.250.67). New cstate: current_term: 1 leader_uuid: "8193261563944939bd4415fc6bdbc26d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:57.897773  2388 leader_election.cc:290] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:14:57.898458  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ce6f31309e4aa9b9b59ecc88bee223" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:14:57.899103  2160 raft_consensus.cc:3060] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.899277  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ce6f31309e4aa9b9b59ecc88bee223" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:14:57.899865  2235 raft_consensus.cc:3060] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.905122  2362 raft_consensus.cc:493] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.905673  2362 raft_consensus.cc:515] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.906762  2235 raft_consensus.cc:2468] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 1.
I20260709 13:14:57.907943  2362 leader_election.cc:290] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:57.908564  2160 raft_consensus.cc:2468] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 1.
I20260709 13:14:57.909173  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e3527afa7745958ef70c96bf1c93e4" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8193261563944939bd4415fc6bdbc26d" is_pre_election: true
I20260709 13:14:57.909821  2273 leader_election.cc:304] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:14:57.909833  2308 raft_consensus.cc:2468] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 0.
I20260709 13:14:57.910148  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e3527afa7745958ef70c96bf1c93e4" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5" is_pre_election: true
I20260709 13:14:57.910727  2160 raft_consensus.cc:2468] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 0.
I20260709 13:14:57.911580  2199 leader_election.cc:304] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:14:57.911885  2388 raft_consensus.cc:2804] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:57.912436  2362 raft_consensus.cc:2804] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:57.912787  2362 raft_consensus.cc:493] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.913075  2388 raft_consensus.cc:697] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Becoming Leader. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:14:57.913146  2362 raft_consensus.cc:3060] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.914040  2388 consensus_queue.cc:237] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.920142  2362 raft_consensus.cc:515] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.923197  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e3527afa7745958ef70c96bf1c93e4" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:14:57.923307  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e3527afa7745958ef70c96bf1c93e4" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:14:57.923780  2362 leader_election.cc:290] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 1 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:57.922739  2055 catalog_manager.cc:5697] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8193261563944939bd4415fc6bdbc26d (127.1.250.67). New cstate: current_term: 1 leader_uuid: "8193261563944939bd4415fc6bdbc26d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:57.924000  2308 raft_consensus.cc:3060] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.924482  2160 raft_consensus.cc:3060] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.932050  2160 raft_consensus.cc:2468] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 1.
I20260709 13:14:57.933571  2200 leader_election.cc:304] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 5dff3be607a343a09879ab364fc8bbc5; no voters: 
I20260709 13:14:57.934502  2362 raft_consensus.cc:2804] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:57.934713  2361 raft_consensus.cc:493] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.935273  2361 raft_consensus.cc:515] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.935990  2308 raft_consensus.cc:2468] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 1.
I20260709 13:14:57.937134  2362 raft_consensus.cc:697] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 1 LEADER]: Becoming Leader. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:14:57.937603  2361 leader_election.cc:290] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:57.938541  2362 consensus_queue.cc:237] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.939194  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5" is_pre_election: true
I20260709 13:14:57.939437  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8193261563944939bd4415fc6bdbc26d" is_pre_election: true
I20260709 13:14:57.940135  2160 raft_consensus.cc:2393] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 069c6281111e43e7807aa8d79455e075 in current term 1: Already voted for candidate 8193261563944939bd4415fc6bdbc26d in this term.
I20260709 13:14:57.941805  2199 leader_election.cc:304] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069c6281111e43e7807aa8d79455e075; no voters: 5dff3be607a343a09879ab364fc8bbc5, 8193261563944939bd4415fc6bdbc26d
I20260709 13:14:57.942850  2361 raft_consensus.cc:3060] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:57.945684  2104 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:57.954941  2361 raft_consensus.cc:2749] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:57.955140  2055 catalog_manager.cc:5697] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069c6281111e43e7807aa8d79455e075 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "069c6281111e43e7807aa8d79455e075" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:57.994029  2388 raft_consensus.cc:493] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.994643  2388 raft_consensus.cc:515] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:57.996856  2388 leader_election.cc:290] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:14:57.997874  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b6eb66be8ec478ba3c38f3cc395c30e" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5" is_pre_election: true
I20260709 13:14:57.998073  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b6eb66be8ec478ba3c38f3cc395c30e" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075" is_pre_election: true
I20260709 13:14:57.998772  2235 raft_consensus.cc:2393] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8193261563944939bd4415fc6bdbc26d in current term 1: Already voted for candidate 5dff3be607a343a09879ab364fc8bbc5 in this term.
I20260709 13:14:57.999660  2273 leader_election.cc:304] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8193261563944939bd4415fc6bdbc26d; no voters: 069c6281111e43e7807aa8d79455e075, 5dff3be607a343a09879ab364fc8bbc5
I20260709 13:14:58.000528  2388 raft_consensus.cc:3060] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.000564  2359 raft_consensus.cc:493] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.001168  2359 raft_consensus.cc:515] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.002940  2359 leader_election.cc:290] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:14:58.004655  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5" is_pre_election: true
I20260709 13:14:58.005326  2160 raft_consensus.cc:2468] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 0.
I20260709 13:14:58.005312  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075" is_pre_election: true
I20260709 13:14:58.006165  2235 raft_consensus.cc:2468] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 0.
I20260709 13:14:58.007685  2388 raft_consensus.cc:2749] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:58.007977  2274 leader_election.cc:304] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:14:58.009297  2388 raft_consensus.cc:2804] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:58.009266  2361 consensus_queue.cc:1048] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:58.009831  2388 raft_consensus.cc:493] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.010206  2388 raft_consensus.cc:3060] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.021438  2362 consensus_queue.cc:1048] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.024389  2358 raft_consensus.cc:493] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.024899  2358 raft_consensus.cc:515] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.029326  2358 leader_election.cc:290] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:58.031273  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784c999e56664bf4b0fcbe69b49d79f1" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8193261563944939bd4415fc6bdbc26d" is_pre_election: true
I20260709 13:14:58.031347  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784c999e56664bf4b0fcbe69b49d79f1" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075" is_pre_election: true
I20260709 13:14:58.032307  2235 raft_consensus.cc:2393] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dff3be607a343a09879ab364fc8bbc5 in current term 1: Already voted for candidate 8193261563944939bd4415fc6bdbc26d in this term.
I20260709 13:14:58.037124  2124 leader_election.cc:304] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5; no voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d
I20260709 13:14:58.037927  2358 raft_consensus.cc:3060] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.043011  2388 raft_consensus.cc:515] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.044291  2358 raft_consensus.cc:2749] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:58.046330  2388 leader_election.cc:290] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:14:58.047804  2160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:14:58.048379  2160 raft_consensus.cc:3060] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.049923  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:14:58.050715  2235 raft_consensus.cc:3060] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.054165  2160 raft_consensus.cc:2468] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 1.
I20260709 13:14:58.057063  2274 leader_election.cc:304] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:14:58.057427  2235 raft_consensus.cc:2468] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 1.
I20260709 13:14:58.058034  2388 raft_consensus.cc:2804] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:58.058405  2359 consensus_queue.cc:1048] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.058908  2388 raft_consensus.cc:697] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Becoming Leader. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:14:58.059890  2388 consensus_queue.cc:237] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.074666  2388 consensus_queue.cc:1048] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.076329  2056 catalog_manager.cc:5697] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8193261563944939bd4415fc6bdbc26d (127.1.250.67). New cstate: current_term: 1 leader_uuid: "8193261563944939bd4415fc6bdbc26d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:58.153610  2388 consensus_queue.cc:1048] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.168315  2388 consensus_queue.cc:1048] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:58.189831  2308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e"
dest_uuid: "8193261563944939bd4415fc6bdbc26d"
mode: GRACEFUL
new_leader_uuid: "5dff3be607a343a09879ab364fc8bbc5"
 from {username='slave'} at 127.0.0.1:37578
I20260709 13:14:58.190588  2308 raft_consensus.cc:606] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Received request to transfer leadership to TS 5dff3be607a343a09879ab364fc8bbc5
I20260709 13:14:58.197322  2308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d"
dest_uuid: "8193261563944939bd4415fc6bdbc26d"
mode: GRACEFUL
new_leader_uuid: "5dff3be607a343a09879ab364fc8bbc5"
 from {username='slave'} at 127.0.0.1:37578
I20260709 13:14:58.197903  2308 raft_consensus.cc:606] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Received request to transfer leadership to TS 5dff3be607a343a09879ab364fc8bbc5
I20260709 13:14:58.202955  2358 consensus_queue.cc:1048] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.206035  2308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766"
dest_uuid: "8193261563944939bd4415fc6bdbc26d"
mode: GRACEFUL
new_leader_uuid: "5dff3be607a343a09879ab364fc8bbc5"
 from {username='slave'} at 127.0.0.1:37578
I20260709 13:14:58.206668  2308 raft_consensus.cc:606] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Received request to transfer leadership to TS 5dff3be607a343a09879ab364fc8bbc5
I20260709 13:14:58.216941  2309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "784c999e56664bf4b0fcbe69b49d79f1"
dest_uuid: "8193261563944939bd4415fc6bdbc26d"
mode: GRACEFUL
new_leader_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:37578
I20260709 13:14:58.217597  2309 raft_consensus.cc:606] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Received request to transfer leadership to TS 069c6281111e43e7807aa8d79455e075
I20260709 13:14:58.225147  2370 consensus_queue.cc:1048] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.247781  2159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b6eb66be8ec478ba3c38f3cc395c30e"
dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
mode: GRACEFUL
new_leader_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:50260
I20260709 13:14:58.248406  2159 raft_consensus.cc:606] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 1 LEADER]: Received request to transfer leadership to TS 069c6281111e43e7807aa8d79455e075
I20260709 13:14:58.253903  2309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05ce6f31309e4aa9b9b59ecc88bee223"
dest_uuid: "8193261563944939bd4415fc6bdbc26d"
mode: GRACEFUL
new_leader_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:37578
I20260709 13:14:58.254504  2309 raft_consensus.cc:606] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Received request to transfer leadership to TS 069c6281111e43e7807aa8d79455e075
I20260709 13:14:58.269474  2235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43e3527afa7745958ef70c96bf1c93e4"
dest_uuid: "069c6281111e43e7807aa8d79455e075"
mode: GRACEFUL
new_leader_uuid: "8193261563944939bd4415fc6bdbc26d"
 from {username='slave'} at 127.0.0.1:35682
I20260709 13:14:58.270038  2235 raft_consensus.cc:606] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 1 LEADER]: Received request to transfer leadership to TS 8193261563944939bd4415fc6bdbc26d
I20260709 13:14:58.306555  2388 consensus_queue.cc:1048] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.314625  2359 raft_consensus.cc:993] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d: : Instructing follower 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:14:58.315097  2390 raft_consensus.cc:1081] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Signalling peer 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:14:58.317536  2234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05ce6f31309e4aa9b9b59ecc88bee223"
dest_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:35668
I20260709 13:14:58.318164  2234 raft_consensus.cc:493] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.318547  2234 raft_consensus.cc:3060] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.321554  2388 consensus_queue.cc:1048] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.328996  2234 raft_consensus.cc:515] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.330904  2235 raft_consensus.cc:1240] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Rejecting Update request from peer 8193261563944939bd4415fc6bdbc26d for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:58.332320  2362 consensus_queue.cc:1048] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:58.332782  2390 consensus_queue.cc:1059] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.333627  2359 raft_consensus.cc:3055] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.333986  2359 raft_consensus.cc:740] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:14:58.334843  2359 consensus_queue.cc:260] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.335920  2234 leader_election.cc:290] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 2 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:58.336000  2359 raft_consensus.cc:3060] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.337572  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ce6f31309e4aa9b9b59ecc88bee223" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:14:58.338500  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ce6f31309e4aa9b9b59ecc88bee223" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:14:58.352100  2309 raft_consensus.cc:2468] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 2.
I20260709 13:14:58.351972  2362 consensus_queue.cc:1048] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.354784  2199 leader_election.cc:304] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d; no voters: 5dff3be607a343a09879ab364fc8bbc5
I20260709 13:14:58.356539  2362 raft_consensus.cc:2804] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:58.357045  2362 raft_consensus.cc:697] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 2 LEADER]: Becoming Leader. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:14:58.357900  2362 consensus_queue.cc:237] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.363799  2359 consensus_queue.cc:1048] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.377813  2359 consensus_queue.cc:1048] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.380105  2056 catalog_manager.cc:5697] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 reported cstate change: term changed from 1 to 2, leader changed from 8193261563944939bd4415fc6bdbc26d (127.1.250.67) to 069c6281111e43e7807aa8d79455e075 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "069c6281111e43e7807aa8d79455e075" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.387137  2390 raft_consensus.cc:993] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d: : Instructing follower 5dff3be607a343a09879ab364fc8bbc5 to start an election
I20260709 13:14:58.387763  2390 raft_consensus.cc:1081] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Signalling peer 5dff3be607a343a09879ab364fc8bbc5 to start an election
I20260709 13:14:58.396941  2159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e"
dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
 from {username='slave'} at 127.0.0.1:50244
I20260709 13:14:58.397723  2159 raft_consensus.cc:493] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.398222  2159 raft_consensus.cc:3060] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.400159  2362 raft_consensus.cc:993] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075: : Instructing follower 8193261563944939bd4415fc6bdbc26d to start an election
I20260709 13:14:58.400584  2362 raft_consensus.cc:1081] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 1 LEADER]: Signalling peer 8193261563944939bd4415fc6bdbc26d to start an election
I20260709 13:14:58.402442  2309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43e3527afa7745958ef70c96bf1c93e4"
dest_uuid: "8193261563944939bd4415fc6bdbc26d"
 from {username='slave'} at 127.0.0.1:37562
I20260709 13:14:58.403102  2309 raft_consensus.cc:493] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.403537  2309 raft_consensus.cc:3060] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.407208  2159 raft_consensus.cc:515] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:14:58.412889  2309 raft_consensus.cc:515] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.417006  2159 leader_election.cc:290] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 2 election: Requested vote from peers 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:14:58.418269  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:14:58.422356  2308 raft_consensus.cc:3055] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.422842  2308 raft_consensus.cc:740] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:14:58.424038  2308 consensus_queue.cc:260] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:14:58.426175  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e3527afa7745958ef70c96bf1c93e4" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:14:58.426841  2233 raft_consensus.cc:3055] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.427168  2233 raft_consensus.cc:740] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:14:58.427884  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e3527afa7745958ef70c96bf1c93e4" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:14:58.427956  2233 consensus_queue.cc:260] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.418546  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:14:58.430552  2233 raft_consensus.cc:3060] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.428791  2158 raft_consensus.cc:3060] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.435883  2308 raft_consensus.cc:3060] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.438468  2309 leader_election.cc:290] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 2 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:14:58.440788  2233 raft_consensus.cc:2468] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 2.
I20260709 13:14:58.449689  2273 leader_election.cc:304] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:14:58.450523  2359 raft_consensus.cc:2804] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:58.451033  2359 raft_consensus.cc:697] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [term 2 LEADER]: Becoming Leader. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:14:58.451390  2158 raft_consensus.cc:2468] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 2.
I20260709 13:14:58.451815  2359 consensus_queue.cc:237] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.453675  2308 raft_consensus.cc:2468] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 2.
I20260709 13:14:58.454882  2124 leader_election.cc:304] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5, 8193261563944939bd4415fc6bdbc26d; no voters: 069c6281111e43e7807aa8d79455e075
I20260709 13:14:58.457407  2358 raft_consensus.cc:2804] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:58.457922  2358 raft_consensus.cc:697] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 2 LEADER]: Becoming Leader. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Running, Role: LEADER
I20260709 13:14:58.458756  2358 consensus_queue.cc:237] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:14:58.461123  2056 catalog_manager.cc:5697] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d reported cstate change: term changed from 1 to 2, leader changed from 069c6281111e43e7807aa8d79455e075 (127.1.250.66) to 8193261563944939bd4415fc6bdbc26d (127.1.250.67). New cstate: current_term: 2 leader_uuid: "8193261563944939bd4415fc6bdbc26d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:58.467936  2055 catalog_manager.cc:5697] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 reported cstate change: term changed from 1 to 2, leader changed from 8193261563944939bd4415fc6bdbc26d (127.1.250.67) to 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "5dff3be607a343a09879ab364fc8bbc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.542196  2359 consensus_queue.cc:1048] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.555615  2359 consensus_queue.cc:1048] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.571398  2388 raft_consensus.cc:993] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d: : Instructing follower 5dff3be607a343a09879ab364fc8bbc5 to start an election
I20260709 13:14:58.572008  2388 raft_consensus.cc:1081] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Signalling peer 5dff3be607a343a09879ab364fc8bbc5 to start an election
I20260709 13:14:58.573936  2158 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766"
dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
 from {username='slave'} at 127.0.0.1:50244
I20260709 13:14:58.574626  2158 raft_consensus.cc:493] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.575088  2158 raft_consensus.cc:3060] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.575811  2388 raft_consensus.cc:993] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d: : Instructing follower 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:14:58.577620  2388 raft_consensus.cc:1081] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Signalling peer 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:14:58.582645  2234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "784c999e56664bf4b0fcbe69b49d79f1"
dest_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:35668
I20260709 13:14:58.584707  2234 raft_consensus.cc:493] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.585481  2234 raft_consensus.cc:3060] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.590603  2158 raft_consensus.cc:515] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.593328  2158 leader_election.cc:290] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 2 election: Requested vote from peers 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:58.594074  2233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:14:58.594655  2233 raft_consensus.cc:3060] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.595567  2234 raft_consensus.cc:515] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.596076  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:14:58.596626  2308 raft_consensus.cc:3055] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.596975  2308 raft_consensus.cc:740] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:14:58.598376  2234 leader_election.cc:290] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 2 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:58.597991  2308 consensus_queue.cc:260] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.599566  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784c999e56664bf4b0fcbe69b49d79f1" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:14:58.600149  2309 raft_consensus.cc:3055] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.600072  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784c999e56664bf4b0fcbe69b49d79f1" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:14:58.600333  2308 raft_consensus.cc:3060] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.600582  2309 raft_consensus.cc:740] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:14:58.600849  2158 raft_consensus.cc:3060] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.601500  2309 consensus_queue.cc:260] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.602700  2309 raft_consensus.cc:3060] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.607520  2434 raft_consensus.cc:993] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d: : Instructing follower 5dff3be607a343a09879ab364fc8bbc5 to start an election
I20260709 13:14:58.608033  2434 raft_consensus.cc:1081] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Signalling peer 5dff3be607a343a09879ab364fc8bbc5 to start an election
I20260709 13:14:58.609162  2308 raft_consensus.cc:2468] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 2.
I20260709 13:14:58.612114  2159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d"
dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
 from {username='slave'} at 127.0.0.1:50244
I20260709 13:14:58.612270  2124 leader_election.cc:304] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:14:58.612797  2159 raft_consensus.cc:493] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.613211  2159 raft_consensus.cc:3060] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.613224  2358 raft_consensus.cc:2804] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:58.613888  2358 raft_consensus.cc:697] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 LEADER]: Becoming Leader. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Running, Role: LEADER
I20260709 13:14:58.614768  2358 consensus_queue.cc:237] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.620659  2370 raft_consensus.cc:993] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5: : Instructing follower 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:14:58.621114  2370 raft_consensus.cc:1081] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 1 LEADER]: Signalling peer 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:14:58.624841  2234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b6eb66be8ec478ba3c38f3cc395c30e"
dest_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:14:58.625458  2234 raft_consensus.cc:493] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.625830  2234 raft_consensus.cc:3060] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.627444  2309 raft_consensus.cc:2468] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 2.
I20260709 13:14:58.627302  2159 raft_consensus.cc:515] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.628703  2199 leader_election.cc:304] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:14:58.629608  2361 raft_consensus.cc:2804] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:58.630054  2361 raft_consensus.cc:697] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 2 LEADER]: Becoming Leader. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:14:58.630626  2235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:14:58.631228  2235 raft_consensus.cc:3060] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.631623  2159 leader_election.cc:290] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 2 election: Requested vote from peers 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:58.630848  2361 consensus_queue.cc:237] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.624684  2233 raft_consensus.cc:2468] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 2.
I20260709 13:14:58.634661  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:14:58.635285  2307 raft_consensus.cc:3055] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.635629  2307 raft_consensus.cc:740] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:14:58.636638  2056 catalog_manager.cc:5697] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 reported cstate change: term changed from 1 to 2, leader changed from 8193261563944939bd4415fc6bdbc26d (127.1.250.67) to 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "5dff3be607a343a09879ab364fc8bbc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.637283  2234 raft_consensus.cc:515] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.636461  2307 consensus_queue.cc:260] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.638610  2307 raft_consensus.cc:3060] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.646473  2235 raft_consensus.cc:2468] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 2.
I20260709 13:14:58.647836  2124 leader_election.cc:304] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 5dff3be607a343a09879ab364fc8bbc5; no voters: 
I20260709 13:14:58.648694  2369 raft_consensus.cc:2804] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:58.649148  2369 raft_consensus.cc:697] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 2 LEADER]: Becoming Leader. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Running, Role: LEADER
I20260709 13:14:58.650048  2158 raft_consensus.cc:2468] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 2.
I20260709 13:14:58.649948  2369 consensus_queue.cc:237] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.652455  2307 raft_consensus.cc:2468] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 2.
I20260709 13:14:58.654110  2055 catalog_manager.cc:5697] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 reported cstate change: term changed from 1 to 2, leader changed from 8193261563944939bd4415fc6bdbc26d (127.1.250.67) to 069c6281111e43e7807aa8d79455e075 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "069c6281111e43e7807aa8d79455e075" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.658272  2234 leader_election.cc:290] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 2 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:14:58.659163  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b6eb66be8ec478ba3c38f3cc395c30e" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:14:58.659912  2158 raft_consensus.cc:3055] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.660255  2158 raft_consensus.cc:740] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Running, Role: LEADER
I20260709 13:14:58.661222  2158 consensus_queue.cc:260] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.662564  2158 raft_consensus.cc:3060] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.665565  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b6eb66be8ec478ba3c38f3cc395c30e" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:14:58.666275  2307 raft_consensus.cc:3060] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.668386  2055 catalog_manager.cc:5697] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 reported cstate change: term changed from 1 to 2, leader changed from 8193261563944939bd4415fc6bdbc26d (127.1.250.67) to 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "5dff3be607a343a09879ab364fc8bbc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.670238  2158 raft_consensus.cc:2468] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 2.
I20260709 13:14:58.671491  2200 leader_election.cc:304] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 5dff3be607a343a09879ab364fc8bbc5; no voters: 
I20260709 13:14:58.672508  2361 raft_consensus.cc:2804] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:58.673004  2361 raft_consensus.cc:697] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [term 2 LEADER]: Becoming Leader. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:14:58.673894  2307 raft_consensus.cc:2468] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 2.
I20260709 13:14:58.673894  2361 consensus_queue.cc:237] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:14:58.682565  2055 catalog_manager.cc:5697] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 reported cstate change: term changed from 1 to 2, leader changed from 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65) to 069c6281111e43e7807aa8d79455e075 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "069c6281111e43e7807aa8d79455e075" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.877259  2234 raft_consensus.cc:3060] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.882635  2234 raft_consensus.cc:1275] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Refusing update from remote peer 5dff3be607a343a09879ab364fc8bbc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:58.884111  2369 consensus_queue.cc:1048] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.897171  2307 raft_consensus.cc:1275] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Refusing update from remote peer 5dff3be607a343a09879ab364fc8bbc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:58.898721  2369 consensus_queue.cc:1048] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:58.913869  2309 raft_consensus.cc:1275] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:58.915360  2361 consensus_queue.cc:1048] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:58.927793  2158 raft_consensus.cc:3060] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.936105  2158 raft_consensus.cc:1275] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:58.937650  2361 consensus_queue.cc:1048] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.002882  2234 raft_consensus.cc:1275] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Refusing update from remote peer 8193261563944939bd4415fc6bdbc26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.004427  2388 consensus_queue.cc:1048] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.013114  2158 raft_consensus.cc:1275] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Refusing update from remote peer 8193261563944939bd4415fc6bdbc26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.014664  2359 consensus_queue.cc:1048] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.030074  2234 raft_consensus.cc:1275] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Refusing update from remote peer 5dff3be607a343a09879ab364fc8bbc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.031281  2369 consensus_queue.cc:1048] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.039878  2309 raft_consensus.cc:1275] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Refusing update from remote peer 5dff3be607a343a09879ab364fc8bbc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.041530  2436 consensus_queue.cc:1048] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.132076  2158 raft_consensus.cc:1275] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.132076  2309 raft_consensus.cc:1275] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Refusing update from remote peer 5dff3be607a343a09879ab364fc8bbc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.133777  2361 consensus_queue.cc:1048] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:59.133857  2369 consensus_queue.cc:1048] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.144773  2234 raft_consensus.cc:1275] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Refusing update from remote peer 5dff3be607a343a09879ab364fc8bbc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.146716  2309 raft_consensus.cc:1275] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.148170  2362 consensus_queue.cc:1048] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.151751  2358 consensus_queue.cc:1048] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.165880  2158 raft_consensus.cc:1275] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.167111  2362 consensus_queue.cc:1048] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.177918  2309 raft_consensus.cc:1275] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.179618  2412 consensus_queue.cc:1048] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:01.305207  2025 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:15:01.306541  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:01.329813  2234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612"
dest_uuid: "069c6281111e43e7807aa8d79455e075"
mode: GRACEFUL
new_leader_uuid: "8193261563944939bd4415fc6bdbc26d"
 from {username='slave'} at 127.0.0.1:51878
I20260709 13:15:01.330382  2234 raft_consensus.cc:606] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 1 LEADER]: Received request to transfer leadership to TS 8193261563944939bd4415fc6bdbc26d
I20260709 13:15:01.335606  2444 raft_consensus.cc:993] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075: : Instructing follower 8193261563944939bd4415fc6bdbc26d to start an election
I20260709 13:15:01.336052  2412 raft_consensus.cc:1081] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 1 LEADER]: Signalling peer 8193261563944939bd4415fc6bdbc26d to start an election
I20260709 13:15:01.337584  2309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612"
dest_uuid: "8193261563944939bd4415fc6bdbc26d"
 from {username='slave'} at 127.0.0.1:37562
I20260709 13:15:01.338186  2309 raft_consensus.cc:493] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:01.338529  2309 raft_consensus.cc:3060] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:01.342025  2158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766"
dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
mode: GRACEFUL
new_leader_uuid: "8193261563944939bd4415fc6bdbc26d"
 from {username='slave'} at 127.0.0.1:55670
I20260709 13:15:01.342525  2158 raft_consensus.cc:606] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 LEADER]: Received request to transfer leadership to TS 8193261563944939bd4415fc6bdbc26d
I20260709 13:15:01.343657  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:01.344110  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:01.345651  2309 raft_consensus.cc:515] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:01.347208  2309 leader_election.cc:290] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 2 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:15:01.348171  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:15:01.348531  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:15:01.348865  2158 raft_consensus.cc:3060] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:01.349223  2234 raft_consensus.cc:3055] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:01.349624  2234 raft_consensus.cc:740] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:15:01.350560  2234 consensus_queue.cc:260] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:01.351954  2234 raft_consensus.cc:3060] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:01.356578  2158 raft_consensus.cc:2468] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 2.
I20260709 13:15:01.357970  2274 leader_election.cc:304] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:15:01.358682  2390 raft_consensus.cc:2804] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:01.359071  2234 raft_consensus.cc:2468] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 2.
I20260709 13:15:01.359961  2390 raft_consensus.cc:697] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 2 LEADER]: Becoming Leader. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:15:01.360814  2390 consensus_queue.cc:237] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:01.368417  2054 catalog_manager.cc:5697] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d reported cstate change: term changed from 1 to 2, leader changed from 069c6281111e43e7807aa8d79455e075 (127.1.250.66) to 8193261563944939bd4415fc6bdbc26d (127.1.250.67). New cstate: current_term: 2 leader_uuid: "8193261563944939bd4415fc6bdbc26d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:01.391978  2438 raft_consensus.cc:993] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5: : Instructing follower 8193261563944939bd4415fc6bdbc26d to start an election
I20260709 13:15:01.392472  2451 raft_consensus.cc:1081] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 LEADER]: Signalling peer 8193261563944939bd4415fc6bdbc26d to start an election
I20260709 13:15:01.394150  2309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766"
dest_uuid: "8193261563944939bd4415fc6bdbc26d"
 from {username='slave'} at 127.0.0.1:37570
I20260709 13:15:01.394733  2309 raft_consensus.cc:493] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:01.395089  2309 raft_consensus.cc:3060] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:01.400929  2309 raft_consensus.cc:515] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:01.402920  2309 leader_election.cc:290] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 3 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:15:01.403623  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:15:01.403854  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:15:01.404248  2158 raft_consensus.cc:3055] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:01.404452  2234 raft_consensus.cc:3060] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:01.404569  2158 raft_consensus.cc:740] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Running, Role: LEADER
I20260709 13:15:01.405405  2158 consensus_queue.cc:260] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:01.406309  2158 raft_consensus.cc:3060] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:01.409607  2234 raft_consensus.cc:2468] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 3.
I20260709 13:15:01.410717  2158 raft_consensus.cc:2468] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 3.
I20260709 13:15:01.410993  2273 leader_election.cc:304] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:15:01.411890  2390 raft_consensus.cc:2804] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:01.412346  2390 raft_consensus.cc:697] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 3 LEADER]: Becoming Leader. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:15:01.412967  2390 consensus_queue.cc:237] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:01.419677  2054 catalog_manager.cc:5697] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d reported cstate change: term changed from 2 to 3, leader changed from 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65) to 8193261563944939bd4415fc6bdbc26d (127.1.250.67). New cstate: current_term: 3 leader_uuid: "8193261563944939bd4415fc6bdbc26d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:01.847311  2234 raft_consensus.cc:1275] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Refusing update from remote peer 8193261563944939bd4415fc6bdbc26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:01.848542  2390 consensus_queue.cc:1048] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:01.858961  2158 raft_consensus.cc:1275] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Refusing update from remote peer 8193261563944939bd4415fc6bdbc26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:01.860374  2390 consensus_queue.cc:1048] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:01.925841  2158 raft_consensus.cc:1275] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Refusing update from remote peer 8193261563944939bd4415fc6bdbc26d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:01.927148  2390 consensus_queue.cc:1048] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:01.935772  2234 raft_consensus.cc:1275] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Refusing update from remote peer 8193261563944939bd4415fc6bdbc26d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:01.937551  2390 consensus_queue.cc:1048] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:02.345018  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:02.355705  2159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e"
dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
mode: GRACEFUL
new_leader_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:50260
I20260709 13:15:02.356302  2159 raft_consensus.cc:606] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 2 LEADER]: Received request to transfer leadership to TS 069c6281111e43e7807aa8d79455e075
I20260709 13:15:02.361495  2159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d"
dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
mode: GRACEFUL
new_leader_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:50260
I20260709 13:15:02.362005  2159 raft_consensus.cc:606] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 2 LEADER]: Received request to transfer leadership to TS 069c6281111e43e7807aa8d79455e075
I20260709 13:15:02.367182  2309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766"
dest_uuid: "8193261563944939bd4415fc6bdbc26d"
mode: GRACEFUL
new_leader_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:37578
I20260709 13:15:02.367692  2309 raft_consensus.cc:606] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 3 LEADER]: Received request to transfer leadership to TS 069c6281111e43e7807aa8d79455e075
I20260709 13:15:02.373592  2159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc8b4dc00c29444eb72b4ed19f635638"
dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
mode: GRACEFUL
new_leader_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:50260
I20260709 13:15:02.374239  2159 raft_consensus.cc:606] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 LEADER]: Received request to transfer leadership to TS 069c6281111e43e7807aa8d79455e075
I20260709 13:15:02.384083  2309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612"
dest_uuid: "8193261563944939bd4415fc6bdbc26d"
mode: GRACEFUL
new_leader_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:37578
I20260709 13:15:02.384876  2309 raft_consensus.cc:606] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 2 LEADER]: Received request to transfer leadership to TS 069c6281111e43e7807aa8d79455e075
I20260709 13:15:02.465597  2456 raft_consensus.cc:993] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d: : Instructing follower 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:15:02.466022  2390 raft_consensus.cc:1081] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 2 LEADER]: Signalling peer 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:15:02.467502  2234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612"
dest_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:35668
I20260709 13:15:02.467952  2234 raft_consensus.cc:493] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:02.468259  2234 raft_consensus.cc:3060] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.472595  2234 raft_consensus.cc:515] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:02.474129  2234 leader_election.cc:290] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 3 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:15:02.474978  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:15:02.475144  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:15:02.475634  2159 raft_consensus.cc:3060] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.475703  2307 raft_consensus.cc:3055] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:02.476182  2307 raft_consensus.cc:740] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:15:02.477011  2307 consensus_queue.cc:260] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:02.478204  2307 raft_consensus.cc:3060] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.482318  2159 raft_consensus.cc:2468] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 3.
I20260709 13:15:02.483634  2200 leader_election.cc:304] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 5dff3be607a343a09879ab364fc8bbc5; no voters: 
I20260709 13:15:02.484421  2412 raft_consensus.cc:2804] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:02.484771  2307 raft_consensus.cc:2468] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 3.
I20260709 13:15:02.485555  2412 raft_consensus.cc:697] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 3 LEADER]: Becoming Leader. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:15:02.486886  2412 consensus_queue.cc:237] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:02.493701  2054 catalog_manager.cc:5697] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 reported cstate change: term changed from 2 to 3, leader changed from 8193261563944939bd4415fc6bdbc26d (127.1.250.67) to 069c6281111e43e7807aa8d79455e075 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "069c6281111e43e7807aa8d79455e075" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.510860  2451 raft_consensus.cc:993] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5: : Instructing follower 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:15:02.511268  2466 raft_consensus.cc:1081] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 LEADER]: Signalling peer 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:15:02.512653  2234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc8b4dc00c29444eb72b4ed19f635638"
dest_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:15:02.513207  2234 raft_consensus.cc:493] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:02.513532  2234 raft_consensus.cc:3060] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.518640  2234 raft_consensus.cc:515] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:02.520247  2234 leader_election.cc:290] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 2 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:15:02.521198  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8b4dc00c29444eb72b4ed19f635638" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:15:02.521289  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8b4dc00c29444eb72b4ed19f635638" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:15:02.521731  2159 raft_consensus.cc:3055] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:02.521786  2307 raft_consensus.cc:3060] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.522148  2159 raft_consensus.cc:740] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Running, Role: LEADER
I20260709 13:15:02.522791  2159 consensus_queue.cc:260] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:02.523656  2159 raft_consensus.cc:3060] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.526590  2307 raft_consensus.cc:2468] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 2.
I20260709 13:15:02.527714  2199 leader_election.cc:304] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:15:02.528469  2159 raft_consensus.cc:2468] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 2.
I20260709 13:15:02.528512  2412 raft_consensus.cc:2804] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:02.529139  2412 raft_consensus.cc:697] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [term 2 LEADER]: Becoming Leader. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:15:02.529906  2412 consensus_queue.cc:237] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:02.536301  2054 catalog_manager.cc:5697] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 reported cstate change: term changed from 1 to 2, leader changed from 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65) to 069c6281111e43e7807aa8d79455e075 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "069c6281111e43e7807aa8d79455e075" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.558620  2456 raft_consensus.cc:993] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d: : Instructing follower 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:15:02.559122  2390 raft_consensus.cc:1081] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 3 LEADER]: Signalling peer 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:15:02.560458  2234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766"
dest_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:35668
I20260709 13:15:02.560885  2234 raft_consensus.cc:493] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:02.561200  2234 raft_consensus.cc:3060] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.565786  2234 raft_consensus.cc:515] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:02.567273  2234 leader_election.cc:290] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 4 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:15:02.568137  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:15:02.568387  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3cf95e60ac400ab8f77e071b0fd766" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:15:02.568691  2159 raft_consensus.cc:3060] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.569028  2307 raft_consensus.cc:3055] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:02.569411  2307 raft_consensus.cc:740] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:15:02.570052  2307 consensus_queue.cc:260] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:02.570926  2307 raft_consensus.cc:3060] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.573820  2159 raft_consensus.cc:2468] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 4.
I20260709 13:15:02.574848  2200 leader_election.cc:304] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 5dff3be607a343a09879ab364fc8bbc5; no voters: 
I20260709 13:15:02.575712  2412 raft_consensus.cc:2804] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:02.575834  2307 raft_consensus.cc:2468] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 4.
I20260709 13:15:02.576258  2412 raft_consensus.cc:697] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 4 LEADER]: Becoming Leader. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:15:02.577157  2412 consensus_queue.cc:237] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:02.583834  2054 catalog_manager.cc:5697] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 reported cstate change: term changed from 3 to 4, leader changed from 8193261563944939bd4415fc6bdbc26d (127.1.250.67) to 069c6281111e43e7807aa8d79455e075 (127.1.250.66). New cstate: current_term: 4 leader_uuid: "069c6281111e43e7807aa8d79455e075" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.726384  2451 raft_consensus.cc:993] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5: : Instructing follower 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:15:02.728081  2466 raft_consensus.cc:1081] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 2 LEADER]: Signalling peer 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:15:02.730221  2235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e"
dest_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:15:02.730866  2235 raft_consensus.cc:493] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:02.731213  2235 raft_consensus.cc:3060] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.731408  2468 raft_consensus.cc:993] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5: : Instructing follower 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:15:02.731856  2466 raft_consensus.cc:1081] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 2 LEADER]: Signalling peer 069c6281111e43e7807aa8d79455e075 to start an election
I20260709 13:15:02.733454  2234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d"
dest_uuid: "069c6281111e43e7807aa8d79455e075"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:15:02.734063  2234 raft_consensus.cc:493] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:02.734433  2234 raft_consensus.cc:3060] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.736552  2235 raft_consensus.cc:515] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:15:02.738425  2235 leader_election.cc:290] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 3 election: Requested vote from peers 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499), 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037)
I20260709 13:15:02.739032  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:15:02.739604  2307 raft_consensus.cc:3060] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.739537  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:15:02.740293  2159 raft_consensus.cc:3055] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:02.740835  2159 raft_consensus.cc:740] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Running, Role: LEADER
I20260709 13:15:02.740264  2234 raft_consensus.cc:515] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:02.741772  2159 consensus_queue.cc:260] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:15:02.742784  2234 leader_election.cc:290] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 3 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:15:02.743315  2159 raft_consensus.cc:3060] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.743911  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:15:02.744146  2158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d" candidate_uuid: "069c6281111e43e7807aa8d79455e075" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:15:02.744570  2309 raft_consensus.cc:3060] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.744719  2158 raft_consensus.cc:3055] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:02.745121  2158 raft_consensus.cc:740] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Running, Role: LEADER
I20260709 13:15:02.746112  2158 consensus_queue.cc:260] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:02.747524  2158 raft_consensus.cc:3060] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.748862  2307 raft_consensus.cc:2468] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 3.
I20260709 13:15:02.750219  2199 leader_election.cc:304] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:15:02.751174  2412 raft_consensus.cc:2804] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:02.751679  2412 raft_consensus.cc:697] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 3 LEADER]: Becoming Leader. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:15:02.752426  2159 raft_consensus.cc:2468] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 3.
I20260709 13:15:02.752561  2412 consensus_queue.cc:237] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:15:02.753481  2309 raft_consensus.cc:2468] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 3.
I20260709 13:15:02.754683  2199 leader_election.cc:304] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:15:02.755461  2461 raft_consensus.cc:2804] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:02.756352  2158 raft_consensus.cc:2468] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069c6281111e43e7807aa8d79455e075 in term 3.
I20260709 13:15:02.758620  2461 raft_consensus.cc:697] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 3 LEADER]: Becoming Leader. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:15:02.759538  2461 consensus_queue.cc:237] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:02.761685  2054 catalog_manager.cc:5697] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 reported cstate change: term changed from 2 to 3, leader changed from 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65) to 069c6281111e43e7807aa8d79455e075 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "069c6281111e43e7807aa8d79455e075" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:02.774050  2054 catalog_manager.cc:5697] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 reported cstate change: term changed from 2 to 3, leader changed from 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65) to 069c6281111e43e7807aa8d79455e075 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "069c6281111e43e7807aa8d79455e075" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.883658  2307 raft_consensus.cc:1275] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:02.884886  2461 consensus_queue.cc:1048] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:02.894030  2158 raft_consensus.cc:1275] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:02.896390  2470 consensus_queue.cc:1048] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:02.970547  2158 raft_consensus.cc:1275] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 4 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:02.971740  2461 consensus_queue.cc:1048] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:02.982858  2309 raft_consensus.cc:1275] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 4 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:02.984264  2478 consensus_queue.cc:1048] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:03.019753  2309 raft_consensus.cc:1275] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:03.021236  2478 consensus_queue.cc:1048] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:03.031051  2158 raft_consensus.cc:1275] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:03.032651  2461 consensus_queue.cc:1048] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:03.240839  2309 raft_consensus.cc:1275] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:03.242697  2461 consensus_queue.cc:1048] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:03.251546  2158 raft_consensus.cc:1275] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:03.253594  2470 consensus_queue.cc:1048] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:03.269397  2158 raft_consensus.cc:1275] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:03.270759  2470 consensus_queue.cc:1048] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:03.280155  2309 raft_consensus.cc:1275] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Refusing update from remote peer 069c6281111e43e7807aa8d79455e075: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:03.281625  2461 consensus_queue.cc:1048] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:05.396950  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:05.406308  2234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05ce6f31309e4aa9b9b59ecc88bee223"
dest_uuid: "069c6281111e43e7807aa8d79455e075"
mode: GRACEFUL
new_leader_uuid: "8193261563944939bd4415fc6bdbc26d"
 from {username='slave'} at 127.0.0.1:51878
I20260709 13:15:05.407112  2234 raft_consensus.cc:606] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 2 LEADER]: Received request to transfer leadership to TS 8193261563944939bd4415fc6bdbc26d
I20260709 13:15:05.410004  2234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612"
dest_uuid: "069c6281111e43e7807aa8d79455e075"
mode: GRACEFUL
new_leader_uuid: "5dff3be607a343a09879ab364fc8bbc5"
 from {username='slave'} at 127.0.0.1:51878
I20260709 13:15:05.410516  2234 raft_consensus.cc:606] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 3 LEADER]: Received request to transfer leadership to TS 5dff3be607a343a09879ab364fc8bbc5
I20260709 13:15:05.412731  2234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "784c999e56664bf4b0fcbe69b49d79f1"
dest_uuid: "069c6281111e43e7807aa8d79455e075"
mode: GRACEFUL
new_leader_uuid: "5dff3be607a343a09879ab364fc8bbc5"
 from {username='slave'} at 127.0.0.1:51878
I20260709 13:15:05.413210  2234 raft_consensus.cc:606] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 2 LEADER]: Received request to transfer leadership to TS 5dff3be607a343a09879ab364fc8bbc5
I20260709 13:15:05.415706  2234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e"
dest_uuid: "069c6281111e43e7807aa8d79455e075"
mode: GRACEFUL
new_leader_uuid: "8193261563944939bd4415fc6bdbc26d"
 from {username='slave'} at 127.0.0.1:51878
I20260709 13:15:05.416200  2234 raft_consensus.cc:606] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 3 LEADER]: Received request to transfer leadership to TS 8193261563944939bd4415fc6bdbc26d
I20260709 13:15:05.418587  2234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d"
dest_uuid: "069c6281111e43e7807aa8d79455e075"
mode: GRACEFUL
new_leader_uuid: "5dff3be607a343a09879ab364fc8bbc5"
 from {username='slave'} at 127.0.0.1:51878
I20260709 13:15:05.419109  2234 raft_consensus.cc:606] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 3 LEADER]: Received request to transfer leadership to TS 5dff3be607a343a09879ab364fc8bbc5
I20260709 13:15:05.420185  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:05.420702  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:05.510695  2488 raft_consensus.cc:993] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075: : Instructing follower 5dff3be607a343a09879ab364fc8bbc5 to start an election
I20260709 13:15:05.511277  2487 raft_consensus.cc:1081] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 2 LEADER]: Signalling peer 5dff3be607a343a09879ab364fc8bbc5 to start an election
I20260709 13:15:05.512912  2159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "784c999e56664bf4b0fcbe69b49d79f1"
dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
 from {username='slave'} at 127.0.0.1:50236
I20260709 13:15:05.513394  2159 raft_consensus.cc:493] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:05.513717  2159 raft_consensus.cc:3060] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:05.519429  2159 raft_consensus.cc:515] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:05.521623  2159 leader_election.cc:290] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 3 election: Requested vote from peers 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:15:05.522629  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784c999e56664bf4b0fcbe69b49d79f1" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:15:05.523012  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784c999e56664bf4b0fcbe69b49d79f1" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:15:05.523420  2234 raft_consensus.cc:3055] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:05.523491  2309 raft_consensus.cc:3060] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:05.523769  2234 raft_consensus.cc:740] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:15:05.524905  2488 raft_consensus.cc:993] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075: : Instructing follower 5dff3be607a343a09879ab364fc8bbc5 to start an election
I20260709 13:15:05.524726  2234 consensus_queue.cc:260] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:05.525403  2487 raft_consensus.cc:1081] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 3 LEADER]: Signalling peer 5dff3be607a343a09879ab364fc8bbc5 to start an election
I20260709 13:15:05.526033  2234 raft_consensus.cc:3060] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:05.526911  2159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612"
dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
 from {username='slave'} at 127.0.0.1:50236
I20260709 13:15:05.527374  2159 raft_consensus.cc:493] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:05.527658  2159 raft_consensus.cc:3060] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:05.530179  2309 raft_consensus.cc:2468] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 3.
I20260709 13:15:05.531576  2124 leader_election.cc:304] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:15:05.531937  2159 raft_consensus.cc:515] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:05.532613  2234 raft_consensus.cc:2468] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 3.
I20260709 13:15:05.533777  2159 leader_election.cc:290] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 4 election: Requested vote from peers 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:15:05.535207  2489 raft_consensus.cc:2804] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:05.535985  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:15:05.536150  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba5caf0251f47f6a916d0647d23d612" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:15:05.536557  2234 raft_consensus.cc:3055] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:05.536669  2309 raft_consensus.cc:3060] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:05.536906  2234 raft_consensus.cc:740] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:15:05.537138  2489 raft_consensus.cc:697] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 LEADER]: Becoming Leader. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Running, Role: LEADER
I20260709 13:15:05.538128  2489 consensus_queue.cc:237] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:05.538224  2234 consensus_queue.cc:260] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:05.539407  2234 raft_consensus.cc:3060] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:05.546550  2234 raft_consensus.cc:2468] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 4.
I20260709 13:15:05.547747  2124 leader_election.cc:304] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069c6281111e43e7807aa8d79455e075, 5dff3be607a343a09879ab364fc8bbc5; no voters: 
I20260709 13:15:05.548491  2489 raft_consensus.cc:2804] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:05.549141  2489 raft_consensus.cc:697] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 4 LEADER]: Becoming Leader. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Running, Role: LEADER
I20260709 13:15:05.549242  2309 raft_consensus.cc:2468] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 4.
I20260709 13:15:05.550272  2489 consensus_queue.cc:237] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:05.551347  2054 catalog_manager.cc:5697] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 reported cstate change: term changed from 2 to 3, leader changed from 069c6281111e43e7807aa8d79455e075 (127.1.250.66) to 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "5dff3be607a343a09879ab364fc8bbc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.568701  2054 catalog_manager.cc:5697] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 reported cstate change: term changed from 3 to 4, leader changed from 069c6281111e43e7807aa8d79455e075 (127.1.250.66) to 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65). New cstate: current_term: 4 leader_uuid: "5dff3be607a343a09879ab364fc8bbc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.578521  2487 raft_consensus.cc:993] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075: : Instructing follower 8193261563944939bd4415fc6bdbc26d to start an election
I20260709 13:15:05.578999  2488 raft_consensus.cc:1081] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 2 LEADER]: Signalling peer 8193261563944939bd4415fc6bdbc26d to start an election
I20260709 13:15:05.580528  2309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05ce6f31309e4aa9b9b59ecc88bee223"
dest_uuid: "8193261563944939bd4415fc6bdbc26d"
 from {username='slave'} at 127.0.0.1:37562
I20260709 13:15:05.580967  2309 raft_consensus.cc:493] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:05.581230  2309 raft_consensus.cc:3060] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:05.585630  2309 raft_consensus.cc:515] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:05.587301  2309 leader_election.cc:290] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 3 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:15:05.588176  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ce6f31309e4aa9b9b59ecc88bee223" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:15:05.588378  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ce6f31309e4aa9b9b59ecc88bee223" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:15:05.588721  2159 raft_consensus.cc:3060] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:05.588917  2234 raft_consensus.cc:3055] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:05.589282  2234 raft_consensus.cc:740] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:15:05.589928  2234 consensus_queue.cc:260] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:05.590931  2234 raft_consensus.cc:3060] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:05.593931  2159 raft_consensus.cc:2468] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 3.
I20260709 13:15:05.595269  2274 leader_election.cc:304] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:15:05.595537  2234 raft_consensus.cc:2468] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 3.
I20260709 13:15:05.596354  2390 raft_consensus.cc:2804] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:05.597695  2390 raft_consensus.cc:697] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 3 LEADER]: Becoming Leader. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:15:05.598443  2390 consensus_queue.cc:237] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:05.605468  2054 catalog_manager.cc:5697] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d reported cstate change: term changed from 2 to 3, leader changed from 069c6281111e43e7807aa8d79455e075 (127.1.250.66) to 8193261563944939bd4415fc6bdbc26d (127.1.250.67). New cstate: current_term: 3 leader_uuid: "8193261563944939bd4415fc6bdbc26d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:05.707267  2487 raft_consensus.cc:993] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075: : Instructing follower 8193261563944939bd4415fc6bdbc26d to start an election
I20260709 13:15:05.707728  2488 raft_consensus.cc:1081] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 3 LEADER]: Signalling peer 8193261563944939bd4415fc6bdbc26d to start an election
I20260709 13:15:05.709226  2309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e"
dest_uuid: "8193261563944939bd4415fc6bdbc26d"
 from {username='slave'} at 127.0.0.1:37562
I20260709 13:15:05.709726  2309 raft_consensus.cc:493] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:05.710059  2309 raft_consensus.cc:3060] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:05.714251  2309 raft_consensus.cc:515] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:15:05.716177  2309 leader_election.cc:290] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 4 election: Requested vote from peers 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037), 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913)
I20260709 13:15:05.717036  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
I20260709 13:15:05.717171  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f2d80b0beb4310bc3c6fa4452c130e" candidate_uuid: "8193261563944939bd4415fc6bdbc26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:15:05.717614  2159 raft_consensus.cc:3060] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:05.717720  2234 raft_consensus.cc:3055] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:05.718134  2234 raft_consensus.cc:740] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:15:05.718812  2234 consensus_queue.cc:260] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:15:05.719733  2234 raft_consensus.cc:3060] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:05.721994  2159 raft_consensus.cc:2468] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 4.
I20260709 13:15:05.723028  2274 leader_election.cc:304] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:15:05.723838  2390 raft_consensus.cc:2804] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:05.724241  2390 raft_consensus.cc:697] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 4 LEADER]: Becoming Leader. State: Replica: 8193261563944939bd4415fc6bdbc26d, State: Running, Role: LEADER
I20260709 13:15:05.724390  2234 raft_consensus.cc:2468] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8193261563944939bd4415fc6bdbc26d in term 4.
I20260709 13:15:05.725183  2390 consensus_queue.cc:237] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } }
I20260709 13:15:05.732131  2054 catalog_manager.cc:5697] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d reported cstate change: term changed from 3 to 4, leader changed from 069c6281111e43e7807aa8d79455e075 (127.1.250.66) to 8193261563944939bd4415fc6bdbc26d (127.1.250.67). New cstate: current_term: 4 leader_uuid: "8193261563944939bd4415fc6bdbc26d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.929514  2487 raft_consensus.cc:993] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075: : Instructing follower 5dff3be607a343a09879ab364fc8bbc5 to start an election
I20260709 13:15:05.930058  2488 raft_consensus.cc:1081] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 3 LEADER]: Signalling peer 5dff3be607a343a09879ab364fc8bbc5 to start an election
I20260709 13:15:05.931366  2159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d"
dest_uuid: "5dff3be607a343a09879ab364fc8bbc5"
 from {username='slave'} at 127.0.0.1:50236
I20260709 13:15:05.931826  2159 raft_consensus.cc:493] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:05.932107  2159 raft_consensus.cc:3060] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:05.936131  2159 raft_consensus.cc:515] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:05.937493  2159 leader_election.cc:290] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 4 election: Requested vote from peers 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913), 8193261563944939bd4415fc6bdbc26d (127.1.250.67:33499)
I20260709 13:15:05.938429  2234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "069c6281111e43e7807aa8d79455e075"
I20260709 13:15:05.938639  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f750daf54046b754cedcf567f17d" candidate_uuid: "5dff3be607a343a09879ab364fc8bbc5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8193261563944939bd4415fc6bdbc26d"
I20260709 13:15:05.938983  2234 raft_consensus.cc:3055] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:05.939081  2309 raft_consensus.cc:3060] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:05.939306  2234 raft_consensus.cc:740] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 069c6281111e43e7807aa8d79455e075, State: Running, Role: LEADER
I20260709 13:15:05.940068  2234 consensus_queue.cc:260] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:05.941293  2234 raft_consensus.cc:3060] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:05.945235  2309 raft_consensus.cc:2468] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 4.
I20260709 13:15:05.946280  2124 leader_election.cc:304] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dff3be607a343a09879ab364fc8bbc5, 8193261563944939bd4415fc6bdbc26d; no voters: 
I20260709 13:15:05.947011  2489 raft_consensus.cc:2804] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:05.947156  2234 raft_consensus.cc:2468] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dff3be607a343a09879ab364fc8bbc5 in term 4.
I20260709 13:15:05.947479  2489 raft_consensus.cc:697] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 4 LEADER]: Becoming Leader. State: Replica: 5dff3be607a343a09879ab364fc8bbc5, State: Running, Role: LEADER
I20260709 13:15:05.948329  2489 consensus_queue.cc:237] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } }
I20260709 13:15:05.955303  2054 catalog_manager.cc:5697] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 reported cstate change: term changed from 3 to 4, leader changed from 069c6281111e43e7807aa8d79455e075 (127.1.250.66) to 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65). New cstate: current_term: 4 leader_uuid: "5dff3be607a343a09879ab364fc8bbc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.971289  2309 raft_consensus.cc:1275] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 4 FOLLOWER]: Refusing update from remote peer 5dff3be607a343a09879ab364fc8bbc5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:05.972543  2489 consensus_queue.cc:1048] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:05.983191  2234 raft_consensus.cc:1275] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 4 FOLLOWER]: Refusing update from remote peer 5dff3be607a343a09879ab364fc8bbc5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:05.984895  2490 consensus_queue.cc:1048] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:06.015169  2234 raft_consensus.cc:1275] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Refusing update from remote peer 5dff3be607a343a09879ab364fc8bbc5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:06.016546  2490 consensus_queue.cc:1048] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:06.025236  2234 raft_consensus.cc:1275] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Refusing update from remote peer 8193261563944939bd4415fc6bdbc26d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:06.026023  2309 raft_consensus.cc:1275] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Refusing update from remote peer 5dff3be607a343a09879ab364fc8bbc5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:06.026727  2390 consensus_queue.cc:1048] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:06.027407  2490 consensus_queue.cc:1048] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:06.035823  2159 raft_consensus.cc:1275] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Refusing update from remote peer 8193261563944939bd4415fc6bdbc26d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:06.038092  2390 consensus_queue.cc:1048] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:06.130836  2159 raft_consensus.cc:1275] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 4 FOLLOWER]: Refusing update from remote peer 8193261563944939bd4415fc6bdbc26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:06.132344  2390 consensus_queue.cc:1048] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dff3be607a343a09879ab364fc8bbc5" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 46037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:06.140553  2235 raft_consensus.cc:1275] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 4 FOLLOWER]: Refusing update from remote peer 8193261563944939bd4415fc6bdbc26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:06.142647  2390 consensus_queue.cc:1048] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:06.388837  2235 raft_consensus.cc:1275] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 4 FOLLOWER]: Refusing update from remote peer 5dff3be607a343a09879ab364fc8bbc5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:06.390121  2490 consensus_queue.cc:1048] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c6281111e43e7807aa8d79455e075" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:06.399111  2309 raft_consensus.cc:1275] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 4 FOLLOWER]: Refusing update from remote peer 5dff3be607a343a09879ab364fc8bbc5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:06.400905  2490 consensus_queue.cc:1048] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8193261563944939bd4415fc6bdbc26d" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:06.421645  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:06.426903  2025 tablet_server.cc:179] TabletServer@127.1.250.65:0 shutting down...
I20260709 13:15:06.452186  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:06.453163  2025 tablet_replica.cc:333] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5: stopping tablet replica
I20260709 13:15:06.454277  2025 raft_consensus.cc:2243] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:06.455246  2025 raft_consensus.cc:2272] T 784c999e56664bf4b0fcbe69b49d79f1 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.458133  2025 tablet_replica.cc:333] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5: stopping tablet replica
I20260709 13:15:06.458712  2025 raft_consensus.cc:2243] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.459226  2025 raft_consensus.cc:2272] T 05ce6f31309e4aa9b9b59ecc88bee223 P 5dff3be607a343a09879ab364fc8bbc5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.461663  2025 tablet_replica.cc:333] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5: stopping tablet replica
I20260709 13:15:06.462430  2025 raft_consensus.cc:2243] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.462935  2025 raft_consensus.cc:2272] T 43e3527afa7745958ef70c96bf1c93e4 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.464740  2025 tablet_replica.cc:333] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5: stopping tablet replica
I20260709 13:15:06.465270  2025 raft_consensus.cc:2243] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:06.465929  2025 raft_consensus.cc:2272] T 6ba5caf0251f47f6a916d0647d23d612 P 5dff3be607a343a09879ab364fc8bbc5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.467777  2025 tablet_replica.cc:333] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5: stopping tablet replica
I20260709 13:15:06.468357  2025 raft_consensus.cc:2243] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.468930  2025 raft_consensus.cc:2272] T bc8b4dc00c29444eb72b4ed19f635638 P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:06.470172  2274 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:06.471488  2025 tablet_replica.cc:333] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5: stopping tablet replica
I20260709 13:15:06.472152  2025 raft_consensus.cc:2243] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.472905  2025 raft_consensus.cc:2272] T 3b6eb66be8ec478ba3c38f3cc395c30e P 5dff3be607a343a09879ab364fc8bbc5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:06.473801  2274 consensus_peers.cc:597] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d -> Peer 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037): Couldn't send request to peer 5dff3be607a343a09879ab364fc8bbc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:06.474900  2025 tablet_replica.cc:333] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5: stopping tablet replica
I20260709 13:15:06.475425  2025 raft_consensus.cc:2243] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:06.476121  2025 raft_consensus.cc:2272] T 9d18f750daf54046b754cedcf567f17d P 5dff3be607a343a09879ab364fc8bbc5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.478143  2025 tablet_replica.cc:333] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5: stopping tablet replica
I20260709 13:15:06.478627  2025 raft_consensus.cc:2243] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.479053  2025 raft_consensus.cc:2272] T bf3cf95e60ac400ab8f77e071b0fd766 P 5dff3be607a343a09879ab364fc8bbc5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.480731  2025 tablet_replica.cc:333] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5: stopping tablet replica
I20260709 13:15:06.481261  2025 raft_consensus.cc:2243] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.481666  2025 raft_consensus.cc:2272] T 82f2d80b0beb4310bc3c6fa4452c130e P 5dff3be607a343a09879ab364fc8bbc5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.583226  2025 tablet_server.cc:196] TabletServer@127.1.250.65:0 shutdown complete.
I20260709 13:15:06.602591  2025 tablet_server.cc:179] TabletServer@127.1.250.66:0 shutting down...
I20260709 13:15:06.625784  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:06.626361  2025 tablet_replica.cc:333] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075: stopping tablet replica
I20260709 13:15:06.626961  2025 raft_consensus.cc:2243] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.627456  2025 raft_consensus.cc:2272] T 43e3527afa7745958ef70c96bf1c93e4 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.629367  2025 tablet_replica.cc:333] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075: stopping tablet replica
I20260709 13:15:06.629894  2025 raft_consensus.cc:2243] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.630290  2025 raft_consensus.cc:2272] T 9d18f750daf54046b754cedcf567f17d P 069c6281111e43e7807aa8d79455e075 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.632187  2025 tablet_replica.cc:333] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075: stopping tablet replica
I20260709 13:15:06.632668  2025 raft_consensus.cc:2243] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:06.633476  2025 raft_consensus.cc:2272] T 3b6eb66be8ec478ba3c38f3cc395c30e P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.635237  2025 tablet_replica.cc:333] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075: stopping tablet replica
I20260709 13:15:06.635802  2025 raft_consensus.cc:2243] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:06.636543  2025 raft_consensus.cc:2272] T bf3cf95e60ac400ab8f77e071b0fd766 P 069c6281111e43e7807aa8d79455e075 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.638149  2025 tablet_replica.cc:333] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075: stopping tablet replica
I20260709 13:15:06.638648  2025 raft_consensus.cc:2243] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.639027  2025 raft_consensus.cc:2272] T 82f2d80b0beb4310bc3c6fa4452c130e P 069c6281111e43e7807aa8d79455e075 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.641929  2025 tablet_replica.cc:333] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075: stopping tablet replica
I20260709 13:15:06.642566  2025 raft_consensus.cc:2243] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.643043  2025 raft_consensus.cc:2272] T 784c999e56664bf4b0fcbe69b49d79f1 P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:06.643574  2273 consensus_peers.cc:597] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d -> Peer 069c6281111e43e7807aa8d79455e075 (127.1.250.66:38913): Couldn't send request to peer 069c6281111e43e7807aa8d79455e075. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:06.645341  2025 tablet_replica.cc:333] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075: stopping tablet replica
I20260709 13:15:06.645776  2025 raft_consensus.cc:2243] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.646102  2025 raft_consensus.cc:2272] T 6ba5caf0251f47f6a916d0647d23d612 P 069c6281111e43e7807aa8d79455e075 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.647948  2025 tablet_replica.cc:333] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075: stopping tablet replica
I20260709 13:15:06.648343  2025 raft_consensus.cc:2243] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:06.648955  2025 raft_consensus.cc:2272] T bc8b4dc00c29444eb72b4ed19f635638 P 069c6281111e43e7807aa8d79455e075 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.650509  2025 tablet_replica.cc:333] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075: stopping tablet replica
I20260709 13:15:06.650892  2025 raft_consensus.cc:2243] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.651211  2025 raft_consensus.cc:2272] T 05ce6f31309e4aa9b9b59ecc88bee223 P 069c6281111e43e7807aa8d79455e075 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:06.673986  2274 consensus_peers.cc:597] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d -> Peer 5dff3be607a343a09879ab364fc8bbc5 (127.1.250.65:46037): Couldn't send request to peer 5dff3be607a343a09879ab364fc8bbc5. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:46037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:06.677843  2025 tablet_server.cc:196] TabletServer@127.1.250.66:0 shutdown complete.
I20260709 13:15:06.694585  2025 tablet_server.cc:179] TabletServer@127.1.250.67:0 shutting down...
I20260709 13:15:06.720191  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:06.720906  2025 tablet_replica.cc:333] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d: stopping tablet replica
I20260709 13:15:06.721629  2025 raft_consensus.cc:2243] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:06.722432  2025 raft_consensus.cc:2272] T 43e3527afa7745958ef70c96bf1c93e4 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.724156  2025 tablet_replica.cc:333] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d: stopping tablet replica
I20260709 13:15:06.724670  2025 raft_consensus.cc:2243] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.725162  2025 raft_consensus.cc:2272] T bf3cf95e60ac400ab8f77e071b0fd766 P 8193261563944939bd4415fc6bdbc26d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.726704  2025 tablet_replica.cc:333] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d: stopping tablet replica
I20260709 13:15:06.727205  2025 raft_consensus.cc:2243] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:06.727900  2025 raft_consensus.cc:2272] T 82f2d80b0beb4310bc3c6fa4452c130e P 8193261563944939bd4415fc6bdbc26d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.729835  2025 tablet_replica.cc:333] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d: stopping tablet replica
I20260709 13:15:06.730327  2025 raft_consensus.cc:2243] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.730722  2025 raft_consensus.cc:2272] T 3b6eb66be8ec478ba3c38f3cc395c30e P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.732270  2025 tablet_replica.cc:333] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d: stopping tablet replica
I20260709 13:15:06.732750  2025 raft_consensus.cc:2243] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.733222  2025 raft_consensus.cc:2272] T 9d18f750daf54046b754cedcf567f17d P 8193261563944939bd4415fc6bdbc26d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.735052  2025 tablet_replica.cc:333] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d: stopping tablet replica
I20260709 13:15:06.735569  2025 raft_consensus.cc:2243] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.736016  2025 raft_consensus.cc:2272] T 784c999e56664bf4b0fcbe69b49d79f1 P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.737959  2025 tablet_replica.cc:333] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d: stopping tablet replica
I20260709 13:15:06.738441  2025 raft_consensus.cc:2243] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.738835  2025 raft_consensus.cc:2272] T 6ba5caf0251f47f6a916d0647d23d612 P 8193261563944939bd4415fc6bdbc26d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.740660  2025 tablet_replica.cc:333] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d: stopping tablet replica
I20260709 13:15:06.741168  2025 raft_consensus.cc:2243] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:06.741863  2025 raft_consensus.cc:2272] T 05ce6f31309e4aa9b9b59ecc88bee223 P 8193261563944939bd4415fc6bdbc26d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.743686  2025 tablet_replica.cc:333] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d: stopping tablet replica
I20260709 13:15:06.744143  2025 raft_consensus.cc:2243] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.744535  2025 raft_consensus.cc:2272] T bc8b4dc00c29444eb72b4ed19f635638 P 8193261563944939bd4415fc6bdbc26d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.771107  2025 tablet_server.cc:196] TabletServer@127.1.250.67:0 shutdown complete.
I20260709 13:15:06.787276  2025 master.cc:562] Master@127.1.250.126:42487 shutting down...
I20260709 13:15:06.881698  2112 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:15:06.941838  2025 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:06.942523  2025 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.942898  2025 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2c0bf169d6b64fa789f5aa349235569d: stopping tablet replica
I20260709 13:15:06.963831  2025 master.cc:584] Master@127.1.250.126:42487 shutdown complete.
069c6281111e43e7807aa8d79455e075  4
5dff3be607a343a09879ab364fc8bbc5  4
8193261563944939bd4415fc6bdbc26d  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12650 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:15:07.006611  2025 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.250.126:33413
I20260709 13:15:07.007894  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:07.014482  2518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:07.015010  2519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:07.016060  2521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:07.017596  2025 server_base.cc:1061] running on GCE node
I20260709 13:15:07.018656  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:07.018959  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:07.019102  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783602907019091 us; error 0 us; skew 500 ppm
I20260709 13:15:07.019692  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:07.022332  2025 webserver.cc:533] Webserver started at http://127.1.250.126:33845/ using document root <none> and password file <none>
I20260709 13:15:07.022876  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:07.023097  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:07.023403  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:07.024571  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/master-0-root/instance:
uuid: "4574d902e18a40278b97d6c8a1412cea"
format_stamp: "Formatted at 2026-07-09 13:15:07 on dist-test-slave-g4pn"
I20260709 13:15:07.029016  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:15:07.032516  2526 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:07.033411  2025 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:07.033651  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/master-0-root
uuid: "4574d902e18a40278b97d6c8a1412cea"
format_stamp: "Formatted at 2026-07-09 13:15:07 on dist-test-slave-g4pn"
I20260709 13:15:07.033890  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:07.046175  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:07.047369  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:07.088020  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.126:33413
I20260709 13:15:07.088146  2577 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.126:33413 every 8 connection(s)
I20260709 13:15:07.092145  2578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.101454  2578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea: Bootstrap starting.
I20260709 13:15:07.106364  2578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:07.110898  2578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea: No bootstrap required, opened a new log
I20260709 13:15:07.113050  2578 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4574d902e18a40278b97d6c8a1412cea" member_type: VOTER }
I20260709 13:15:07.113474  2578 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:07.113703  2578 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4574d902e18a40278b97d6c8a1412cea, State: Initialized, Role: FOLLOWER
I20260709 13:15:07.114290  2578 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4574d902e18a40278b97d6c8a1412cea" member_type: VOTER }
I20260709 13:15:07.114732  2578 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:07.114960  2578 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:07.115228  2578 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:07.119426  2578 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4574d902e18a40278b97d6c8a1412cea" member_type: VOTER }
I20260709 13:15:07.120112  2578 leader_election.cc:304] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4574d902e18a40278b97d6c8a1412cea; no voters: 
I20260709 13:15:07.121505  2578 leader_election.cc:290] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:07.121827  2581 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:07.123265  2581 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [term 1 LEADER]: Becoming Leader. State: Replica: 4574d902e18a40278b97d6c8a1412cea, State: Running, Role: LEADER
I20260709 13:15:07.123953  2581 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4574d902e18a40278b97d6c8a1412cea" member_type: VOTER }
I20260709 13:15:07.125030  2578 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:07.129177  2583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4574d902e18a40278b97d6c8a1412cea. Latest consensus state: current_term: 1 leader_uuid: "4574d902e18a40278b97d6c8a1412cea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4574d902e18a40278b97d6c8a1412cea" member_type: VOTER } }
I20260709 13:15:07.129968  2583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:07.131151  2582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4574d902e18a40278b97d6c8a1412cea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4574d902e18a40278b97d6c8a1412cea" member_type: VOTER } }
I20260709 13:15:07.131883  2582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:07.136516  2588 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:07.142027  2588 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:07.143049  2025 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:07.151285  2588 catalog_manager.cc:1383] Generated new cluster ID: 480400da873148d289625bf260b07534
I20260709 13:15:07.151589  2588 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:07.179768  2588 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:07.181054  2588 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:07.200598  2588 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea: Generated new TSK 0
I20260709 13:15:07.201188  2588 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:07.209506  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:07.215822  2599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:07.216724  2600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:07.219825  2602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:07.220532  2025 server_base.cc:1061] running on GCE node
I20260709 13:15:07.221392  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:07.221580  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:07.221753  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783602907221739 us; error 0 us; skew 500 ppm
I20260709 13:15:07.222241  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:07.224553  2025 webserver.cc:533] Webserver started at http://127.1.250.65:40217/ using document root <none> and password file <none>
I20260709 13:15:07.225000  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:07.225261  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:07.225472  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:07.226486  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/ts-0-root/instance:
uuid: "ea8ca4aa76354c09afe1f37627a6b613"
format_stamp: "Formatted at 2026-07-09 13:15:07 on dist-test-slave-g4pn"
I20260709 13:15:07.230999  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:15:07.234216  2607 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:07.235106  2025 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:15:07.235414  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/ts-0-root
uuid: "ea8ca4aa76354c09afe1f37627a6b613"
format_stamp: "Formatted at 2026-07-09 13:15:07 on dist-test-slave-g4pn"
I20260709 13:15:07.235675  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:07.252270  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:07.253891  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:07.255848  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:07.258129  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:07.258311  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:07.258595  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:07.258762  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:07.300136  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.65:33351
I20260709 13:15:07.300232  2669 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.65:33351 every 8 connection(s)
I20260709 13:15:07.305341  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:07.312124  2674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:07.313877  2675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:07.316910  2677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:07.318630  2025 server_base.cc:1061] running on GCE node
I20260709 13:15:07.319662  2670 heartbeater.cc:344] Connected to a master server at 127.1.250.126:33413
I20260709 13:15:07.320091  2670 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:07.320190  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:07.320528  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:07.320746  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783602907320725 us; error 0 us; skew 500 ppm
I20260709 13:15:07.321162  2670 heartbeater.cc:507] Master 127.1.250.126:33413 requested a full tablet report, sending...
I20260709 13:15:07.321619  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:07.323742  2543 ts_manager.cc:194] Registered new tserver with Master: ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351)
I20260709 13:15:07.324882  2025 webserver.cc:533] Webserver started at http://127.1.250.66:36613/ using document root <none> and password file <none>
I20260709 13:15:07.325410  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:07.325611  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:07.325964  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:07.326206  2543 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48694
I20260709 13:15:07.327697  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/ts-1-root/instance:
uuid: "eed2db69d6f94554b76d516ba7d98490"
format_stamp: "Formatted at 2026-07-09 13:15:07 on dist-test-slave-g4pn"
I20260709 13:15:07.332696  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:07.336122  2682 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:07.336890  2025 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:15:07.337235  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/ts-1-root
uuid: "eed2db69d6f94554b76d516ba7d98490"
format_stamp: "Formatted at 2026-07-09 13:15:07 on dist-test-slave-g4pn"
I20260709 13:15:07.337581  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:07.368171  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:07.369535  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:07.370972  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:07.373292  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:07.373481  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:07.373813  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:07.373961  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:07.416110  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.66:38351
I20260709 13:15:07.416239  2744 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.66:38351 every 8 connection(s)
I20260709 13:15:07.421052  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:07.428996  2748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:07.432001  2749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:07.434976  2025 server_base.cc:1061] running on GCE node
W20260709 13:15:07.435822  2751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:07.436697  2745 heartbeater.cc:344] Connected to a master server at 127.1.250.126:33413
I20260709 13:15:07.437026  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:15:07.437153  2745 heartbeater.cc:461] Registering TS with master...
W20260709 13:15:07.437346  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:07.437583  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783602907437559 us; error 0 us; skew 500 ppm
I20260709 13:15:07.438102  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:07.438254  2745 heartbeater.cc:507] Master 127.1.250.126:33413 requested a full tablet report, sending...
I20260709 13:15:07.440842  2543 ts_manager.cc:194] Registered new tserver with Master: eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351)
I20260709 13:15:07.440944  2025 webserver.cc:533] Webserver started at http://127.1.250.67:40851/ using document root <none> and password file <none>
I20260709 13:15:07.441602  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:07.441850  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:07.442173  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:07.442664  2543 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48706
I20260709 13:15:07.443683  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/ts-2-root/instance:
uuid: "27f50cbadf0b4667b694fa940273a112"
format_stamp: "Formatted at 2026-07-09 13:15:07 on dist-test-slave-g4pn"
I20260709 13:15:07.448279  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:07.451617  2756 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:07.452339  2025 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:15:07.452641  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/ts-2-root
uuid: "27f50cbadf0b4667b694fa940273a112"
format_stamp: "Formatted at 2026-07-09 13:15:07 on dist-test-slave-g4pn"
I20260709 13:15:07.452910  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602894180814-2025-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:07.467509  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:07.468706  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:07.470294  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:07.472488  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:07.472673  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:07.472945  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:07.473132  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:15:07.514773  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.67:34453
I20260709 13:15:07.514899  2818 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.67:34453 every 8 connection(s)
I20260709 13:15:07.529644  2819 heartbeater.cc:344] Connected to a master server at 127.1.250.126:33413
I20260709 13:15:07.530040  2819 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:07.531070  2819 heartbeater.cc:507] Master 127.1.250.126:33413 requested a full tablet report, sending...
I20260709 13:15:07.533710  2543 ts_manager.cc:194] Registered new tserver with Master: 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:07.533993  2025 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016076513s
I20260709 13:15:07.535660  2543 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48710
I20260709 13:15:07.560644  2543 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48716:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:07.563730  2543 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:07.655499  2710 tablet_service.cc:1511] Processing CreateTablet for tablet ae5d42c2a0504f8eaa593f5fbac08345 (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:07.656598  2709 tablet_service.cc:1511] Processing CreateTablet for tablet cb8b1ed4d0a14b769d47523954a2fce5 (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:07.656980  2710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae5d42c2a0504f8eaa593f5fbac08345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.658057  2709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8b1ed4d0a14b769d47523954a2fce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.657847  2708 tablet_service.cc:1511] Processing CreateTablet for tablet 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:07.659684  2708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.656641  2707 tablet_service.cc:1511] Processing CreateTablet for tablet 2e129ffeca244f29976764022b760edc (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:07.666656  2707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e129ffeca244f29976764022b760edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.668695  2782 tablet_service.cc:1511] Processing CreateTablet for tablet 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:07.670068  2782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.674253  2784 tablet_service.cc:1511] Processing CreateTablet for tablet ae5d42c2a0504f8eaa593f5fbac08345 (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:07.675084  2635 tablet_service.cc:1511] Processing CreateTablet for tablet ae5d42c2a0504f8eaa593f5fbac08345 (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:07.675616  2784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae5d42c2a0504f8eaa593f5fbac08345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.676340  2635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae5d42c2a0504f8eaa593f5fbac08345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.677896  2628 tablet_service.cc:1511] Processing CreateTablet for tablet 938fd2297189411f9545fd31df9d0ea4 (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:07.678249  2634 tablet_service.cc:1511] Processing CreateTablet for tablet cb8b1ed4d0a14b769d47523954a2fce5 (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:07.679214  2628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938fd2297189411f9545fd31df9d0ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.680472  2633 tablet_service.cc:1511] Processing CreateTablet for tablet 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:07.689407  2633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.689343  2631 tablet_service.cc:1511] Processing CreateTablet for tablet 3662a338455a4acaae7a6887452aa38f (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:07.690794  2631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3662a338455a4acaae7a6887452aa38f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.692207  2634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8b1ed4d0a14b769d47523954a2fce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.692215  2775 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5eee6eac9e456595b69de203f2445b (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:07.693848  2775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5eee6eac9e456595b69de203f2445b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.694196  2630 tablet_service.cc:1511] Processing CreateTablet for tablet ccd388f530164bbb84b06b26d2a789f1 (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:07.695526  2630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd388f530164bbb84b06b26d2a789f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.698318  2629 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcce0630ae041dc87b3f695e73dd0cb (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:07.699679  2629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcce0630ae041dc87b3f695e73dd0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.702318  2627 tablet_service.cc:1511] Processing CreateTablet for tablet 246568b455744f5b849b10ac433025be (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:07.703670  2627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 246568b455744f5b849b10ac433025be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.704758  2626 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5eee6eac9e456595b69de203f2445b (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:07.706455  2626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5eee6eac9e456595b69de203f2445b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.680727  2783 tablet_service.cc:1511] Processing CreateTablet for tablet cb8b1ed4d0a14b769d47523954a2fce5 (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:07.682448  2781 tablet_service.cc:1511] Processing CreateTablet for tablet 2e129ffeca244f29976764022b760edc (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:07.683549  2778 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcce0630ae041dc87b3f695e73dd0cb (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:07.684113  2780 tablet_service.cc:1511] Processing CreateTablet for tablet 3662a338455a4acaae7a6887452aa38f (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:07.685336  2777 tablet_service.cc:1511] Processing CreateTablet for tablet 938fd2297189411f9545fd31df9d0ea4 (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:07.717885  2777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938fd2297189411f9545fd31df9d0ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.721801  2778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcce0630ae041dc87b3f695e73dd0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.730692  2706 tablet_service.cc:1511] Processing CreateTablet for tablet 3662a338455a4acaae7a6887452aa38f (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:07.732101  2706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3662a338455a4acaae7a6887452aa38f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.732421  2702 tablet_service.cc:1511] Processing CreateTablet for tablet 246568b455744f5b849b10ac433025be (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:07.685866  2779 tablet_service.cc:1511] Processing CreateTablet for tablet ccd388f530164bbb84b06b26d2a789f1 (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:07.687574  2632 tablet_service.cc:1511] Processing CreateTablet for tablet 2e129ffeca244f29976764022b760edc (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:07.687837  2776 tablet_service.cc:1511] Processing CreateTablet for tablet 246568b455744f5b849b10ac433025be (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:07.736935  2780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3662a338455a4acaae7a6887452aa38f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.740921  2703 tablet_service.cc:1511] Processing CreateTablet for tablet 938fd2297189411f9545fd31df9d0ea4 (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:07.744194  2701 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5eee6eac9e456595b69de203f2445b (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:07.749645  2632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e129ffeca244f29976764022b760edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.749828  2704 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcce0630ae041dc87b3f695e73dd0cb (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:07.736805  2705 tablet_service.cc:1511] Processing CreateTablet for tablet ccd388f530164bbb84b06b26d2a789f1 (DEFAULT_TABLE table=test-workload [id=be586f864ef64f17afa57c292c38d1f6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:07.758059  2702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 246568b455744f5b849b10ac433025be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.759615  2704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcce0630ae041dc87b3f695e73dd0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.760936  2705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd388f530164bbb84b06b26d2a789f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.762555  2701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5eee6eac9e456595b69de203f2445b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.765249  2703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938fd2297189411f9545fd31df9d0ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.779592  2776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 246568b455744f5b849b10ac433025be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.782169  2783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8b1ed4d0a14b769d47523954a2fce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.784143  2781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e129ffeca244f29976764022b760edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.786487  2779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd388f530164bbb84b06b26d2a789f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.849429  2834 tablet_bootstrap.cc:492] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490: Bootstrap starting.
I20260709 13:15:07.853715  2835 tablet_bootstrap.cc:492] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613: Bootstrap starting.
I20260709 13:15:07.882225  2835 tablet_bootstrap.cc:654] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:07.906422  2834 tablet_bootstrap.cc:654] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:07.931188  2836 tablet_bootstrap.cc:492] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112: Bootstrap starting.
I20260709 13:15:07.943997  2836 tablet_bootstrap.cc:654] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:07.953217  2835 tablet_bootstrap.cc:492] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613: No bootstrap required, opened a new log
I20260709 13:15:07.953732  2835 ts_tablet_manager.cc:1403] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613: Time spent bootstrapping tablet: real 0.100s	user 0.023s	sys 0.027s
I20260709 13:15:07.958763  2834 tablet_bootstrap.cc:492] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490: No bootstrap required, opened a new log
I20260709 13:15:07.959311  2834 ts_tablet_manager.cc:1403] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490: Time spent bootstrapping tablet: real 0.110s	user 0.006s	sys 0.007s
I20260709 13:15:07.956879  2835 raft_consensus.cc:359] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:07.961755  2835 raft_consensus.cc:385] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:07.962046  2835 raft_consensus.cc:740] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Initialized, Role: FOLLOWER
I20260709 13:15:07.962909  2835 consensus_queue.cc:260] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:07.968708  2835 ts_tablet_manager.cc:1434] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 13:15:07.969475  2670 heartbeater.cc:499] Master 127.1.250.126:33413 was elected leader, sending a full tablet report...
I20260709 13:15:07.978446  2834 raft_consensus.cc:359] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:07.989706  2834 raft_consensus.cc:385] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:07.990342  2834 raft_consensus.cc:740] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Initialized, Role: FOLLOWER
I20260709 13:15:07.991276  2834 consensus_queue.cc:260] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:07.993412  2835 tablet_bootstrap.cc:492] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613: Bootstrap starting.
I20260709 13:15:08.013973  2835 tablet_bootstrap.cc:654] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.018209  2745 heartbeater.cc:499] Master 127.1.250.126:33413 was elected leader, sending a full tablet report...
I20260709 13:15:08.018888  2834 ts_tablet_manager.cc:1434] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490: Time spent starting tablet: real 0.059s	user 0.010s	sys 0.023s
I20260709 13:15:08.018958  2836 tablet_bootstrap.cc:492] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112: No bootstrap required, opened a new log
I20260709 13:15:08.019584  2836 ts_tablet_manager.cc:1403] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112: Time spent bootstrapping tablet: real 0.089s	user 0.019s	sys 0.049s
I20260709 13:15:08.020061  2834 tablet_bootstrap.cc:492] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P eed2db69d6f94554b76d516ba7d98490: Bootstrap starting.
I20260709 13:15:08.022529  2836 raft_consensus.cc:359] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.023492  2836 raft_consensus.cc:385] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.023876  2836 raft_consensus.cc:740] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.025139  2836 consensus_queue.cc:260] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.029397  2834 tablet_bootstrap.cc:654] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P eed2db69d6f94554b76d516ba7d98490: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.031123  2835 tablet_bootstrap.cc:492] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613: No bootstrap required, opened a new log
I20260709 13:15:08.031803  2835 ts_tablet_manager.cc:1403] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.008s
I20260709 13:15:08.035512  2835 raft_consensus.cc:359] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.036653  2835 raft_consensus.cc:385] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.037042  2835 raft_consensus.cc:740] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.038281  2835 consensus_queue.cc:260] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.041301  2835 ts_tablet_manager.cc:1434] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.003s
I20260709 13:15:08.042649  2835 tablet_bootstrap.cc:492] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613: Bootstrap starting.
I20260709 13:15:08.051580  2834 tablet_bootstrap.cc:492] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P eed2db69d6f94554b76d516ba7d98490: No bootstrap required, opened a new log
I20260709 13:15:08.051756  2835 tablet_bootstrap.cc:654] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.052238  2834 ts_tablet_manager.cc:1403] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P eed2db69d6f94554b76d516ba7d98490: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.007s
I20260709 13:15:08.055094  2819 heartbeater.cc:499] Master 127.1.250.126:33413 was elected leader, sending a full tablet report...
I20260709 13:15:08.056198  2834 raft_consensus.cc:359] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.056649  2836 ts_tablet_manager.cc:1434] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112: Time spent starting tablet: real 0.037s	user 0.020s	sys 0.015s
I20260709 13:15:08.056847  2834 raft_consensus.cc:385] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.057271  2834 raft_consensus.cc:740] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.057714  2836 tablet_bootstrap.cc:492] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112: Bootstrap starting.
I20260709 13:15:08.058245  2834 consensus_queue.cc:260] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P eed2db69d6f94554b76d516ba7d98490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.064544  2836 tablet_bootstrap.cc:654] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.066215  2834 ts_tablet_manager.cc:1434] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P eed2db69d6f94554b76d516ba7d98490: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:15:08.067606  2834 tablet_bootstrap.cc:492] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490: Bootstrap starting.
I20260709 13:15:08.076606  2836 tablet_bootstrap.cc:492] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112: No bootstrap required, opened a new log
I20260709 13:15:08.076499  2841 raft_consensus.cc:493] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.077178  2841 raft_consensus.cc:515] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:08.079836  2841 leader_election.cc:290] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453), ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351)
I20260709 13:15:08.080283  2835 tablet_bootstrap.cc:492] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613: No bootstrap required, opened a new log
I20260709 13:15:08.080847  2835 ts_tablet_manager.cc:1403] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.018s
I20260709 13:15:08.080907  2834 tablet_bootstrap.cc:654] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.084079  2835 raft_consensus.cc:359] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:08.085196  2835 raft_consensus.cc:385] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.085599  2835 raft_consensus.cc:740] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.086660  2835 consensus_queue.cc:260] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:08.089367  2835 ts_tablet_manager.cc:1434] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:15:08.090564  2835 tablet_bootstrap.cc:492] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613: Bootstrap starting.
I20260709 13:15:08.094894  2836 ts_tablet_manager.cc:1403] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.007s
I20260709 13:15:08.097337  2835 tablet_bootstrap.cc:654] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.098591  2836 raft_consensus.cc:359] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:08.099547  2836 raft_consensus.cc:385] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.099915  2836 raft_consensus.cc:740] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.102511  2840 raft_consensus.cc:493] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.103227  2840 raft_consensus.cc:515] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.100826  2836 consensus_queue.cc:260] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:08.112296  2840 leader_election.cc:290] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.113353  2836 ts_tablet_manager.cc:1434] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:15:08.114619  2836 tablet_bootstrap.cc:492] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112: Bootstrap starting.
I20260709 13:15:08.118197  2835 tablet_bootstrap.cc:492] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613: No bootstrap required, opened a new log
I20260709 13:15:08.118923  2835 ts_tablet_manager.cc:1403] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.004s
I20260709 13:15:08.120033  2843 raft_consensus.cc:493] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.120548  2843 raft_consensus.cc:515] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:08.122220  2836 tablet_bootstrap.cc:654] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.123446  2835 raft_consensus.cc:359] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.124316  2835 raft_consensus.cc:385] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.124506  2843 leader_election.cc:290] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351)
I20260709 13:15:08.124701  2835 raft_consensus.cc:740] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.126199  2834 tablet_bootstrap.cc:492] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490: No bootstrap required, opened a new log
I20260709 13:15:08.125754  2835 consensus_queue.cc:260] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.126693  2834 ts_tablet_manager.cc:1403] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.007s
I20260709 13:15:08.130060  2834 raft_consensus.cc:359] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.133984  2834 raft_consensus.cc:385] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.134311  2834 raft_consensus.cc:740] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.131942  2835 ts_tablet_manager.cc:1434] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
W20260709 13:15:08.136034  2591 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:08.136209  2835 tablet_bootstrap.cc:492] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613: Bootstrap starting.
I20260709 13:15:08.139240  2834 consensus_queue.cc:260] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.141515  2834 ts_tablet_manager.cc:1434] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:15:08.145422  2835 tablet_bootstrap.cc:654] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.166366  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112" is_pre_election: true
I20260709 13:15:08.167272  2794 raft_consensus.cc:2468] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 0.
I20260709 13:15:08.167258  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613" is_pre_election: true
I20260709 13:15:08.168742  2645 raft_consensus.cc:2468] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 0.
I20260709 13:15:08.169602  2684 leader_election.cc:304] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:08.171312  2841 raft_consensus.cc:2804] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.172751  2841 raft_consensus.cc:493] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.173269  2841 raft_consensus.cc:3060] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.185442  2841 raft_consensus.cc:515] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:08.189615  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:08.190436  2794 raft_consensus.cc:3060] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.193181  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490" is_pre_election: true
I20260709 13:15:08.194090  2720 raft_consensus.cc:2393] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27f50cbadf0b4667b694fa940273a112 in current term 1: Already voted for candidate eed2db69d6f94554b76d516ba7d98490 in this term.
I20260709 13:15:08.195869  2834 tablet_bootstrap.cc:492] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490: Bootstrap starting.
I20260709 13:15:08.197904  2794 raft_consensus.cc:2468] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 1.
I20260709 13:15:08.198588  2840 raft_consensus.cc:493] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.199088  2684 leader_election.cc:304] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:08.199126  2840 raft_consensus.cc:515] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.198180  2841 leader_election.cc:290] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 1 election: Requested vote from peers 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453), ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351)
I20260709 13:15:08.205853  2841 raft_consensus.cc:2804] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:08.206243  2840 leader_election.cc:290] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.206395  2841 raft_consensus.cc:697] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 1 LEADER]: Becoming Leader. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Running, Role: LEADER
I20260709 13:15:08.202929  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
I20260709 13:15:08.207135  2645 raft_consensus.cc:3060] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.207533  2841 consensus_queue.cc:237] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:08.208176  2793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbc9ccd4c4d42b0ac47ff54aa3bf2b2" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112" is_pre_election: true
I20260709 13:15:08.213060  2834 tablet_bootstrap.cc:654] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.215404  2645 raft_consensus.cc:2468] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 1.
W20260709 13:15:08.215752  2609 leader_election.cc:343] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.217836  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246568b455744f5b849b10ac433025be" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112" is_pre_election: true
I20260709 13:15:08.218766  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246568b455744f5b849b10ac433025be" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490" is_pre_election: true
W20260709 13:15:08.219352  2609 leader_election.cc:343] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.221698  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbc9ccd4c4d42b0ac47ff54aa3bf2b2" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490" is_pre_election: true
I20260709 13:15:08.222622  2720 raft_consensus.cc:2468] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 0.
W20260709 13:15:08.224582  2610 leader_election.cc:343] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.225055  2610 leader_election.cc:304] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613; no voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490
I20260709 13:15:08.205157  2836 tablet_bootstrap.cc:492] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112: No bootstrap required, opened a new log
I20260709 13:15:08.202592  2835 tablet_bootstrap.cc:492] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613: No bootstrap required, opened a new log
I20260709 13:15:08.226241  2835 ts_tablet_manager.cc:1403] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613: Time spent bootstrapping tablet: real 0.090s	user 0.020s	sys 0.034s
I20260709 13:15:08.226193  2834 tablet_bootstrap.cc:492] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490: No bootstrap required, opened a new log
I20260709 13:15:08.226938  2834 ts_tablet_manager.cc:1403] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.003s
I20260709 13:15:08.229429  2836 ts_tablet_manager.cc:1403] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112: Time spent bootstrapping tablet: real 0.115s	user 0.033s	sys 0.038s
I20260709 13:15:08.230803  2834 raft_consensus.cc:359] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.231536  2834 raft_consensus.cc:385] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.231822  2834 raft_consensus.cc:740] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.232348  2836 raft_consensus.cc:359] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.233047  2836 raft_consensus.cc:385] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.232718  2834 consensus_queue.cc:260] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.233363  2836 raft_consensus.cc:740] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.235181  2840 raft_consensus.cc:2749] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:08.236199  2644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613" is_pre_election: true
I20260709 13:15:08.237317  2644 raft_consensus.cc:2393] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27f50cbadf0b4667b694fa940273a112 in current term 1: Already voted for candidate eed2db69d6f94554b76d516ba7d98490 in this term.
I20260709 13:15:08.237687  2835 raft_consensus.cc:359] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.238623  2835 raft_consensus.cc:385] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.239207  2835 raft_consensus.cc:740] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.239540  2760 leader_election.cc:304] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112; no voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490
I20260709 13:15:08.240783  2843 raft_consensus.cc:2749] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:08.240245  2835 consensus_queue.cc:260] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.242421  2834 ts_tablet_manager.cc:1434] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:15:08.243352  2834 tablet_bootstrap.cc:492] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490: Bootstrap starting.
I20260709 13:15:08.243300  2835 ts_tablet_manager.cc:1434] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 13:15:08.241758  2610 leader_election.cc:304] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490; no voters: 27f50cbadf0b4667b694fa940273a112
I20260709 13:15:08.245815  2835 tablet_bootstrap.cc:492] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613: Bootstrap starting.
I20260709 13:15:08.245862  2840 raft_consensus.cc:2804] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.246307  2840 raft_consensus.cc:493] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.246651  2840 raft_consensus.cc:3060] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.252784  2835 tablet_bootstrap.cc:654] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.254664  2840 raft_consensus.cc:515] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.258291  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbc9ccd4c4d42b0ac47ff54aa3bf2b2" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:08.258617  2834 tablet_bootstrap.cc:654] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.258930  2720 raft_consensus.cc:3060] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.260074  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbc9ccd4c4d42b0ac47ff54aa3bf2b2" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112"
W20260709 13:15:08.261850  2609 leader_election.cc:343] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:08.263258  2684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:34453, user_credentials={real_user=slave}} blocked reactor thread for 64245.7us
I20260709 13:15:08.263847  2840 leader_election.cc:290] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 election: Requested vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.234323  2836 consensus_queue.cc:260] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.268077  2836 ts_tablet_manager.cc:1434] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:15:08.269167  2836 tablet_bootstrap.cc:492] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112: Bootstrap starting.
I20260709 13:15:08.269371  2720 raft_consensus.cc:2468] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 1.
I20260709 13:15:08.271552  2610 leader_election.cc:304] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490; no voters: 27f50cbadf0b4667b694fa940273a112
I20260709 13:15:08.272358  2840 raft_consensus.cc:2804] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:08.274724  2834 tablet_bootstrap.cc:492] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490: No bootstrap required, opened a new log
I20260709 13:15:08.275266  2834 ts_tablet_manager.cc:1403] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.001s
I20260709 13:15:08.274837  2543 catalog_manager.cc:5697] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 reported cstate change: term changed from 0 to 1, leader changed from <none> to eed2db69d6f94554b76d516ba7d98490 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "eed2db69d6f94554b76d516ba7d98490" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.278345  2834 raft_consensus.cc:359] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.278744  2836 tablet_bootstrap.cc:654] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.279078  2834 raft_consensus.cc:385] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.279425  2834 raft_consensus.cc:740] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.281325  2835 tablet_bootstrap.cc:492] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613: No bootstrap required, opened a new log
I20260709 13:15:08.281797  2835 ts_tablet_manager.cc:1403] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.005s
I20260709 13:15:08.285034  2835 raft_consensus.cc:359] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.286937  2835 raft_consensus.cc:385] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.287278  2835 raft_consensus.cc:740] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.289794  2835 consensus_queue.cc:260] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.293848  2840 raft_consensus.cc:697] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Becoming Leader. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:08.295377  2834 consensus_queue.cc:260] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.299996  2834 ts_tablet_manager.cc:1434] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 13:15:08.300148  2865 raft_consensus.cc:493] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.301178  2834 tablet_bootstrap.cc:492] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490: Bootstrap starting.
I20260709 13:15:08.301594  2835 ts_tablet_manager.cc:1434] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.005s
I20260709 13:15:08.301123  2865 raft_consensus.cc:515] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.302613  2835 tablet_bootstrap.cc:492] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613: Bootstrap starting.
I20260709 13:15:08.303918  2865 leader_election.cc:290] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.298974  2840 consensus_queue.cc:237] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.306165  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3662a338455a4acaae7a6887452aa38f" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490" is_pre_election: true
I20260709 13:15:08.306926  2720 raft_consensus.cc:2468] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 0.
I20260709 13:15:08.308146  2610 leader_election.cc:304] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:08.308770  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3662a338455a4acaae7a6887452aa38f" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112" is_pre_election: true
W20260709 13:15:08.310738  2609 leader_election.cc:343] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.313604  2865 raft_consensus.cc:2804] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.314051  2865 raft_consensus.cc:493] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.317283  2835 tablet_bootstrap.cc:654] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.318872  2834 tablet_bootstrap.cc:654] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.319267  2836 tablet_bootstrap.cc:492] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112: No bootstrap required, opened a new log
I20260709 13:15:08.319798  2836 ts_tablet_manager.cc:1403] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.004s
I20260709 13:15:08.315025  2865 raft_consensus.cc:3060] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.323027  2836 raft_consensus.cc:359] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.323801  2836 raft_consensus.cc:385] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.324270  2836 raft_consensus.cc:740] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.325155  2836 consensus_queue.cc:260] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.327755  2836 ts_tablet_manager.cc:1434] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:08.329166  2836 tablet_bootstrap.cc:492] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112: Bootstrap starting.
I20260709 13:15:08.330955  2865 raft_consensus.cc:515] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.333911  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3662a338455a4acaae7a6887452aa38f" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:08.334506  2720 raft_consensus.cc:3060] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.336930  2836 tablet_bootstrap.cc:654] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.337970  2834 tablet_bootstrap.cc:492] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490: No bootstrap required, opened a new log
I20260709 13:15:08.338606  2834 ts_tablet_manager.cc:1403] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.003s
I20260709 13:15:08.341571  2843 raft_consensus.cc:493] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.342034  2843 raft_consensus.cc:515] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.342216  2834 raft_consensus.cc:359] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.342872  2834 raft_consensus.cc:385] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.342896  2720 raft_consensus.cc:2468] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 1.
I20260709 13:15:08.343281  2834 raft_consensus.cc:740] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.344193  2843 leader_election.cc:290] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351)
I20260709 13:15:08.344705  2610 leader_election.cc:304] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:08.344022  2834 consensus_queue.cc:260] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.345870  2840 raft_consensus.cc:2804] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:08.346002  2719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5eee6eac9e456595b69de203f2445b" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490" is_pre_election: true
I20260709 13:15:08.346437  2840 raft_consensus.cc:697] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Becoming Leader. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:08.346740  2719 raft_consensus.cc:2468] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 0.
I20260709 13:15:08.347214  2834 ts_tablet_manager.cc:1434] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:15:08.347429  2840 consensus_queue.cc:237] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.348201  2834 tablet_bootstrap.cc:492] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490: Bootstrap starting.
I20260709 13:15:08.348671  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5eee6eac9e456595b69de203f2445b" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613" is_pre_election: true
I20260709 13:15:08.350349  2836 tablet_bootstrap.cc:492] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112: No bootstrap required, opened a new log
I20260709 13:15:08.350921  2836 ts_tablet_manager.cc:1403] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 13:15:08.351854  2759 leader_election.cc:304] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490; no voters: 
W20260709 13:15:08.352954  2760 leader_election.cc:343] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.353897  2843 raft_consensus.cc:2804] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.354278  2843 raft_consensus.cc:493] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.354627  2843 raft_consensus.cc:3060] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.355370  2834 tablet_bootstrap.cc:654] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.357254  2868 raft_consensus.cc:493] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.357801  2868 raft_consensus.cc:515] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.361099  2841 raft_consensus.cc:493] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.361232  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8b1ed4d0a14b769d47523954a2fce5" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490" is_pre_election: true
I20260709 13:15:08.361824  2720 raft_consensus.cc:2468] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 0.
I20260709 13:15:08.361610  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8b1ed4d0a14b769d47523954a2fce5" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112" is_pre_election: true
I20260709 13:15:08.362360  2868 leader_election.cc:290] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.361565  2841 raft_consensus.cc:515] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.363030  2610 leader_election.cc:304] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:08.356148  2836 raft_consensus.cc:359] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.363674  2836 raft_consensus.cc:385] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.364851  2841 leader_election.cc:290] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.365254  2836 raft_consensus.cc:740] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.365584  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613" is_pre_election: true
I20260709 13:15:08.366153  2836 consensus_queue.cc:260] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.366494  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112" is_pre_election: true
I20260709 13:15:08.369172  2794 raft_consensus.cc:2468] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 0.
I20260709 13:15:08.369728  2835 tablet_bootstrap.cc:492] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613: No bootstrap required, opened a new log
W20260709 13:15:08.367074  2686 leader_election.cc:343] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.363897  2868 raft_consensus.cc:2804] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.370203  2835 ts_tablet_manager.cc:1403] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.016s
I20260709 13:15:08.369969  2843 raft_consensus.cc:515] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.370352  2868 raft_consensus.cc:493] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.370813  2868 raft_consensus.cc:3060] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.371104  2684 leader_election.cc:304] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490; no voters: ea8ca4aa76354c09afe1f37627a6b613
I20260709 13:15:08.372126  2841 raft_consensus.cc:2804] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.372516  2841 raft_consensus.cc:493] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.372874  2841 raft_consensus.cc:3060] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.373698  2835 raft_consensus.cc:359] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.374451  2835 raft_consensus.cc:385] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.374743  2835 raft_consensus.cc:740] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Initialized, Role: FOLLOWER
W20260709 13:15:08.367234  2609 leader_election.cc:343] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.368040  2834 tablet_bootstrap.cc:492] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490: No bootstrap required, opened a new log
I20260709 13:15:08.375458  2835 consensus_queue.cc:260] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.376137  2834 ts_tablet_manager.cc:1403] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.005s
I20260709 13:15:08.377594  2865 leader_election.cc:290] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 election: Requested vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.378010  2835 ts_tablet_manager.cc:1434] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:15:08.377902  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5eee6eac9e456595b69de203f2445b" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
I20260709 13:15:08.379150  2835 tablet_bootstrap.cc:492] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613: Bootstrap starting.
I20260709 13:15:08.379736  2834 raft_consensus.cc:359] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.380954  2865 raft_consensus.cc:493] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:08.381994  2760 leader_election.cc:343] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.384426  2834 raft_consensus.cc:385] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.384784  2834 raft_consensus.cc:740] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.385250  2878 raft_consensus.cc:493] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.386286  2835 tablet_bootstrap.cc:654] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.382673  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3662a338455a4acaae7a6887452aa38f" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:08.385950  2878 raft_consensus.cc:515] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.386739  2794 raft_consensus.cc:3060] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.387552  2841 raft_consensus.cc:515] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.384675  2865 raft_consensus.cc:515] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.392207  2793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112" is_pre_election: true
I20260709 13:15:08.392844  2793 raft_consensus.cc:2468] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 0.
I20260709 13:15:08.382719  2836 ts_tablet_manager.cc:1434] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.003s
I20260709 13:15:08.394307  2609 leader_election.cc:304] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, ea8ca4aa76354c09afe1f37627a6b613; no voters: 
I20260709 13:15:08.394959  2836 tablet_bootstrap.cc:492] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P 27f50cbadf0b4667b694fa940273a112: Bootstrap starting.
I20260709 13:15:08.395169  2840 raft_consensus.cc:2804] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.395551  2840 raft_consensus.cc:493] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.395870  2840 raft_consensus.cc:3060] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.396109  2794 raft_consensus.cc:2468] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 1.
I20260709 13:15:08.385761  2834 consensus_queue.cc:260] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.398437  2834 ts_tablet_manager.cc:1434] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:15:08.399466  2834 tablet_bootstrap.cc:492] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490: Bootstrap starting.
I20260709 13:15:08.401643  2843 leader_election.cc:290] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 election: Requested vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351)
I20260709 13:15:08.390049  2542 catalog_manager.cc:5697] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.402736  2719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5eee6eac9e456595b69de203f2445b" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:08.403285  2719 raft_consensus.cc:3060] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.404222  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
I20260709 13:15:08.405896  2834 tablet_bootstrap.cc:654] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.406412  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:08.407003  2794 raft_consensus.cc:3060] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.410928  2840 raft_consensus.cc:515] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.412820  2645 raft_consensus.cc:2393] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eed2db69d6f94554b76d516ba7d98490 in current term 1: Already voted for candidate ea8ca4aa76354c09afe1f37627a6b613 in this term.
I20260709 13:15:08.414047  2718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:08.414947  2718 raft_consensus.cc:2393] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea8ca4aa76354c09afe1f37627a6b613 in current term 1: Already voted for candidate eed2db69d6f94554b76d516ba7d98490 in this term.
I20260709 13:15:08.415676  2719 raft_consensus.cc:2468] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 1.
I20260709 13:15:08.416457  2865 leader_election.cc:290] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.417019  2840 leader_election.cc:290] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 election: Requested vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.417330  2793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:08.417124  2759 leader_election.cc:304] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490; no voters: ea8ca4aa76354c09afe1f37627a6b613
I20260709 13:15:08.418226  2878 leader_election.cc:290] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351)
I20260709 13:15:08.418785  2878 raft_consensus.cc:2804] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:08.419206  2878 raft_consensus.cc:697] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [term 1 LEADER]: Becoming Leader. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Running, Role: LEADER
I20260709 13:15:08.419503  2644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613" is_pre_election: true
I20260709 13:15:08.419819  2609 leader_election.cc:304] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613; no voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490
I20260709 13:15:08.420019  2878 consensus_queue.cc:237] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.421340  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490" is_pre_election: true
I20260709 13:15:08.422062  2859 raft_consensus.cc:493] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.383795  2868 raft_consensus.cc:515] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.426159  2859 raft_consensus.cc:515] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.428092  2840 raft_consensus.cc:2749] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:08.428289  2719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490" is_pre_election: true
W20260709 13:15:08.429219  2760 leader_election.cc:343] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.430066  2720 raft_consensus.cc:2393] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea8ca4aa76354c09afe1f37627a6b613 in current term 1: Already voted for candidate eed2db69d6f94554b76d516ba7d98490 in this term.
W20260709 13:15:08.430361  2759 leader_election.cc:343] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.431020  2859 leader_election.cc:290] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.430963  2759 leader_election.cc:304] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112; no voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490
I20260709 13:15:08.432231  2644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e129ffeca244f29976764022b760edc" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613" is_pre_election: true
I20260709 13:15:08.434810  2794 raft_consensus.cc:2468] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 1.
I20260709 13:15:08.435849  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8b1ed4d0a14b769d47523954a2fce5" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:08.436352  2720 raft_consensus.cc:3060] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.427415  2841 leader_election.cc:290] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 1 election: Requested vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.439937  2868 leader_election.cc:290] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 election: Requested vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
W20260709 13:15:08.440109  2686 leader_election.cc:343] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.443348  2843 raft_consensus.cc:2749] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:08.444085  2835 tablet_bootstrap.cc:492] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613: No bootstrap required, opened a new log
I20260709 13:15:08.444526  2835 ts_tablet_manager.cc:1403] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613: Time spent bootstrapping tablet: real 0.066s	user 0.005s	sys 0.007s
I20260709 13:15:08.444746  2793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e129ffeca244f29976764022b760edc" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112" is_pre_election: true
I20260709 13:15:08.445452  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8b1ed4d0a14b769d47523954a2fce5" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112"
W20260709 13:15:08.446710  2609 leader_election.cc:343] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.447153  2684 leader_election.cc:304] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490; no voters: ea8ca4aa76354c09afe1f37627a6b613
I20260709 13:15:08.447260  2835 raft_consensus.cc:359] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.448037  2835 raft_consensus.cc:385] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.448288  2835 raft_consensus.cc:740] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.449034  2720 raft_consensus.cc:2468] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 1.
I20260709 13:15:08.449294  2841 raft_consensus.cc:2804] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:08.450001  2836 tablet_bootstrap.cc:654] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P 27f50cbadf0b4667b694fa940273a112: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.449942  2841 raft_consensus.cc:697] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 1 LEADER]: Becoming Leader. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Running, Role: LEADER
I20260709 13:15:08.450243  2610 leader_election.cc:304] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490; no voters: 27f50cbadf0b4667b694fa940273a112
I20260709 13:15:08.451181  2841 consensus_queue.cc:237] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.448925  2835 consensus_queue.cc:260] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.454828  2835 ts_tablet_manager.cc:1434] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:08.453915  2868 raft_consensus.cc:2804] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:08.448800  2684 leader_election.cc:343] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.456248  2868 raft_consensus.cc:697] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Becoming Leader. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:08.457768  2684 leader_election.cc:304] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eed2db69d6f94554b76d516ba7d98490; no voters: 27f50cbadf0b4667b694fa940273a112, ea8ca4aa76354c09afe1f37627a6b613
I20260709 13:15:08.458235  2868 consensus_queue.cc:237] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.459412  2859 raft_consensus.cc:2749] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:08.468976  2834 tablet_bootstrap.cc:492] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490: No bootstrap required, opened a new log
I20260709 13:15:08.469754  2834 ts_tablet_manager.cc:1403] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490: Time spent bootstrapping tablet: real 0.070s	user 0.028s	sys 0.040s
I20260709 13:15:08.473476  2834 raft_consensus.cc:359] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.476305  2834 raft_consensus.cc:385] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.477216  2834 raft_consensus.cc:740] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.479082  2834 consensus_queue.cc:260] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.476940  2835 tablet_bootstrap.cc:492] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613: Bootstrap starting.
I20260709 13:15:08.480958  2834 ts_tablet_manager.cc:1434] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:15:08.481972  2836 tablet_bootstrap.cc:492] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P 27f50cbadf0b4667b694fa940273a112: No bootstrap required, opened a new log
I20260709 13:15:08.483932  2836 ts_tablet_manager.cc:1403] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P 27f50cbadf0b4667b694fa940273a112: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.013s
I20260709 13:15:08.484283  2834 tablet_bootstrap.cc:492] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490: Bootstrap starting.
I20260709 13:15:08.487386  2836 raft_consensus.cc:359] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.488195  2836 raft_consensus.cc:385] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.488602  2836 raft_consensus.cc:740] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.489609  2836 consensus_queue.cc:260] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P 27f50cbadf0b4667b694fa940273a112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.491554  2834 tablet_bootstrap.cc:654] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.496120  2541 catalog_manager.cc:5697] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27f50cbadf0b4667b694fa940273a112 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "27f50cbadf0b4667b694fa940273a112" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:08.502547  2835 tablet_bootstrap.cc:654] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.504071  2834 tablet_bootstrap.cc:492] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490: No bootstrap required, opened a new log
I20260709 13:15:08.503451  2542 catalog_manager.cc:5697] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 reported cstate change: term changed from 0 to 1, leader changed from <none> to eed2db69d6f94554b76d516ba7d98490 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "eed2db69d6f94554b76d516ba7d98490" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.504582  2834 ts_tablet_manager.cc:1403] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:15:08.511090  2834 raft_consensus.cc:359] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.511951  2834 raft_consensus.cc:385] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.512276  2834 raft_consensus.cc:740] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.513104  2834 consensus_queue.cc:260] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.515105  2834 ts_tablet_manager.cc:1434] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:15:08.515338  2835 tablet_bootstrap.cc:492] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613: No bootstrap required, opened a new log
I20260709 13:15:08.515758  2835 ts_tablet_manager.cc:1403] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.000s
I20260709 13:15:08.515954  2834 tablet_bootstrap.cc:492] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490: Bootstrap starting.
I20260709 13:15:08.518011  2835 raft_consensus.cc:359] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.518507  2835 raft_consensus.cc:385] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.518723  2835 raft_consensus.cc:740] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.519567  2835 consensus_queue.cc:260] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.521560  2835 ts_tablet_manager.cc:1434] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:15:08.521184  2543 catalog_manager.cc:5697] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.522518  2835 tablet_bootstrap.cc:492] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613: Bootstrap starting.
I20260709 13:15:08.505661  2836 ts_tablet_manager.cc:1434] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P 27f50cbadf0b4667b694fa940273a112: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:15:08.523604  2836 tablet_bootstrap.cc:492] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112: Bootstrap starting.
I20260709 13:15:08.523279  2543 catalog_manager.cc:5697] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.528051  2835 tablet_bootstrap.cc:654] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.530678  2836 tablet_bootstrap.cc:654] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.534822  2834 tablet_bootstrap.cc:654] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.552075  2835 tablet_bootstrap.cc:492] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613: No bootstrap required, opened a new log
I20260709 13:15:08.552887  2835 ts_tablet_manager.cc:1403] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.008s
I20260709 13:15:08.556859  2835 raft_consensus.cc:359] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.557950  2835 raft_consensus.cc:385] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.558341  2835 raft_consensus.cc:740] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.559157  2835 consensus_queue.cc:260] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.561002  2835 ts_tablet_manager.cc:1434] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:08.568811  2834 tablet_bootstrap.cc:492] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490: No bootstrap required, opened a new log
I20260709 13:15:08.569286  2836 tablet_bootstrap.cc:492] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112: No bootstrap required, opened a new log
I20260709 13:15:08.569378  2834 ts_tablet_manager.cc:1403] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.017s
I20260709 13:15:08.569732  2836 ts_tablet_manager.cc:1403] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.018s
I20260709 13:15:08.571683  2834 raft_consensus.cc:359] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.572232  2834 raft_consensus.cc:385] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.571988  2836 raft_consensus.cc:359] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.572479  2834 raft_consensus.cc:740] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.572661  2836 raft_consensus.cc:385] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.572997  2836 raft_consensus.cc:740] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.573236  2834 consensus_queue.cc:260] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.573714  2836 consensus_queue.cc:260] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.575296  2834 ts_tablet_manager.cc:1434] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:08.576045  2836 ts_tablet_manager.cc:1434] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:08.577441  2836 tablet_bootstrap.cc:492] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112: Bootstrap starting.
I20260709 13:15:08.582322  2868 raft_consensus.cc:493] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.582816  2868 raft_consensus.cc:515] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.583974  2836 tablet_bootstrap.cc:654] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.584851  2868 leader_election.cc:290] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.586033  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112" is_pre_election: true
I20260709 13:15:08.586663  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490" is_pre_election: true
I20260709 13:15:08.586838  2794 raft_consensus.cc:2468] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 0.
I20260709 13:15:08.587261  2720 raft_consensus.cc:2468] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 0.
I20260709 13:15:08.588631  2610 leader_election.cc:304] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:08.589381  2868 raft_consensus.cc:2804] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.589778  2868 raft_consensus.cc:493] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.590142  2868 raft_consensus.cc:3060] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.592429  2836 tablet_bootstrap.cc:492] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112: No bootstrap required, opened a new log
I20260709 13:15:08.592883  2836 ts_tablet_manager.cc:1403] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112: Time spent bootstrapping tablet: real 0.016s	user 0.002s	sys 0.011s
I20260709 13:15:08.595017  2836 raft_consensus.cc:359] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.595454  2836 raft_consensus.cc:385] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.595531  2868 raft_consensus.cc:515] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.595889  2836 raft_consensus.cc:740] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.596743  2836 consensus_queue.cc:260] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.597496  2868 leader_election.cc:290] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 election: Requested vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.598348  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:08.598587  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:08.598842  2836 ts_tablet_manager.cc:1434] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:08.598912  2720 raft_consensus.cc:3060] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.599082  2794 raft_consensus.cc:3060] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.599866  2836 tablet_bootstrap.cc:492] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112: Bootstrap starting.
I20260709 13:15:08.604367  2836 tablet_bootstrap.cc:654] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.606202  2720 raft_consensus.cc:2468] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 1.
I20260709 13:15:08.606206  2794 raft_consensus.cc:2468] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 1.
I20260709 13:15:08.607504  2609 leader_election.cc:304] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, ea8ca4aa76354c09afe1f37627a6b613; no voters: 
I20260709 13:15:08.608534  2868 raft_consensus.cc:2804] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:08.608969  2868 raft_consensus.cc:697] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Becoming Leader. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:08.609810  2868 consensus_queue.cc:237] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.612099  2836 tablet_bootstrap.cc:492] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112: No bootstrap required, opened a new log
I20260709 13:15:08.612572  2836 ts_tablet_manager.cc:1403] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:15:08.615124  2836 raft_consensus.cc:359] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.615885  2836 raft_consensus.cc:385] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.616225  2836 raft_consensus.cc:740] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.616955  2836 consensus_queue.cc:260] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.618629  2836 ts_tablet_manager.cc:1434] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:08.618409  2541 catalog_manager.cc:5697] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.619755  2836 tablet_bootstrap.cc:492] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112: Bootstrap starting.
I20260709 13:15:08.626055  2836 tablet_bootstrap.cc:654] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.633733  2836 tablet_bootstrap.cc:492] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112: No bootstrap required, opened a new log
I20260709 13:15:08.634122  2836 ts_tablet_manager.cc:1403] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 13:15:08.636016  2836 raft_consensus.cc:359] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.636453  2836 raft_consensus.cc:385] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.636685  2836 raft_consensus.cc:740] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.637327  2836 consensus_queue.cc:260] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.639009  2836 ts_tablet_manager.cc:1434] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:15:08.695128  2878 raft_consensus.cc:493] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.695595  2878 raft_consensus.cc:515] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.697270  2878 leader_election.cc:290] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351)
I20260709 13:15:08.698022  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246568b455744f5b849b10ac433025be" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613" is_pre_election: true
I20260709 13:15:08.698225  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246568b455744f5b849b10ac433025be" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490" is_pre_election: true
I20260709 13:15:08.698545  2645 raft_consensus.cc:2468] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 0.
I20260709 13:15:08.698798  2720 raft_consensus.cc:2468] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 0.
I20260709 13:15:08.699615  2760 leader_election.cc:304] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, ea8ca4aa76354c09afe1f37627a6b613; no voters: 
I20260709 13:15:08.700341  2878 raft_consensus.cc:2804] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.700716  2878 raft_consensus.cc:493] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.701025  2878 raft_consensus.cc:3060] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.706568  2878 raft_consensus.cc:515] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.708496  2878 leader_election.cc:290] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 election: Requested vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351)
I20260709 13:15:08.709611  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246568b455744f5b849b10ac433025be" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
I20260709 13:15:08.709909  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246568b455744f5b849b10ac433025be" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:08.710234  2645 raft_consensus.cc:3060] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.710526  2720 raft_consensus.cc:3060] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.715186  2720 raft_consensus.cc:2468] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 1.
I20260709 13:15:08.715184  2645 raft_consensus.cc:2468] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 1.
I20260709 13:15:08.716315  2759 leader_election.cc:304] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:08.717002  2878 raft_consensus.cc:2804] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:08.717535  2878 raft_consensus.cc:697] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 1 LEADER]: Becoming Leader. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Running, Role: LEADER
I20260709 13:15:08.718238  2878 consensus_queue.cc:237] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.725397  2541 catalog_manager.cc:5697] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27f50cbadf0b4667b694fa940273a112 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "27f50cbadf0b4667b694fa940273a112" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:08.744562  2841 consensus_queue.cc:1048] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:08.757248  2878 raft_consensus.cc:493] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.757773  2897 consensus_queue.cc:1048] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:08.757961  2878 raft_consensus.cc:515] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.761315  2878 leader_election.cc:290] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351)
I20260709 13:15:08.762018  2644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e129ffeca244f29976764022b760edc" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613" is_pre_election: true
I20260709 13:15:08.762789  2644 raft_consensus.cc:2468] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 0.
I20260709 13:15:08.763243  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e129ffeca244f29976764022b760edc" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490" is_pre_election: true
I20260709 13:15:08.763895  2720 raft_consensus.cc:2468] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 0.
I20260709 13:15:08.764207  2760 leader_election.cc:304] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, ea8ca4aa76354c09afe1f37627a6b613; no voters: 
I20260709 13:15:08.765151  2843 raft_consensus.cc:2804] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.765583  2843 raft_consensus.cc:493] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.765897  2843 raft_consensus.cc:3060] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.771472  2868 raft_consensus.cc:493] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.771981  2868 raft_consensus.cc:515] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.773294  2843 raft_consensus.cc:515] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.774474  2868 leader_election.cc:290] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.775771  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490" is_pre_election: true
I20260709 13:15:08.776075  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e129ffeca244f29976764022b760edc" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
I20260709 13:15:08.776402  2720 raft_consensus.cc:2468] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 0.
I20260709 13:15:08.776674  2645 raft_consensus.cc:3060] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.777760  2610 leader_election.cc:304] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:08.778352  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e129ffeca244f29976764022b760edc" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:08.778585  2868 raft_consensus.cc:2804] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.778892  2720 raft_consensus.cc:3060] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.779605  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112" is_pre_election: true
I20260709 13:15:08.780009  2878 raft_consensus.cc:493] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.780181  2794 raft_consensus.cc:2468] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 0.
I20260709 13:15:08.780458  2878 raft_consensus.cc:515] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.782559  2878 leader_election.cc:290] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351)
I20260709 13:15:08.778935  2868 raft_consensus.cc:493] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.783609  2645 raft_consensus.cc:2468] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 1.
I20260709 13:15:08.783991  2868 raft_consensus.cc:3060] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.784081  2719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8b1ed4d0a14b769d47523954a2fce5" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490" is_pre_election: true
I20260709 13:15:08.784953  2719 raft_consensus.cc:2393] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27f50cbadf0b4667b694fa940273a112 in current term 1: Already voted for candidate ea8ca4aa76354c09afe1f37627a6b613 in this term.
I20260709 13:15:08.785254  2760 leader_election.cc:304] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, ea8ca4aa76354c09afe1f37627a6b613; no voters: 
I20260709 13:15:08.786360  2878 raft_consensus.cc:2804] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:08.787753  2720 raft_consensus.cc:2468] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 1.
I20260709 13:15:08.787714  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8b1ed4d0a14b769d47523954a2fce5" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613" is_pre_election: true
I20260709 13:15:08.788805  2843 leader_election.cc:290] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 election: Requested vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351)
I20260709 13:15:08.790040  2760 leader_election.cc:304] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112; no voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490
I20260709 13:15:08.790608  2878 raft_consensus.cc:697] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 1 LEADER]: Becoming Leader. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Running, Role: LEADER
I20260709 13:15:08.790978  2901 raft_consensus.cc:3060] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.791039  2868 raft_consensus.cc:515] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.791687  2878 consensus_queue.cc:237] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.793217  2868 leader_election.cc:290] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 election: Requested vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.794458  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:08.794780  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:08.795243  2720 raft_consensus.cc:3060] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.795337  2794 raft_consensus.cc:3060] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.799997  2901 raft_consensus.cc:2749] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:08.801839  2542 catalog_manager.cc:5697] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27f50cbadf0b4667b694fa940273a112 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "27f50cbadf0b4667b694fa940273a112" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:08.802727  2794 raft_consensus.cc:2468] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 1.
I20260709 13:15:08.802727  2720 raft_consensus.cc:2468] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 1.
I20260709 13:15:08.803985  2610 leader_election.cc:304] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:08.804672  2868 raft_consensus.cc:2804] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:08.805115  2868 raft_consensus.cc:697] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Becoming Leader. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:08.805912  2868 consensus_queue.cc:237] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.813189  2868 consensus_queue.cc:1048] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:08.815330  2542 catalog_manager.cc:5697] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.819542  2868 raft_consensus.cc:493] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.820077  2868 raft_consensus.cc:515] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:08.822314  2868 leader_election.cc:290] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:08.824193  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5eee6eac9e456595b69de203f2445b" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f50cbadf0b4667b694fa940273a112" is_pre_election: true
I20260709 13:15:08.825044  2793 raft_consensus.cc:3060] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P 27f50cbadf0b4667b694fa940273a112 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.825044  2719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5eee6eac9e456595b69de203f2445b" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eed2db69d6f94554b76d516ba7d98490" is_pre_election: true
I20260709 13:15:08.828850  2719 raft_consensus.cc:2393] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea8ca4aa76354c09afe1f37627a6b613 in current term 1: Already voted for candidate 27f50cbadf0b4667b694fa940273a112 in this term.
I20260709 13:15:08.832334  2610 leader_election.cc:304] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613; no voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490
I20260709 13:15:08.833614  2840 raft_consensus.cc:3060] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.837654  2865 consensus_queue.cc:1048] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:08.840481  2840 raft_consensus.cc:2749] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:08.841929  2865 consensus_queue.cc:1048] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:08.844399  2901 consensus_queue.cc:1048] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:08.862143  2859 consensus_queue.cc:1048] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:08.866816  2868 consensus_queue.cc:1048] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:08.874460  2878 consensus_queue.cc:1048] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:08.893213  2841 consensus_queue.cc:1048] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:08.893167  2865 consensus_queue.cc:1048] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:08.915045  2840 consensus_queue.cc:1048] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.070077  2719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345"
dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
mode: GRACEFUL
new_leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:15:09.070559  2719 raft_consensus.cc:606] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 1 LEADER]: Received request to transfer leadership to TS ea8ca4aa76354c09afe1f37627a6b613
I20260709 13:15:09.080861  2840 consensus_queue.cc:1048] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.097100  2865 consensus_queue.cc:1048] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:09.097527  2794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e129ffeca244f29976764022b760edc"
dest_uuid: "27f50cbadf0b4667b694fa940273a112"
mode: GRACEFUL
new_leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
 from {username='slave'} at 127.0.0.1:46420
I20260709 13:15:09.098091  2794 raft_consensus.cc:606] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 1 LEADER]: Received request to transfer leadership to TS ea8ca4aa76354c09afe1f37627a6b613
I20260709 13:15:09.119056  2645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1"
dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
mode: GRACEFUL
new_leader_uuid: "eed2db69d6f94554b76d516ba7d98490"
 from {username='slave'} at 127.0.0.1:45356
I20260709 13:15:09.119678  2645 raft_consensus.cc:606] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Received request to transfer leadership to TS eed2db69d6f94554b76d516ba7d98490
I20260709 13:15:09.128580  2645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4"
dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
mode: GRACEFUL
new_leader_uuid: "eed2db69d6f94554b76d516ba7d98490"
 from {username='slave'} at 127.0.0.1:45356
I20260709 13:15:09.129176  2645 raft_consensus.cc:606] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Received request to transfer leadership to TS eed2db69d6f94554b76d516ba7d98490
I20260709 13:15:09.134565  2794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "246568b455744f5b849b10ac433025be"
dest_uuid: "27f50cbadf0b4667b694fa940273a112"
mode: GRACEFUL
new_leader_uuid: "eed2db69d6f94554b76d516ba7d98490"
 from {username='slave'} at 127.0.0.1:46420
I20260709 13:15:09.135219  2794 raft_consensus.cc:606] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 1 LEADER]: Received request to transfer leadership to TS eed2db69d6f94554b76d516ba7d98490
I20260709 13:15:09.172884  2901 consensus_queue.cc:1048] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.183894  2901 consensus_queue.cc:1048] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.192917  2843 raft_consensus.cc:993] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112: : Instructing follower eed2db69d6f94554b76d516ba7d98490 to start an election
I20260709 13:15:09.193413  2901 raft_consensus.cc:1081] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 1 LEADER]: Signalling peer eed2db69d6f94554b76d516ba7d98490 to start an election
I20260709 13:15:09.195147  2719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "246568b455744f5b849b10ac433025be"
dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
 from {username='slave'} at 127.0.0.1:58812
I20260709 13:15:09.195709  2719 raft_consensus.cc:493] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.196159  2719 raft_consensus.cc:3060] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.200779  2719 raft_consensus.cc:515] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:09.202468  2719 leader_election.cc:290] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 2 election: Requested vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:09.203563  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246568b455744f5b849b10ac433025be" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:09.203629  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246568b455744f5b849b10ac433025be" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
I20260709 13:15:09.204245  2794 raft_consensus.cc:3055] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:09.204304  2645 raft_consensus.cc:3060] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.204636  2794 raft_consensus.cc:740] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Running, Role: LEADER
I20260709 13:15:09.205502  2794 consensus_queue.cc:260] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:09.206427  2794 raft_consensus.cc:3060] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.211210  2645 raft_consensus.cc:2468] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 2.
I20260709 13:15:09.212482  2686 leader_election.cc:304] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:09.212918  2794 raft_consensus.cc:2468] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 2.
I20260709 13:15:09.213222  2841 raft_consensus.cc:2804] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.213757  2841 raft_consensus.cc:697] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [term 2 LEADER]: Becoming Leader. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Running, Role: LEADER
I20260709 13:15:09.214551  2841 consensus_queue.cc:237] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:09.220790  2541 catalog_manager.cc:5697] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 reported cstate change: term changed from 1 to 2, leader changed from 27f50cbadf0b4667b694fa940273a112 (127.1.250.67) to eed2db69d6f94554b76d516ba7d98490 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "eed2db69d6f94554b76d516ba7d98490" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.275812  2859 raft_consensus.cc:993] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490: : Instructing follower ea8ca4aa76354c09afe1f37627a6b613 to start an election
I20260709 13:15:09.276382  2841 raft_consensus.cc:1081] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 1 LEADER]: Signalling peer ea8ca4aa76354c09afe1f37627a6b613 to start an election
I20260709 13:15:09.278219  2645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345"
dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
 from {username='slave'} at 127.0.0.1:45332
I20260709 13:15:09.278868  2645 raft_consensus.cc:493] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.279201  2645 raft_consensus.cc:3060] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.285061  2645 raft_consensus.cc:515] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:09.286854  2645 leader_election.cc:290] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 2 election: Requested vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:09.287755  2719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:09.287940  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:09.288280  2719 raft_consensus.cc:3055] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:09.288511  2794 raft_consensus.cc:3060] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.288621  2719 raft_consensus.cc:740] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Running, Role: LEADER
I20260709 13:15:09.289455  2719 consensus_queue.cc:260] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:09.290500  2719 raft_consensus.cc:3060] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.295624  2794 raft_consensus.cc:2468] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 2.
I20260709 13:15:09.296278  2719 raft_consensus.cc:2468] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 2.
I20260709 13:15:09.296882  2609 leader_election.cc:304] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, ea8ca4aa76354c09afe1f37627a6b613; no voters: 
I20260709 13:15:09.297806  2919 raft_consensus.cc:2804] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.298223  2919 raft_consensus.cc:697] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 LEADER]: Becoming Leader. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:09.299005  2919 consensus_queue.cc:237] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:09.305994  2541 catalog_manager.cc:5697] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 reported cstate change: term changed from 1 to 2, leader changed from eed2db69d6f94554b76d516ba7d98490 (127.1.250.66) to ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.331898  2901 consensus_queue.cc:1048] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.351083  2865 consensus_queue.cc:1048] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.358251  2878 consensus_queue.cc:1048] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.360915  2840 raft_consensus.cc:993] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613: : Instructing follower eed2db69d6f94554b76d516ba7d98490 to start an election
I20260709 13:15:09.365734  2865 consensus_queue.cc:1048] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.374557  2919 raft_consensus.cc:1081] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Signalling peer eed2db69d6f94554b76d516ba7d98490 to start an election
I20260709 13:15:09.376592  2720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1"
dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
 from {username='slave'} at 127.0.0.1:58796
I20260709 13:15:09.377396  2720 raft_consensus.cc:493] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.377815  2720 raft_consensus.cc:3060] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.386864  2878 raft_consensus.cc:993] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112: : Instructing follower ea8ca4aa76354c09afe1f37627a6b613 to start an election
I20260709 13:15:09.387446  2878 raft_consensus.cc:1081] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 1 LEADER]: Signalling peer ea8ca4aa76354c09afe1f37627a6b613 to start an election
I20260709 13:15:09.389156  2645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e129ffeca244f29976764022b760edc"
dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
 from {username='slave'} at 127.0.0.1:45346
I20260709 13:15:09.389760  2645 raft_consensus.cc:493] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.390185  2645 raft_consensus.cc:3060] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.391086  2720 raft_consensus.cc:515] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:09.394248  2793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:09.394779  2793 raft_consensus.cc:3060] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.395552  2644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
I20260709 13:15:09.396122  2644 raft_consensus.cc:3055] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:09.396471  2644 raft_consensus.cc:740] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:09.397492  2644 consensus_queue.cc:260] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:09.398658  2644 raft_consensus.cc:3060] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.394289  2720 leader_election.cc:290] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 2 election: Requested vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:09.403337  2645 raft_consensus.cc:515] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:09.404083  2793 raft_consensus.cc:2468] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 2.
I20260709 13:15:09.405485  2645 leader_election.cc:290] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 2 election: Requested vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:09.405951  2684 leader_election.cc:304] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:09.406737  2897 raft_consensus.cc:2804] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.406934  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e129ffeca244f29976764022b760edc" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:09.407253  2897 raft_consensus.cc:697] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 2 LEADER]: Becoming Leader. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Running, Role: LEADER
I20260709 13:15:09.407401  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e129ffeca244f29976764022b760edc" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:09.407548  2794 raft_consensus.cc:3055] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:09.408012  2794 raft_consensus.cc:740] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Running, Role: LEADER
I20260709 13:15:09.408129  2897 consensus_queue.cc:237] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:09.409181  2720 raft_consensus.cc:3060] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.408850  2794 consensus_queue.cc:260] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:09.410145  2794 raft_consensus.cc:3060] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.414166  2644 raft_consensus.cc:2468] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 2.
I20260709 13:15:09.416311  2720 raft_consensus.cc:2468] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 2.
I20260709 13:15:09.416255  2542 catalog_manager.cc:5697] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 reported cstate change: term changed from 1 to 2, leader changed from ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65) to eed2db69d6f94554b76d516ba7d98490 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "eed2db69d6f94554b76d516ba7d98490" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.417935  2610 leader_election.cc:304] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:09.416805  2794 raft_consensus.cc:2468] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 2.
I20260709 13:15:09.419148  2840 raft_consensus.cc:2804] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.419643  2840 raft_consensus.cc:697] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [term 2 LEADER]: Becoming Leader. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:09.420450  2840 consensus_queue.cc:237] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:09.429893  2542 catalog_manager.cc:5697] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 reported cstate change: term changed from 1 to 2, leader changed from 27f50cbadf0b4667b694fa940273a112 (127.1.250.67) to ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.486586  2840 raft_consensus.cc:993] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613: : Instructing follower eed2db69d6f94554b76d516ba7d98490 to start an election
I20260709 13:15:09.487076  2919 raft_consensus.cc:1081] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Signalling peer eed2db69d6f94554b76d516ba7d98490 to start an election
I20260709 13:15:09.488584  2720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4"
dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
 from {username='slave'} at 127.0.0.1:58796
I20260709 13:15:09.489159  2720 raft_consensus.cc:493] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.489480  2720 raft_consensus.cc:3060] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.495234  2720 raft_consensus.cc:515] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:09.496946  2720 leader_election.cc:290] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 2 election: Requested vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:09.498059  2644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
I20260709 13:15:09.498204  2793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:09.498660  2644 raft_consensus.cc:3055] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:09.498770  2793 raft_consensus.cc:3060] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.498965  2644 raft_consensus.cc:740] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:09.499758  2644 consensus_queue.cc:260] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:09.500727  2644 raft_consensus.cc:3060] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.504786  2793 raft_consensus.cc:2468] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 2.
I20260709 13:15:09.506040  2684 leader_election.cc:304] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:09.506224  2644 raft_consensus.cc:2468] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 2.
I20260709 13:15:09.507169  2897 raft_consensus.cc:2804] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.507766  2897 raft_consensus.cc:697] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 2 LEADER]: Becoming Leader. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Running, Role: LEADER
I20260709 13:15:09.508433  2897 consensus_queue.cc:237] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:09.515077  2542 catalog_manager.cc:5697] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 reported cstate change: term changed from 1 to 2, leader changed from ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65) to eed2db69d6f94554b76d516ba7d98490 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "eed2db69d6f94554b76d516ba7d98490" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.662864  2793 raft_consensus.cc:1275] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Refusing update from remote peer eed2db69d6f94554b76d516ba7d98490: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:09.664168  2841 consensus_queue.cc:1048] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:09.665712  2644 raft_consensus.cc:1275] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Refusing update from remote peer eed2db69d6f94554b76d516ba7d98490: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:09.667016  2841 consensus_queue.cc:1048] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:09.808781  2793 raft_consensus.cc:1275] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Refusing update from remote peer ea8ca4aa76354c09afe1f37627a6b613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:09.810210  2919 consensus_queue.cc:1048] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:09.820125  2720 raft_consensus.cc:1275] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Refusing update from remote peer ea8ca4aa76354c09afe1f37627a6b613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:09.822643  2868 consensus_queue.cc:1048] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:09.851773  2793 raft_consensus.cc:1275] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Refusing update from remote peer ea8ca4aa76354c09afe1f37627a6b613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:09.853034  2868 consensus_queue.cc:1048] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:09.860981  2720 raft_consensus.cc:1275] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Refusing update from remote peer ea8ca4aa76354c09afe1f37627a6b613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:09.863440  2919 consensus_queue.cc:1048] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:09.990411  2644 raft_consensus.cc:1275] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Refusing update from remote peer eed2db69d6f94554b76d516ba7d98490: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:09.991907  2897 consensus_queue.cc:1048] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:09.999428  2793 raft_consensus.cc:1275] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Refusing update from remote peer eed2db69d6f94554b76d516ba7d98490: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.001691  2859 consensus_queue.cc:1048] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.070554  2794 raft_consensus.cc:1275] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Refusing update from remote peer eed2db69d6f94554b76d516ba7d98490: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.072032  2859 consensus_queue.cc:1048] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.075037  2644 raft_consensus.cc:1275] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Refusing update from remote peer eed2db69d6f94554b76d516ba7d98490: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.076516  2859 consensus_queue.cc:1048] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:12.168831  2025 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:15:12.169622  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:12.195508  2644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345"
dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
mode: GRACEFUL
new_leader_uuid: "27f50cbadf0b4667b694fa940273a112"
 from {username='slave'} at 127.0.0.1:37216
I20260709 13:15:12.196194  2644 raft_consensus.cc:606] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 LEADER]: Received request to transfer leadership to TS 27f50cbadf0b4667b694fa940273a112
I20260709 13:15:12.198691  2644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb8b1ed4d0a14b769d47523954a2fce5"
dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
mode: GRACEFUL
new_leader_uuid: "27f50cbadf0b4667b694fa940273a112"
 from {username='slave'} at 127.0.0.1:37216
I20260709 13:15:12.199179  2644 raft_consensus.cc:606] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Received request to transfer leadership to TS 27f50cbadf0b4667b694fa940273a112
I20260709 13:15:12.200104  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:12.200536  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:12.256067  2930 raft_consensus.cc:993] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613: : Instructing follower 27f50cbadf0b4667b694fa940273a112 to start an election
I20260709 13:15:12.256515  2930 raft_consensus.cc:1081] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 LEADER]: Signalling peer 27f50cbadf0b4667b694fa940273a112 to start an election
I20260709 13:15:12.257937  2793 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345"
dest_uuid: "27f50cbadf0b4667b694fa940273a112"
 from {username='slave'} at 127.0.0.1:46412
I20260709 13:15:12.258406  2793 raft_consensus.cc:493] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:12.258687  2793 raft_consensus.cc:3060] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:12.263489  2793 raft_consensus.cc:515] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:12.265324  2793 leader_election.cc:290] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 3 election: Requested vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351)
I20260709 13:15:12.266243  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:12.266256  2644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
I20260709 13:15:12.266860  2720 raft_consensus.cc:3060] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:12.266987  2644 raft_consensus.cc:3055] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:12.267374  2644 raft_consensus.cc:740] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:12.268047  2644 consensus_queue.cc:260] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:12.269155  2644 raft_consensus.cc:3060] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:12.271675  2720 raft_consensus.cc:2468] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 3.
I20260709 13:15:12.272833  2759 leader_election.cc:304] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:12.273643  2878 raft_consensus.cc:2804] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:12.274608  2878 raft_consensus.cc:697] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 3 LEADER]: Becoming Leader. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Running, Role: LEADER
I20260709 13:15:12.274856  2644 raft_consensus.cc:2468] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 3.
I20260709 13:15:12.275514  2878 consensus_queue.cc:237] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:12.282706  2541 catalog_manager.cc:5697] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 reported cstate change: term changed from 2 to 3, leader changed from ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65) to 27f50cbadf0b4667b694fa940273a112 (127.1.250.67). New cstate: current_term: 3 leader_uuid: "27f50cbadf0b4667b694fa940273a112" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.505327  2935 raft_consensus.cc:993] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613: : Instructing follower 27f50cbadf0b4667b694fa940273a112 to start an election
I20260709 13:15:12.505946  2930 raft_consensus.cc:1081] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Signalling peer 27f50cbadf0b4667b694fa940273a112 to start an election
I20260709 13:15:12.507373  2793 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb8b1ed4d0a14b769d47523954a2fce5"
dest_uuid: "27f50cbadf0b4667b694fa940273a112"
 from {username='slave'} at 127.0.0.1:46412
I20260709 13:15:12.507851  2793 raft_consensus.cc:493] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:12.508173  2793 raft_consensus.cc:3060] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.514132  2793 raft_consensus.cc:515] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:12.515799  2793 leader_election.cc:290] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 2 election: Requested vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351)
I20260709 13:15:12.516657  2644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8b1ed4d0a14b769d47523954a2fce5" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
I20260709 13:15:12.516799  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8b1ed4d0a14b769d47523954a2fce5" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:12.517333  2644 raft_consensus.cc:3055] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:12.517372  2720 raft_consensus.cc:3060] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.517768  2644 raft_consensus.cc:740] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:12.518582  2644 consensus_queue.cc:260] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:12.519541  2644 raft_consensus.cc:3060] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.521793  2720 raft_consensus.cc:2468] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 2.
I20260709 13:15:12.522771  2759 leader_election.cc:304] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:12.523703  2878 raft_consensus.cc:2804] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:12.524139  2878 raft_consensus.cc:697] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 2 LEADER]: Becoming Leader. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Running, Role: LEADER
I20260709 13:15:12.524791  2878 consensus_queue.cc:237] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:12.525803  2644 raft_consensus.cc:2468] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 2.
I20260709 13:15:12.534122  2541 catalog_manager.cc:5697] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 reported cstate change: term changed from 1 to 2, leader changed from ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65) to 27f50cbadf0b4667b694fa940273a112 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "27f50cbadf0b4667b694fa940273a112" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.745111  2644 raft_consensus.cc:1275] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Refusing update from remote peer 27f50cbadf0b4667b694fa940273a112: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:12.746417  2878 consensus_queue.cc:1048] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:12.761803  2720 raft_consensus.cc:1275] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Refusing update from remote peer 27f50cbadf0b4667b694fa940273a112: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:12.763213  2946 consensus_queue.cc:1048] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:12.959308  2720 raft_consensus.cc:1275] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Refusing update from remote peer 27f50cbadf0b4667b694fa940273a112: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.960505  2946 consensus_queue.cc:1048] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:12.969550  2644 raft_consensus.cc:1275] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Refusing update from remote peer 27f50cbadf0b4667b694fa940273a112: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.971643  2946 consensus_queue.cc:1048] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.201418  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:13.212459  2793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345"
dest_uuid: "27f50cbadf0b4667b694fa940273a112"
mode: GRACEFUL
new_leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
 from {username='slave'} at 127.0.0.1:46420
I20260709 13:15:13.213069  2793 raft_consensus.cc:606] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 3 LEADER]: Received request to transfer leadership to TS ea8ca4aa76354c09afe1f37627a6b613
I20260709 13:15:13.218329  2793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb8b1ed4d0a14b769d47523954a2fce5"
dest_uuid: "27f50cbadf0b4667b694fa940273a112"
mode: GRACEFUL
new_leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
 from {username='slave'} at 127.0.0.1:46420
I20260709 13:15:13.218987  2793 raft_consensus.cc:606] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 2 LEADER]: Received request to transfer leadership to TS ea8ca4aa76354c09afe1f37627a6b613
I20260709 13:15:13.232528  2720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1"
dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
mode: GRACEFUL
new_leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:15:13.233116  2720 raft_consensus.cc:606] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 2 LEADER]: Received request to transfer leadership to TS ea8ca4aa76354c09afe1f37627a6b613
I20260709 13:15:13.238662  2720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb"
dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
mode: GRACEFUL
new_leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:15:13.239239  2720 raft_consensus.cc:606] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 1 LEADER]: Received request to transfer leadership to TS ea8ca4aa76354c09afe1f37627a6b613
I20260709 13:15:13.244736  2720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4"
dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
mode: GRACEFUL
new_leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:15:13.245237  2720 raft_consensus.cc:606] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 2 LEADER]: Received request to transfer leadership to TS ea8ca4aa76354c09afe1f37627a6b613
I20260709 13:15:13.274781  2931 raft_consensus.cc:993] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490: : Instructing follower ea8ca4aa76354c09afe1f37627a6b613 to start an election
I20260709 13:15:13.275266  2951 raft_consensus.cc:1081] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 2 LEADER]: Signalling peer ea8ca4aa76354c09afe1f37627a6b613 to start an election
I20260709 13:15:13.276820  2644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4"
dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
 from {username='slave'} at 127.0.0.1:45332
I20260709 13:15:13.277362  2644 raft_consensus.cc:493] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.277704  2644 raft_consensus.cc:3060] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.282590  2644 raft_consensus.cc:515] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:13.284299  2644 leader_election.cc:290] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 3 election: Requested vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:13.285235  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:13.285444  2793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:13.285737  2720 raft_consensus.cc:3055] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:13.286067  2793 raft_consensus.cc:3060] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.286099  2720 raft_consensus.cc:740] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Running, Role: LEADER
I20260709 13:15:13.287611  2720 consensus_queue.cc:260] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:13.288901  2720 raft_consensus.cc:3060] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.289276  2931 raft_consensus.cc:993] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490: : Instructing follower ea8ca4aa76354c09afe1f37627a6b613 to start an election
I20260709 13:15:13.289709  2951 raft_consensus.cc:1081] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 2 LEADER]: Signalling peer ea8ca4aa76354c09afe1f37627a6b613 to start an election
I20260709 13:15:13.291070  2644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1"
dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
 from {username='slave'} at 127.0.0.1:45332
I20260709 13:15:13.291520  2644 raft_consensus.cc:493] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.291826  2644 raft_consensus.cc:3060] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.293615  2793 raft_consensus.cc:2468] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 3.
I20260709 13:15:13.294961  2609 leader_election.cc:304] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, ea8ca4aa76354c09afe1f37627a6b613; no voters: 
I20260709 13:15:13.295796  2930 raft_consensus.cc:2804] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:13.295854  2720 raft_consensus.cc:2468] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 3.
I20260709 13:15:13.297071  2930 raft_consensus.cc:697] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 LEADER]: Becoming Leader. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:13.298103  2644 raft_consensus.cc:515] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:13.299161  2930 consensus_queue.cc:237] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:13.300899  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:13.301487  2720 raft_consensus.cc:3055] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:13.301695  2644 leader_election.cc:290] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 3 election: Requested vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:13.301838  2720 raft_consensus.cc:740] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Running, Role: LEADER
I20260709 13:15:13.301904  2793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:13.302659  2793 raft_consensus.cc:3060] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.302769  2720 consensus_queue.cc:260] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:13.303879  2720 raft_consensus.cc:3060] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.309875  2793 raft_consensus.cc:2468] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 3.
I20260709 13:15:13.310508  2720 raft_consensus.cc:2468] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 3.
I20260709 13:15:13.312458  2610 leader_election.cc:304] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:13.314064  2954 raft_consensus.cc:2804] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:13.316666  2954 raft_consensus.cc:697] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 LEADER]: Becoming Leader. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:13.317668  2954 consensus_queue.cc:237] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:13.318356  2542 catalog_manager.cc:5697] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 reported cstate change: term changed from 2 to 3, leader changed from eed2db69d6f94554b76d516ba7d98490 (127.1.250.66) to ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.321019  2936 raft_consensus.cc:993] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112: : Instructing follower ea8ca4aa76354c09afe1f37627a6b613 to start an election
I20260709 13:15:13.321707  2936 raft_consensus.cc:1081] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 3 LEADER]: Signalling peer ea8ca4aa76354c09afe1f37627a6b613 to start an election
I20260709 13:15:13.323968  2644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345"
dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
 from {username='slave'} at 127.0.0.1:45346
I20260709 13:15:13.324584  2644 raft_consensus.cc:493] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.325114  2644 raft_consensus.cc:3060] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.330113  2644 raft_consensus.cc:515] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:13.332237  2644 leader_election.cc:290] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 4 election: Requested vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:13.333146  2793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:13.333798  2793 raft_consensus.cc:3055] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:13.334059  2793 raft_consensus.cc:740] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Running, Role: LEADER
I20260709 13:15:13.333142  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5d42c2a0504f8eaa593f5fbac08345" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:13.334690  2793 consensus_queue.cc:260] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:13.335219  2720 raft_consensus.cc:3060] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.335913  2793 raft_consensus.cc:3060] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.340970  2720 raft_consensus.cc:2468] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 4.
I20260709 13:15:13.342379  2793 raft_consensus.cc:2468] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 4.
I20260709 13:15:13.342212  2610 leader_election.cc:304] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:13.343166  2954 raft_consensus.cc:2804] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:13.343950  2954 raft_consensus.cc:697] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 4 LEADER]: Becoming Leader. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:13.344200  2542 catalog_manager.cc:5697] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 reported cstate change: term changed from 2 to 3, leader changed from eed2db69d6f94554b76d516ba7d98490 (127.1.250.66) to ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.344832  2954 consensus_queue.cc:237] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } }
I20260709 13:15:13.356184  2542 catalog_manager.cc:5697] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 reported cstate change: term changed from 3 to 4, leader changed from 27f50cbadf0b4667b694fa940273a112 (127.1.250.67) to ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65). New cstate: current_term: 4 leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.476622  2931 raft_consensus.cc:993] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490: : Instructing follower ea8ca4aa76354c09afe1f37627a6b613 to start an election
I20260709 13:15:13.477166  2931 raft_consensus.cc:1081] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 1 LEADER]: Signalling peer ea8ca4aa76354c09afe1f37627a6b613 to start an election
I20260709 13:15:13.478747  2644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb"
dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
 from {username='slave'} at 127.0.0.1:45332
I20260709 13:15:13.479264  2644 raft_consensus.cc:493] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.479753  2644 raft_consensus.cc:3060] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.485355  2644 raft_consensus.cc:515] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:13.487236  2644 leader_election.cc:290] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 2 election: Requested vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:13.488238  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:13.488238  2793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:13.489125  2793 raft_consensus.cc:3060] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.489049  2720 raft_consensus.cc:3055] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.489617  2720 raft_consensus.cc:740] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Running, Role: LEADER
I20260709 13:15:13.490360  2720 consensus_queue.cc:260] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:13.491664  2720 raft_consensus.cc:3060] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.495837  2793 raft_consensus.cc:2468] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 2.
I20260709 13:15:13.497177  2609 leader_election.cc:304] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, ea8ca4aa76354c09afe1f37627a6b613; no voters: 
I20260709 13:15:13.497769  2720 raft_consensus.cc:2468] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 2.
I20260709 13:15:13.497918  2954 raft_consensus.cc:2804] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.498375  2954 raft_consensus.cc:697] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 2 LEADER]: Becoming Leader. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:13.499249  2954 consensus_queue.cc:237] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:13.506045  2542 catalog_manager.cc:5697] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 reported cstate change: term changed from 1 to 2, leader changed from eed2db69d6f94554b76d516ba7d98490 (127.1.250.66) to ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.538283  2936 raft_consensus.cc:993] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112: : Instructing follower ea8ca4aa76354c09afe1f37627a6b613 to start an election
I20260709 13:15:13.538821  2961 raft_consensus.cc:1081] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 2 LEADER]: Signalling peer ea8ca4aa76354c09afe1f37627a6b613 to start an election
I20260709 13:15:13.540446  2644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb8b1ed4d0a14b769d47523954a2fce5"
dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
 from {username='slave'} at 127.0.0.1:45346
I20260709 13:15:13.540917  2644 raft_consensus.cc:493] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.541278  2644 raft_consensus.cc:3060] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.545784  2644 raft_consensus.cc:515] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:13.547398  2644 leader_election.cc:290] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 3 election: Requested vote from peers eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:13.548494  2793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8b1ed4d0a14b769d47523954a2fce5" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:13.548506  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8b1ed4d0a14b769d47523954a2fce5" candidate_uuid: "ea8ca4aa76354c09afe1f37627a6b613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:13.549019  2793 raft_consensus.cc:3055] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:13.549114  2720 raft_consensus.cc:3060] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.549376  2793 raft_consensus.cc:740] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Running, Role: LEADER
I20260709 13:15:13.550014  2793 consensus_queue.cc:260] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:13.550941  2793 raft_consensus.cc:3060] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.553918  2720 raft_consensus.cc:2468] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 3.
I20260709 13:15:13.555054  2610 leader_election.cc:304] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:13.555193  2793 raft_consensus.cc:2468] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8ca4aa76354c09afe1f37627a6b613 in term 3.
I20260709 13:15:13.555943  2954 raft_consensus.cc:2804] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:13.556476  2954 raft_consensus.cc:697] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 LEADER]: Becoming Leader. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:13.557292  2954 consensus_queue.cc:237] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:13.563156  2542 catalog_manager.cc:5697] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 reported cstate change: term changed from 2 to 3, leader changed from 27f50cbadf0b4667b694fa940273a112 (127.1.250.67) to ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "ea8ca4aa76354c09afe1f37627a6b613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.707751  2793 raft_consensus.cc:1275] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Refusing update from remote peer ea8ca4aa76354c09afe1f37627a6b613: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:13.709185  2954 consensus_queue.cc:1048] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:13.718490  2720 raft_consensus.cc:1275] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Refusing update from remote peer ea8ca4aa76354c09afe1f37627a6b613: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:13.720139  2955 consensus_queue.cc:1048] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:13.762022  2793 raft_consensus.cc:1275] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 4 FOLLOWER]: Refusing update from remote peer ea8ca4aa76354c09afe1f37627a6b613: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:13.763306  2930 consensus_queue.cc:1048] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:13.769759  2720 raft_consensus.cc:1275] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 4 FOLLOWER]: Refusing update from remote peer ea8ca4aa76354c09afe1f37627a6b613: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:13.771190  2955 consensus_queue.cc:1048] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:13.802526  2720 raft_consensus.cc:1275] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Refusing update from remote peer ea8ca4aa76354c09afe1f37627a6b613: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:13.803745  2930 consensus_queue.cc:1048] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:13.813817  2793 raft_consensus.cc:1275] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Refusing update from remote peer ea8ca4aa76354c09afe1f37627a6b613: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:13.815373  2952 consensus_queue.cc:1048] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:13.923487  2720 raft_consensus.cc:1275] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Refusing update from remote peer ea8ca4aa76354c09afe1f37627a6b613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.925115  2952 consensus_queue.cc:1048] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.935714  2793 raft_consensus.cc:1275] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Refusing update from remote peer ea8ca4aa76354c09afe1f37627a6b613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.937312  2952 consensus_queue.cc:1048] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.986385  2793 raft_consensus.cc:1275] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Refusing update from remote peer ea8ca4aa76354c09afe1f37627a6b613: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:13.987891  2930 consensus_queue.cc:1048] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:13.996721  2719 raft_consensus.cc:1275] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Refusing update from remote peer ea8ca4aa76354c09afe1f37627a6b613: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:13.998728  2930 consensus_queue.cc:1048] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:16.252799  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:16.261408  2644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3662a338455a4acaae7a6887452aa38f"
dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
mode: GRACEFUL
new_leader_uuid: "27f50cbadf0b4667b694fa940273a112"
 from {username='slave'} at 127.0.0.1:37216
I20260709 13:15:16.262112  2644 raft_consensus.cc:606] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Received request to transfer leadership to TS 27f50cbadf0b4667b694fa940273a112
I20260709 13:15:16.265169  2644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb"
dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
mode: GRACEFUL
new_leader_uuid: "eed2db69d6f94554b76d516ba7d98490"
 from {username='slave'} at 127.0.0.1:37216
I20260709 13:15:16.265654  2644 raft_consensus.cc:606] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 2 LEADER]: Received request to transfer leadership to TS eed2db69d6f94554b76d516ba7d98490
I20260709 13:15:16.267843  2644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4"
dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
mode: GRACEFUL
new_leader_uuid: "eed2db69d6f94554b76d516ba7d98490"
 from {username='slave'} at 127.0.0.1:37216
I20260709 13:15:16.268324  2644 raft_consensus.cc:606] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 LEADER]: Received request to transfer leadership to TS eed2db69d6f94554b76d516ba7d98490
I20260709 13:15:16.270913  2644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1"
dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
mode: GRACEFUL
new_leader_uuid: "27f50cbadf0b4667b694fa940273a112"
 from {username='slave'} at 127.0.0.1:37216
I20260709 13:15:16.271355  2644 raft_consensus.cc:606] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 LEADER]: Received request to transfer leadership to TS 27f50cbadf0b4667b694fa940273a112
I20260709 13:15:16.272466  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:16.272966  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:16.428221  2930 raft_consensus.cc:993] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613: : Instructing follower eed2db69d6f94554b76d516ba7d98490 to start an election
I20260709 13:15:16.428877  2977 raft_consensus.cc:1081] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 2 LEADER]: Signalling peer eed2db69d6f94554b76d516ba7d98490 to start an election
I20260709 13:15:16.430749  2719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb"
dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
 from {username='slave'} at 127.0.0.1:58796
I20260709 13:15:16.431311  2719 raft_consensus.cc:493] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.431784  2719 raft_consensus.cc:3060] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:16.435443  2930 raft_consensus.cc:993] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613: : Instructing follower 27f50cbadf0b4667b694fa940273a112 to start an election
I20260709 13:15:16.436137  2930 raft_consensus.cc:1081] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 LEADER]: Signalling peer 27f50cbadf0b4667b694fa940273a112 to start an election
I20260709 13:15:16.438977  2794 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1"
dest_uuid: "27f50cbadf0b4667b694fa940273a112"
 from {username='slave'} at 127.0.0.1:46412
I20260709 13:15:16.439590  2794 raft_consensus.cc:493] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.439913  2794 raft_consensus.cc:3060] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:16.440866  2719 raft_consensus.cc:515] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:16.444031  2719 leader_election.cc:290] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 3 election: Requested vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:16.444490  2644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
I20260709 13:15:16.444998  2793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcce0630ae041dc87b3f695e73dd0cb" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:16.445509  2644 raft_consensus.cc:3055] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:16.445587  2793 raft_consensus.cc:3060] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:16.445937  2644 raft_consensus.cc:740] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:16.446920  2644 consensus_queue.cc:260] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:16.448359  2644 raft_consensus.cc:3060] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:16.449075  2794 raft_consensus.cc:515] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:16.453015  2720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:16.453656  2720 raft_consensus.cc:3060] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:16.453800  2977 raft_consensus.cc:993] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613: : Instructing follower eed2db69d6f94554b76d516ba7d98490 to start an election
I20260709 13:15:16.453989  2793 raft_consensus.cc:2468] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 3.
I20260709 13:15:16.454324  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd388f530164bbb84b06b26d2a789f1" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
I20260709 13:15:16.454788  2977 raft_consensus.cc:1081] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 LEADER]: Signalling peer eed2db69d6f94554b76d516ba7d98490 to start an election
I20260709 13:15:16.454959  2645 raft_consensus.cc:3055] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:16.455325  2645 raft_consensus.cc:740] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:16.456517  2719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4"
dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
 from {username='slave'} at 127.0.0.1:58796
I20260709 13:15:16.457195  2719 raft_consensus.cc:493] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.457641  2719 raft_consensus.cc:3060] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:16.458016  2794 leader_election.cc:290] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 4 election: Requested vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351)
I20260709 13:15:16.456252  2645 consensus_queue.cc:260] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:16.460083  2645 raft_consensus.cc:3060] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:16.457633  2684 leader_election.cc:304] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:16.462368  2931 raft_consensus.cc:2804] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:16.466012  2720 raft_consensus.cc:2468] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 4.
I20260709 13:15:16.467958  2719 raft_consensus.cc:515] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:16.469333  2645 raft_consensus.cc:2468] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 4.
I20260709 13:15:16.471936  2719 leader_election.cc:290] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 4 election: Requested vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), 27f50cbadf0b4667b694fa940273a112 (127.1.250.67:34453)
I20260709 13:15:16.472378  2643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
I20260709 13:15:16.475291  2644 raft_consensus.cc:2468] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 3.
I20260709 13:15:16.475415  2643 raft_consensus.cc:3055] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:16.475860  2643 raft_consensus.cc:740] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:16.473503  2931 raft_consensus.cc:697] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 3 LEADER]: Becoming Leader. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Running, Role: LEADER
I20260709 13:15:16.476861  2643 consensus_queue.cc:260] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:16.477391  2931 consensus_queue.cc:237] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:16.476475  2760 leader_election.cc:304] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, ea8ca4aa76354c09afe1f37627a6b613; no voters: 
I20260709 13:15:16.479394  2961 raft_consensus.cc:2804] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:16.478331  2643 raft_consensus.cc:3060] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:16.482654  2961 raft_consensus.cc:697] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 4 LEADER]: Becoming Leader. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Running, Role: LEADER
I20260709 13:15:16.486115  2961 consensus_queue.cc:237] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:16.490527  2643 raft_consensus.cc:2468] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 4.
I20260709 13:15:16.492061  2686 leader_election.cc:304] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea8ca4aa76354c09afe1f37627a6b613, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:16.493389  2979 raft_consensus.cc:2804] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:16.493932  2979 raft_consensus.cc:697] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 4 LEADER]: Becoming Leader. State: Replica: eed2db69d6f94554b76d516ba7d98490, State: Running, Role: LEADER
I20260709 13:15:16.494385  2543 catalog_manager.cc:5697] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 reported cstate change: term changed from 2 to 3, leader changed from ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65) to eed2db69d6f94554b76d516ba7d98490 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "eed2db69d6f94554b76d516ba7d98490" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:16.495096  2979 consensus_queue.cc:237] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:16.499168  2794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938fd2297189411f9545fd31df9d0ea4" candidate_uuid: "eed2db69d6f94554b76d516ba7d98490" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "27f50cbadf0b4667b694fa940273a112"
I20260709 13:15:16.499881  2794 raft_consensus.cc:3060] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:16.500811  2541 catalog_manager.cc:5697] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 reported cstate change: term changed from 3 to 4, leader changed from ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65) to 27f50cbadf0b4667b694fa940273a112 (127.1.250.67). New cstate: current_term: 4 leader_uuid: "27f50cbadf0b4667b694fa940273a112" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:16.508209  2794 raft_consensus.cc:2468] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eed2db69d6f94554b76d516ba7d98490 in term 4.
I20260709 13:15:16.522397  2541 catalog_manager.cc:5697] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 reported cstate change: term changed from 3 to 4, leader changed from ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65) to eed2db69d6f94554b76d516ba7d98490 (127.1.250.66). New cstate: current_term: 4 leader_uuid: "eed2db69d6f94554b76d516ba7d98490" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:16.677943  2930 raft_consensus.cc:993] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613: : Instructing follower 27f50cbadf0b4667b694fa940273a112 to start an election
I20260709 13:15:16.678489  2930 raft_consensus.cc:1081] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Signalling peer 27f50cbadf0b4667b694fa940273a112 to start an election
I20260709 13:15:16.680194  2794 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3662a338455a4acaae7a6887452aa38f"
dest_uuid: "27f50cbadf0b4667b694fa940273a112"
 from {username='slave'} at 127.0.0.1:46412
I20260709 13:15:16.680671  2794 raft_consensus.cc:493] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.680950  2794 raft_consensus.cc:3060] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.685838  2794 raft_consensus.cc:515] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:16.687412  2794 leader_election.cc:290] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 2 election: Requested vote from peers ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351), eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351)
I20260709 13:15:16.688527  2643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3662a338455a4acaae7a6887452aa38f" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea8ca4aa76354c09afe1f37627a6b613"
I20260709 13:15:16.688555  2719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3662a338455a4acaae7a6887452aa38f" candidate_uuid: "27f50cbadf0b4667b694fa940273a112" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eed2db69d6f94554b76d516ba7d98490"
I20260709 13:15:16.689205  2643 raft_consensus.cc:3055] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:16.689380  2719 raft_consensus.cc:3060] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.689651  2643 raft_consensus.cc:740] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea8ca4aa76354c09afe1f37627a6b613, State: Running, Role: LEADER
I20260709 13:15:16.690491  2643 consensus_queue.cc:260] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:16.691500  2643 raft_consensus.cc:3060] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.694792  2719 raft_consensus.cc:2468] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 2.
I20260709 13:15:16.696041  2759 leader_election.cc:304] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27f50cbadf0b4667b694fa940273a112, eed2db69d6f94554b76d516ba7d98490; no voters: 
I20260709 13:15:16.696722  2643 raft_consensus.cc:2468] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27f50cbadf0b4667b694fa940273a112 in term 2.
I20260709 13:15:16.696789  2961 raft_consensus.cc:2804] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:16.697366  2961 raft_consensus.cc:697] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [term 2 LEADER]: Becoming Leader. State: Replica: 27f50cbadf0b4667b694fa940273a112, State: Running, Role: LEADER
I20260709 13:15:16.698326  2961 consensus_queue.cc:237] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } }
I20260709 13:15:16.706542  2541 catalog_manager.cc:5697] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 reported cstate change: term changed from 1 to 2, leader changed from ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65) to 27f50cbadf0b4667b694fa940273a112 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "27f50cbadf0b4667b694fa940273a112" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:17.037405  2643 raft_consensus.cc:1275] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 4 FOLLOWER]: Refusing update from remote peer 27f50cbadf0b4667b694fa940273a112: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:17.038859  2961 consensus_queue.cc:1048] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:17.041190  2794 raft_consensus.cc:1275] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Refusing update from remote peer eed2db69d6f94554b76d516ba7d98490: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:17.042519  2979 consensus_queue.cc:1048] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:17.051923  2793 raft_consensus.cc:1275] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 4 FOLLOWER]: Refusing update from remote peer eed2db69d6f94554b76d516ba7d98490: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:17.054993  2979 consensus_queue.cc:1048] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f50cbadf0b4667b694fa940273a112" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:17.072700  2645 raft_consensus.cc:1275] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Refusing update from remote peer eed2db69d6f94554b76d516ba7d98490: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:17.077311  2995 consensus_queue.cc:1048] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:17.080492  2719 raft_consensus.cc:1275] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 4 FOLLOWER]: Refusing update from remote peer 27f50cbadf0b4667b694fa940273a112: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:17.084131  3000 consensus_queue.cc:1048] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:17.110872  2645 raft_consensus.cc:1275] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 4 FOLLOWER]: Refusing update from remote peer eed2db69d6f94554b76d516ba7d98490: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:17.113691  2979 consensus_queue.cc:1048] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:17.133654  2645 raft_consensus.cc:1275] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Refusing update from remote peer 27f50cbadf0b4667b694fa940273a112: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.134912  3000 consensus_queue.cc:1048] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8ca4aa76354c09afe1f37627a6b613" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.144562  2719 raft_consensus.cc:1275] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Refusing update from remote peer 27f50cbadf0b4667b694fa940273a112: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.146346  2981 consensus_queue.cc:1048] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eed2db69d6f94554b76d516ba7d98490" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:17.273960  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:17.281047  2025 tablet_server.cc:179] TabletServer@127.1.250.65:0 shutting down...
I20260709 13:15:17.305372  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:17.306267  2025 tablet_replica.cc:333] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613: stopping tablet replica
W20260709 13:15:17.306838  2760 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260709 13:15:17.306955  2025 raft_consensus.cc:2243] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.307978  2025 raft_consensus.cc:2272] T 2e129ffeca244f29976764022b760edc P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:17.309855  2760 consensus_peers.cc:597] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 -> Peer ea8ca4aa76354c09afe1f37627a6b613 (127.1.250.65:33351): Couldn't send request to peer ea8ca4aa76354c09afe1f37627a6b613. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:17.310310  2025 tablet_replica.cc:333] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613: stopping tablet replica
I20260709 13:15:17.310868  2025 raft_consensus.cc:2243] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.311295  2025 raft_consensus.cc:2272] T ccd388f530164bbb84b06b26d2a789f1 P ea8ca4aa76354c09afe1f37627a6b613 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.314205  2025 tablet_replica.cc:333] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613: stopping tablet replica
I20260709 13:15:17.315022  2025 raft_consensus.cc:2243] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.315529  2025 raft_consensus.cc:2272] T 3662a338455a4acaae7a6887452aa38f P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.318397  2025 tablet_replica.cc:333] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613: stopping tablet replica
I20260709 13:15:17.318928  2025 raft_consensus.cc:2243] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.319355  2025 raft_consensus.cc:2272] T 2f5eee6eac9e456595b69de203f2445b P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.321275  2025 tablet_replica.cc:333] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613: stopping tablet replica
I20260709 13:15:17.321792  2025 raft_consensus.cc:2243] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.322604  2025 raft_consensus.cc:2272] T ae5d42c2a0504f8eaa593f5fbac08345 P ea8ca4aa76354c09afe1f37627a6b613 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.324496  2025 tablet_replica.cc:333] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613: stopping tablet replica
I20260709 13:15:17.325282  2025 raft_consensus.cc:2243] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.326118  2025 raft_consensus.cc:2272] T cb8b1ed4d0a14b769d47523954a2fce5 P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.327903  2025 tablet_replica.cc:333] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613: stopping tablet replica
I20260709 13:15:17.328490  2025 raft_consensus.cc:2243] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.328898  2025 raft_consensus.cc:2272] T 938fd2297189411f9545fd31df9d0ea4 P ea8ca4aa76354c09afe1f37627a6b613 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.331076  2025 tablet_replica.cc:333] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613: stopping tablet replica
I20260709 13:15:17.331648  2025 raft_consensus.cc:2243] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.332363  2025 raft_consensus.cc:2272] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P ea8ca4aa76354c09afe1f37627a6b613 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.334075  2025 tablet_replica.cc:333] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613: stopping tablet replica
I20260709 13:15:17.334540  2025 raft_consensus.cc:2243] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.334960  2025 raft_consensus.cc:2272] T 8dcce0630ae041dc87b3f695e73dd0cb P ea8ca4aa76354c09afe1f37627a6b613 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.337245  2025 tablet_replica.cc:333] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613: stopping tablet replica
I20260709 13:15:17.337739  2025 raft_consensus.cc:2243] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.338109  2025 raft_consensus.cc:2272] T 246568b455744f5b849b10ac433025be P ea8ca4aa76354c09afe1f37627a6b613 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.359496  2025 tablet_server.cc:196] TabletServer@127.1.250.65:0 shutdown complete.
I20260709 13:15:17.382359  2025 tablet_server.cc:179] TabletServer@127.1.250.66:0 shutting down...
I20260709 13:15:17.407894  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:17.408600  2025 tablet_replica.cc:333] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490: stopping tablet replica
I20260709 13:15:17.409271  2025 raft_consensus.cc:2243] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.409691  2025 raft_consensus.cc:2272] T ccd388f530164bbb84b06b26d2a789f1 P eed2db69d6f94554b76d516ba7d98490 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.411804  2025 tablet_replica.cc:333] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490: stopping tablet replica
I20260709 13:15:17.412322  2025 raft_consensus.cc:2243] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.412719  2025 raft_consensus.cc:2272] T 2e129ffeca244f29976764022b760edc P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.414580  2025 tablet_replica.cc:333] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490: stopping tablet replica
I20260709 13:15:17.415050  2025 raft_consensus.cc:2243] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.415524  2025 raft_consensus.cc:2272] T cb8b1ed4d0a14b769d47523954a2fce5 P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.417254  2025 tablet_replica.cc:333] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490: stopping tablet replica
I20260709 13:15:17.417805  2025 raft_consensus.cc:2243] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.418279  2025 raft_consensus.cc:2272] T ae5d42c2a0504f8eaa593f5fbac08345 P eed2db69d6f94554b76d516ba7d98490 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.420032  2025 tablet_replica.cc:333] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490: stopping tablet replica
I20260709 13:15:17.420455  2025 raft_consensus.cc:2243] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.420938  2025 raft_consensus.cc:2272] T 2f5eee6eac9e456595b69de203f2445b P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.422921  2025 tablet_replica.cc:333] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490: stopping tablet replica
I20260709 13:15:17.423408  2025 raft_consensus.cc:2243] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.424376  2025 raft_consensus.cc:2272] T 246568b455744f5b849b10ac433025be P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.426438  2025 tablet_replica.cc:333] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490: stopping tablet replica
I20260709 13:15:17.427093  2025 raft_consensus.cc:2243] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.427850  2025 raft_consensus.cc:2272] T 8dcce0630ae041dc87b3f695e73dd0cb P eed2db69d6f94554b76d516ba7d98490 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.430783  2025 tablet_replica.cc:333] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490: stopping tablet replica
I20260709 13:15:17.431293  2025 raft_consensus.cc:2243] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.432011  2025 raft_consensus.cc:2272] T 938fd2297189411f9545fd31df9d0ea4 P eed2db69d6f94554b76d516ba7d98490 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.433933  2025 tablet_replica.cc:333] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P eed2db69d6f94554b76d516ba7d98490: stopping tablet replica
I20260709 13:15:17.434417  2025 raft_consensus.cc:2243] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.434845  2025 raft_consensus.cc:2272] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P eed2db69d6f94554b76d516ba7d98490 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.436668  2025 tablet_replica.cc:333] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490: stopping tablet replica
I20260709 13:15:17.437239  2025 raft_consensus.cc:2243] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.437675  2025 raft_consensus.cc:2272] T 3662a338455a4acaae7a6887452aa38f P eed2db69d6f94554b76d516ba7d98490 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.468434  2025 tablet_server.cc:196] TabletServer@127.1.250.66:0 shutdown complete.
W20260709 13:15:17.472430  2759 consensus_peers.cc:597] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 -> Peer eed2db69d6f94554b76d516ba7d98490 (127.1.250.66:38351): Couldn't send request to peer eed2db69d6f94554b76d516ba7d98490. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:38351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:17.489445  2025 tablet_server.cc:179] TabletServer@127.1.250.67:0 shutting down...
I20260709 13:15:17.514168  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:17.514819  2025 tablet_replica.cc:333] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112: stopping tablet replica
I20260709 13:15:17.515403  2025 raft_consensus.cc:2243] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.515831  2025 raft_consensus.cc:2272] T cb8b1ed4d0a14b769d47523954a2fce5 P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.517619  2025 tablet_replica.cc:333] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112: stopping tablet replica
I20260709 13:15:17.518107  2025 raft_consensus.cc:2243] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.518839  2025 raft_consensus.cc:2272] T ccd388f530164bbb84b06b26d2a789f1 P 27f50cbadf0b4667b694fa940273a112 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.521513  2025 tablet_replica.cc:333] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112: stopping tablet replica
I20260709 13:15:17.522018  2025 raft_consensus.cc:2243] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.522437  2025 raft_consensus.cc:2272] T 2e129ffeca244f29976764022b760edc P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.524324  2025 tablet_replica.cc:333] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112: stopping tablet replica
I20260709 13:15:17.524931  2025 raft_consensus.cc:2243] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.525596  2025 raft_consensus.cc:2272] T 246568b455744f5b849b10ac433025be P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.528293  2025 tablet_replica.cc:333] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112: stopping tablet replica
I20260709 13:15:17.528833  2025 raft_consensus.cc:2243] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.529292  2025 raft_consensus.cc:2272] T 8dcce0630ae041dc87b3f695e73dd0cb P 27f50cbadf0b4667b694fa940273a112 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.532063  2025 tablet_replica.cc:333] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P 27f50cbadf0b4667b694fa940273a112: stopping tablet replica
I20260709 13:15:17.532575  2025 raft_consensus.cc:2243] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.532966  2025 raft_consensus.cc:2272] T 4bbc9ccd4c4d42b0ac47ff54aa3bf2b2 P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.534597  2025 tablet_replica.cc:333] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112: stopping tablet replica
I20260709 13:15:17.535108  2025 raft_consensus.cc:2243] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.535593  2025 raft_consensus.cc:2272] T 938fd2297189411f9545fd31df9d0ea4 P 27f50cbadf0b4667b694fa940273a112 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.537887  2025 tablet_replica.cc:333] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112: stopping tablet replica
I20260709 13:15:17.538400  2025 raft_consensus.cc:2243] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.539189  2025 raft_consensus.cc:2272] T 3662a338455a4acaae7a6887452aa38f P 27f50cbadf0b4667b694fa940273a112 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.541438  2025 tablet_replica.cc:333] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112: stopping tablet replica
I20260709 13:15:17.541947  2025 raft_consensus.cc:2243] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.542374  2025 raft_consensus.cc:2272] T ae5d42c2a0504f8eaa593f5fbac08345 P 27f50cbadf0b4667b694fa940273a112 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.543944  2025 tablet_replica.cc:333] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112: stopping tablet replica
I20260709 13:15:17.544373  2025 raft_consensus.cc:2243] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.545174  2025 raft_consensus.cc:2272] T 2f5eee6eac9e456595b69de203f2445b P 27f50cbadf0b4667b694fa940273a112 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.574565  2025 tablet_server.cc:196] TabletServer@127.1.250.67:0 shutdown complete.
I20260709 13:15:17.593719  2025 master.cc:562] Master@127.1.250.126:33413 shutting down...
I20260709 13:15:17.615649  2025 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.616333  2025 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.616679  2025 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4574d902e18a40278b97d6c8a1412cea: stopping tablet replica
I20260709 13:15:17.638139  2025 master.cc:584] Master@127.1.250.126:33413 shutdown complete.
27f50cbadf0b4667b694fa940273a112  1
ea8ca4aa76354c09afe1f37627a6b613  5
eed2db69d6f94554b76d516ba7d98490  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10677 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:15:17.684316  2025 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.250.126:33381
I20260709 13:15:17.685665  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:17.691323  3009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.692276  3010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.693245  3012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.693374  2025 server_base.cc:1061] running on GCE node
I20260709 13:15:17.694418  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:17.694751  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:17.694885  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783602917694873 us; error 0 us; skew 500 ppm
I20260709 13:15:17.695426  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:17.698273  2025 webserver.cc:533] Webserver started at http://127.1.250.126:45747/ using document root <none> and password file <none>
I20260709 13:15:17.698746  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:17.698906  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:17.699132  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:17.700227  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/master-0-root/instance:
uuid: "2d86a7fbede6469c844c1637c8ddd791"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-g4pn"
I20260709 13:15:17.704903  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:15:17.709497  3017 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.710352  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:15:17.710703  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/master-0-root
uuid: "2d86a7fbede6469c844c1637c8ddd791"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-g4pn"
I20260709 13:15:17.710999  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:17.726397  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:17.727882  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:17.771662  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.126:33381
I20260709 13:15:17.771768  3068 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.126:33381 every 8 connection(s)
I20260709 13:15:17.775910  3069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.786046  3069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791: Bootstrap starting.
I20260709 13:15:17.790730  3069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.795295  3069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791: No bootstrap required, opened a new log
I20260709 13:15:17.797505  3069 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d86a7fbede6469c844c1637c8ddd791" member_type: VOTER }
I20260709 13:15:17.797904  3069 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.798177  3069 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d86a7fbede6469c844c1637c8ddd791, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.798872  3069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d86a7fbede6469c844c1637c8ddd791" member_type: VOTER }
I20260709 13:15:17.799329  3069 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:17.799540  3069 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:17.799827  3069 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.804421  3069 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d86a7fbede6469c844c1637c8ddd791" member_type: VOTER }
I20260709 13:15:17.804991  3069 leader_election.cc:304] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d86a7fbede6469c844c1637c8ddd791; no voters: 
I20260709 13:15:17.806260  3069 leader_election.cc:290] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:17.806625  3072 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.808290  3072 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [term 1 LEADER]: Becoming Leader. State: Replica: 2d86a7fbede6469c844c1637c8ddd791, State: Running, Role: LEADER
I20260709 13:15:17.809158  3072 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d86a7fbede6469c844c1637c8ddd791" member_type: VOTER }
I20260709 13:15:17.810170  3069 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:17.814205  3074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d86a7fbede6469c844c1637c8ddd791. Latest consensus state: current_term: 1 leader_uuid: "2d86a7fbede6469c844c1637c8ddd791" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d86a7fbede6469c844c1637c8ddd791" member_type: VOTER } }
I20260709 13:15:17.814666  3073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d86a7fbede6469c844c1637c8ddd791" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d86a7fbede6469c844c1637c8ddd791" member_type: VOTER } }
I20260709 13:15:17.815011  3074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:17.815541  3073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:17.818197  3078 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:17.823487  3078 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:17.834052  2025 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:17.834368  3078 catalog_manager.cc:1383] Generated new cluster ID: 9dde9e4984294236805d6e20a9929483
I20260709 13:15:17.834677  3078 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:17.849352  3078 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:17.850764  3078 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:17.873984  3078 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791: Generated new TSK 0
I20260709 13:15:17.874666  3078 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:17.901343  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:17.908317  3090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.910184  3091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.913653  2025 server_base.cc:1061] running on GCE node
W20260709 13:15:17.913616  3093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.915400  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:17.915640  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:17.915827  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783602917915802 us; error 0 us; skew 500 ppm
I20260709 13:15:17.916379  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:17.919480  2025 webserver.cc:533] Webserver started at http://127.1.250.65:38171/ using document root <none> and password file <none>
I20260709 13:15:17.920267  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:17.920518  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:17.920826  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:17.922043  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-0-root/instance:
uuid: "fc48eecc27554cb58b15193cd442b1d3"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-g4pn"
I20260709 13:15:17.929919  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:15:17.934206  3098 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.935271  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:15:17.935525  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-0-root
uuid: "fc48eecc27554cb58b15193cd442b1d3"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-g4pn"
I20260709 13:15:17.936007  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:17.952033  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:17.953409  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:17.954952  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:17.957437  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:17.957633  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.957811  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:17.958194  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:18.005409  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.65:41323
I20260709 13:15:18.005504  3160 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.65:41323 every 8 connection(s)
I20260709 13:15:18.010878  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:18.019886  3166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:18.022786  3165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:18.023842  2025 server_base.cc:1061] running on GCE node
W20260709 13:15:18.025944  3168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:18.027199  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:18.027405  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:18.027642  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783602918027620 us; error 0 us; skew 500 ppm
I20260709 13:15:18.028527  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:18.030810  3161 heartbeater.cc:344] Connected to a master server at 127.1.250.126:33381
I20260709 13:15:18.031445  3161 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:18.032047  2025 webserver.cc:533] Webserver started at http://127.1.250.66:39351/ using document root <none> and password file <none>
I20260709 13:15:18.032454  3161 heartbeater.cc:507] Master 127.1.250.126:33381 requested a full tablet report, sending...
I20260709 13:15:18.032691  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:18.033032  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:18.033574  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:18.034983  3034 ts_manager.cc:194] Registered new tserver with Master: fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323)
I20260709 13:15:18.035127  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root/instance:
uuid: "43b01d5a97e149008d543a6615219928"
format_stamp: "Formatted at 2026-07-09 13:15:18 on dist-test-slave-g4pn"
I20260709 13:15:18.037528  3034 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38218
I20260709 13:15:18.041023  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:15:18.045233  3173 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:18.046263  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:18.046623  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root
uuid: "43b01d5a97e149008d543a6615219928"
format_stamp: "Formatted at 2026-07-09 13:15:18 on dist-test-slave-g4pn"
I20260709 13:15:18.047165  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:18.063177  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:18.064498  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:18.066073  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:18.068524  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:18.068800  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:18.069070  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:18.069317  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:15:18.114307  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.66:42299
I20260709 13:15:18.114428  3235 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.66:42299 every 8 connection(s)
I20260709 13:15:18.119066  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:18.128481  3239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:18.131835  3240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:18.132781  3242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:18.134765  2025 server_base.cc:1061] running on GCE node
I20260709 13:15:18.135993  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:18.136304  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:18.136569  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783602918136538 us; error 0 us; skew 500 ppm
I20260709 13:15:18.137310  3236 heartbeater.cc:344] Connected to a master server at 127.1.250.126:33381
I20260709 13:15:18.137380  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:18.137805  3236 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:18.138882  3236 heartbeater.cc:507] Master 127.1.250.126:33381 requested a full tablet report, sending...
I20260709 13:15:18.140595  2025 webserver.cc:533] Webserver started at http://127.1.250.67:33501/ using document root <none> and password file <none>
I20260709 13:15:18.141185  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:18.141495  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:18.141388  3034 ts_manager.cc:194] Registered new tserver with Master: 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:18.141927  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:18.143118  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root/instance:
uuid: "48080cf0460346769ab046a4f9457aa5"
format_stamp: "Formatted at 2026-07-09 13:15:18 on dist-test-slave-g4pn"
I20260709 13:15:18.143121  3034 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38226
I20260709 13:15:18.148998  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:15:18.152997  3247 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:18.154070  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:18.154413  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root
uuid: "48080cf0460346769ab046a4f9457aa5"
format_stamp: "Formatted at 2026-07-09 13:15:18 on dist-test-slave-g4pn"
I20260709 13:15:18.154768  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:18.168104  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:18.169685  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:18.171387  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:18.173928  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:18.174178  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:18.174418  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:18.174592  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:18.224725  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.67:41801
I20260709 13:15:18.224834  3309 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.67:41801 every 8 connection(s)
I20260709 13:15:18.240624  3310 heartbeater.cc:344] Connected to a master server at 127.1.250.126:33381
I20260709 13:15:18.241037  3310 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:18.241940  3310 heartbeater.cc:507] Master 127.1.250.126:33381 requested a full tablet report, sending...
I20260709 13:15:18.244051  3034 ts_manager.cc:194] Registered new tserver with Master: 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:18.245056  2025 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016260199s
I20260709 13:15:18.245792  3034 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38234
I20260709 13:15:18.273168  3034 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38246:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:18.279424  3034 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:18.503204  3198 tablet_service.cc:1511] Processing CreateTablet for tablet da022fb530574c2ba921df0848818f6b (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:18.503504  3201 tablet_service.cc:1511] Processing CreateTablet for tablet faebd952bf73433d84a3292167ecd165 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:18.505215  3198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da022fb530574c2ba921df0848818f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.505976  3200 tablet_service.cc:1511] Processing CreateTablet for tablet d2222d9a550a4cdaa84c7bf97a7ab954 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:18.508292  3199 tablet_service.cc:1511] Processing CreateTablet for tablet c7276ed9ac0542f885cc824522eb9d58 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:18.510552  3197 tablet_service.cc:1511] Processing CreateTablet for tablet f0e8f18d12244c29aac431f7d6786d0b (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:18.510720  3126 tablet_service.cc:1511] Processing CreateTablet for tablet faebd952bf73433d84a3292167ecd165 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:18.510921  3124 tablet_service.cc:1511] Processing CreateTablet for tablet c7276ed9ac0542f885cc824522eb9d58 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:18.512013  3126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faebd952bf73433d84a3292167ecd165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.512296  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2222d9a550a4cdaa84c7bf97a7ab954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.512681  3124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7276ed9ac0542f885cc824522eb9d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.514202  3275 tablet_service.cc:1511] Processing CreateTablet for tablet faebd952bf73433d84a3292167ecd165 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:18.514309  3125 tablet_service.cc:1511] Processing CreateTablet for tablet d2222d9a550a4cdaa84c7bf97a7ab954 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:18.515586  3275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faebd952bf73433d84a3292167ecd165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.515987  3271 tablet_service.cc:1511] Processing CreateTablet for tablet f0e8f18d12244c29aac431f7d6786d0b (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:18.516736  3123 tablet_service.cc:1511] Processing CreateTablet for tablet da022fb530574c2ba921df0848818f6b (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:18.517344  3271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e8f18d12244c29aac431f7d6786d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.517676  3199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7276ed9ac0542f885cc824522eb9d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.519122  3122 tablet_service.cc:1511] Processing CreateTablet for tablet f0e8f18d12244c29aac431f7d6786d0b (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:18.520727  3197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e8f18d12244c29aac431f7d6786d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.521457  3121 tablet_service.cc:1511] Processing CreateTablet for tablet 4d7eb1bec1634d2784b28588ef1161c0 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:18.522301  3272 tablet_service.cc:1511] Processing CreateTablet for tablet da022fb530574c2ba921df0848818f6b (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:18.523641  3272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da022fb530574c2ba921df0848818f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.525786  3201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faebd952bf73433d84a3292167ecd165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.526149  3273 tablet_service.cc:1511] Processing CreateTablet for tablet c7276ed9ac0542f885cc824522eb9d58 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:18.527515  3273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7276ed9ac0542f885cc824522eb9d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.532040  3123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da022fb530574c2ba921df0848818f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.534008  3196 tablet_service.cc:1511] Processing CreateTablet for tablet 4d7eb1bec1634d2784b28588ef1161c0 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:18.532222  3274 tablet_service.cc:1511] Processing CreateTablet for tablet d2222d9a550a4cdaa84c7bf97a7ab954 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:18.535320  3196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7eb1bec1634d2784b28588ef1161c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.536774  3270 tablet_service.cc:1511] Processing CreateTablet for tablet 4d7eb1bec1634d2784b28588ef1161c0 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:18.537673  3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2222d9a550a4cdaa84c7bf97a7ab954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.538486  3120 tablet_service.cc:1511] Processing CreateTablet for tablet 404209c6105f4945b077c33471d63370 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:18.539189  3122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e8f18d12244c29aac431f7d6786d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.540103  3120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404209c6105f4945b077c33471d63370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.540747  3270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7eb1bec1634d2784b28588ef1161c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.541471  3121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7eb1bec1634d2784b28588ef1161c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.543115  3125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2222d9a550a4cdaa84c7bf97a7ab954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.554178  3195 tablet_service.cc:1511] Processing CreateTablet for tablet 404209c6105f4945b077c33471d63370 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:18.555624  3195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404209c6105f4945b077c33471d63370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.557277  3194 tablet_service.cc:1511] Processing CreateTablet for tablet dea47b33000a4a0e9cb380dbe716761d (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:18.558645  3194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea47b33000a4a0e9cb380dbe716761d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.562952  3193 tablet_service.cc:1511] Processing CreateTablet for tablet cd9bf15d386d49f0977913d9628e22af (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:18.564364  3193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9bf15d386d49f0977913d9628e22af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.566470  3269 tablet_service.cc:1511] Processing CreateTablet for tablet 404209c6105f4945b077c33471d63370 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:18.570111  3192 tablet_service.cc:1511] Processing CreateTablet for tablet b7ab044361f54dae84978720aac3998c (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:18.571556  3192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ab044361f54dae84978720aac3998c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.579550  3269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404209c6105f4945b077c33471d63370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.583669  3119 tablet_service.cc:1511] Processing CreateTablet for tablet dea47b33000a4a0e9cb380dbe716761d (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:18.584713  3118 tablet_service.cc:1511] Processing CreateTablet for tablet cd9bf15d386d49f0977913d9628e22af (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:18.587726  3117 tablet_service.cc:1511] Processing CreateTablet for tablet b7ab044361f54dae84978720aac3998c (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:18.584713  3268 tablet_service.cc:1511] Processing CreateTablet for tablet dea47b33000a4a0e9cb380dbe716761d (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:18.590165  3268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea47b33000a4a0e9cb380dbe716761d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.594496  3267 tablet_service.cc:1511] Processing CreateTablet for tablet cd9bf15d386d49f0977913d9628e22af (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:18.596984  3267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9bf15d386d49f0977913d9628e22af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.597674  3266 tablet_service.cc:1511] Processing CreateTablet for tablet b7ab044361f54dae84978720aac3998c (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:18.599027  3266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ab044361f54dae84978720aac3998c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.609882  3119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea47b33000a4a0e9cb380dbe716761d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.613524  3118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9bf15d386d49f0977913d9628e22af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.617518  3117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ab044361f54dae84978720aac3998c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.646291  3123 tablet_service.cc:1511] Processing CreateTablet for tablet f97b7c75c06648e2b8f08f69dcb106af (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:18.647684  3123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97b7c75c06648e2b8f08f69dcb106af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.696205  3272 tablet_service.cc:1511] Processing CreateTablet for tablet 233be522a83f4bea8c48247e49ee33a0 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:18.698356  3270 tablet_service.cc:1511] Processing CreateTablet for tablet 9d10d3c525b541649db9c882a1398789 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:18.696205  3273 tablet_service.cc:1511] Processing CreateTablet for tablet f97b7c75c06648e2b8f08f69dcb106af (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:18.692746  3193 tablet_service.cc:1511] Processing CreateTablet for tablet f97b7c75c06648e2b8f08f69dcb106af (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:18.705157  3126 tablet_service.cc:1511] Processing CreateTablet for tablet 233be522a83f4bea8c48247e49ee33a0 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:18.706153  3270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d10d3c525b541649db9c882a1398789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.706434  3126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233be522a83f4bea8c48247e49ee33a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.706997  3275 tablet_service.cc:1511] Processing CreateTablet for tablet 9e51511dc4ca4db4817c3216d9d1db6e (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:18.708874  3275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e51511dc4ca4db4817c3216d9d1db6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.712289  3325 tablet_bootstrap.cc:492] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:18.722640  3271 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce6e7e8eeb846ab832cf477e2ba0b35 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:18.728050  3117 tablet_service.cc:1511] Processing CreateTablet for tablet 9d10d3c525b541649db9c882a1398789 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:18.729117  3273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97b7c75c06648e2b8f08f69dcb106af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.729422  3193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97b7c75c06648e2b8f08f69dcb106af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.733490  3198 tablet_service.cc:1511] Processing CreateTablet for tablet 233be522a83f4bea8c48247e49ee33a0 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:18.734164  3122 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce6e7e8eeb846ab832cf477e2ba0b35 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:18.728591  3120 tablet_service.cc:1511] Processing CreateTablet for tablet 9e51511dc4ca4db4817c3216d9d1db6e (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:18.737507  3201 tablet_service.cc:1511] Processing CreateTablet for tablet 9d10d3c525b541649db9c882a1398789 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:18.746502  3194 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce6e7e8eeb846ab832cf477e2ba0b35 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:18.747876  3268 tablet_service.cc:1511] Processing CreateTablet for tablet 386629ac4b1c40a2973b2650d0165bc3 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:18.750315  3192 tablet_service.cc:1511] Processing CreateTablet for tablet 386629ac4b1c40a2973b2650d0165bc3 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:18.750675  3124 tablet_service.cc:1511] Processing CreateTablet for tablet 5881853d6b7b4e038027c4a93fdc0b41 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:18.744864  3119 tablet_service.cc:1511] Processing CreateTablet for tablet 386629ac4b1c40a2973b2650d0165bc3 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:18.752008  3326 tablet_bootstrap.cc:492] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:18.755698  3269 tablet_service.cc:1511] Processing CreateTablet for tablet 5881853d6b7b4e038027c4a93fdc0b41 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:18.772600  3198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233be522a83f4bea8c48247e49ee33a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.795531  3267 tablet_service.cc:1511] Processing CreateTablet for tablet c209ebcbec0e4e4ba79f8473c2f4d39b (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:18.777108  3271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce6e7e8eeb846ab832cf477e2ba0b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.797421  3327 tablet_bootstrap.cc:492] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:18.797739  3272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233be522a83f4bea8c48247e49ee33a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.776831  3270 tablet_service.cc:1511] Processing CreateTablet for tablet c85d4a2b8cd74bd69285c748e4453e24 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:18.777650  3122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce6e7e8eeb846ab832cf477e2ba0b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.783054  3126 tablet_service.cc:1511] Processing CreateTablet for tablet 01cb424e009f49c2a8944cc68a07dd66 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:18.799243  3119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386629ac4b1c40a2973b2650d0165bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.787545  3123 tablet_service.cc:1511] Processing CreateTablet for tablet c209ebcbec0e4e4ba79f8473c2f4d39b (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:18.798543  3268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386629ac4b1c40a2973b2650d0165bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.799998  3120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e51511dc4ca4db4817c3216d9d1db6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.801973  3121 tablet_service.cc:1511] Processing CreateTablet for tablet c85d4a2b8cd74bd69285c748e4453e24 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:18.803249  3121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85d4a2b8cd74bd69285c748e4453e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.806121  3274 tablet_service.cc:1511] Processing CreateTablet for tablet 01cb424e009f49c2a8944cc68a07dd66 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:18.807376  3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01cb424e009f49c2a8944cc68a07dd66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.807974  3126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01cb424e009f49c2a8944cc68a07dd66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.812459  3117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d10d3c525b541649db9c882a1398789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.813405  3269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5881853d6b7b4e038027c4a93fdc0b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.817435  3123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c209ebcbec0e4e4ba79f8473c2f4d39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.821465  3270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85d4a2b8cd74bd69285c748e4453e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.809295  3195 tablet_service.cc:1511] Processing CreateTablet for tablet 9e51511dc4ca4db4817c3216d9d1db6e (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:18.824122  3118 tablet_service.cc:1511] Processing CreateTablet for tablet 528677c11f624ca18f75db1e739e29d6 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:18.824604  3192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386629ac4b1c40a2973b2650d0165bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.825625  3194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce6e7e8eeb846ab832cf477e2ba0b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.828212  3125 tablet_service.cc:1511] Processing CreateTablet for tablet bce4572fe1d742f8b02088bc9e1bbbba (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
W20260709 13:15:18.831341  3082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:18.833577  3197 tablet_service.cc:1511] Processing CreateTablet for tablet 5881853d6b7b4e038027c4a93fdc0b41 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:18.835423  3266 tablet_service.cc:1511] Processing CreateTablet for tablet bce4572fe1d742f8b02088bc9e1bbbba (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:18.836683  3266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce4572fe1d742f8b02088bc9e1bbbba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.841554  3267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c209ebcbec0e4e4ba79f8473c2f4d39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.845417  3124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5881853d6b7b4e038027c4a93fdc0b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.852187  3118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528677c11f624ca18f75db1e739e29d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.857630  3125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce4572fe1d742f8b02088bc9e1bbbba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.874873  3198 tablet_service.cc:1511] Processing CreateTablet for tablet c85d4a2b8cd74bd69285c748e4453e24 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:18.876488  3198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85d4a2b8cd74bd69285c748e4453e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.878563  3199 tablet_service.cc:1511] Processing CreateTablet for tablet bce4572fe1d742f8b02088bc9e1bbbba (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:18.880187  3199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce4572fe1d742f8b02088bc9e1bbbba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.885457  3201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d10d3c525b541649db9c882a1398789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.891279  3200 tablet_service.cc:1511] Processing CreateTablet for tablet 01cb424e009f49c2a8944cc68a07dd66 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:18.893711  3122 tablet_service.cc:1511] Processing CreateTablet for tablet 56db43db40f644309c6db08523b1b033 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:18.895008  3122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56db43db40f644309c6db08523b1b033. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.893724  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01cb424e009f49c2a8944cc68a07dd66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.897764  3197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5881853d6b7b4e038027c4a93fdc0b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.897595  3196 tablet_service.cc:1511] Processing CreateTablet for tablet c209ebcbec0e4e4ba79f8473c2f4d39b (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:18.899959  3325 tablet_bootstrap.cc:654] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.906168  3327 tablet_bootstrap.cc:654] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.909581  3326 tablet_bootstrap.cc:654] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.933450  3275 tablet_service.cc:1511] Processing CreateTablet for tablet 528677c11f624ca18f75db1e739e29d6 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:18.934803  3275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528677c11f624ca18f75db1e739e29d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.941547  3117 tablet_service.cc:1511] Processing CreateTablet for tablet a455058d628f40fc9d810a0d764560dd (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:18.949273  3193 tablet_service.cc:1511] Processing CreateTablet for tablet 528677c11f624ca18f75db1e739e29d6 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:18.948711  3126 tablet_service.cc:1511] Processing CreateTablet for tablet 8ed81e18346d4bb3a9f0b77ae5ca8477 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:18.950634  3193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528677c11f624ca18f75db1e739e29d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.951890  3271 tablet_service.cc:1511] Processing CreateTablet for tablet 56db43db40f644309c6db08523b1b033 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:18.953277  3271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56db43db40f644309c6db08523b1b033. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.943197  3117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a455058d628f40fc9d810a0d764560dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.967300  3195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e51511dc4ca4db4817c3216d9d1db6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.979627  3327 tablet_bootstrap.cc:492] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:18.980252  3327 ts_tablet_manager.cc:1403] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.183s	user 0.015s	sys 0.000s
I20260709 13:15:18.983397  3327 raft_consensus.cc:359] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:18.993952  3327 raft_consensus.cc:385] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.989271  3126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ed81e18346d4bb3a9f0b77ae5ca8477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.994269  3272 tablet_service.cc:1511] Processing CreateTablet for tablet a455058d628f40fc9d810a0d764560dd (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:19.004805  3120 tablet_service.cc:1511] Processing CreateTablet for tablet 772d700b048349bf9547efac6befb60d (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:19.009519  3268 tablet_service.cc:1511] Processing CreateTablet for tablet 8ed81e18346d4bb3a9f0b77ae5ca8477 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:19.016736  3119 tablet_service.cc:1511] Processing CreateTablet for tablet ea9019901d1a42beb5690a4096277f3e (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:19.016577  3325 tablet_bootstrap.cc:492] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:19.019937  3196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c209ebcbec0e4e4ba79f8473c2f4d39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.019743  3192 tablet_service.cc:1511] Processing CreateTablet for tablet 56db43db40f644309c6db08523b1b033 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:19.021306  3325 ts_tablet_manager.cc:1403] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.309s	user 0.008s	sys 0.017s
I20260709 13:15:19.019781  3200 tablet_service.cc:1511] Processing CreateTablet for tablet a455058d628f40fc9d810a0d764560dd (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:19.026600  3192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56db43db40f644309c6db08523b1b033. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.023831  3122 tablet_service.cc:1511] Processing CreateTablet for tablet 812e4fbcaef1473b9c0467dcbbfca8a3 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:18.995504  3327 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.033991  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a455058d628f40fc9d810a0d764560dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.033915  3327 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.040588  3161 heartbeater.cc:499] Master 127.1.250.126:33381 was elected leader, sending a full tablet report...
I20260709 13:15:19.046419  3194 tablet_service.cc:1511] Processing CreateTablet for tablet 8ed81e18346d4bb3a9f0b77ae5ca8477 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:19.050401  3123 tablet_service.cc:1511] Processing CreateTablet for tablet c414d51e428042c596cb410c48956c63 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:19.051348  3272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a455058d628f40fc9d810a0d764560dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.054692  3326 tablet_bootstrap.cc:492] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:19.055224  3326 ts_tablet_manager.cc:1403] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.304s	user 0.011s	sys 0.018s
I20260709 13:15:19.057116  3268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ed81e18346d4bb3a9f0b77ae5ca8477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.054682  3325 raft_consensus.cc:359] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.057811  3325 raft_consensus.cc:385] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.058216  3325 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.059096  3122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812e4fbcaef1473b9c0467dcbbfca8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.059355  3325 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.063150  3198 tablet_service.cc:1511] Processing CreateTablet for tablet 772d700b048349bf9547efac6befb60d (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:19.050446  3270 tablet_service.cc:1511] Processing CreateTablet for tablet 772d700b048349bf9547efac6befb60d (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:19.064829  3198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772d700b048349bf9547efac6befb60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.066568  3270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772d700b048349bf9547efac6befb60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.066941  3273 tablet_service.cc:1511] Processing CreateTablet for tablet ea9019901d1a42beb5690a4096277f3e (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:19.069192  3199 tablet_service.cc:1511] Processing CreateTablet for tablet ea9019901d1a42beb5690a4096277f3e (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:19.074383  3192 tablet_service.cc:1511] Processing CreateTablet for tablet 812e4fbcaef1473b9c0467dcbbfca8a3 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:19.078440  3201 tablet_service.cc:1511] Processing CreateTablet for tablet c414d51e428042c596cb410c48956c63 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:19.082882  3269 tablet_service.cc:1511] Processing CreateTablet for tablet 812e4fbcaef1473b9c0467dcbbfca8a3 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:19.102308  3326 raft_consensus.cc:359] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.103084  3326 raft_consensus.cc:385] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.103374  3326 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.104952  3327 ts_tablet_manager.cc:1434] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.124s	user 0.020s	sys 0.005s
I20260709 13:15:19.106029  3120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772d700b048349bf9547efac6befb60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.106382  3124 tablet_service.cc:1511] Processing CreateTablet for tablet c258b23309c4453b850ba59d3011c806 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:19.107882  3199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea9019901d1a42beb5690a4096277f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.111553  3326 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.113487  3119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea9019901d1a42beb5690a4096277f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.115172  3194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ed81e18346d4bb3a9f0b77ae5ca8477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.118249  3123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c414d51e428042c596cb410c48956c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.123888  3197 tablet_service.cc:1511] Processing CreateTablet for tablet c258b23309c4453b850ba59d3011c806 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:19.125717  3273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea9019901d1a42beb5690a4096277f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.131075  3201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c414d51e428042c596cb410c48956c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.148733  3236 heartbeater.cc:499] Master 127.1.250.126:33381 was elected leader, sending a full tablet report...
I20260709 13:15:19.154749  3325 ts_tablet_manager.cc:1434] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.132s	user 0.024s	sys 0.033s
I20260709 13:15:19.158939  3310 heartbeater.cc:499] Master 127.1.250.126:33381 was elected leader, sending a full tablet report...
I20260709 13:15:19.159123  3269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812e4fbcaef1473b9c0467dcbbfca8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.159267  3325 tablet_bootstrap.cc:492] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:19.164268  3266 tablet_service.cc:1511] Processing CreateTablet for tablet c258b23309c4453b850ba59d3011c806 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:19.167137  3125 tablet_service.cc:1511] Processing CreateTablet for tablet de07cb03de034f1bae53ef08d27db7a7 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:19.167074  3195 tablet_service.cc:1511] Processing CreateTablet for tablet de07cb03de034f1bae53ef08d27db7a7 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:19.168874  3124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c258b23309c4453b850ba59d3011c806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.171649  3331 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.197880  3325 tablet_bootstrap.cc:654] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.201179  3267 tablet_service.cc:1511] Processing CreateTablet for tablet c414d51e428042c596cb410c48956c63 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:19.203006  3118 tablet_service.cc:1511] Processing CreateTablet for tablet 23d682925c4b46799576472fe9f97a07 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:19.204483  3326 ts_tablet_manager.cc:1434] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.149s	user 0.009s	sys 0.001s
I20260709 13:15:19.205534  3331 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.209323  3327 tablet_bootstrap.cc:492] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:19.209975  3197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c258b23309c4453b850ba59d3011c806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.209059  3331 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:19.226096  3125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de07cb03de034f1bae53ef08d27db7a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.255347  3194 tablet_service.cc:1511] Processing CreateTablet for tablet 114dd3d94ac84ebb8bff7ff66e92d269 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:19.238322  3199 tablet_service.cc:1511] Processing CreateTablet for tablet 23d682925c4b46799576472fe9f97a07 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:19.258358  3266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c258b23309c4453b850ba59d3011c806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.258481  3118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d682925c4b46799576472fe9f97a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.239308  3192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812e4fbcaef1473b9c0467dcbbfca8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.265443  3199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d682925c4b46799576472fe9f97a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.266396  3195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de07cb03de034f1bae53ef08d27db7a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.242182  3117 tablet_service.cc:1511] Processing CreateTablet for tablet 874b2f5f161c46be919ed69ca338da41 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:19.242092  3196 tablet_service.cc:1511] Processing CreateTablet for tablet 874b2f5f161c46be919ed69ca338da41 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:19.243983  3327 tablet_bootstrap.cc:654] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.245566  3126 tablet_service.cc:1511] Processing CreateTablet for tablet 114dd3d94ac84ebb8bff7ff66e92d269 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:19.247571  3121 tablet_service.cc:1511] Processing CreateTablet for tablet 4861cf36e0334e60863d0921b834dd0b (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:19.252040  3123 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1a4d71ef0f4287999b5ee60fe02740 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:19.278621  3270 tablet_service.cc:1511] Processing CreateTablet for tablet de07cb03de034f1bae53ef08d27db7a7 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:19.280450  3270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de07cb03de034f1bae53ef08d27db7a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.283079  3268 tablet_service.cc:1511] Processing CreateTablet for tablet 23d682925c4b46799576472fe9f97a07 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:19.248035  3119 tablet_service.cc:1511] Processing CreateTablet for tablet 37a53418fbf14b998493923afc272c3c (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:19.252113  3326 tablet_bootstrap.cc:492] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:19.284934  3268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d682925c4b46799576472fe9f97a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.291141  3123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1a4d71ef0f4287999b5ee60fe02740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.292169  3275 tablet_service.cc:1511] Processing CreateTablet for tablet 874b2f5f161c46be919ed69ca338da41 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:19.292706  3194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114dd3d94ac84ebb8bff7ff66e92d269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.301980  3274 tablet_service.cc:1511] Processing CreateTablet for tablet 114dd3d94ac84ebb8bff7ff66e92d269 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:19.303714  3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114dd3d94ac84ebb8bff7ff66e92d269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.310230  3267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c414d51e428042c596cb410c48956c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.310585  3117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 874b2f5f161c46be919ed69ca338da41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.315205  3269 tablet_service.cc:1511] Processing CreateTablet for tablet 4861cf36e0334e60863d0921b834dd0b (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:19.316560  3269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4861cf36e0334e60863d0921b834dd0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.321532  3119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a53418fbf14b998493923afc272c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.321444  3275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 874b2f5f161c46be919ed69ca338da41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.325647  3126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114dd3d94ac84ebb8bff7ff66e92d269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.326282  3121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4861cf36e0334e60863d0921b834dd0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.326439  3122 tablet_service.cc:1511] Processing CreateTablet for tablet 30f88ddc17f44a3084db05c84e5e6a81 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:19.327914  3122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f88ddc17f44a3084db05c84e5e6a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.332590  3196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 874b2f5f161c46be919ed69ca338da41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.326453  3272 tablet_service.cc:1511] Processing CreateTablet for tablet 37a53418fbf14b998493923afc272c3c (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:19.338531  3193 tablet_service.cc:1511] Processing CreateTablet for tablet 37a53418fbf14b998493923afc272c3c (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:19.339110  3272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a53418fbf14b998493923afc272c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.339752  3193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a53418fbf14b998493923afc272c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.357146  3325 tablet_bootstrap.cc:492] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:19.357779  3325 ts_tablet_manager.cc:1403] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.199s	user 0.013s	sys 0.004s
I20260709 13:15:19.361788  3200 tablet_service.cc:1511] Processing CreateTablet for tablet 4861cf36e0334e60863d0921b834dd0b (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:19.363122  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4861cf36e0334e60863d0921b834dd0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.366566  3273 tablet_service.cc:1511] Processing CreateTablet for tablet 30f88ddc17f44a3084db05c84e5e6a81 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:19.367964  3273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f88ddc17f44a3084db05c84e5e6a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.369100  3333 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.369568  3333 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.371527  3120 tablet_service.cc:1511] Processing CreateTablet for tablet 94bb18481fd64fec92315ec868c651f4 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:19.372864  3120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bb18481fd64fec92315ec868c651f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.374140  3197 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1a4d71ef0f4287999b5ee60fe02740 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:19.375533  3197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1a4d71ef0f4287999b5ee60fe02740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.378942  3198 tablet_service.cc:1511] Processing CreateTablet for tablet 30f88ddc17f44a3084db05c84e5e6a81 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:19.380329  3198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f88ddc17f44a3084db05c84e5e6a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.381609  3326 tablet_bootstrap.cc:654] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.388811  3271 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1a4d71ef0f4287999b5ee60fe02740 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:19.390213  3271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1a4d71ef0f4287999b5ee60fe02740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.395648  3333 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:19.406474  3332 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.407048  3332 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.376436  3325 raft_consensus.cc:359] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.423010  3117 tablet_service.cc:1511] Processing CreateTablet for tablet b4f37f97e44445a8978d2cde7a9c9c58 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:19.428993  3117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f37f97e44445a8978d2cde7a9c9c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.427206  3325 raft_consensus.cc:385] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.441439  3325 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.442291  3325 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.473672  3124 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae5c762a7f347f4a2de941d47ed1903 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:19.475137  3124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae5c762a7f347f4a2de941d47ed1903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.477566  3325 ts_tablet_manager.cc:1434] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.119s	user 0.011s	sys 0.003s
I20260709 13:15:19.478859  3332 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:19.533510  3201 tablet_service.cc:1511] Processing CreateTablet for tablet 94bb18481fd64fec92315ec868c651f4 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:19.532577  3325 tablet_bootstrap.cc:492] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:19.548350  3268 tablet_service.cc:1511] Processing CreateTablet for tablet 94bb18481fd64fec92315ec868c651f4 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:19.559805  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:19.568852  3125 tablet_service.cc:1511] Processing CreateTablet for tablet 2e805018f85b41fc88644215be011084 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:19.570487  3125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e805018f85b41fc88644215be011084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.579471  3267 tablet_service.cc:1511] Processing CreateTablet for tablet b4f37f97e44445a8978d2cde7a9c9c58 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 13:15:19.594949  3176 leader_election.cc:343] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.603755  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:19.603832  3201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bb18481fd64fec92315ec868c651f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.605535  3192 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae5c762a7f347f4a2de941d47ed1903 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:19.606949  3192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae5c762a7f347f4a2de941d47ed1903. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:19.613969  3100 leader_election.cc:343] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.624660  3274 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae5c762a7f347f4a2de941d47ed1903 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:19.649031  3118 tablet_service.cc:1511] Processing CreateTablet for tablet 2fe9b83583444570807fd6aa3bcc925d (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:19.650450  3118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe9b83583444570807fd6aa3bcc925d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.654384  3123 tablet_service.cc:1511] Processing CreateTablet for tablet ccc7fa450cf74c28bef080a5f5dc8fa8 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:19.654384  3266 tablet_service.cc:1511] Processing CreateTablet for tablet ccc7fa450cf74c28bef080a5f5dc8fa8 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:19.656087  3123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc7fa450cf74c28bef080a5f5dc8fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.663146  3195 tablet_service.cc:1511] Processing CreateTablet for tablet 2e805018f85b41fc88644215be011084 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:19.664451  3344 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.664738  3195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e805018f85b41fc88644215be011084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.665000  3344 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.666425  3270 tablet_service.cc:1511] Processing CreateTablet for tablet 2e805018f85b41fc88644215be011084 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:19.667604  3344 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:19.668320  3199 tablet_service.cc:1511] Processing CreateTablet for tablet b4f37f97e44445a8978d2cde7a9c9c58 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:19.671506  3269 tablet_service.cc:1511] Processing CreateTablet for tablet 2fe9b83583444570807fd6aa3bcc925d (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:19.678509  3199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f37f97e44445a8978d2cde7a9c9c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.678926  3268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bb18481fd64fec92315ec868c651f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.696180  3266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc7fa450cf74c28bef080a5f5dc8fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.703094  3327 tablet_bootstrap.cc:492] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:19.703725  3327 ts_tablet_manager.cc:1403] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.525s	user 0.021s	sys 0.034s
I20260709 13:15:19.706811  3327 raft_consensus.cc:359] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.719115  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:19.719872  3285 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:19.724385  3126 tablet_service.cc:1511] Processing CreateTablet for tablet 3af680172a5440a2bfa7e8a99ea9c1fc (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:19.725911  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:19.716426  3327 raft_consensus.cc:385] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.717113  3267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f37f97e44445a8978d2cde7a9c9c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.726214  3268 tablet_service.cc:1511] Processing CreateTablet for tablet 3af680172a5440a2bfa7e8a99ea9c1fc (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:19.728960  3136 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:19.729514  3268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af680172a5440a2bfa7e8a99ea9c1fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.730348  3270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e805018f85b41fc88644215be011084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.734323  3273 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9a3cde8b784484802f97dd03f5d338 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:19.737371  3250 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:19.738317  3344 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:19.738693  3344 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.739033  3344 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.739063  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:19.740123  3333 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:19.740486  3333 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.740823  3333 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.745205  3194 tablet_service.cc:1511] Processing CreateTablet for tablet ccc7fa450cf74c28bef080a5f5dc8fa8 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:19.746560  3194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc7fa450cf74c28bef080a5f5dc8fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.726344  3326 tablet_bootstrap.cc:492] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:19.749812  3269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe9b83583444570807fd6aa3bcc925d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.728067  3327 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.762005  3326 ts_tablet_manager.cc:1403] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.509s	user 0.015s	sys 0.030s
I20260709 13:15:19.778057  3119 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9a3cde8b784484802f97dd03f5d338 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:19.780871  3125 tablet_service.cc:1511] Processing CreateTablet for tablet c7177cc3a5e547a3b1bef3c6c3c3a368 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:19.783893  3326 raft_consensus.cc:359] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.784688  3326 raft_consensus.cc:385] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.787804  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:19.794219  3200 tablet_service.cc:1511] Processing CreateTablet for tablet 2fe9b83583444570807fd6aa3bcc925d (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:19.795159  3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae5c762a7f347f4a2de941d47ed1903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.795619  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe9b83583444570807fd6aa3bcc925d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.799304  3273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9a3cde8b784484802f97dd03f5d338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.758675  3333 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:19.806237  3250 leader_election.cc:343] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.809988  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:19.811582  3176 leader_election.cc:343] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.812070  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:19.816576  3333 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:19.817942  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:15:19.819789  3100 leader_election.cc:343] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.820900  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:19.803313  3126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af680172a5440a2bfa7e8a99ea9c1fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.825519  3125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7177cc3a5e547a3b1bef3c6c3c3a368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.828042  3325 tablet_bootstrap.cc:654] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.830405  3119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9a3cde8b784484802f97dd03f5d338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.801380  3327 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.832635  3195 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9a3cde8b784484802f97dd03f5d338 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:19.834404  3195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9a3cde8b784484802f97dd03f5d338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.784996  3326 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.836071  3192 tablet_service.cc:1511] Processing CreateTablet for tablet 3af680172a5440a2bfa7e8a99ea9c1fc (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:19.836849  3326 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.838624  3192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af680172a5440a2bfa7e8a99ea9c1fc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:19.857069  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45526.5us
W20260709 13:15:19.861876  3082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:19.860188  3326 ts_tablet_manager.cc:1434] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.000s
I20260709 13:15:19.868891  3351 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:19.869889  3326 tablet_bootstrap.cc:492] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:19.870206  3198 tablet_service.cc:1511] Processing CreateTablet for tablet 2d7a98c6990948fab7c20936964c4d3e (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:19.877424  3325 tablet_bootstrap.cc:492] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:19.878165  3325 ts_tablet_manager.cc:1403] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.367s	user 0.010s	sys 0.006s
I20260709 13:15:19.879246  3198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d7a98c6990948fab7c20936964c4d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.890434  3271 tablet_service.cc:1511] Processing CreateTablet for tablet 2d7a98c6990948fab7c20936964c4d3e (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:19.891937  3271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d7a98c6990948fab7c20936964c4d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.892215  3117 tablet_service.cc:1511] Processing CreateTablet for tablet 2d7a98c6990948fab7c20936964c4d3e (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:19.893569  3117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d7a98c6990948fab7c20936964c4d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.898429  3200 tablet_service.cc:1511] Processing CreateTablet for tablet c7177cc3a5e547a3b1bef3c6c3c3a368 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:19.899919  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7177cc3a5e547a3b1bef3c6c3c3a368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.902624  3123 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4a8a614fca4531aab11f5963396f62 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:19.903954  3123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4a8a614fca4531aab11f5963396f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.905364  3333 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.905581  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:19.905921  3333 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.908243  3333 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:19.909708  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:19.910051  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:19.911504  3101 leader_election.cc:343] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:19.912104  3100 leader_election.cc:343] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.912597  3100 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:19.914774  3333 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:19.908023  3270 tablet_service.cc:1511] Processing CreateTablet for tablet c7177cc3a5e547a3b1bef3c6c3c3a368 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:19.915774  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:19.917260  3249 leader_election.cc:343] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:19.918573  3249 leader_election.cc:343] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.918984  3249 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:19.920133  3332 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:19.924275  3327 ts_tablet_manager.cc:1434] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.220s	user 0.012s	sys 0.002s
I20260709 13:15:19.921237  3344 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.926652  3285 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 1: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:19.929934  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:19.931156  3333 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:19.933431  3199 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4a8a614fca4531aab11f5963396f62 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:19.934170  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:19.934893  3199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4a8a614fca4531aab11f5963396f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.935034  3136 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:19.936733  3344 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:19.937345  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:15:19.938860  3249 leader_election.cc:343] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.939317  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:19.940474  3344 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:19.949659  3327 tablet_bootstrap.cc:492] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
W20260709 13:15:19.949009  3020 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 57891.5us
I20260709 13:15:19.951555  3326 tablet_bootstrap.cc:654] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.957262  3325 raft_consensus.cc:359] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.958128  3325 raft_consensus.cc:385] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.958475  3325 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.961148  3197 tablet_service.cc:1511] Processing CreateTablet for tablet 432d705ff69845aaac398233202f4081 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:19.962857  3197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432d705ff69845aaac398233202f4081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.970819  3325 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:19.921497  3270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7177cc3a5e547a3b1bef3c6c3c3a368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.972817  3327 tablet_bootstrap.cc:654] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.973743  3125 tablet_service.cc:1511] Processing CreateTablet for tablet 432d705ff69845aaac398233202f4081 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:19.976147  3274 tablet_service.cc:1511] Processing CreateTablet for tablet 432d705ff69845aaac398233202f4081 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:19.979020  3194 tablet_service.cc:1511] Processing CreateTablet for tablet 66614160a1bf4bb49ea02007f6679b0f (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:19.995477  3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432d705ff69845aaac398233202f4081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.985935  3266 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4a8a614fca4531aab11f5963396f62 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:19.990816  3192 tablet_service.cc:1511] Processing CreateTablet for tablet d4df8838ab784efd9cfa105ba373b14c (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:19.982383  3117 tablet_service.cc:1511] Processing CreateTablet for tablet 66614160a1bf4bb49ea02007f6679b0f (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:19.996037  3194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66614160a1bf4bb49ea02007f6679b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.997761  3325 ts_tablet_manager.cc:1434] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.003s
I20260709 13:15:19.998358  3267 tablet_service.cc:1511] Processing CreateTablet for tablet 66614160a1bf4bb49ea02007f6679b0f (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:20.000198  3125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432d705ff69845aaac398233202f4081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.001857  3117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66614160a1bf4bb49ea02007f6679b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.006170  3267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66614160a1bf4bb49ea02007f6679b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.007239  3192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4df8838ab784efd9cfa105ba373b14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.008270  3325 tablet_bootstrap.cc:492] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:20.011941  3119 tablet_service.cc:1511] Processing CreateTablet for tablet d4df8838ab784efd9cfa105ba373b14c (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:20.015179  3271 tablet_service.cc:1511] Processing CreateTablet for tablet d4df8838ab784efd9cfa105ba373b14c (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:20.016791  3271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4df8838ab784efd9cfa105ba373b14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.026144  3266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4a8a614fca4531aab11f5963396f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.027190  3126 tablet_service.cc:1511] Processing CreateTablet for tablet 7b205eb6f14c40c88b346e392de18687 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:20.028582  3126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b205eb6f14c40c88b346e392de18687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.028874  3198 tablet_service.cc:1511] Processing CreateTablet for tablet 7b205eb6f14c40c88b346e392de18687 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:20.031649  3119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4df8838ab784efd9cfa105ba373b14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.032406  3268 tablet_service.cc:1511] Processing CreateTablet for tablet 7b205eb6f14c40c88b346e392de18687 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:20.035137  3268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b205eb6f14c40c88b346e392de18687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.037593  3195 tablet_service.cc:1511] Processing CreateTablet for tablet 5f5212495b02454ba6ddf4c62cf58b04 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:20.039393  3195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5212495b02454ba6ddf4c62cf58b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.049821  3198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b205eb6f14c40c88b346e392de18687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.059152  3193 tablet_service.cc:1511] Processing CreateTablet for tablet a6ed1a03592e491cbb924069df406f18 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:20.060497  3193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ed1a03592e491cbb924069df406f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.079802  3352 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.080358  3352 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.082938  3352 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.084100  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:20.085774  3176 leader_election.cc:343] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.090195  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:20.090579  3123 tablet_service.cc:1511] Processing CreateTablet for tablet 5f5212495b02454ba6ddf4c62cf58b04 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:20.094435  3123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5212495b02454ba6ddf4c62cf58b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.096614  3194 tablet_service.cc:1511] Processing CreateTablet for tablet ce9155778cd542acbbc8b00bd8b7316c (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 13:15:20.098490  3176 leader_election.cc:343] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.098975  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:20.099944  3327 tablet_bootstrap.cc:492] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:20.100458  3327 ts_tablet_manager.cc:1403] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.151s	user 0.012s	sys 0.009s
I20260709 13:15:20.101763  3121 tablet_service.cc:1511] Processing CreateTablet for tablet ce9155778cd542acbbc8b00bd8b7316c (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:20.106776  3121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9155778cd542acbbc8b00bd8b7316c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.105376  3352 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:20.114109  3199 tablet_service.cc:1511] Processing CreateTablet for tablet aded29f2cce84c3c8e2a5337dce77bde (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:20.114954  3326 tablet_bootstrap.cc:492] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:20.115437  3326 ts_tablet_manager.cc:1403] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.246s	user 0.029s	sys 0.035s
I20260709 13:15:20.118708  3269 tablet_service.cc:1511] Processing CreateTablet for tablet 5f5212495b02454ba6ddf4c62cf58b04 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:20.119298  3200 tablet_service.cc:1511] Processing CreateTablet for tablet 104b1eb7d49f449095e30c69e8680096 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:20.120767  3194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9155778cd542acbbc8b00bd8b7316c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.121861  3117 tablet_service.cc:1511] Processing CreateTablet for tablet a6ed1a03592e491cbb924069df406f18 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:20.118270  3327 raft_consensus.cc:359] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.131100  3199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aded29f2cce84c3c8e2a5337dce77bde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.134240  3325 tablet_bootstrap.cc:654] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.136217  3117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ed1a03592e491cbb924069df406f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.137346  3269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5212495b02454ba6ddf4c62cf58b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.136996  3267 tablet_service.cc:1511] Processing CreateTablet for tablet 104b1eb7d49f449095e30c69e8680096 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:20.137629  3120 tablet_service.cc:1511] Processing CreateTablet for tablet 104b1eb7d49f449095e30c69e8680096 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:20.138324  3267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104b1eb7d49f449095e30c69e8680096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.138837  3120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104b1eb7d49f449095e30c69e8680096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.138581  3271 tablet_service.cc:1511] Processing CreateTablet for tablet a6ed1a03592e491cbb924069df406f18 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:20.139787  3271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ed1a03592e491cbb924069df406f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.146255  3125 tablet_service.cc:1511] Processing CreateTablet for tablet aded29f2cce84c3c8e2a5337dce77bde (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:20.147658  3125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aded29f2cce84c3c8e2a5337dce77bde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.129242  3327 raft_consensus.cc:385] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.153623  3327 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.154426  3327 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.156637  3327 ts_tablet_manager.cc:1434] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:15:20.157505  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104b1eb7d49f449095e30c69e8680096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.158141  3270 tablet_service.cc:1511] Processing CreateTablet for tablet aded29f2cce84c3c8e2a5337dce77bde (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:20.159457  3270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aded29f2cce84c3c8e2a5337dce77bde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.164785  3274 tablet_service.cc:1511] Processing CreateTablet for tablet ce9155778cd542acbbc8b00bd8b7316c (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:20.166306  3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9155778cd542acbbc8b00bd8b7316c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.148011  3326 raft_consensus.cc:359] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.177336  3192 tablet_service.cc:1511] Processing CreateTablet for tablet 023c1461b69c46bdb3c42ee16f303ea2 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:20.184907  3325 tablet_bootstrap.cc:492] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:20.185477  3325 ts_tablet_manager.cc:1403] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.177s	user 0.015s	sys 0.000s
I20260709 13:15:20.186388  3192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023c1461b69c46bdb3c42ee16f303ea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.177361  3326 raft_consensus.cc:385] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.188439  3326 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.189795  3327 tablet_bootstrap.cc:492] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:20.190551  3270 tablet_service.cc:1511] Processing CreateTablet for tablet 023c1461b69c46bdb3c42ee16f303ea2 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:20.190641  3326 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.191689  3270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023c1461b69c46bdb3c42ee16f303ea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.192906  3326 ts_tablet_manager.cc:1434] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.000s
I20260709 13:15:20.195667  3326 tablet_bootstrap.cc:492] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:20.207247  3325 raft_consensus.cc:359] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.207858  3325 raft_consensus.cc:385] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.208107  3325 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.208443  3333 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.208945  3333 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.211097  3333 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.212707  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:20.213900  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:20.214507  3211 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:20.217700  3326 tablet_bootstrap.cc:654] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.218677  3100 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:20.220134  3117 tablet_service.cc:1511] Processing CreateTablet for tablet 023c1461b69c46bdb3c42ee16f303ea2 (DEFAULT_TABLE table=test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:20.221060  3117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023c1461b69c46bdb3c42ee16f303ea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.219691  3333 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.222536  3333 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.222854  3333 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.225899  3327 tablet_bootstrap.cc:654] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:20.226792  3101 leader_election.cc:343] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.208784  3325 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.237282  3333 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.241387  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:20.242151  3211 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.246503  3333 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.247431  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:15:20.248950  3101 leader_election.cc:343] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.256194  3211 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:20.257813  3100 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:20.259114  3325 ts_tablet_manager.cc:1434] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 13:15:20.259333  3333 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.260210  3325 tablet_bootstrap.cc:492] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:20.266122  3333 raft_consensus.cc:697] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:20.266762  3325 tablet_bootstrap.cc:654] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.267930  3326 tablet_bootstrap.cc:492] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:20.268566  3326 ts_tablet_manager.cc:1403] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.008s
I20260709 13:15:20.267400  3333 consensus_queue.cc:237] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.271637  3326 raft_consensus.cc:359] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.272648  3326 raft_consensus.cc:385] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.273023  3326 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.273312  3327 tablet_bootstrap.cc:492] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:20.273820  3327 ts_tablet_manager.cc:1403] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.006s
I20260709 13:15:20.274106  3326 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.276062  3326 ts_tablet_manager.cc:1434] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:20.276430  3325 tablet_bootstrap.cc:492] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:20.277539  3326 tablet_bootstrap.cc:492] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:20.276919  3325 ts_tablet_manager.cc:1403] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.003s
I20260709 13:15:20.279276  3327 raft_consensus.cc:359] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.280007  3327 raft_consensus.cc:385] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.280288  3327 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.281335  3325 raft_consensus.cc:359] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.281204  3327 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.281070  3030 catalog_manager.cc:5697] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.282053  3325 raft_consensus.cc:385] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.284049  3327 ts_tablet_manager.cc:1434] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:20.282527  3325 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.285360  3326 tablet_bootstrap.cc:654] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.286005  3325 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.288370  3325 ts_tablet_manager.cc:1434] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:20.292655  3325 tablet_bootstrap.cc:492] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:20.293731  3327 tablet_bootstrap.cc:492] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:20.299446  3325 tablet_bootstrap.cc:654] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.303222  3327 tablet_bootstrap.cc:654] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.307185  3344 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.307709  3344 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.308880  3326 tablet_bootstrap.cc:492] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:20.309612  3326 ts_tablet_manager.cc:1403] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.013s
I20260709 13:15:20.311460  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:20.311758  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:20.312438  3211 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:20.312402  3326 raft_consensus.cc:359] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.313321  3344 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:20.313438  3326 raft_consensus.cc:385] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.313949  3326 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.313840  3249 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:20.314706  3344 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.314823  3326 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.316665  3326 ts_tablet_manager.cc:1434] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:15:20.317811  3326 tablet_bootstrap.cc:492] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:20.323026  3344 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:20.326215  3327 tablet_bootstrap.cc:492] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:20.326722  3327 ts_tablet_manager.cc:1403] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.005s
I20260709 13:15:20.326774  3326 tablet_bootstrap.cc:654] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.336614  3327 raft_consensus.cc:359] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.337397  3327 raft_consensus.cc:385] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.337692  3327 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.338717  3327 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.341161  3327 ts_tablet_manager.cc:1434] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:15:20.342103  3325 tablet_bootstrap.cc:492] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:20.342414  3327 tablet_bootstrap.cc:492] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:20.342837  3325 ts_tablet_manager.cc:1403] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.020s
I20260709 13:15:20.345055  3326 tablet_bootstrap.cc:492] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:20.345590  3326 ts_tablet_manager.cc:1403] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.020s
I20260709 13:15:20.346308  3325 raft_consensus.cc:359] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.347424  3325 raft_consensus.cc:385] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.347810  3325 raft_consensus.cc:740] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.348567  3326 raft_consensus.cc:359] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.348767  3325 consensus_queue.cc:260] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.349467  3326 raft_consensus.cc:385] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.349390  3327 tablet_bootstrap.cc:654] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.349881  3326 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.350610  3326 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.352855  3326 ts_tablet_manager.cc:1434] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:15:20.353856  3326 tablet_bootstrap.cc:492] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:20.356158  3325 ts_tablet_manager.cc:1434] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:15:20.357396  3325 tablet_bootstrap.cc:492] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:20.363526  3326 tablet_bootstrap.cc:654] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.364143  3325 tablet_bootstrap.cc:654] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.368294  3333 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.369057  3333 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.374284  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:20.374609  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:20.375218  3211 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:20.377048  3100 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:20.378288  3359 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.378782  3359 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.379196  3359 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.379735  3333 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:15:20.383020  3101 leader_election.cc:343] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.385739  3352 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.386317  3352 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.388625  3344 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.388736  3352 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.389267  3344 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.391111  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:20.391511  3344 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:20.391808  3285 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:20.392156  3325 tablet_bootstrap.cc:492] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:20.392685  3325 ts_tablet_manager.cc:1403] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.010s
I20260709 13:15:20.393450  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:20.393399  3359 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.394209  3136 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:20.395416  3327 tablet_bootstrap.cc:492] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:20.395180  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:20.395798  3359 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.395970  3327 ts_tablet_manager.cc:1403] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.009s
I20260709 13:15:20.396559  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:20.396982  3210 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.397662  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:20.398286  3211 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:20.399082  3327 raft_consensus.cc:359] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.399562  3249 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:20.399812  3327 raft_consensus.cc:385] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.400198  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:20.401706  3344 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.402081  3344 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.402426  3344 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.402597  3326 tablet_bootstrap.cc:492] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:20.403187  3326 ts_tablet_manager.cc:1403] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.010s
I20260709 13:15:20.403416  3325 raft_consensus.cc:359] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.404219  3325 raft_consensus.cc:385] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.404518  3325 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.404832  3210 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:20.400158  3327 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.405301  3325 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.399092  3352 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.406487  3100 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:20.406760  3352 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.407321  3352 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.407698  3359 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.407902  3325 ts_tablet_manager.cc:1434] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:15:20.408439  3359 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:20.409508  3359 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.410270  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:20.410095  3326 raft_consensus.cc:359] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.410969  3325 tablet_bootstrap.cc:492] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
W20260709 13:15:20.411414  3101 leader_election.cc:343] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.418133  3333 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.418669  3333 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.420972  3333 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.421783  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:20.422469  3325 tablet_bootstrap.cc:654] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.422600  3344 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:20.423216  3100 leader_election.cc:343] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.410980  3326 raft_consensus.cc:385] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.425820  3326 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.426350  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:20.427351  3326 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.410997  3136 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:20.431068  3326 ts_tablet_manager.cc:1434] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
W20260709 13:15:20.431767  3101 leader_election.cc:343] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.432466  3326 tablet_bootstrap.cc:492] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:20.432416  3101 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:20.439095  3325 tablet_bootstrap.cc:492] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:20.439533  3325 ts_tablet_manager.cc:1403] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.008s
I20260709 13:15:20.440423  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:20.441025  3136 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.442270  3325 raft_consensus.cc:359] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.442634  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:20.442943  3325 raft_consensus.cc:385] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.443277  3325 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.440689  3030 catalog_manager.cc:5697] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.444072  3325 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.445384  3326 tablet_bootstrap.cc:654] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.448388  3136 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:20.449633  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:20.450603  3332 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.406509  3327 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.437618  3352 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.453203  3352 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.438596  3344 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:20.454082  3210 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 1: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:20.454324  3344 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.454906  3344 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.457216  3344 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:20.458459  3325 ts_tablet_manager.cc:1434] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:15:20.459147  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:20.459609  3325 tablet_bootstrap.cc:492] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:20.460148  3135 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:20.461407  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:20.462311  3134 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:20.463824  3250 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:20.464785  3344 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.465188  3344 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.465548  3344 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.467715  3325 tablet_bootstrap.cc:654] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.468678  3359 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:20.473698  3344 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.478665  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:20.479491  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:20.480592  3344 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:20.480537  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:20.479477  3136 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:20.482473  3249 leader_election.cc:343] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.485035  3325 tablet_bootstrap.cc:492] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:20.485513  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:20.485558  3325 ts_tablet_manager.cc:1403] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.009s
I20260709 13:15:20.488461  3136 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:20.489892  3250 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:20.491071  3344 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.490767  3325 raft_consensus.cc:359] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.491830  3344 raft_consensus.cc:697] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:15:20.492347  3249 leader_election.cc:343] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.493803  3332 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:20.491830  3325 raft_consensus.cc:385] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.494726  3325 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.494710  3332 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.495795  3325 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.493311  3344 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.497895  3325 ts_tablet_manager.cc:1434] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:15:20.498395  3327 ts_tablet_manager.cc:1434] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.102s	user 0.011s	sys 0.013s
I20260709 13:15:20.498929  3325 tablet_bootstrap.cc:492] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:20.499605  3327 tablet_bootstrap.cc:492] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:20.506628  3327 tablet_bootstrap.cc:654] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.506783  3325 tablet_bootstrap.cc:654] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.508646  3326 tablet_bootstrap.cc:492] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:20.509193  3326 ts_tablet_manager.cc:1403] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.077s	user 0.020s	sys 0.014s
I20260709 13:15:20.513099  3326 raft_consensus.cc:359] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.513806  3326 raft_consensus.cc:385] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.513696  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:20.514114  3326 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.515153  3377 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:20.515007  3326 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.517426  3326 ts_tablet_manager.cc:1434] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:20.524197  3034 catalog_manager.cc:5697] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:20.526065  3327 tablet_bootstrap.cc:492] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:20.526688  3327 ts_tablet_manager.cc:1403] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.001s
I20260709 13:15:20.530485  3327 raft_consensus.cc:359] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.531348  3327 raft_consensus.cc:385] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.531745  3327 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.533183  3325 tablet_bootstrap.cc:492] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:20.532622  3327 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.533633  3325 ts_tablet_manager.cc:1403] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.035s	user 0.030s	sys 0.003s
I20260709 13:15:20.535611  3327 ts_tablet_manager.cc:1434] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:20.536286  3325 raft_consensus.cc:359] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.536960  3325 raft_consensus.cc:385] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.537268  3325 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.538064  3325 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.539619  3326 tablet_bootstrap.cc:492] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:20.540387  3325 ts_tablet_manager.cc:1434] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:20.541292  3325 tablet_bootstrap.cc:492] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:20.545706  3327 tablet_bootstrap.cc:492] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:20.545861  3326 tablet_bootstrap.cc:654] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.546833  3325 tablet_bootstrap.cc:654] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.556980  3327 tablet_bootstrap.cc:654] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.565857  3326 tablet_bootstrap.cc:492] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:20.566639  3326 ts_tablet_manager.cc:1403] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.018s
I20260709 13:15:20.568281  3327 tablet_bootstrap.cc:492] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:20.568804  3327 ts_tablet_manager.cc:1403] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.005s
I20260709 13:15:20.570442  3326 raft_consensus.cc:359] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.571522  3326 raft_consensus.cc:385] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.571655  3327 raft_consensus.cc:359] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.572014  3326 raft_consensus.cc:740] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.572424  3327 raft_consensus.cc:385] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.572903  3327 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.571960  3030 catalog_manager.cc:5697] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:20.573952  3327 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.573424  3326 consensus_queue.cc:260] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.575218  3359 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.575685  3359 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.576328  3327 ts_tablet_manager.cc:1434] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:20.576666  3326 ts_tablet_manager.cc:1434] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:15:20.577297  3327 tablet_bootstrap.cc:492] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:20.577790  3359 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.579869  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:20.580143  3326 tablet_bootstrap.cc:492] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:20.580608  3210 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:20.581918  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:20.582551  3285 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:20.583671  3327 tablet_bootstrap.cc:654] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.583881  3101 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:20.586616  3359 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.587127  3359 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.587690  3359 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.588231  3326 tablet_bootstrap.cc:654] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.594964  3327 tablet_bootstrap.cc:492] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:20.595481  3327 ts_tablet_manager.cc:1403] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:15:20.598321  3327 raft_consensus.cc:359] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.599112  3327 raft_consensus.cc:385] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.599522  3327 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.600466  3327 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.602468  3326 tablet_bootstrap.cc:492] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:20.602738  3327 ts_tablet_manager.cc:1434] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:15:20.603042  3326 ts_tablet_manager.cc:1403] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 13:15:20.603662  3327 tablet_bootstrap.cc:492] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:20.606678  3326 raft_consensus.cc:359] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.607587  3326 raft_consensus.cc:385] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.607926  3326 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.609040  3326 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.609876  3327 tablet_bootstrap.cc:654] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.612417  3326 ts_tablet_manager.cc:1434] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:15:20.613672  3326 tablet_bootstrap.cc:492] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:20.621307  3327 tablet_bootstrap.cc:492] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:20.621807  3327 ts_tablet_manager.cc:1403] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.007s
I20260709 13:15:20.623240  3359 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.623991  3326 tablet_bootstrap.cc:654] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.624893  3327 raft_consensus.cc:359] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.625604  3327 raft_consensus.cc:385] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.625872  3327 raft_consensus.cc:740] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.626228  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:20.626770  3210 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.626801  3327 consensus_queue.cc:260] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.629144  3327 ts_tablet_manager.cc:1434] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:15:20.630172  3327 tablet_bootstrap.cc:492] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:20.634349  3210 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:20.635843  3327 tablet_bootstrap.cc:654] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.635627  3100 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:20.636726  3333 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.637017  3326 tablet_bootstrap.cc:492] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:20.637974  3326 ts_tablet_manager.cc:1403] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.003s
I20260709 13:15:20.641028  3377 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.645466  3377 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.648512  3326 raft_consensus.cc:359] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.648813  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:20.649240  3326 raft_consensus.cc:385] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.649530  3136 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:20.650949  3176 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:20.651811  3352 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.652311  3352 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.652693  3352 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.653860  3377 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.654460  3333 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:20.640422  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:20.655947  3333 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.656914  3285 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.658459  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:20.659134  3284 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:20.661235  3377 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.661739  3377 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.664314  3352 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.649533  3326 raft_consensus.cc:740] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.665951  3377 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.666567  3326 consensus_queue.cc:260] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.670302  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:20.670656  3285 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:20.671066  3134 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.672380  3359 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.667488  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:20.673588  3284 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:20.674492  3359 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.668208  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:20.674964  3359 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.675506  3326 ts_tablet_manager.cc:1434] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:15:20.675694  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:20.675920  3136 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:20.676368  3325 tablet_bootstrap.cc:492] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:20.676493  3326 tablet_bootstrap.cc:492] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:20.676918  3325 ts_tablet_manager.cc:1403] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.136s	user 0.050s	sys 0.075s
I20260709 13:15:20.679037  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:20.679713  3284 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:20.680861  3101 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:20.680608  3325 raft_consensus.cc:359] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.681685  3325 raft_consensus.cc:385] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.679037  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:20.682458  3210 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:20.682500  3391 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.683147  3391 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.683337  3325 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.683547  3391 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.684022  3377 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.684507  3377 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.684900  3377 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.684623  3325 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.688122  3332 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.688849  3332 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.691120  3332 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:20.692467  3326 tablet_bootstrap.cc:654] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.692713  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:20.693377  3136 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:20.693331  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:20.694103  3210 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:20.694705  3250 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:20.694972  3134 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:20.695592  3332 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.695947  3332 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.687651  3325 ts_tablet_manager.cc:1434] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:20.696354  3332 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.696111  3176 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:20.697165  3359 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.699018  3325 tablet_bootstrap.cc:492] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:20.703473  3377 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.699318  3391 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.707739  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:20.708480  3210 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 1: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:20.702472  3352 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.709820  3352 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.703516  3332 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.713510  3352 raft_consensus.cc:697] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:20.716467  3326 tablet_bootstrap.cc:492] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:20.717105  3326 ts_tablet_manager.cc:1403] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.004s
I20260709 13:15:20.719610  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:20.721221  3134 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.721618  3391 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.727151  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:20.727604  3377 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.727854  3285 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.721392  3033 catalog_manager.cc:5697] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.732419  3134 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:20.733440  3332 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:20.733803  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:20.719817  3352 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.734684  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:20.733752  3250 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:20.735390  3284 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.735491  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:20.735952  3332 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.736076  3210 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.737517  3332 raft_consensus.cc:697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:20.738706  3326 raft_consensus.cc:359] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.739866  3326 raft_consensus.cc:385] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.739775  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:20.740226  3326 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.740643  3136 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:20.738458  3332 consensus_queue.cc:237] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.742552  3326 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.744658  3391 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.745142  3391 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.746999  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:20.747414  3326 ts_tablet_manager.cc:1434] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.001s
I20260709 13:15:20.747823  3377 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:20.749137  3284 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:20.749575  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:20.746002  3285 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:20.747408  3391 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.748415  3326 tablet_bootstrap.cc:492] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:20.749575  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:20.751994  3211 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:20.746006  3210 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
W20260709 13:15:20.754396  3101 leader_election.cc:343] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.755386  3100 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:20.756453  3391 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.756856  3391 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.757154  3327 tablet_bootstrap.cc:492] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:20.757221  3391 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.757745  3327 ts_tablet_manager.cc:1403] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.128s	user 0.015s	sys 0.015s
I20260709 13:15:20.761198  3030 catalog_manager.cc:5697] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.761160  3327 raft_consensus.cc:359] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.764046  3327 raft_consensus.cc:385] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.764343  3327 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.764892  3325 tablet_bootstrap.cc:654] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.765143  3327 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.767076  3327 ts_tablet_manager.cc:1434] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:20.768335  3327 tablet_bootstrap.cc:492] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:20.769275  3326 tablet_bootstrap.cc:654] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.770030  3101 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:20.772454  3333 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.772918  3333 raft_consensus.cc:697] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:20.773964  3333 consensus_queue.cc:237] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.774441  3359 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:20.776350  3359 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.787406  3391 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.790630  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:15:20.792193  3101 leader_election.cc:343] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.776844  3359 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.794673  3394 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.793054  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:20.795536  3394 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.796281  3211 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.797704  3394 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.802716  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:20.803191  3359 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.803546  3136 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:20.792879  3391 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.807283  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:20.810523  3101 leader_election.cc:343] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.809638  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:20.813089  3285 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:20.817929  3327 tablet_bootstrap.cc:654] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.818411  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:20.819824  3394 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.822806  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:20.811388  3030 catalog_manager.cc:5697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:20.825927  3100 leader_election.cc:343] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.826555  3100 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:20.827469  3333 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:20.830128  3359 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:20.839776  3326 tablet_bootstrap.cc:492] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:20.840427  3326 ts_tablet_manager.cc:1403] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.014s
I20260709 13:15:20.842329  3032 catalog_manager.cc:5697] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.846045  3211 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:20.851190  3284 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.853788  3100 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:20.852236  3394 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:20.861519  3325 tablet_bootstrap.cc:492] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:20.862171  3325 ts_tablet_manager.cc:1403] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.163s	user 0.008s	sys 0.020s
I20260709 13:15:20.862677  3359 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.865624  3359 raft_consensus.cc:697] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:20.866364  3359 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.866245  3325 raft_consensus.cc:359] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.867244  3325 raft_consensus.cc:385] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.867602  3325 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.868610  3325 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.871272  3325 ts_tablet_manager.cc:1434] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
W20260709 13:15:20.871615  3082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:20.872671  3325 tablet_bootstrap.cc:492] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:20.877346  3333 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:20.878918  3332 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.879418  3332 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.882876  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:20.883421  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:20.883932  3326 raft_consensus.cc:359] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.884660  3326 raft_consensus.cc:385] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.884953  3326 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
W20260709 13:15:20.885242  3249 leader_election.cc:343] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.885679  3326 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.882835  3332 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:15:20.885742  3250 leader_election.cc:343] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.894603  3326 ts_tablet_manager.cc:1434] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.002s
I20260709 13:15:20.894933  3250 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:20.896946  3327 tablet_bootstrap.cc:492] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:20.897419  3327 ts_tablet_manager.cc:1403] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.130s	user 0.006s	sys 0.006s
I20260709 13:15:20.897895  3326 tablet_bootstrap.cc:492] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:20.898679  3332 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:20.904403  3332 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:20.912915  3333 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.913446  3333 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.915112  3333 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.914413  3032 catalog_manager.cc:5697] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.916052  3326 tablet_bootstrap.cc:654] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.916541  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:20.917305  3325 tablet_bootstrap.cc:654] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.917207  3211 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:20.918741  3100 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:20.920094  3391 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.920493  3391 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.920838  3391 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.922106  3399 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:20.925021  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:20.925813  3284 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:20.903357  3327 raft_consensus.cc:359] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.928236  3327 raft_consensus.cc:385] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.928537  3327 raft_consensus.cc:740] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.929255  3327 consensus_queue.cc:260] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.933770  3327 ts_tablet_manager.cc:1434] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:15:20.938967  3327 tablet_bootstrap.cc:492] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:20.943024  3211 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.943807  3325 tablet_bootstrap.cc:492] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:20.944248  3325 ts_tablet_manager.cc:1403] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.072s	user 0.006s	sys 0.018s
I20260709 13:15:20.946074  3391 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.952695  3391 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:20.953975  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:20.954774  3285 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.967563  3326 tablet_bootstrap.cc:492] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:20.967638  3285 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:20.968235  3326 ts_tablet_manager.cc:1403] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.014s
I20260709 13:15:20.969002  3101 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:20.969182  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:20.969902  3210 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.969911  3391 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.970494  3391 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:20.971287  3391 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.977169  3210 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:20.979717  3325 raft_consensus.cc:359] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.980319  3325 raft_consensus.cc:385] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.980643  3325 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.981480  3325 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.983870  3325 ts_tablet_manager.cc:1434] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.018s
I20260709 13:15:20.984789  3325 tablet_bootstrap.cc:492] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:20.990242  3326 raft_consensus.cc:359] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.991171  3326 raft_consensus.cc:385] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.991513  3326 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.992205  3327 tablet_bootstrap.cc:654] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.991984  3332 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:20.998682  3359 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.999213  3359 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:20.999339  3332 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.001406  3359 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:21.003569  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:21.004655  3325 tablet_bootstrap.cc:654] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:21.004943  3101 leader_election.cc:343] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.010819  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:21.014026  3100 leader_election.cc:343] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.014506  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:21.015679  3391 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:21.011054  3326 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.018909  3033 catalog_manager.cc:5697] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.020035  3326 ts_tablet_manager.cc:1434] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 13:15:21.021193  3326 tablet_bootstrap.cc:492] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:21.023710  3325 tablet_bootstrap.cc:492] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:21.024183  3325 ts_tablet_manager.cc:1403] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:15:21.027235  3325 raft_consensus.cc:359] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.027915  3325 raft_consensus.cc:385] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.028185  3325 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.031355  3394 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.031970  3394 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.036139  3326 tablet_bootstrap.cc:654] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.038898  3394 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:21.040052  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:21.040699  3136 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:21.041436  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:21.046492  3344 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.047648  3176 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:15:21.051172  3176 leader_election.cc:343] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.052081  3394 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.052556  3394 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.052933  3394 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.053386  3327 tablet_bootstrap.cc:492] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:21.053887  3327 ts_tablet_manager.cc:1403] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.017s
I20260709 13:15:21.056998  3327 raft_consensus.cc:359] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.057910  3327 raft_consensus.cc:385] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.059301  3327 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.028838  3325 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.061149  3326 tablet_bootstrap.cc:492] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:21.061775  3326 ts_tablet_manager.cc:1403] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.015s
I20260709 13:15:21.065948  3394 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.069103  3326 raft_consensus.cc:359] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.069818  3326 raft_consensus.cc:385] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.070086  3326 raft_consensus.cc:740] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.070763  3325 ts_tablet_manager.cc:1434] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:15:21.070887  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:21.070847  3326 consensus_queue.cc:260] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.072319  3136 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.072836  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:21.073824  3326 ts_tablet_manager.cc:1434] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 13:15:21.074357  3176 leader_election.cc:343] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.074857  3326 tablet_bootstrap.cc:492] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:21.076481  3394 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:21.071300  3327 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.081631  3326 tablet_bootstrap.cc:654] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.083765  3327 ts_tablet_manager.cc:1434] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:15:21.081631  3325 tablet_bootstrap.cc:492] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:21.088650  3136 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:21.090010  3325 tablet_bootstrap.cc:654] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.090273  3327 tablet_bootstrap.cc:492] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:21.090198  3176 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:21.091601  3394 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.092234  3394 raft_consensus.cc:697] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:21.093158  3394 consensus_queue.cc:237] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.095988  3391 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.096575  3327 tablet_bootstrap.cc:654] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.105404  3327 tablet_bootstrap.cc:492] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:21.106065  3327 ts_tablet_manager.cc:1403] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.001s
I20260709 13:15:21.115779  3327 raft_consensus.cc:359] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.116474  3327 raft_consensus.cc:385] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.116750  3327 raft_consensus.cc:740] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.117412  3327 consensus_queue.cc:260] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.119493  3327 ts_tablet_manager.cc:1434] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:15:21.120365  3327 tablet_bootstrap.cc:492] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:21.122720  3326 tablet_bootstrap.cc:492] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:21.123131  3326 ts_tablet_manager.cc:1403] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.008s
I20260709 13:15:21.126179  3391 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.125813  3326 raft_consensus.cc:359] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.126917  3326 raft_consensus.cc:385] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.127261  3326 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.127993  3326 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.128361  3030 catalog_manager.cc:5697] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.133312  3327 tablet_bootstrap.cc:654] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.135531  3325 tablet_bootstrap.cc:492] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:21.136592  3325 ts_tablet_manager.cc:1403] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.008s
I20260709 13:15:21.139384  3325 raft_consensus.cc:359] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.140105  3325 raft_consensus.cc:385] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.140462  3325 raft_consensus.cc:740] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.141309  3325 consensus_queue.cc:260] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.146947  3325 ts_tablet_manager.cc:1434] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:15:21.147974  3325 tablet_bootstrap.cc:492] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:21.149391  3394 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.149919  3394 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.152107  3394 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:21.154266  3325 tablet_bootstrap.cc:654] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.154031  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:21.155226  3284 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:21.155227  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:21.156040  3136 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:21.156719  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:21.157249  3327 tablet_bootstrap.cc:492] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:21.157691  3327 ts_tablet_manager.cc:1403] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.011s
I20260709 13:15:21.158118  3394 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.158344  3378 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.158543  3394 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.158900  3394 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.158852  3378 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.160422  3327 raft_consensus.cc:359] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.161108  3327 raft_consensus.cc:385] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.161384  3327 raft_consensus.cc:740] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.162035  3327 consensus_queue.cc:260] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.162556  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:21.167819  3327 ts_tablet_manager.cc:1434] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:21.168758  3327 tablet_bootstrap.cc:492] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
W20260709 13:15:21.168570  3250 leader_election.cc:343] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.170871  3378 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:21.173416  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:21.173475  3326 ts_tablet_manager.cc:1434] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 13:15:21.174319  3210 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:21.175822  3326 tablet_bootstrap.cc:492] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:21.179425  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:21.186058  3394 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.186580  3332 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.187427  3332 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.188951  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:21.189560  3136 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.189891  3327 tablet_bootstrap.cc:654] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.190881  3344 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.191351  3344 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.191699  3344 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.192127  3332 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:21.192667  3332 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.195354  3325 tablet_bootstrap.cc:492] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:21.195885  3325 ts_tablet_manager.cc:1403] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.019s
I20260709 13:15:21.196960  3394 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:21.198040  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:21.198123  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:21.198263  3136 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:21.198866  3284 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:21.199458  3249 leader_election.cc:343] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.200297  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:21.201282  3394 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.202016  3394 raft_consensus.cc:697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:21.202913  3394 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.203962  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:21.204586  3136 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:21.205736  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:21.206357  3284 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:21.203048  3344 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.207026  3332 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.207872  3332 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.213330  3326 tablet_bootstrap.cc:654] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.208312  3332 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.215901  3378 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.214140  3325 raft_consensus.cc:359] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.218672  3325 raft_consensus.cc:385] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.218968  3325 raft_consensus.cc:740] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.220981  3325 consensus_queue.cc:260] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.223078  3325 ts_tablet_manager.cc:1434] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:15:21.223730  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:21.225124  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:21.225888  3209 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:21.229739  3250 leader_election.cc:343] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.229892  3325 tablet_bootstrap.cc:492] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:21.233577  3344 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:21.246624  3344 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.247242  3344 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.252900  3359 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.258296  3332 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.264166  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:21.264374  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:21.264990  3136 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.266047  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:21.266389  3209 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:21.266840  3211 raft_consensus.cc:2393] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:21.267938  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:21.269027  3378 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.270062  3378 raft_consensus.cc:697] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:21.271081  3378 consensus_queue.cc:237] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.264425  3344 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:21.271755  3391 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.277061  3136 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:21.278326  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:21.284806  3376 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.285537  3376 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:21.287002  3332 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:21.286623  3376 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.296597  3030 catalog_manager.cc:5697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.325181  3391 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.329545  3391 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.332616  3391 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:21.333945  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:21.336997  3100 leader_election.cc:343] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.337352  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:21.338145  3285 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:21.339847  3352 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.343219  3101 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:21.351456  3359 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.390046  3359 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.390681  3359 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.391448  3325 tablet_bootstrap.cc:654] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.392905  3359 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:21.394922  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:21.395622  3211 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
W20260709 13:15:21.395891  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 52827.5us
I20260709 13:15:21.397248  3359 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.398613  3359 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.399039  3359 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.399591  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:21.401566  3101 leader_election.cc:343] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.405951  3327 tablet_bootstrap.cc:492] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:21.406424  3327 ts_tablet_manager.cc:1403] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.238s	user 0.016s	sys 0.018s
I20260709 13:15:21.410524  3327 raft_consensus.cc:359] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.411437  3327 raft_consensus.cc:385] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.412076  3327 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.413944  3327 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.422773  3249 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:21.423822  3332 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.430599  3326 tablet_bootstrap.cc:492] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:21.431136  3326 ts_tablet_manager.cc:1403] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.255s	user 0.011s	sys 0.010s
I20260709 13:15:21.431577  3332 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:21.445299  3100 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:21.446771  3333 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.447314  3333 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.447786  3333 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.457288  3333 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.460421  3399 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.463471  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:21.467487  3399 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.468757  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:21.469349  3208 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.482393  3208 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:21.497293  3391 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.503005  3327 ts_tablet_manager.cc:1434] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.041s
I20260709 13:15:21.504070  3327 tablet_bootstrap.cc:492] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:21.507771  3033 catalog_manager.cc:5697] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:21.502983  3326 raft_consensus.cc:359] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.510152  3326 raft_consensus.cc:385] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.510507  3326 raft_consensus.cc:740] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.511344  3326 consensus_queue.cc:260] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:21.517764  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 55121.1us
I20260709 13:15:21.522621  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:21.523245  3437 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:21.524199  3327 tablet_bootstrap.cc:654] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.528326  3326 ts_tablet_manager.cc:1434] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.002s
I20260709 13:15:21.529384  3326 tablet_bootstrap.cc:492] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:21.519338  3100 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:15:21.530893  3101 leader_election.cc:343] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.520052  3333 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:21.530413  3325 tablet_bootstrap.cc:492] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:21.533456  3325 ts_tablet_manager.cc:1403] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.304s	user 0.052s	sys 0.058s
W20260709 13:15:21.533629  3249 leader_election.cc:343] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.535905  3326 tablet_bootstrap.cc:654] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.541357  3376 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.543409  3376 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.545835  3376 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:21.541742  3443 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.546428  3443 raft_consensus.cc:697] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:21.547345  3443 consensus_queue.cc:237] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.549273  3332 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.549834  3332 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.553984  3332 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:21.553601  3359 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.555464  3325 raft_consensus.cc:359] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.557279  3325 raft_consensus.cc:385] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.557636  3325 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.556599  3359 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:21.564925  3325 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.564026  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:21.574028  3325 ts_tablet_manager.cc:1434] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:15:21.575172  3325 tablet_bootstrap.cc:492] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:21.567976  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:21.571970  3211 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:21.571439  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:21.588559  3327 tablet_bootstrap.cc:492] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:21.589221  3327 ts_tablet_manager.cc:1403] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.085s	user 0.020s	sys 0.013s
I20260709 13:15:21.592020  3327 raft_consensus.cc:359] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.592553  3325 tablet_bootstrap.cc:654] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.596011  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:21.592674  3327 raft_consensus.cc:385] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.597864  3327 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.598495  3327 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:21.576642  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 48576.5us
I20260709 13:15:21.585582  3208 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.603029  3327 ts_tablet_manager.cc:1434] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:15:21.599081  3376 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:21.613425  3283 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.606256  3376 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.613605  3437 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:21.615798  3376 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.595148  3032 catalog_manager.cc:5697] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.622275  3327 tablet_bootstrap.cc:492] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:21.622355  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:21.623113  3282 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.642467  3326 tablet_bootstrap.cc:492] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:21.643160  3326 ts_tablet_manager.cc:1403] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.114s	user 0.015s	sys 0.027s
I20260709 13:15:21.650323  3440 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:21.675137  3376 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.678695  3326 raft_consensus.cc:359] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.679869  3325 tablet_bootstrap.cc:492] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:21.680433  3325 ts_tablet_manager.cc:1403] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.106s	user 0.027s	sys 0.011s
I20260709 13:15:21.682739  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:21.683136  3325 raft_consensus.cc:359] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.683434  3135 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:21.684104  3325 raft_consensus.cc:385] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.679927  3326 raft_consensus.cc:385] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.684423  3325 raft_consensus.cc:740] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.685648  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:21.686265  3133 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.686416  3325 consensus_queue.cc:260] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.686842  3376 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:21.688032  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:21.689311  3033 catalog_manager.cc:5697] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:21.692487  3325 ts_tablet_manager.cc:1434] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:15:21.691251  3282 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:21.684535  3326 raft_consensus.cc:740] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.695550  3325 tablet_bootstrap.cc:492] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:21.698033  3326 consensus_queue.cc:260] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.687453  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:21.701294  3210 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.701452  3208 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:21.702778  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:21.704113  3359 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.704571  3359 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:21.705344  3359 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:21.717248  3448 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:15:21.731663  3210 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:15:21.736510  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:21.738540  3447 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:21.739181  3447 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:21.740299  3447 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.746114  3326 ts_tablet_manager.cc:1434] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.010s
I20260709 13:15:21.742291  3333 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.747895  3326 tablet_bootstrap.cc:492] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:21.746510  3250 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:21.750280  3332 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:21.750401  3376 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.752187  3437 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.753153  3333 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.763458  3333 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:21.764211  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:21.765040  3210 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 1: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:21.774816  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:21.775660  3135 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.798329  3327 tablet_bootstrap.cc:654] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.800321  3101 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:21.769932  3133 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:15:21.816120  3437 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.818851  3326 tablet_bootstrap.cc:654] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.821190  3359 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:21.816447  3032 catalog_manager.cc:5697] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 0 to 2, leader changed from <none> to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:21.829516  3376 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.828135  3033 catalog_manager.cc:5697] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.835064  3376 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.836061  3376 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.839713  3359 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.840016  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:21.840410  3359 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.843740  3359 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:15:21.845691  3249 leader_election.cc:343] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.848834  3352 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.849561  3352 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.854156  3352 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:21.855541  3376 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:21.863951  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:21.866154  3325 tablet_bootstrap.cc:654] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.866008  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:21.861933  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:21.870443  3176 leader_election.cc:343] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.870278  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:21.872195  3101 leader_election.cc:343] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.884320  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:21.907060  3100 leader_election.cc:343] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.908228  3100 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:21.909031  3359 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:21.906733  3283 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:21.913467  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:15:21.914062  3249 consensus_peers.cc:597] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:21.914315  3352 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:21.914472  3250 leader_election.cc:343] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.914798  3352 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.914976  3250 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:21.915220  3352 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.916254  3378 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:21.926717  3352 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.929032  3352 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:21.930282  3326 tablet_bootstrap.cc:492] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:21.930788  3326 ts_tablet_manager.cc:1403] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.183s	user 0.012s	sys 0.019s
I20260709 13:15:21.933619  3327 tablet_bootstrap.cc:492] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:21.934091  3327 ts_tablet_manager.cc:1403] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.313s	user 0.015s	sys 0.063s
I20260709 13:15:21.936757  3326 raft_consensus.cc:359] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.937168  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:21.937551  3326 raft_consensus.cc:385] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.937876  3326 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.937932  3283 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.938743  3326 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.939126  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:21.939963  3327 raft_consensus.cc:359] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.940655  3327 raft_consensus.cc:385] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.940965  3327 raft_consensus.cc:740] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.941730  3326 ts_tablet_manager.cc:1434] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:15:21.941713  3327 consensus_queue.cc:260] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.942870  3326 tablet_bootstrap.cc:492] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
W20260709 13:15:21.954046  3176 leader_election.cc:343] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.954211  3327 ts_tablet_manager.cc:1434] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 13:15:21.964133  3332 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:21.967644  3082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:21.976868  3283 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:21.965559  3327 tablet_bootstrap.cc:492] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:21.968204  3326 tablet_bootstrap.cc:654] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.982008  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:21.983306  3352 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.983764  3352 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:21.984879  3352 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.986785  3327 tablet_bootstrap.cc:654] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.973686  3325 tablet_bootstrap.cc:492] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:21.990275  3325 ts_tablet_manager.cc:1403] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.297s	user 0.022s	sys 0.019s
I20260709 13:15:21.996816  3325 raft_consensus.cc:359] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:21.997520  3325 raft_consensus.cc:385] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.997797  3325 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.998418  3325 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.000368  3325 ts_tablet_manager.cc:1434] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.000s
I20260709 13:15:22.001451  3325 tablet_bootstrap.cc:492] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:22.001658  3033 catalog_manager.cc:5697] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.025929  3325 tablet_bootstrap.cc:654] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.026398  3327 tablet_bootstrap.cc:492] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:22.026945  3327 ts_tablet_manager.cc:1403] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.000s
W20260709 13:15:22.027849  3101 consensus_peers.cc:597] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 -> Peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Couldn't send request to peer 48080cf0460346769ab046a4f9457aa5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:22.028208  3326 tablet_bootstrap.cc:492] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:22.028800  3326 ts_tablet_manager.cc:1403] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.005s
I20260709 13:15:22.031540  3327 raft_consensus.cc:359] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.031934  3326 raft_consensus.cc:359] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.032577  3327 raft_consensus.cc:385] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.032773  3326 raft_consensus.cc:385] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.033209  3327 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.033342  3326 raft_consensus.cc:740] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.034341  3327 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.035389  3399 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.036147  3399 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.039660  3399 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.040239  3326 consensus_queue.cc:260] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.041321  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:22.042861  3283 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:22.044438  3101 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:22.045416  3359 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.045814  3359 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.046154  3359 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.050777  3327 ts_tablet_manager.cc:1434] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:15:22.053597  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:22.055159  3100 leader_election.cc:343] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.058127  3326 ts_tablet_manager.cc:1434] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:15:22.060806  3399 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:15:22.072677  3325 tablet_bootstrap.cc:492] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:22.073165  3325 ts_tablet_manager.cc:1403] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.036s
I20260709 13:15:22.071877  3326 tablet_bootstrap.cc:492] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:22.075853  3325 raft_consensus.cc:359] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.076535  3325 raft_consensus.cc:385] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.076804  3325 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.057173  3327 tablet_bootstrap.cc:492] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:22.077478  3325 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.079641  3325 ts_tablet_manager.cc:1434] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:22.079932  3326 tablet_bootstrap.cc:654] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.080504  3325 tablet_bootstrap.cc:492] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:22.082568  3333 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.083069  3333 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.085280  3333 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.086591  3325 tablet_bootstrap.cc:654] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.087225  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:22.087910  3283 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:22.061617  3359 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.089169  3101 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:22.091204  3327 tablet_bootstrap.cc:654] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.091732  3443 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.092150  3443 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.092528  3443 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.092300  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:22.097981  3100 leader_election.cc:343] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.098649  3359 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.099424  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:22.100219  3283 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.115643  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:22.123190  3399 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:22.130316  3100 leader_election.cc:343] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.132397  3443 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.145747  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:15:22.147549  3100 leader_election.cc:343] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.148939  3283 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:22.151889  3101 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:22.152418  3443 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.153237  3443 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.160188  3443 raft_consensus.cc:697] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:22.163065  3443 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.174355  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:22.175118  3283 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.181360  3326 tablet_bootstrap.cc:492] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:22.182086  3326 ts_tablet_manager.cc:1403] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.110s	user 0.010s	sys 0.007s
I20260709 13:15:22.184233  3327 tablet_bootstrap.cc:492] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:22.184695  3327 ts_tablet_manager.cc:1403] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.128s	user 0.042s	sys 0.051s
I20260709 13:15:22.179553  3333 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:15:22.186008  3326 raft_consensus.cc:359] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.186800  3326 raft_consensus.cc:385] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.187134  3326 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.187685  3325 tablet_bootstrap.cc:492] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:22.188112  3325 ts_tablet_manager.cc:1403] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.108s	user 0.045s	sys 0.048s
I20260709 13:15:22.188413  3326 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.187139  3327 raft_consensus.cc:359] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.192945  3327 raft_consensus.cc:385] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.193257  3327 raft_consensus.cc:740] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.193890  3327 consensus_queue.cc:260] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.194208  3283 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:22.194569  3352 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.191161  3325 raft_consensus.cc:359] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.195508  3325 raft_consensus.cc:385] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.195287  3352 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.196229  3327 ts_tablet_manager.cc:1434] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:15:22.197052  3326 ts_tablet_manager.cc:1434] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:15:22.198441  3326 tablet_bootstrap.cc:492] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:22.198145  3101 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:22.202168  3399 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.202652  3399 raft_consensus.cc:697] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:22.202913  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:22.203552  3134 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:22.203485  3399 consensus_queue.cc:237] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.205145  3326 tablet_bootstrap.cc:654] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.205006  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:22.206172  3437 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.206540  3437 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.206897  3437 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.197161  3327 tablet_bootstrap.cc:492] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:22.215546  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:22.216964  3176 leader_election.cc:343] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.220100  3352 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.228821  3437 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.231694  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:22.232300  3134 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.237267  3352 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.237828  3352 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.195860  3325 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.240883  3326 tablet_bootstrap.cc:492] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:22.241144  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:22.241459  3325 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.242223  3327 tablet_bootstrap.cc:654] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:22.244527  3176 leader_election.cc:343] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.241357  3326 ts_tablet_manager.cc:1403] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.017s
I20260709 13:15:22.245901  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:22.246628  3352 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.247043  3284 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:22.248566  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:22.249604  3437 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.249277  3326 raft_consensus.cc:359] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.250105  3326 raft_consensus.cc:385] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.250149  3437 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.250450  3326 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.250602  3437 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.251008  3437 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.251113  3326 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.251463  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:22.253166  3326 ts_tablet_manager.cc:1434] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:15:22.252580  3032 catalog_manager.cc:5697] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:22.253715  3176 leader_election.cc:343] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.254070  3326 tablet_bootstrap.cc:492] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:22.258438  3325 ts_tablet_manager.cc:1434] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 13:15:22.259503  3325 tablet_bootstrap.cc:492] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:22.263792  3326 tablet_bootstrap.cc:654] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.265439  3327 tablet_bootstrap.cc:492] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:22.265332  3134 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:22.266577  3327 ts_tablet_manager.cc:1403] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.000s
I20260709 13:15:22.266996  3325 tablet_bootstrap.cc:654] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.266882  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:22.267769  3352 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.268298  3352 raft_consensus.cc:697] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:22.269325  3352 consensus_queue.cc:237] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.266588  3437 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.276046  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:22.276664  3134 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.285522  3327 raft_consensus.cc:359] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.286240  3327 raft_consensus.cc:385] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.286500  3327 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.287118  3327 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.287520  3325 tablet_bootstrap.cc:492] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:22.288138  3325 ts_tablet_manager.cc:1403] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.004s
I20260709 13:15:22.289290  3327 ts_tablet_manager.cc:1434] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:15:22.284319  3134 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:22.290218  3327 tablet_bootstrap.cc:492] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:22.291110  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:22.292670  3284 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.294451  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:22.291612  3325 raft_consensus.cc:359] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.295332  3325 raft_consensus.cc:385] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.291574  3437 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.295606  3325 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.296031  3437 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.296334  3325 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.298745  3325 ts_tablet_manager.cc:1434] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:22.296924  3437 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:22.299661  3325 tablet_bootstrap.cc:492] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:22.300122  3437 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.308072  3030 catalog_manager.cc:5697] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.309966  3033 catalog_manager.cc:5697] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.314751  3284 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:22.316918  3325 tablet_bootstrap.cc:654] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.318531  3134 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:22.320374  3332 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.330156  3327 tablet_bootstrap.cc:654] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.334025  3210 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:22.335764  3332 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.339473  3326 tablet_bootstrap.cc:492] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:22.339928  3326 ts_tablet_manager.cc:1403] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.086s	user 0.027s	sys 0.015s
I20260709 13:15:22.344043  3326 raft_consensus.cc:359] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.344702  3326 raft_consensus.cc:385] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.344947  3326 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.345714  3326 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.347792  3326 ts_tablet_manager.cc:1434] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:22.348631  3033 catalog_manager.cc:5697] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.352810  3326 tablet_bootstrap.cc:492] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:22.354180  3325 tablet_bootstrap.cc:492] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:22.354743  3325 ts_tablet_manager.cc:1403] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.024s
I20260709 13:15:22.358103  3325 raft_consensus.cc:359] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.358924  3325 raft_consensus.cc:385] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.359181  3325 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.359367  3326 tablet_bootstrap.cc:654] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.359817  3325 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.384043  3325 ts_tablet_manager.cc:1434] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:15:22.385113  3325 tablet_bootstrap.cc:492] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:22.391167  3325 tablet_bootstrap.cc:654] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.397217  3326 tablet_bootstrap.cc:492] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:22.397701  3326 ts_tablet_manager.cc:1403] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.015s
I20260709 13:15:22.400485  3326 raft_consensus.cc:359] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.401190  3326 raft_consensus.cc:385] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.401433  3326 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.402009  3326 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.404385  3326 ts_tablet_manager.cc:1434] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:22.405316  3326 tablet_bootstrap.cc:492] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:22.397249  3327 tablet_bootstrap.cc:492] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:22.412497  3326 tablet_bootstrap.cc:654] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.405931  3327 ts_tablet_manager.cc:1403] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.003s
I20260709 13:15:22.423779  3326 tablet_bootstrap.cc:492] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:22.424386  3437 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.423825  3327 raft_consensus.cc:359] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.424474  3326 ts_tablet_manager.cc:1403] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:15:22.423851  3325 tablet_bootstrap.cc:492] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:22.424885  3327 raft_consensus.cc:385] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.425267  3325 ts_tablet_manager.cc:1403] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.018s
I20260709 13:15:22.424867  3437 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.425410  3327 raft_consensus.cc:740] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.426501  3327 consensus_queue.cc:260] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.427213  3437 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.427341  3326 raft_consensus.cc:359] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.427984  3326 raft_consensus.cc:385] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.428258  3326 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.428786  3326 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.430209  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:22.430730  3325 raft_consensus.cc:359] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.431450  3325 raft_consensus.cc:385] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.431784  3325 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.431833  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:22.432618  3325 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.432619  3284 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:22.435422  3325 ts_tablet_manager.cc:1434] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:22.436177  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:22.437007  3437 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.431006  3326 ts_tablet_manager.cc:1434] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:22.439946  3326 tablet_bootstrap.cc:492] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:22.439962  3327 ts_tablet_manager.cc:1434] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:15:22.440383  3325 tablet_bootstrap.cc:492] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:22.445364  3394 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.445864  3394 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.446713  3326 tablet_bootstrap.cc:654] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.446782  3325 tablet_bootstrap.cc:654] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.447898  3394 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.450441  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:22.452601  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:22.452951  3176 leader_election.cc:343] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.456951  3327 tablet_bootstrap.cc:492] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
W20260709 13:15:22.457746  3176 leader_election.cc:343] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.458359  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:22.459355  3333 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.459489  3394 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:22.459843  3333 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.462001  3333 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.465193  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:22.466404  3327 tablet_bootstrap.cc:654] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:22.467386  3100 leader_election.cc:343] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.468178  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:22.468822  3284 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:22.469954  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:22.472313  3443 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.472898  3443 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.473290  3443 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.473380  3378 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.473848  3378 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.475901  3378 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:22.477622  3437 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:22.477809  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:22.479159  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:22.479658  3249 leader_election.cc:343] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:22.480389  3250 leader_election.cc:343] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.480823  3250 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:22.481564  3344 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:22.482657  3325 tablet_bootstrap.cc:492] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:22.482775  3210 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.483078  3325 ts_tablet_manager.cc:1403] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.026s
I20260709 13:15:22.484992  3325 raft_consensus.cc:359] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.485826  3325 raft_consensus.cc:385] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.486094  3325 raft_consensus.cc:740] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.486631  3325 consensus_queue.cc:260] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.488511  3325 ts_tablet_manager.cc:1434] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:15:22.484447  3443 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.489773  3325 tablet_bootstrap.cc:492] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:22.491629  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:15:22.493191  3100 leader_election.cc:343] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.496440  3325 tablet_bootstrap.cc:654] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.502942  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:22.503356  3134 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.503767  3284 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.507239  3326 tablet_bootstrap.cc:492] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:22.507707  3326 ts_tablet_manager.cc:1403] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.003s
I20260709 13:15:22.509298  3443 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.510864  3326 raft_consensus.cc:359] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.511569  3326 raft_consensus.cc:385] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.511837  3326 raft_consensus.cc:740] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.514956  3326 consensus_queue.cc:260] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.516916  3326 ts_tablet_manager.cc:1434] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 13:15:22.517422  3327 tablet_bootstrap.cc:492] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:22.517783  3326 tablet_bootstrap.cc:492] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:22.518018  3327 ts_tablet_manager.cc:1403] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.000s
I20260709 13:15:22.522310  3327 raft_consensus.cc:359] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.523095  3327 raft_consensus.cc:385] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.523445  3327 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.524271  3327 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.531635  3284 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:22.532841  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:22.533988  3443 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.534643  3443 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:22.535676  3326 tablet_bootstrap.cc:654] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.535463  3443 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.540683  3327 ts_tablet_manager.cc:1434] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:15:22.541795  3327 tablet_bootstrap.cc:492] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:22.550211  3327 tablet_bootstrap.cc:654] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.551421  3437 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:22.552028  3437 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.553571  3394 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.555102  3437 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.559240  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:22.561928  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:22.563413  3176 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:22.564611  3437 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:22.571530  3030 catalog_manager.cc:5697] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.581382  3326 tablet_bootstrap.cc:492] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:22.581882  3326 ts_tablet_manager.cc:1403] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.000s
I20260709 13:15:22.584540  3326 raft_consensus.cc:359] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.585291  3326 raft_consensus.cc:385] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.585562  3326 raft_consensus.cc:740] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.590114  3440 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.593065  3327 tablet_bootstrap.cc:492] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:22.593567  3327 ts_tablet_manager.cc:1403] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.026s
I20260709 13:15:22.596271  3327 raft_consensus.cc:359] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.600940  3325 tablet_bootstrap.cc:492] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:22.598263  3327 raft_consensus.cc:385] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.602885  3327 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.603653  3327 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.605660  3327 ts_tablet_manager.cc:1434] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:15:22.605991  3325 ts_tablet_manager.cc:1403] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.116s	user 0.020s	sys 0.046s
I20260709 13:15:22.606945  3327 tablet_bootstrap.cc:492] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:22.608637  3325 raft_consensus.cc:359] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.613227  3325 raft_consensus.cc:385] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.613601  3325 raft_consensus.cc:740] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.614341  3325 consensus_queue.cc:260] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.616626  3325 ts_tablet_manager.cc:1434] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.000s
I20260709 13:15:22.617527  3325 tablet_bootstrap.cc:492] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:22.617950  3210 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.609455  3326 consensus_queue.cc:260] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.621541  3326 ts_tablet_manager.cc:1434] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:15:22.622567  3326 tablet_bootstrap.cc:492] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:22.625197  3399 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.625787  3399 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.626579  3443 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.627020  3443 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.628206  3326 tablet_bootstrap.cc:654] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.629280  3399 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.628966  3443 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.634052  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:22.634709  3284 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:22.634900  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:22.635914  3443 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.635499  3283 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:22.638260  3327 tablet_bootstrap.cc:654] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.639959  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:22.640568  3211 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:22.641757  3100 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:22.643246  3101 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:22.644172  3333 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.644513  3333 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.644827  3333 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.646070  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:22.642695  3443 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.650082  3443 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:22.650269  3100 leader_election.cc:343] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.650509  3443 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.655344  3399 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.658677  3443 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.663968  3399 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.660722  3325 tablet_bootstrap.cc:654] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.664496  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:22.665203  3281 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.667902  3443 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.669617  3326 tablet_bootstrap.cc:492] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:22.670075  3326 ts_tablet_manager.cc:1403] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.002s
I20260709 13:15:22.664495  3399 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.671196  3327 tablet_bootstrap.cc:492] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:22.671746  3327 ts_tablet_manager.cc:1403] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.009s
I20260709 13:15:22.672820  3326 raft_consensus.cc:359] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.673528  3326 raft_consensus.cc:385] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.673777  3326 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.674233  3327 raft_consensus.cc:359] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.674250  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:22.674357  3326 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.674938  3327 raft_consensus.cc:385] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.675231  3327 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.675838  3327 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:22.676421  3101 leader_election.cc:343] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.676576  3326 ts_tablet_manager.cc:1434] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:22.677454  3326 tablet_bootstrap.cc:492] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:22.683521  3327 ts_tablet_manager.cc:1434] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:15:22.672914  3399 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.684450  3327 tablet_bootstrap.cc:492] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:22.686220  3281 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:22.686507  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:22.652027  3333 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.688783  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:22.689738  3333 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:15:22.690622  3100 leader_election.cc:343] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.691059  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:22.692405  3208 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.691146  3100 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:22.695642  3333 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.697059  3327 tablet_bootstrap.cc:654] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.697000  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:22.697819  3281 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.700796  3333 raft_consensus.cc:697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:22.702242  3359 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:22.704291  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:22.705796  3281 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
W20260709 13:15:22.707899  3100 leader_election.cc:343] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.708431  3101 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:22.708410  3443 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.709409  3359 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.709884  3359 raft_consensus.cc:697] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:22.710806  3359 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.712121  3333 consensus_queue.cc:237] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.713611  3326 tablet_bootstrap.cc:654] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.722291  3327 tablet_bootstrap.cc:492] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:22.724952  3327 ts_tablet_manager.cc:1403] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.001s
I20260709 13:15:22.730252  3208 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:22.737432  3327 raft_consensus.cc:359] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.738435  3327 raft_consensus.cc:385] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.738780  3327 raft_consensus.cc:740] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.739053  3326 tablet_bootstrap.cc:492] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:22.739678  3326 ts_tablet_manager.cc:1403] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.004s
I20260709 13:15:22.741614  3327 consensus_queue.cc:260] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.742879  3332 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.743994  3327 ts_tablet_manager.cc:1434] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:15:22.743422  3332 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.747089  3326 raft_consensus.cc:359] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.747546  3325 tablet_bootstrap.cc:492] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:22.747761  3326 raft_consensus.cc:385] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.748127  3326 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.748208  3332 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:22.748364  3325 ts_tablet_manager.cc:1403] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.131s	user 0.043s	sys 0.021s
I20260709 13:15:22.748979  3326 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.749998  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:22.750214  3443 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.750901  3327 tablet_bootstrap.cc:492] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:22.750990  3132 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 1: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:22.752885  3326 ts_tablet_manager.cc:1434] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:15:22.753286  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:22.754061  3326 tablet_bootstrap.cc:492] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:22.755285  3249 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:22.755486  3325 raft_consensus.cc:359] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.757810  3325 raft_consensus.cc:385] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.758191  3325 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.759779  3378 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.763316  3325 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.786274  3325 ts_tablet_manager.cc:1434] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.037s	user 0.012s	sys 0.004s
I20260709 13:15:22.786825  3378 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:22.789120  3325 tablet_bootstrap.cc:492] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:22.792809  3440 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.799631  3030 catalog_manager.cc:5697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.800994  3030 catalog_manager.cc:5697] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.817267  3326 tablet_bootstrap.cc:654] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.817934  3443 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.821863  3443 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.825220  3443 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.826364  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:22.829322  3325 tablet_bootstrap.cc:654] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.829933  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:22.830850  3284 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
W20260709 13:15:22.829437  3100 leader_election.cc:343] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.833840  3101 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:22.837031  3333 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.840535  3333 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.840925  3333 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.842383  3440 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.858902  3327 tablet_bootstrap.cc:654] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.858742  3352 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.859640  3325 tablet_bootstrap.cc:492] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:22.848073  3333 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.866317  3352 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.860165  3325 ts_tablet_manager.cc:1403] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.017s
I20260709 13:15:22.875454  3325 raft_consensus.cc:359] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.876052  3325 raft_consensus.cc:385] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.876298  3325 raft_consensus.cc:740] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.876925  3325 consensus_queue.cc:260] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.879524  3325 ts_tablet_manager.cc:1434] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:22.879828  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:22.880642  3325 tablet_bootstrap.cc:492] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:22.885275  3325 tablet_bootstrap.cc:654] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:22.914577  3100 leader_election.cc:343] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.916383  3333 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.917652  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:22.918260  3284 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.926188  3284 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:22.927484  3101 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:22.929023  3443 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.929530  3443 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:22.930321  3443 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.931676  3344 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.932375  3344 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.933102  3359 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.933597  3359 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.935603  3359 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.936192  3352 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.936654  3352 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.937912  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:22.939105  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:22.939728  3283 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:22.939677  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:22.937112  3344 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:22.941717  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:22.942011  3101 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:22.942634  3352 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.942929  3359 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.943346  3359 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.943660  3359 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.944006  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:22.944783  3283 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:22.941668  3327 tablet_bootstrap.cc:492] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:22.946013  3327 ts_tablet_manager.cc:1403] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.195s	user 0.021s	sys 0.006s
I20260709 13:15:22.946108  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:22.946981  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:22.947589  3440 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.949103  3332 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:22.952494  3326 tablet_bootstrap.cc:492] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:22.953117  3326 ts_tablet_manager.cc:1403] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.199s	user 0.014s	sys 0.007s
I20260709 13:15:22.957664  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:22.960131  3208 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:22.966636  3359 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.962312  3440 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:22.969765  3359 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.970937  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:22.971542  3284 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.973245  3327 raft_consensus.cc:359] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.973961  3327 raft_consensus.cc:385] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.974243  3327 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.975076  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:22.974900  3327 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.975612  3211 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.980201  3283 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.982939  3211 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:22.984961  3100 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:22.985419  3325 tablet_bootstrap.cc:492] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:22.985947  3325 ts_tablet_manager.cc:1403] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.106s	user 0.028s	sys 0.063s
I20260709 13:15:22.985904  3333 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.986608  3333 raft_consensus.cc:697] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:22.987740  3333 consensus_queue.cc:237] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.988996  3325 raft_consensus.cc:359] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.989701  3325 raft_consensus.cc:385] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.989923  3352 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.972298  3326 raft_consensus.cc:359] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.990664  3326 raft_consensus.cc:385] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.990468  3352 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.990938  3326 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.991652  3326 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.989974  3325 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.992498  3352 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:22.992785  3325 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:22.993583  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:22.995342  3325 ts_tablet_manager.cc:1434] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
W20260709 13:15:22.995882  3176 leader_election.cc:343] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.994421  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:22.996570  3325 tablet_bootstrap.cc:492] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
W20260709 13:15:22.997793  3176 leader_election.cc:343] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.998194  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:22.999047  3440 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:23.000612  3326 ts_tablet_manager.cc:1434] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.002s
I20260709 13:15:23.001541  3326 tablet_bootstrap.cc:492] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:23.007910  3284 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:23.010284  3327 ts_tablet_manager.cc:1434] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.002s
I20260709 13:15:23.012781  3326 tablet_bootstrap.cc:654] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.016302  3325 tablet_bootstrap.cc:654] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.021183  3327 tablet_bootstrap.cc:492] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:23.035780  3325 tablet_bootstrap.cc:492] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:23.036402  3325 ts_tablet_manager.cc:1403] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.009s
I20260709 13:15:23.038472  3326 tablet_bootstrap.cc:492] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:23.038906  3326 ts_tablet_manager.cc:1403] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.038s	user 0.023s	sys 0.006s
I20260709 13:15:23.039386  3325 raft_consensus.cc:359] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.040091  3325 raft_consensus.cc:385] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.040360  3325 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.041016  3325 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.041348  3030 catalog_manager.cc:5697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.043167  3325 ts_tablet_manager.cc:1434] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:15:23.044090  3325 tablet_bootstrap.cc:492] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:23.043977  3326 raft_consensus.cc:359] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.044755  3326 raft_consensus.cc:385] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.050455  3325 tablet_bootstrap.cc:654] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.045053  3326 raft_consensus.cc:740] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.051410  3326 consensus_queue.cc:260] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.053511  3326 ts_tablet_manager.cc:1434] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:15:23.054749  3443 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.055183  3443 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.057394  3443 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.058377  3326 tablet_bootstrap.cc:492] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:23.058548  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:23.060081  3101 leader_election.cc:343] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.058334  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:23.061731  3100 leader_election.cc:343] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.062467  3100 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:23.063303  3443 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:23.065445  3344 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.066080  3326 tablet_bootstrap.cc:654] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.065949  3344 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.068382  3344 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:23.071437  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:23.073130  3250 leader_election.cc:343] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.074069  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:23.076753  3249 leader_election.cc:343] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.077713  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:23.079505  3378 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:23.094321  3443 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.094821  3443 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.095695  3326 tablet_bootstrap.cc:492] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:23.096208  3326 ts_tablet_manager.cc:1403] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.004s
I20260709 13:15:23.096539  3443 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.098023  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:23.099372  3101 leader_election.cc:343] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.099501  3326 raft_consensus.cc:359] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.100196  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:23.100468  3326 raft_consensus.cc:385] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.100814  3211 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:23.100895  3326 raft_consensus.cc:740] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.102535  3100 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:23.102385  3326 consensus_queue.cc:260] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.104009  3333 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:23.104434  3333 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.104777  3333 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.105391  3326 ts_tablet_manager.cc:1434] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 13:15:23.106663  3326 tablet_bootstrap.cc:492] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:23.114393  3443 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.122251  3327 tablet_bootstrap.cc:654] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.122936  3325 tablet_bootstrap.cc:492] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:23.123394  3325 ts_tablet_manager.cc:1403] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.079s	user 0.032s	sys 0.028s
I20260709 13:15:23.124728  3399 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.125231  3399 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.131702  3399 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.132824  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:23.132413  3333 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.133478  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:23.134382  3101 leader_election.cc:343] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:23.134948  3100 leader_election.cc:343] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.135257  3100 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:23.135815  3399 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:23.139982  3399 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.146997  3333 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.147877  3325 raft_consensus.cc:359] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.148425  3325 raft_consensus.cc:385] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.148711  3325 raft_consensus.cc:740] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.149386  3325 consensus_queue.cc:260] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.149865  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:23.150761  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:23.151224  3211 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:23.152143  3101 leader_election.cc:343] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.152928  3325 ts_tablet_manager.cc:1434] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 13:15:23.153797  3325 tablet_bootstrap.cc:492] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:23.161423  3326 tablet_bootstrap.cc:654] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:23.163959  3082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:23.163425  3030 catalog_manager.cc:5697] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.166582  3211 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:23.167933  3100 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:23.168200  3325 tablet_bootstrap.cc:654] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.168742  3333 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:23.169310  3333 raft_consensus.cc:697] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:23.170181  3333 consensus_queue.cc:237] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.190935  3209 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.199191  3325 tablet_bootstrap.cc:492] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:23.199849  3325 ts_tablet_manager.cc:1403] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.009s
I20260709 13:15:23.205600  3327 tablet_bootstrap.cc:492] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:23.206314  3327 ts_tablet_manager.cc:1403] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.185s	user 0.012s	sys 0.011s
I20260709 13:15:23.207521  3399 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.210251  3325 raft_consensus.cc:359] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.213651  3325 raft_consensus.cc:385] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.214085  3325 raft_consensus.cc:740] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.212795  3327 raft_consensus.cc:359] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.215523  3327 raft_consensus.cc:385] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.216020  3327 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.217454  3327 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.220798  3327 ts_tablet_manager.cc:1434] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:15:23.221853  3327 tablet_bootstrap.cc:492] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:23.218339  3325 consensus_queue.cc:260] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.224047  3333 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.224516  3333 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.225771  3325 ts_tablet_manager.cc:1434] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:15:23.227669  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:23.228634  3325 tablet_bootstrap.cc:492] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:23.228255  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:23.228283  3283 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:23.229238  3209 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:23.230187  3101 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:23.231185  3333 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.232080  3333 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:23.232486  3333 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.233036  3333 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.239652  3327 tablet_bootstrap.cc:654] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.242393  3325 tablet_bootstrap.cc:654] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.248096  3533 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:23.257860  3326 tablet_bootstrap.cc:492] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:23.258417  3326 ts_tablet_manager.cc:1403] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.152s	user 0.014s	sys 0.006s
I20260709 13:15:23.258658  3325 tablet_bootstrap.cc:492] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:23.260460  3325 ts_tablet_manager.cc:1403] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.003s
I20260709 13:15:23.256748  3333 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.259091  3032 catalog_manager.cc:5697] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.266997  3327 tablet_bootstrap.cc:492] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:23.267983  3327 ts_tablet_manager.cc:1403] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.007s
I20260709 13:15:23.269695  3333 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.269400  3325 raft_consensus.cc:359] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.272892  3325 raft_consensus.cc:385] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.273300  3325 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.273736  3327 raft_consensus.cc:359] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.274506  3327 raft_consensus.cc:385] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.274905  3327 raft_consensus.cc:740] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.274331  3325 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.276072  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:23.276638  3211 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.277516  3325 ts_tablet_manager.cc:1434] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:15:23.278831  3325 tablet_bootstrap.cc:492] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:23.282686  3327 consensus_queue.cc:260] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.285413  3333 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.288228  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:23.289031  3327 ts_tablet_manager.cc:1434] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 13:15:23.290035  3327 tablet_bootstrap.cc:492] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:23.289389  3333 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:23.288823  3282 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.286072  3326 raft_consensus.cc:359] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.293187  3326 raft_consensus.cc:385] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.293514  3326 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.294409  3326 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.298763  3211 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:23.303402  3100 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:23.307590  3326 ts_tablet_manager.cc:1434] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.002s
I20260709 13:15:23.308240  3282 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:23.309696  3326 tablet_bootstrap.cc:492] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:23.313465  3538 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.314404  3538 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.317286  3538 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.318804  3333 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:23.319293  3333 raft_consensus.cc:697] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:23.319382  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:23.320025  3333 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.322268  3282 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:23.329023  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:23.329747  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:23.330651  3533 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:23.331030  3533 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.331341  3533 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.333949  3327 tablet_bootstrap.cc:654] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.334697  3378 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:23.332552  3100 leader_election.cc:343] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.335168  3378 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.338644  3378 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:23.343672  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:23.345741  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:23.347469  3249 leader_election.cc:343] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:23.348213  3250 leader_election.cc:343] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.348841  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:23.349793  3344 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:23.350857  3325 tablet_bootstrap.cc:654] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.393683  3333 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.416329  3538 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.425765  3327 tablet_bootstrap.cc:492] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:23.425983  3325 tablet_bootstrap.cc:492] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:23.426403  3327 ts_tablet_manager.cc:1403] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.137s	user 0.015s	sys 0.013s
I20260709 13:15:23.426724  3325 ts_tablet_manager.cc:1403] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.148s	user 0.020s	sys 0.006s
I20260709 13:15:23.425999  3326 tablet_bootstrap.cc:654] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.431401  3344 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.432189  3327 raft_consensus.cc:359] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.434056  3327 raft_consensus.cc:385] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.434273  3327 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.435071  3533 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.432611  3344 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:23.439528  3100 consensus_peers.cc:597] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:23.440277  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:23.440805  3440 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:23.441687  3250 leader_election.cc:343] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.441489  3440 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.441810  3533 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.443194  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:23.443435  3440 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.443789  3283 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.445253  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:23.445173  3327 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.445930  3281 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:23.447757  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:23.446174  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:23.448385  3132 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:23.449625  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:23.447276  3033 catalog_manager.cc:5697] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.452129  3437 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:23.452217  3327 ts_tablet_manager.cc:1434] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:15:23.452562  3437 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.452906  3437 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.453263  3327 tablet_bootstrap.cc:492] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:23.449446  3325 raft_consensus.cc:359] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.454011  3325 raft_consensus.cc:385] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.454296  3325 raft_consensus.cc:740] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.454950  3325 consensus_queue.cc:260] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.458741  3325 ts_tablet_manager.cc:1434] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:15:23.459682  3325 tablet_bootstrap.cc:492] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:23.457861  3344 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:23.462965  3378 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.463498  3378 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:23.468997  3100 leader_election.cc:343] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.474771  3327 tablet_bootstrap.cc:654] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.476534  3533 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.479772  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:23.480257  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:23.480430  3134 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:23.480634  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:23.483079  3332 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:23.483711  3249 leader_election.cc:343] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.483810  3378 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:23.486241  3249 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:23.483697  3332 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.487098  3378 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:23.486197  3250 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:23.504379  3378 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:23.504761  3378 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:23.504844  3249 leader_election.cc:343] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.505143  3378 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.506565  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:23.507730  3209 raft_consensus.cc:2393] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:23.489605  3332 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:23.514747  3437 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.522253  3437 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.526053  3326 tablet_bootstrap.cc:492] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:23.526598  3326 ts_tablet_manager.cc:1403] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.217s	user 0.017s	sys 0.013s
I20260709 13:15:23.485435  3283 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:23.529448  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:23.530221  3284 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.530884  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:23.531488  3134 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.534325  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:23.542553  3327 tablet_bootstrap.cc:492] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:23.543066  3327 ts_tablet_manager.cc:1403] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.003s
I20260709 13:15:23.544296  3134 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:23.545395  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:23.545743  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:23.546963  3437 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:23.547981  3284 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:23.544461  3326 raft_consensus.cc:359] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.549234  3378 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.549877  3326 raft_consensus.cc:385] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.550218  3326 raft_consensus.cc:740] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.549877  3537 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:23.551020  3437 raft_consensus.cc:697] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:23.551462  3537 raft_consensus.cc:697] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:23.552271  3437 consensus_queue.cc:237] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.554800  3325 tablet_bootstrap.cc:654] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.554706  3327 raft_consensus.cc:359] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.555533  3327 raft_consensus.cc:385] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.555860  3327 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.556598  3327 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.557401  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:15:23.564788  3249 leader_election.cc:343] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.550884  3326 consensus_queue.cc:260] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.552682  3537 consensus_queue.cc:237] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.573918  3326 ts_tablet_manager.cc:1434] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.002s
I20260709 13:15:23.575169  3326 tablet_bootstrap.cc:492] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:23.565259  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:23.578039  3332 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.581434  3032 catalog_manager.cc:5697] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.560474  3327 ts_tablet_manager.cc:1434] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 13:15:23.586472  3332 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:23.590157  3325 tablet_bootstrap.cc:492] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:23.590855  3325 ts_tablet_manager.cc:1403] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.131s	user 0.015s	sys 0.026s
I20260709 13:15:23.591096  3326 tablet_bootstrap.cc:654] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.586485  3327 tablet_bootstrap.cc:492] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:23.593719  3325 raft_consensus.cc:359] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.594570  3325 raft_consensus.cc:385] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.594915  3325 raft_consensus.cc:740] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.596290  3325 consensus_queue.cc:260] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.599419  3325 ts_tablet_manager.cc:1434] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:23.599690  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:23.600302  3134 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.600646  3325 tablet_bootstrap.cc:492] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:23.606251  3534 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.607416  3325 tablet_bootstrap.cc:654] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.617846  3534 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.618374  3534 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.619359  3325 tablet_bootstrap.cc:492] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:23.619804  3325 ts_tablet_manager.cc:1403] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:15:23.621191  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:23.551513  3378 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:15:23.626387  3100 leader_election.cc:343] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.627388  3134 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:23.629647  3325 raft_consensus.cc:359] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.629935  3250 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:23.630775  3325 raft_consensus.cc:385] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.631019  3378 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:23.631245  3325 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.631763  3378 raft_consensus.cc:697] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:23.632200  3325 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.632658  3378 consensus_queue.cc:237] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.634125  3534 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.634938  3326 tablet_bootstrap.cc:492] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:23.637483  3325 ts_tablet_manager.cc:1434] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:15:23.638420  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:23.639989  3326 ts_tablet_manager.cc:1403] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.003s
I20260709 13:15:23.641928  3325 tablet_bootstrap.cc:492] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
W20260709 13:15:23.642992  3101 leader_election.cc:343] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.647912  3101 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:23.649323  3534 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:23.650653  3326 raft_consensus.cc:359] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.651346  3326 raft_consensus.cc:385] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.651659  3326 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.652390  3326 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.654847  3327 tablet_bootstrap.cc:654] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.659300  3326 ts_tablet_manager.cc:1434] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:15:23.660494  3352 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.660912  3326 tablet_bootstrap.cc:492] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:23.661327  3352 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.665489  3352 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.665671  3327 tablet_bootstrap.cc:492] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:23.666093  3327 ts_tablet_manager.cc:1403] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.080s	user 0.006s	sys 0.008s
I20260709 13:15:23.671839  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:23.672711  3284 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:23.673004  3030 catalog_manager.cc:5697] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.673640  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:23.680908  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:23.682458  3352 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.685869  3538 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.676129  3327 raft_consensus.cc:359] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.687155  3327 raft_consensus.cc:385] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.687518  3327 raft_consensus.cc:740] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.688261  3327 consensus_queue.cc:260] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.692500  3327 ts_tablet_manager.cc:1434] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:15:23.679080  3325 tablet_bootstrap.cc:654] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.695353  3326 tablet_bootstrap.cc:654] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.696197  3327 tablet_bootstrap.cc:492] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:23.708976  3440 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.709610  3440 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.712167  3440 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.713758  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:23.713310  3030 catalog_manager.cc:5697] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:23.717406  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:23.721383  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:23.724377  3440 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:23.732559  3352 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:23.739339  3325 tablet_bootstrap.cc:492] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:23.739802  3325 ts_tablet_manager.cc:1403] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.098s	user 0.009s	sys 0.001s
I20260709 13:15:23.739823  3326 tablet_bootstrap.cc:492] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:23.740324  3326 ts_tablet_manager.cc:1403] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.080s	user 0.019s	sys 0.019s
I20260709 13:15:23.742799  3326 raft_consensus.cc:359] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.743443  3326 raft_consensus.cc:385] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.743736  3326 raft_consensus.cc:740] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.744477  3326 consensus_queue.cc:260] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.744957  3327 tablet_bootstrap.cc:654] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.748008  3325 raft_consensus.cc:359] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.749123  3325 raft_consensus.cc:385] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.749460  3325 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.751461  3326 ts_tablet_manager.cc:1434] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:15:23.752468  3326 tablet_bootstrap.cc:492] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:23.758379  3326 tablet_bootstrap.cc:654] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.767033  3325 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.769933  3326 tablet_bootstrap.cc:492] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:23.770464  3326 ts_tablet_manager.cc:1403] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:15:23.770591  3325 ts_tablet_manager.cc:1434] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:15:23.773569  3326 raft_consensus.cc:359] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.777287  3326 raft_consensus.cc:385] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.777596  3326 raft_consensus.cc:740] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.777925  3325 tablet_bootstrap.cc:492] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:23.778587  3326 consensus_queue.cc:260] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.780331  3326 ts_tablet_manager.cc:1434] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:23.776145  3327 tablet_bootstrap.cc:492] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:23.781116  3327 ts_tablet_manager.cc:1403] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.019s
I20260709 13:15:23.782086  3326 tablet_bootstrap.cc:492] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:23.783577  3327 raft_consensus.cc:359] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.784224  3327 raft_consensus.cc:385] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.784479  3327 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.785097  3327 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.787189  3327 ts_tablet_manager.cc:1434] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:23.788039  3326 tablet_bootstrap.cc:654] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.788280  3327 tablet_bootstrap.cc:492] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:23.794221  3538 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.799213  3327 tablet_bootstrap.cc:654] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.808799  3326 tablet_bootstrap.cc:492] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:23.793171  3325 tablet_bootstrap.cc:654] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.809381  3326 ts_tablet_manager.cc:1403] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.011s
I20260709 13:15:23.812415  3326 raft_consensus.cc:359] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.813158  3326 raft_consensus.cc:385] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.813113  3333 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:23.813675  3326 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.814922  3326 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.818369  3325 tablet_bootstrap.cc:492] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:23.818856  3325 ts_tablet_manager.cc:1403] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.002s
I20260709 13:15:23.821508  3325 raft_consensus.cc:359] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.822196  3325 raft_consensus.cc:385] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.822463  3325 raft_consensus.cc:740] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.823388  3326 ts_tablet_manager.cc:1434] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:15:23.823297  3325 consensus_queue.cc:260] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.825188  3326 tablet_bootstrap.cc:492] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:23.827178  3325 ts_tablet_manager.cc:1434] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:23.828295  3325 tablet_bootstrap.cc:492] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:23.832113  3326 tablet_bootstrap.cc:654] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.833657  3352 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.834190  3352 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.836009  3325 tablet_bootstrap.cc:654] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.836401  3352 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.838765  3208 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.839635  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:23.842290  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:23.843369  3134 raft_consensus.cc:2393] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:23.845330  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:23.846927  3352 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.848769  3325 tablet_bootstrap.cc:492] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:23.849269  3325 ts_tablet_manager.cc:1403] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.008s
I20260709 13:15:23.859898  3378 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.860399  3378 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.860721  3325 raft_consensus.cc:359] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.861523  3325 raft_consensus.cc:385] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.861814  3325 raft_consensus.cc:740] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.862625  3325 consensus_queue.cc:260] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.864022  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:23.864703  3325 ts_tablet_manager.cc:1434] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:15:23.865628  3325 tablet_bootstrap.cc:492] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
W20260709 13:15:23.865521  3249 leader_election.cc:343] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.872511  3325 tablet_bootstrap.cc:654] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.875720  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:23.876641  3134 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:23.878007  3250 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:23.878819  3332 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:23.879231  3332 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.879560  3332 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.888105  3378 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:23.890853  3325 tablet_bootstrap.cc:492] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:23.891582  3325 ts_tablet_manager.cc:1403] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 13:15:23.894170  3325 raft_consensus.cc:359] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.896098  3325 raft_consensus.cc:385] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.896799  3325 raft_consensus.cc:740] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.898566  3325 consensus_queue.cc:260] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.899092  3327 tablet_bootstrap.cc:492] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:23.899587  3327 ts_tablet_manager.cc:1403] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.111s	user 0.004s	sys 0.007s
I20260709 13:15:23.900729  3325 ts_tablet_manager.cc:1434] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:15:23.901966  3327 raft_consensus.cc:359] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.902525  3327 raft_consensus.cc:385] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.902760  3327 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.903362  3327 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.904790  3325 tablet_bootstrap.cc:492] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:23.892786  3332 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.905444  3333 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.905884  3333 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.909375  3333 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.916626  3327 ts_tablet_manager.cc:1434] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 13:15:23.913014  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:23.920315  3327 tablet_bootstrap.cc:492] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:23.925566  3352 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:23.924993  3100 leader_election.cc:343] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.980311  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:23.982443  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:23.983083  3135 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.984220  3440 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.984689  3440 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.986845  3440 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:23.982896  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:23.987247  3352 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.987466  3283 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:23.991189  3534 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.991900  3352 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:23.992396  3534 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:24.000839  3249 leader_election.cc:343] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.001137  3534 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:24.001718  3135 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:24.005132  3327 tablet_bootstrap.cc:654] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.005757  3325 tablet_bootstrap.cc:654] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.014279  3534 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.011122  3250 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:24.015376  3326 tablet_bootstrap.cc:492] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:23.993956  3332 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:24.017012  3326 ts_tablet_manager.cc:1403] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.191s	user 0.054s	sys 0.079s
I20260709 13:15:24.018232  3378 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:24.018787  3378 raft_consensus.cc:697] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:24.019677  3378 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.020640  3326 raft_consensus.cc:359] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.021581  3326 raft_consensus.cc:385] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.022611  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:24.021952  3326 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.014766  3534 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.029435  3326 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.039426  3326 ts_tablet_manager.cc:1434] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:15:24.039964  3537 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.041028  3537 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.045629  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:24.050107  3352 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:24.069751  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:24.040103  3100 leader_election.cc:343] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:24.158301  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 121277us
W20260709 13:15:24.157354  3317 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.1.250.126:33381, user_credentials={real_user=slave}} blocked reactor thread for 107781us
I20260709 13:15:24.157598  3534 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:24.071545  3352 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.087s
W20260709 13:15:24.159063  3176 leader_election.cc:343] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.042644  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:24.160238  3332 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.165987  3326 tablet_bootstrap.cc:492] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:24.086443  3537 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:24.168198  3283 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:24.164371  3134 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:24.169955  3332 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:24.164716  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 90008.5us
I20260709 13:15:24.178131  3344 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.198808  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:24.200927  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:24.202019  3437 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:24.202409  3437 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.202732  3437 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.209131  3327 tablet_bootstrap.cc:492] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:24.210393  3327 ts_tablet_manager.cc:1403] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.290s	user 0.018s	sys 0.019s
W20260709 13:15:24.192446  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 120586us
I20260709 13:15:24.213490  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:24.194862  3344 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.220877  3325 tablet_bootstrap.cc:492] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:24.292204  3325 ts_tablet_manager.cc:1403] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.388s	user 0.016s	sys 0.054s
I20260709 13:15:24.266043  3327 raft_consensus.cc:359] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.293808  3327 raft_consensus.cc:385] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.283876  3101 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:24.294130  3327 raft_consensus.cc:740] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.267304  3333 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:15:24.294845  3327 consensus_queue.cc:260] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.256572  3332 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:24.252305  3344 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:24.296676  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:24.297122  3327 ts_tablet_manager.cc:1434] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.086s	user 0.010s	sys 0.008s
I20260709 13:15:24.296432  3443 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:24.298861  3443 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.299216  3443 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.302440  3327 tablet_bootstrap.cc:492] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:24.305312  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:24.305964  3281 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:24.262195  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:24.306653  3326 tablet_bootstrap.cc:654] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.306726  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:24.267045  3100 leader_election.cc:343] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.262282  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:24.307382  3285 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:24.221029  3352 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.083s
I20260709 13:15:24.267477  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:24.311941  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:24.312340  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 44963.9us
I20260709 13:15:24.314437  3580 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:24.314821  3580 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.315119  3580 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:24.315946  3250 leader_election.cc:343] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:24.317204  3100 leader_election.cc:343] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.264925  3437 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.318905  3101 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:24.310706  3134 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:24.321556  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:24.322633  3538 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:24.324805  3538 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.325205  3538 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.329598  3208 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 1: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:24.328953  3250 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:24.335362  3578 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.336037  3578 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.338989  3578 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:24.342901  3344 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:24.344167  3344 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.344713  3325 raft_consensus.cc:359] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.345340  3344 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.345577  3325 raft_consensus.cc:385] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.345943  3325 raft_consensus.cc:740] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.346751  3327 tablet_bootstrap.cc:654] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.347788  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:24.356599  3325 consensus_queue.cc:260] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.324498  3443 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.361598  3325 ts_tablet_manager.cc:1434] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.000s
I20260709 13:15:24.361776  3101 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:24.359356  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:24.365808  3101 leader_election.cc:343] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.366294  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:24.366925  3333 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:24.365207  3533 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:24.368319  3533 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.368734  3533 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.364980  3135 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:24.354444  3580 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.355247  3578 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:15:24.362371  3538 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.376688  3538 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:24.376914  3443 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:24.379355  3326 tablet_bootstrap.cc:492] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:24.379854  3326 ts_tablet_manager.cc:1403] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.214s	user 0.028s	sys 0.020s
I20260709 13:15:24.381538  3250 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:24.384651  3325 tablet_bootstrap.cc:492] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:24.395856  3333 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:24.446841  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:24.458506  3135 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.460881  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:24.461199  3573 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:24.461647  3573 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.461987  3573 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.468063  3327 tablet_bootstrap.cc:492] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:24.468524  3327 ts_tablet_manager.cc:1403] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.166s	user 0.009s	sys 0.018s
I20260709 13:15:24.475131  3326 raft_consensus.cc:359] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.475926  3326 raft_consensus.cc:385] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.476168  3326 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.479516  3326 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.483721  3352 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.485221  3326 ts_tablet_manager.cc:1434] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.008s
I20260709 13:15:24.485298  3352 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.486652  3344 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.487577  3352 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:24.488446  3280 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:24.497720  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:24.488343  3327 raft_consensus.cc:359] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.505476  3327 raft_consensus.cc:385] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.506524  3327 raft_consensus.cc:740] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.508205  3327 consensus_queue.cc:260] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.523591  3327 ts_tablet_manager.cc:1434] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.004s
I20260709 13:15:24.519780  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:24.530478  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:24.535781  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:24.537832  3030 catalog_manager.cc:5697] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.541594  3344 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:24.541888  3326 tablet_bootstrap.cc:492] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:24.522329  3580 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:24.554589  3325 tablet_bootstrap.cc:654] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.559571  3580 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.552837  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:24.567625  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:15:24.576524  3249 leader_election.cc:343] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.577064  3249 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:24.577236  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:24.577898  3279 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.574257  3282 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.580637  3578 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:24.570765  3580 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:24.588527  3584 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:15:24.595377  3325 tablet_bootstrap.cc:492] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:24.595814  3325 ts_tablet_manager.cc:1403] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.211s	user 0.012s	sys 0.003s
W20260709 13:15:24.592348  3585 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:15:24.598774  3573 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.588426  3332 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:15:24.599195  3533 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.601747  3533 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:24.602470  3326 tablet_bootstrap.cc:654] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.604630  3580 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:24.604753  3573 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:24.607631  3325 raft_consensus.cc:359] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.608388  3325 raft_consensus.cc:385] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.608690  3325 raft_consensus.cc:740] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
W20260709 13:15:24.588426  3249 leader_election.cc:343] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.644969  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:24.645891  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 88289.9us
W20260709 13:15:24.646911  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 58343.2us
I20260709 13:15:24.647341  3136 raft_consensus.cc:2393] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:24.662221  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:24.663543  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:24.664602  3134 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.663580  3207 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 1: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:15:24.678115  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 107574us
I20260709 13:15:24.691612  3573 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.680779  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:24.693807  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:24.684175  3325 consensus_queue.cc:260] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.702893  3284 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.692684  3573 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.719643  3437 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:24.720188  3327 tablet_bootstrap.cc:492] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:24.764520  3325 ts_tablet_manager.cc:1434] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.168s	user 0.008s	sys 0.000s
I20260709 13:15:24.811031  3573 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:24.816629  3325 tablet_bootstrap.cc:492] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
W20260709 13:15:24.804929  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 91618.5us
I20260709 13:15:24.853600  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:24.854460  3283 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.867398  3279 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:24.871333  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:24.882007  3284 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:24.895527  3325 tablet_bootstrap.cc:654] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.901666  3101 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:24.906124  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:24.910964  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 228978us
W20260709 13:15:24.911841  3100 leader_election.cc:343] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.918098  3207 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.919045  3283 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:24.930644  3135 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:24.932006  3538 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:24.938745  3578 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:24.940846  3326 tablet_bootstrap.cc:492] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:24.941721  3326 ts_tablet_manager.cc:1403] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.400s	user 0.011s	sys 0.008s
I20260709 13:15:24.935993  3538 raft_consensus.cc:697] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:24.949819  3538 consensus_queue.cc:237] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:24.951357  3176 leader_election.cc:343] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.951910  3101 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:24.946273  3134 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
W20260709 13:15:24.944286  3250 leader_election.cc:343] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.948197  3327 tablet_bootstrap.cc:654] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.960193  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:24.956517  3100 leader_election.cc:343] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.983819  3534 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:24.984400  3534 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:24.985863  3534 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:24.986562  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:25.011251  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:25.012503  3580 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.013159  3250 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:25.014356  3332 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.015025  3332 raft_consensus.cc:697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:25.016067  3332 consensus_queue.cc:237] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.013932  3580 raft_consensus.cc:697] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:25.025488  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:25.026664  3578 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:15:25.027436  3249 leader_election.cc:343] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.025975  3580 consensus_queue.cc:237] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.024544  3326 raft_consensus.cc:359] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.030864  3326 raft_consensus.cc:385] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.031278  3326 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.032027  3326 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.035145  3326 ts_tablet_manager.cc:1434] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.093s	user 0.004s	sys 0.012s
W20260709 13:15:25.038249  3082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:15:25.035851  3176 leader_election.cc:343] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:25.041886  3249 leader_election.cc:343] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.043133  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:25.044004  3578 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.045527  3578 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:25.053393  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:25.061004  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:25.061990  3281 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:25.075634  3534 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.081627  3582 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.084071  3326 tablet_bootstrap.cc:492] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:25.078845  3534 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.102321  3534 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:25.063788  3282 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:25.104419  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:25.105487  3280 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 1: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:25.106767  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:25.107472  3101 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:25.111760  3608 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.112550  3608 raft_consensus.cc:697] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:15:25.116902  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 63621.2us
I20260709 13:15:25.118409  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:25.116890  3332 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.124963  3582 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.124986  3332 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.127147  3582 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:25.128189  3582 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.128834  3332 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:25.136672  3030 catalog_manager.cc:5697] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.140242  3325 tablet_bootstrap.cc:492] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:25.143646  3325 ts_tablet_manager.cc:1403] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.327s	user 0.017s	sys 0.036s
I20260709 13:15:25.116973  3608 consensus_queue.cc:237] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.145789  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:25.165902  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:25.168004  3327 tablet_bootstrap.cc:492] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:25.172099  3325 raft_consensus.cc:359] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.173213  3327 ts_tablet_manager.cc:1403] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.454s	user 0.044s	sys 0.013s
W20260709 13:15:25.174104  3100 leader_election.cc:343] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.173147  3325 raft_consensus.cc:385] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.174849  3325 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.175912  3327 raft_consensus.cc:359] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.176681  3327 raft_consensus.cc:385] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.176998  3327 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.177011  3580 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.177618  3580 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.177708  3327 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.178071  3580 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.178933  3326 tablet_bootstrap.cc:654] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.180953  3325 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.182945  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:25.188598  3327 ts_tablet_manager.cc:1434] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:15:25.194002  3327 tablet_bootstrap.cc:492] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:25.188871  3325 ts_tablet_manager.cc:1434] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:15:25.198439  3325 tablet_bootstrap.cc:492] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:25.207558  3100 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:25.208501  3333 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:25.215205  3250 leader_election.cc:343] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.232898  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:25.236213  3333 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.223562  3580 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.252949  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:25.254070  3580 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:15:25.238391  3249 leader_election.cc:343] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:25.255007  3176 leader_election.cc:343] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.242879  3326 tablet_bootstrap.cc:492] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:25.255447  3249 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:25.255860  3326 ts_tablet_manager.cc:1403] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.172s	user 0.012s	sys 0.008s
I20260709 13:15:25.256426  3332 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.258790  3327 tablet_bootstrap.cc:654] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.258977  3031 catalog_manager.cc:5697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.263180  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:25.263900  3283 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.259083  3326 raft_consensus.cc:359] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.265439  3326 raft_consensus.cc:385] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.270504  3326 raft_consensus.cc:740] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.272660  3326 consensus_queue.cc:260] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.275321  3032 catalog_manager.cc:5697] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.277539  3032 catalog_manager.cc:5697] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.283591  3283 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:25.286746  3327 tablet_bootstrap.cc:492] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:25.287263  3327 ts_tablet_manager.cc:1403] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.000s
I20260709 13:15:25.288386  3326 ts_tablet_manager.cc:1434] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.003s
I20260709 13:15:25.248447  3325 tablet_bootstrap.cc:654] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.290326  3326 tablet_bootstrap.cc:492] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:25.292629  3327 raft_consensus.cc:359] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.293339  3327 raft_consensus.cc:385] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.293612  3327 raft_consensus.cc:740] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.294227  3327 consensus_queue.cc:260] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.296003  3327 ts_tablet_manager.cc:1434] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:25.297029  3327 tablet_bootstrap.cc:492] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:25.298127  3326 tablet_bootstrap.cc:654] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.302872  3327 tablet_bootstrap.cc:654] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.306016  3031 catalog_manager.cc:5697] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.314488  3327 tablet_bootstrap.cc:492] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:25.314971  3327 ts_tablet_manager.cc:1403] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.011s
I20260709 13:15:25.315840  3580 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.316329  3580 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.318421  3580 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:25.323734  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:25.324261  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:25.324707  3136 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:25.326155  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:25.327817  3176 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:25.328763  3582 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.329207  3580 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.329348  3582 raft_consensus.cc:697] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:25.330416  3582 consensus_queue.cc:237] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.344143  3034 catalog_manager.cc:5697] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.347191  3326 tablet_bootstrap.cc:492] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:25.348775  3326 ts_tablet_manager.cc:1403] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.059s	user 0.025s	sys 0.013s
I20260709 13:15:25.338155  3327 raft_consensus.cc:359] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.351058  3327 raft_consensus.cc:385] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.351498  3327 raft_consensus.cc:740] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.353690  3326 raft_consensus.cc:359] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.354528  3580 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.356948  3325 tablet_bootstrap.cc:492] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:25.357573  3325 ts_tablet_manager.cc:1403] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.159s	user 0.017s	sys 0.021s
I20260709 13:15:25.356976  3326 raft_consensus.cc:385] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.358381  3326 raft_consensus.cc:740] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.359807  3326 consensus_queue.cc:260] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.361357  3327 consensus_queue.cc:260] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.363907  3327 ts_tablet_manager.cc:1434] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.002s
I20260709 13:15:25.365058  3327 tablet_bootstrap.cc:492] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:25.365741  3326 ts_tablet_manager.cc:1434] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:15:25.366766  3326 tablet_bootstrap.cc:492] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:25.360426  3325 raft_consensus.cc:359] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.368073  3325 raft_consensus.cc:385] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.368706  3325 raft_consensus.cc:740] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.369787  3325 consensus_queue.cc:260] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.373436  3326 tablet_bootstrap.cc:654] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.371058  3327 tablet_bootstrap.cc:654] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.374945  3325 ts_tablet_manager.cc:1434] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:15:25.376508  3325 tablet_bootstrap.cc:492] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:25.386802  3325 tablet_bootstrap.cc:654] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.418147  3031 catalog_manager.cc:5697] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.423444  3352 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.424170  3352 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.431161  3352 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:25.431006  3592 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:25.434907  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:25.438334  3582 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.438985  3582 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.431951  3608 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.440469  3608 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.442077  3582 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:25.443423  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:25.445852  3100 leader_election.cc:343] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.445487  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:25.446255  3332 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.447057  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:25.448665  3608 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:25.434093  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:25.449800  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:25.451097  3176 leader_election.cc:343] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.451599  3282 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
W20260709 13:15:25.451773  3176 leader_election.cc:343] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.452280  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:25.451784  3283 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:25.452955  3101 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:25.453516  3352 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.454021  3608 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.461333  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:25.460616  3608 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.467140  3608 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.469002  3332 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.478039  3327 tablet_bootstrap.cc:492] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:25.478704  3327 ts_tablet_manager.cc:1403] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.114s	user 0.038s	sys 0.044s
I20260709 13:15:25.464633  3352 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.497166  3327 raft_consensus.cc:359] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.497869  3327 raft_consensus.cc:385] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.498131  3327 raft_consensus.cc:740] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.498752  3327 consensus_queue.cc:260] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:25.504089  3100 consensus_peers.cc:597] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:25.508524  3326 tablet_bootstrap.cc:492] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:25.509032  3327 ts_tablet_manager.cc:1434] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:15:25.509253  3326 ts_tablet_manager.cc:1403] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.143s	user 0.018s	sys 0.036s
I20260709 13:15:25.518877  3325 tablet_bootstrap.cc:492] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:25.525892  3325 ts_tablet_manager.cc:1403] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.150s	user 0.019s	sys 0.009s
I20260709 13:15:25.526309  3582 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.525059  3327 tablet_bootstrap.cc:492] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:25.528175  3326 raft_consensus.cc:359] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.528992  3326 raft_consensus.cc:385] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.529330  3326 raft_consensus.cc:740] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.530036  3326 consensus_queue.cc:260] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.532765  3326 ts_tablet_manager.cc:1434] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:15:25.533447  3333 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.534054  3326 tablet_bootstrap.cc:492] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:25.532474  3325 raft_consensus.cc:359] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.536144  3325 raft_consensus.cc:385] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.536477  3325 raft_consensus.cc:740] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.524775  3352 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.537139  3325 consensus_queue.cc:260] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:25.543053  3637 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:15:25.547761  3325 ts_tablet_manager.cc:1434] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:15:25.549175  3325 tablet_bootstrap.cc:492] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:25.549607  3592 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.568128  3327 tablet_bootstrap.cc:654] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.569765  3352 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:15:25.593287  3333 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:25.601331  3326 tablet_bootstrap.cc:654] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.617813  3608 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.619035  3352 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:25.647630  3325 tablet_bootstrap.cc:654] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.652820  3332 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.653522  3332 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.656826  3332 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:25.670296  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:25.670985  3207 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:25.671540  3573 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.672024  3573 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.672263  3249 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:25.674253  3573 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:25.675443  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:25.676084  3131 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:25.677284  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:25.678610  3249 leader_election.cc:343] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.674526  3574 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.679417  3574 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.679752  3574 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.681093  3608 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:25.681437  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:25.682312  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:25.682956  3131 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:25.685070  3250 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:25.686633  3573 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.688591  3574 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.690507  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:25.690335  3352 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.691031  3284 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.687258  3573 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.700474  3284 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:25.697005  3573 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.710736  3101 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:25.717593  3534 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.737703  3206 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.739140  3534 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:15:25.739717  3100 leader_election.cc:343] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.740110  3534 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.740818  3573 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.746390  3574 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:25.748391  3573 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:25.769908  3326 tablet_bootstrap.cc:492] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:25.770609  3326 ts_tablet_manager.cc:1403] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.237s	user 0.015s	sys 0.025s
I20260709 13:15:25.775513  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:25.776144  3135 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.776952  3325 tablet_bootstrap.cc:492] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:25.777493  3325 ts_tablet_manager.cc:1403] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.229s	user 0.015s	sys 0.016s
I20260709 13:15:25.778368  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:25.779134  3130 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.780056  3325 raft_consensus.cc:359] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.780701  3325 raft_consensus.cc:385] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.780965  3325 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.781592  3325 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.770710  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:25.782542  3205 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.783821  3325 ts_tablet_manager.cc:1434] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:25.788601  3325 tablet_bootstrap.cc:492] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:25.795240  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:25.806340  3647 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.805768  3135 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:25.813627  3647 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.814060  3250 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:25.819126  3647 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:15:25.820632  3249 leader_election.cc:343] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.822010  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:25.819840  3332 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.823923  3332 raft_consensus.cc:697] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:25.824678  3332 consensus_queue.cc:237] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.827476  3650 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:15:25.833487  3326 raft_consensus.cc:359] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.834489  3580 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.837796  3326 raft_consensus.cc:385] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.838194  3326 raft_consensus.cc:740] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.839048  3326 consensus_queue.cc:260] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.837934  3580 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.838102  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:25.846308  3580 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:25.848151  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:25.852450  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:25.889678  3326 ts_tablet_manager.cc:1434] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.119s	user 0.006s	sys 0.001s
I20260709 13:15:25.907954  3325 tablet_bootstrap.cc:654] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.899729  3282 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 1: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:25.914394  3205 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:25.917411  3130 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:25.925009  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:25.925009  3250 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:25.929163  3573 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.923785  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:25.929726  3573 raft_consensus.cc:697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:25.933486  3327 tablet_bootstrap.cc:492] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:25.933964  3327 ts_tablet_manager.cc:1403] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.409s	user 0.010s	sys 0.018s
I20260709 13:15:25.932225  3592 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.941833  3582 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:25.938961  3573 consensus_queue.cc:237] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.946789  3326 tablet_bootstrap.cc:492] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:25.948553  3031 catalog_manager.cc:5697] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.956585  3600 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:25.957244  3325 tablet_bootstrap.cc:492] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:25.957821  3325 ts_tablet_manager.cc:1403] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.170s	user 0.008s	sys 0.006s
I20260709 13:15:25.959363  3592 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.967504  3592 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.968031  3592 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.968263  3582 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.971772  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:25.972304  3592 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:25.971484  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:25.973707  3101 leader_election.cc:343] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:25.975448  3100 leader_election.cc:343] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.976382  3100 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:25.981611  3649 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.984782  3325 raft_consensus.cc:359] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.986974  3327 raft_consensus.cc:359] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:25.987950  3327 raft_consensus.cc:385] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.988235  3325 raft_consensus.cc:385] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.988310  3327 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.988628  3325 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.989310  3327 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.003178  3325 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.006501  3325 ts_tablet_manager.cc:1434] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:15:26.011349  3327 ts_tablet_manager.cc:1434] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.000s
I20260709 13:15:26.005971  3578 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.017443  3650 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.017983  3650 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.015928  3578 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.024619  3650 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:26.024750  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:26.025481  3325 tablet_bootstrap.cc:492] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:26.027135  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:26.027731  3283 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:26.029036  3327 tablet_bootstrap.cc:492] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
W20260709 13:15:26.029382  3100 leader_election.cc:343] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.030468  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:26.031908  3578 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:26.032042  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:26.035212  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:26.035864  3326 tablet_bootstrap.cc:654] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.036898  3592 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:26.037180  3249 leader_election.cc:343] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.037328  3592 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.040855  3592 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.053880  3327 tablet_bootstrap.cc:654] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.071025  3325 tablet_bootstrap.cc:654] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.090269  3030 catalog_manager.cc:5697] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.097400  3578 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.097942  3578 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.099850  3327 tablet_bootstrap.cc:492] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:26.100317  3327 ts_tablet_manager.cc:1403] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.008s
I20260709 13:15:26.102535  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:26.103348  3326 tablet_bootstrap.cc:492] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:26.103797  3326 ts_tablet_manager.cc:1403] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.157s	user 0.012s	sys 0.004s
W20260709 13:15:26.103935  3250 leader_election.cc:343] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.104864  3592 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.105669  3578 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:26.107594  3135 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:26.107501  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:26.107833  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:26.107995  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:26.108525  3283 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:26.108762  3249 leader_election.cc:343] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.109143  3249 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:26.110072  3578 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:26.112291  3100 leader_election.cc:343] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.111470  3592 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:26.111059  3250 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:26.115248  3283 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:26.116076  3578 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.116501  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:26.117254  3592 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.117895  3592 raft_consensus.cc:697] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:26.118718  3592 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.133424  3326 raft_consensus.cc:359] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.134567  3326 raft_consensus.cc:385] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.135036  3326 raft_consensus.cc:740] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.134991  3327 raft_consensus.cc:359] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.138170  3327 raft_consensus.cc:385] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.138476  3327 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.139902  3030 catalog_manager.cc:5697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.142428  3327 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.143982  3326 consensus_queue.cc:260] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.146589  3326 ts_tablet_manager.cc:1434] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.003s
I20260709 13:15:26.147843  3326 tablet_bootstrap.cc:492] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:26.151151  3325 tablet_bootstrap.cc:492] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:26.151628  3325 ts_tablet_manager.cc:1403] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.020s
I20260709 13:15:26.154237  3325 raft_consensus.cc:359] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.154894  3325 raft_consensus.cc:385] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.155155  3325 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.156667  3327 ts_tablet_manager.cc:1434] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.001s
I20260709 13:15:26.157900  3325 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.158830  3327 tablet_bootstrap.cc:492] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:26.159307  3326 tablet_bootstrap.cc:654] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.175431  3034 catalog_manager.cc:5697] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.186427  3325 ts_tablet_manager.cc:1434] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 13:15:26.187780  3325 tablet_bootstrap.cc:492] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:26.195202  3327 tablet_bootstrap.cc:654] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.198770  3325 tablet_bootstrap.cc:654] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.209502  3327 tablet_bootstrap.cc:492] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:26.209995  3327 ts_tablet_manager.cc:1403] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.003s
I20260709 13:15:26.210451  3326 tablet_bootstrap.cc:492] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:26.210906  3326 ts_tablet_manager.cc:1403] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.019s
I20260709 13:15:26.212779  3327 raft_consensus.cc:359] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.213620  3327 raft_consensus.cc:385] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.213917  3327 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.214677  3327 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.217557  3326 raft_consensus.cc:359] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.218218  3326 raft_consensus.cc:385] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.218457  3326 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.219154  3326 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.221585  3326 ts_tablet_manager.cc:1434] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:26.222609  3326 tablet_bootstrap.cc:492] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:26.223660  3327 ts_tablet_manager.cc:1434] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:15:26.226312  3327 tablet_bootstrap.cc:492] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:26.230306  3326 tablet_bootstrap.cc:654] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.233577  3327 tablet_bootstrap.cc:654] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.238183  3325 tablet_bootstrap.cc:492] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:26.238637  3325 ts_tablet_manager.cc:1403] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.003s
I20260709 13:15:26.241402  3325 raft_consensus.cc:359] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.242044  3325 raft_consensus.cc:385] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.242316  3325 raft_consensus.cc:740] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.243085  3325 consensus_queue.cc:260] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.243654  3206 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.245622  3325 ts_tablet_manager.cc:1434] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:26.246920  3325 tablet_bootstrap.cc:492] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:26.253331  3325 tablet_bootstrap.cc:654] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:26.257634  3082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:26.257910  3592 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.257893  3327 tablet_bootstrap.cc:492] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:26.259505  3327 ts_tablet_manager.cc:1403] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:15:26.269914  3327 raft_consensus.cc:359] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.271124  3327 raft_consensus.cc:385] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.271406  3327 raft_consensus.cc:740] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.272192  3327 consensus_queue.cc:260] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.279783  3327 ts_tablet_manager.cc:1434] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:15:26.281155  3327 tablet_bootstrap.cc:492] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:26.284832  3325 tablet_bootstrap.cc:492] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:26.285430  3325 ts_tablet_manager.cc:1403] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.015s
I20260709 13:15:26.287406  3327 tablet_bootstrap.cc:654] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.289394  3325 raft_consensus.cc:359] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.290356  3325 raft_consensus.cc:385] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.290683  3325 raft_consensus.cc:740] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.291363  3325 consensus_queue.cc:260] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.293610  3325 ts_tablet_manager.cc:1434] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:15:26.295298  3325 tablet_bootstrap.cc:492] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:26.298139  3600 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.298717  3600 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.300725  3600 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:26.302443  3325 tablet_bootstrap.cc:654] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.309235  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:26.310355  3283 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:26.315577  3648 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.316203  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:26.318375  3325 tablet_bootstrap.cc:492] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:26.318879  3325 ts_tablet_manager.cc:1403] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.007s
I20260709 13:15:26.322001  3325 raft_consensus.cc:359] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.322817  3325 raft_consensus.cc:385] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.323146  3325 raft_consensus.cc:740] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.324244  3325 consensus_queue.cc:260] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.328047  3325 ts_tablet_manager.cc:1434] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:15:26.329913  3325 tablet_bootstrap.cc:492] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:26.329057  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:26.335845  3325 tablet_bootstrap.cc:654] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.336390  3352 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.362514  3325 tablet_bootstrap.cc:492] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:26.363127  3325 ts_tablet_manager.cc:1403] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.005s
I20260709 13:15:26.367589  3325 raft_consensus.cc:359] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.370870  3325 raft_consensus.cc:385] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.371228  3325 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.372056  3325 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.373987  3352 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.374509  3325 ts_tablet_manager.cc:1434] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:15:26.375849  3325 tablet_bootstrap.cc:492] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:26.384620  3325 tablet_bootstrap.cc:654] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.382118  3326 tablet_bootstrap.cc:492] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:26.386193  3326 ts_tablet_manager.cc:1403] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.164s	user 0.029s	sys 0.044s
I20260709 13:15:26.388804  3326 raft_consensus.cc:359] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.389389  3326 raft_consensus.cc:385] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.389672  3326 raft_consensus.cc:740] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.391258  3327 tablet_bootstrap.cc:492] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:26.391690  3327 ts_tablet_manager.cc:1403] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.111s	user 0.006s	sys 0.007s
I20260709 13:15:26.393391  3326 consensus_queue.cc:260] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.393966  3327 raft_consensus.cc:359] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.396202  3327 raft_consensus.cc:385] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.396490  3327 raft_consensus.cc:740] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.397224  3327 consensus_queue.cc:260] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.399156  3327 ts_tablet_manager.cc:1434] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:26.400360  3327 tablet_bootstrap.cc:492] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:26.397795  3326 ts_tablet_manager.cc:1434] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:15:26.404210  3326 tablet_bootstrap.cc:492] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:26.411056  3326 tablet_bootstrap.cc:654] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.424764  3327 tablet_bootstrap.cc:654] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.428732  3648 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.429279  3648 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.430976  3592 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.431512  3592 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.432713  3326 tablet_bootstrap.cc:492] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:26.432921  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:26.433439  3326 ts_tablet_manager.cc:1403] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.009s
I20260709 13:15:26.433853  3592 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:26.434923  3648 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:26.436174  3327 tablet_bootstrap.cc:492] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:26.436280  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:26.436630  3327 ts_tablet_manager.cc:1403] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.003s
I20260709 13:15:26.436980  3282 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:26.436717  3326 raft_consensus.cc:359] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.437664  3326 raft_consensus.cc:385] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.437985  3326 raft_consensus.cc:740] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.439860  3325 tablet_bootstrap.cc:492] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:26.440310  3325 ts_tablet_manager.cc:1403] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.001s
W20260709 13:15:26.440297  3100 leader_election.cc:343] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.440634  3326 consensus_queue.cc:260] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.441708  3327 raft_consensus.cc:359] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.442348  3327 raft_consensus.cc:385] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.442615  3327 raft_consensus.cc:740] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.443111  3326 ts_tablet_manager.cc:1434] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:26.443431  3325 raft_consensus.cc:359] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.444160  3325 raft_consensus.cc:385] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.444291  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:26.444965  3326 tablet_bootstrap.cc:492] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:26.445117  3277 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:26.446318  3101 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:26.447163  3592 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.447485  3101 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:26.447543  3592 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.448061  3592 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.448398  3648 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.448890  3648 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.449318  3648 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.454645  3578 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.455194  3578 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.457048  3573 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.443224  3327 consensus_queue.cc:260] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.462745  3327 ts_tablet_manager.cc:1434] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:15:26.482671  3578 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:26.483211  3327 tablet_bootstrap.cc:492] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:26.483754  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:26.486199  3574 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.488464  3207 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:26.488804  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:26.490985  3250 leader_election.cc:343] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.491390  3648 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.493825  3327 tablet_bootstrap.cc:654] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.495223  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:26.496027  3648 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:26.495260  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:26.496755  3211 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.476920  3592 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.498775  3592 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:26.499441  3327 tablet_bootstrap.cc:492] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:26.500001  3327 ts_tablet_manager.cc:1403] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:15:26.501518  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:26.503201  3211 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:26.503245  3327 raft_consensus.cc:359] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.504360  3327 raft_consensus.cc:385] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.504669  3327 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.505432  3327 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.507159  3327 ts_tablet_manager.cc:1434] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:26.508100  3327 tablet_bootstrap.cc:492] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
W20260709 13:15:26.508441  3249 leader_election.cc:343] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.508667  3100 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:26.508863  3249 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:15:26.509877  3100 leader_election.cc:343] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.510047  3650 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.510529  3650 raft_consensus.cc:697] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:26.511399  3650 consensus_queue.cc:237] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.444460  3325 raft_consensus.cc:740] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.514663  3578 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.515451  3327 tablet_bootstrap.cc:654] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.495509  3326 tablet_bootstrap.cc:654] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.520566  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:26.520749  3592 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.521260  3282 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.521500  3592 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.525014  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:26.525691  3209 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:26.526808  3100 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:26.527334  3578 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.527590  3648 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.527477  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:26.528021  3648 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.527837  3578 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.528272  3277 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.528419  3648 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.529844  3578 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:26.533046  3327 tablet_bootstrap.cc:492] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:26.533583  3327 ts_tablet_manager.cc:1403] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.000s
I20260709 13:15:26.515391  3325 consensus_queue.cc:260] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.535341  3592 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:26.538304  3277 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:26.539503  3648 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.540846  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:26.542172  3325 ts_tablet_manager.cc:1434] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.000s
W20260709 13:15:26.542500  3249 leader_election.cc:343] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.543103  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:26.543684  3207 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.548555  3325 tablet_bootstrap.cc:492] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:26.548492  3101 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:26.549539  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:26.540429  3327 raft_consensus.cc:359] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.551324  3327 raft_consensus.cc:385] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.551625  3327 raft_consensus.cc:740] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
W20260709 13:15:26.553028  3250 leader_election.cc:343] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.552913  3649 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.558674  3250 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:26.552776  3327 consensus_queue.cc:260] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.559360  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:26.560004  3283 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.554374  3211 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.555045  3648 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:26.574386  3332 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:26.579455  3326 tablet_bootstrap.cc:492] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:26.579982  3326 ts_tablet_manager.cc:1403] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.136s	user 0.012s	sys 0.002s
I20260709 13:15:26.581768  3327 ts_tablet_manager.cc:1434] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:15:26.563922  3573 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.560875  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:26.582669  3283 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:26.584897  3101 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:26.583323  3649 raft_consensus.cc:697] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:26.586989  3282 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:26.601714  3332 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.602206  3332 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.604166  3332 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:26.604899  3573 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:15:26.612123  3592 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.612656  3592 raft_consensus.cc:697] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:26.618556  3327 tablet_bootstrap.cc:492] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
W20260709 13:15:26.625751  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 57058.5us
I20260709 13:15:26.600864  3277 raft_consensus.cc:2376] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1. Re-sending same reply.
I20260709 13:15:26.613552  3592 consensus_queue.cc:237] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.632176  3207 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:26.634279  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:26.634363  3326 raft_consensus.cc:359] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.621023  3580 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.634284  3325 tablet_bootstrap.cc:654] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.635110  3326 raft_consensus.cc:385] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.635102  3132 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:26.640367  3326 raft_consensus.cc:740] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.644145  3326 consensus_queue.cc:260] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.649286  3582 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.649219  3573 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.649618  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:26.649856  3582 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.649963  3573 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.648336  3580 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.651813  3582 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:26.652611  3580 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:26.651855  3573 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:26.654947  3250 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:26.647877  3649 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.686762  3352 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.687440  3352 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.682971  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:26.662264  3574 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.695717  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:26.707152  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:26.709791  3332 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.710084  3574 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.710487  3574 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.710251  3332 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.710094  3326 ts_tablet_manager.cc:1434] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.130s	user 0.008s	sys 0.000s
I20260709 13:15:26.712116  3326 tablet_bootstrap.cc:492] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:26.712131  3332 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:15:26.714856  3250 leader_election.cc:343] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:26.697512  3249 leader_election.cc:343] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.716419  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:26.716531  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:26.741911  3686 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 13:15:26.749060  3250 leader_election.cc:343] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.737457  3325 tablet_bootstrap.cc:492] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:26.739964  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:26.753649  3325 ts_tablet_manager.cc:1403] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.211s	user 0.016s	sys 0.009s
I20260709 13:15:26.742811  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:26.695811  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:26.696821  3352 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:26.757715  3325 raft_consensus.cc:359] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.761009  3325 raft_consensus.cc:385] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.761471  3325 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.762506  3325 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:26.746484  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 49018.2us
I20260709 13:15:26.769133  3326 tablet_bootstrap.cc:654] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.775934  3325 ts_tablet_manager.cc:1434] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:15:26.774392  3031 catalog_manager.cc:5697] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.787353  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:26.719619  3327 tablet_bootstrap.cc:654] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:26.798745  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 102476us
I20260709 13:15:26.801280  3176 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:26.804497  3176 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:26.805292  3352 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:26.827104  3249 leader_election.cc:343] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.827616  3249 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:26.829414  3332 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.829694  3325 tablet_bootstrap.cc:492] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:26.809474  3582 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.768976  3574 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.842675  3207 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.833901  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:26.856671  3282 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:26.858232  3574 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:26.867497  3693 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.868026  3693 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.870093  3693 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:26.875283  3325 tablet_bootstrap.cc:654] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:26.876988  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 48056.3us
W20260709 13:15:26.878057  3249 leader_election.cc:343] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.878654  3249 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:26.885725  3332 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.886379  3332 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.910219  3573 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:26.924549  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 46555us
I20260709 13:15:26.927774  3332 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:26.928574  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:26.930330  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:26.931746  3136 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.932763  3582 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.933277  3582 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.935299  3582 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:26.938639  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:26.940893  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:26.941241  3650 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:26.943799  3100 leader_election.cc:343] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.945605  3352 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:26.946689  3250 leader_election.cc:343] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.949981  3698 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.965253  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:26.969447  3136 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:26.972437  3327 tablet_bootstrap.cc:492] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:26.972945  3327 ts_tablet_manager.cc:1403] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.356s	user 0.017s	sys 0.008s
I20260709 13:15:26.974872  3250 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:26.950526  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:26.977752  3327 raft_consensus.cc:359] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.985167  3327 raft_consensus.cc:385] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.985491  3327 raft_consensus.cc:740] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.987691  3327 consensus_queue.cc:260] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:26.988080  3352 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:26.992914  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 45197.7us
I20260709 13:15:26.973872  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:26.987347  3578 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.957548  3698 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.030376  3281 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:27.059207  3326 tablet_bootstrap.cc:492] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:27.059876  3326 ts_tablet_manager.cc:1403] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.348s	user 0.019s	sys 0.012s
I20260709 13:15:27.041271  3578 raft_consensus.cc:697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:27.094769  3698 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:27.095535  3325 tablet_bootstrap.cc:492] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:27.096037  3325 ts_tablet_manager.cc:1403] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.270s	user 0.010s	sys 0.005s
I20260709 13:15:27.104769  3578 consensus_queue.cc:237] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.114477  3325 raft_consensus.cc:359] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.124399  3693 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.150121  3325 raft_consensus.cc:385] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.152354  3325 raft_consensus.cc:740] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.153115  3325 consensus_queue.cc:260] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.157652  3325 ts_tablet_manager.cc:1434] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 13:15:27.158831  3325 tablet_bootstrap.cc:492] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:27.121188  3326 raft_consensus.cc:359] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.161314  3326 raft_consensus.cc:385] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.161614  3326 raft_consensus.cc:740] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.162292  3326 consensus_queue.cc:260] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.128852  3582 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.166260  3582 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.168645  3101 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:27.169092  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:27.169695  3689 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.170154  3689 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.170529  3689 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.171432  3582 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:27.118120  3695 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.136898  3327 ts_tablet_manager.cc:1434] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.164s	user 0.007s	sys 0.001s
W20260709 13:15:27.175879  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 134206us
W20260709 13:15:27.178123  3249 leader_election.cc:343] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.178535  3249 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:27.178781  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:27.179435  3278 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:27.179512  3710 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.180807  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:27.181828  3249 leader_election.cc:343] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.183045  3327 tablet_bootstrap.cc:492] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:27.179553  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:27.188619  3136 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:27.189862  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:27.181856  3276 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:27.192818  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:27.193413  3134 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
I20260709 13:15:27.190884  3580 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.194568  3580 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.195006  3580 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.164901  3326 ts_tablet_manager.cc:1434] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.105s	user 0.004s	sys 0.004s
I20260709 13:15:27.200302  3176 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:27.206450  3352 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.206928  3352 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.207217  3352 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.203496  3250 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:27.232594  3710 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.233060  3710 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.233457  3710 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.234707  3326 tablet_bootstrap.cc:492] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:27.238240  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:27.221359  3689 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.250099  3687 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:15:27.254933  3352 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.263134  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:27.264140  3131 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:27.275403  3687 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.282186  3580 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.282090  3327 tablet_bootstrap.cc:654] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.287776  3325 tablet_bootstrap.cc:654] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.286067  3352 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:27.290216  3209 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 1: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:27.291311  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:27.291955  3278 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.270996  3710 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:27.289767  3311 tablet.cc:2406] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:27.313786  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:27.314622  3134 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.294127  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:27.311122  3580 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:27.334208  3694 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.085s
W20260709 13:15:27.354601  3082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:27.357147  3325 tablet_bootstrap.cc:492] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:27.357635  3325 ts_tablet_manager.cc:1403] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.199s	user 0.018s	sys 0.006s
I20260709 13:15:27.332419  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:27.361876  3326 tablet_bootstrap.cc:654] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.370330  3206 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 1: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:27.358711  3710 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:27.372823  3134 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:27.374289  3700 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.359479  3689 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:27.360671  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:27.389878  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:27.390720  3208 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 1: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:27.391717  3250 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:27.392769  3327 tablet_bootstrap.cc:492] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:27.393242  3327 ts_tablet_manager.cc:1403] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.211s	user 0.039s	sys 0.027s
I20260709 13:15:27.374765  3700 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.397660  3700 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:27.423153  3327 raft_consensus.cc:359] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.423882  3327 raft_consensus.cc:385] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.424150  3327 raft_consensus.cc:740] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.425284  3327 consensus_queue.cc:260] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.407616  3276 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:27.379693  3278 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:27.438053  3176 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:27.441867  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:27.429514  3650 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.443337  3327 ts_tablet_manager.cc:1434] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.003s
I20260709 13:15:27.454289  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:27.449172  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:27.450642  3650 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.456919  3279 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 1: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:27.458652  3650 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:27.459388  3725 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.459816  3711 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.460007  3725 raft_consensus.cc:697] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:27.460502  3711 raft_consensus.cc:697] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:27.464989  3101 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:27.465361  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:27.463682  3031 catalog_manager.cc:5697] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:15:27.466897  3327 tablet_bootstrap.cc:492] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:27.467448  3031 catalog_manager.cc:5697] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
W20260709 13:15:27.470420  3249 leader_election.cc:343] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.437170  3649 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:15:27.469890  3650 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.469686  3580 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.461158  3725 consensus_queue.cc:237] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.461565  3711 consensus_queue.cc:237] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:27.490904  3250 leader_election.cc:343] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.491794  3250 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:27.490919  3325 raft_consensus.cc:359] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.493256  3325 raft_consensus.cc:385] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.493466  3325 raft_consensus.cc:740] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.493996  3325 consensus_queue.cc:260] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.496631  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:27.497290  3276 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:27.509543  3325 ts_tablet_manager.cc:1434] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.152s	user 0.009s	sys 0.000s
I20260709 13:15:27.510758  3325 tablet_bootstrap.cc:492] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:27.512077  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:27.499394  3700 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.525563  3101 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:27.535732  3326 tablet_bootstrap.cc:492] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:27.536204  3326 ts_tablet_manager.cc:1403] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.313s	user 0.030s	sys 0.024s
W20260709 13:15:27.549962  3100 leader_election.cc:343] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.534057  3650 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.555691  3032 catalog_manager.cc:5697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.558432  3650 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.569917  3650 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.581789  3710 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.655100  3207 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.649937  3574 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.657289  3574 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.661369  3326 raft_consensus.cc:359] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.662286  3326 raft_consensus.cc:385] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.662602  3326 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.664919  3326 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.692934  3325 tablet_bootstrap.cc:654] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.697503  3327 tablet_bootstrap.cc:654] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.716730  3326 ts_tablet_manager.cc:1434] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.180s	user 0.008s	sys 0.000s
I20260709 13:15:27.719604  3574 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:27.724203  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:27.730799  3249 leader_election.cc:343] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.733371  3710 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.734355  3650 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.738158  3650 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:27.739709  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:15:27.741515  3100 leader_election.cc:343] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.742938  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:27.740000  3325 tablet_bootstrap.cc:492] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:27.746141  3325 ts_tablet_manager.cc:1403] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.236s	user 0.014s	sys 0.000s
I20260709 13:15:27.746604  3650 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.747105  3650 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.748754  3325 raft_consensus.cc:359] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.751262  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:27.751791  3325 raft_consensus.cc:385] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.752090  3325 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
W20260709 13:15:27.753029  3100 leader_election.cc:343] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.753268  3327 tablet_bootstrap.cc:492] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:27.754019  3327 ts_tablet_manager.cc:1403] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.302s	user 0.023s	sys 0.037s
I20260709 13:15:27.749902  3650 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:27.752785  3325 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.757264  3327 raft_consensus.cc:359] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.758071  3327 raft_consensus.cc:385] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.758386  3327 raft_consensus.cc:740] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.759093  3327 consensus_queue.cc:260] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.760042  3325 ts_tablet_manager.cc:1434] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:15:27.761056  3325 tablet_bootstrap.cc:492] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:27.761538  3327 ts_tablet_manager.cc:1434] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:15:27.769989  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:27.770635  3285 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.772233  3327 tablet_bootstrap.cc:492] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:27.778574  3327 tablet_bootstrap.cc:654] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.778925  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:27.779593  3279 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
W20260709 13:15:27.781948  3250 leader_election.cc:343] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.782536  3250 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:27.785295  3712 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.789880  3285 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:27.793843  3327 tablet_bootstrap.cc:492] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:27.794348  3327 ts_tablet_manager.cc:1403] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 13:15:27.796921  3327 raft_consensus.cc:359] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.797778  3327 raft_consensus.cc:385] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.798082  3327 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.798849  3327 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.800606  3327 ts_tablet_manager.cc:1434] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:27.801597  3327 tablet_bootstrap.cc:492] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:27.808077  3326 tablet_bootstrap.cc:492] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:27.808446  3325 tablet_bootstrap.cc:654] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.817322  3326 tablet_bootstrap.cc:654] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.821595  3325 tablet_bootstrap.cc:492] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:27.822067  3325 ts_tablet_manager.cc:1403] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.000s
I20260709 13:15:27.823009  3327 tablet_bootstrap.cc:654] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.824721  3325 raft_consensus.cc:359] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.825523  3325 raft_consensus.cc:385] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.825824  3325 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.826936  3325 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.829411  3325 ts_tablet_manager.cc:1434] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:27.830399  3325 tablet_bootstrap.cc:492] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5: Bootstrap starting.
I20260709 13:15:27.830679  3326 tablet_bootstrap.cc:492] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:27.831141  3326 ts_tablet_manager.cc:1403] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.023s	user 0.002s	sys 0.011s
I20260709 13:15:27.833814  3326 raft_consensus.cc:359] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.834187  3327 tablet_bootstrap.cc:492] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:27.834455  3326 raft_consensus.cc:385] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.834760  3326 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.834842  3327 ts_tablet_manager.cc:1403] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 13:15:27.835402  3326 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.837781  3326 ts_tablet_manager.cc:1434] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:15:27.838745  3326 tablet_bootstrap.cc:492] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:27.838536  3327 raft_consensus.cc:359] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.839327  3327 raft_consensus.cc:385] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.839677  3327 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.840601  3325 tablet_bootstrap.cc:654] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.840473  3327 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.842555  3327 ts_tablet_manager.cc:1434] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:27.843443  3327 tablet_bootstrap.cc:492] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:27.843510  3031 catalog_manager.cc:5697] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.795238  3101 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:15:27.847839  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 52680.7us
I20260709 13:15:27.848963  3649 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.849633  3649 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.850034  3649 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.848505  3101 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:27.857893  3326 tablet_bootstrap.cc:654] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.858816  3694 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.862293  3694 raft_consensus.cc:697] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:27.863121  3694 consensus_queue.cc:237] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.872928  3032 catalog_manager.cc:5697] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.883019  3327 tablet_bootstrap.cc:654] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.891952  3325 tablet_bootstrap.cc:492] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5: No bootstrap required, opened a new log
I20260709 13:15:27.892449  3325 ts_tablet_manager.cc:1403] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.031s
I20260709 13:15:27.895108  3325 raft_consensus.cc:359] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.895761  3325 raft_consensus.cc:385] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.896041  3325 raft_consensus.cc:740] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.896489  3649 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.896745  3325 consensus_queue.cc:260] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.900708  3325 ts_tablet_manager.cc:1434] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:15:27.904887  3327 tablet_bootstrap.cc:492] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:27.905396  3327 ts_tablet_manager.cc:1403] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.000s
I20260709 13:15:27.908102  3327 raft_consensus.cc:359] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.908758  3327 raft_consensus.cc:385] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.917223  3327 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.918831  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:27.918157  3327 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.919442  3207 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.926236  3327 ts_tablet_manager.cc:1434] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:15:27.928283  3207 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:27.930606  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:27.931595  3694 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.931787  3326 tablet_bootstrap.cc:492] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:27.932096  3694 raft_consensus.cc:697] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:27.932268  3326 ts_tablet_manager.cc:1403] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.000s
I20260709 13:15:27.932934  3694 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.934762  3326 raft_consensus.cc:359] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.935398  3326 raft_consensus.cc:385] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.935675  3326 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.939033  3649 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:27.939994  3326 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.942198  3326 ts_tablet_manager.cc:1434] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:15:27.943621  3326 tablet_bootstrap.cc:492] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:27.943305  3034 catalog_manager.cc:5697] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.943892  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:27.944619  3276 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.953370  3326 tablet_bootstrap.cc:654] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.959647  3326 tablet_bootstrap.cc:492] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:27.960101  3326 ts_tablet_manager.cc:1403] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.017s	user 0.003s	sys 0.007s
I20260709 13:15:27.962432  3327 tablet_bootstrap.cc:492] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:27.966619  3716 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.967161  3716 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.956921  3276 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:27.968716  3326 raft_consensus.cc:359] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:27.969596  3326 raft_consensus.cc:385] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.969844  3326 raft_consensus.cc:740] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.970711  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:27.970463  3326 consensus_queue.cc:260] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:27.972170  3250 leader_election.cc:343] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.972790  3716 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:27.973678  3327 tablet_bootstrap.cc:654] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.974313  3326 ts_tablet_manager.cc:1434] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:15:27.966789  3034 catalog_manager.cc:5697] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.976547  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:27.976871  3716 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.977906  3326 tablet_bootstrap.cc:492] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
W20260709 13:15:27.979064  3249 leader_election.cc:343] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.979561  3249 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:27.980558  3716 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.984647  3326 tablet_bootstrap.cc:654] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.993180  3716 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.994375  3327 tablet_bootstrap.cc:492] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:27.994843  3327 ts_tablet_manager.cc:1403] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:15:28.003499  3686 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.004236  3686 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.004900  3327 raft_consensus.cc:359] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.011175  3327 raft_consensus.cc:385] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.011672  3327 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.012935  3326 tablet_bootstrap.cc:492] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:28.008387  3694 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.013466  3326 ts_tablet_manager.cc:1403] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.007s
I20260709 13:15:28.013531  3694 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.016424  3694 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:28.016333  3326 raft_consensus.cc:359] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.017109  3326 raft_consensus.cc:385] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.017436  3326 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.017897  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:28.018097  3326 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.018735  3279 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:28.019625  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:28.020728  3326 ts_tablet_manager.cc:1434] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:28.020534  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:28.017836  3327 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.021407  3209 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:28.024410  3207 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:28.025151  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:28.025445  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:28.025822  3276 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:28.026300  3694 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.026695  3694 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.026873  3327 ts_tablet_manager.cc:1434] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 13:15:28.027047  3694 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.020757  3686 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:28.021868  3326 tablet_bootstrap.cc:492] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:28.029767  3100 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:28.030797  3725 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.032423  3693 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.032876  3693 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.033257  3693 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.035044  3694 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.048712  3706 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.049628  3706 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.063645  3327 tablet_bootstrap.cc:492] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:28.066720  3706 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:28.068486  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:28.069316  3135 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:28.070592  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:28.063539  3600 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:15:28.073880  3725 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.073820  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:28.074362  3725 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.074565  3285 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:28.074764  3725 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.101013  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:28.102011  3285 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.098019  3694 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:28.072723  3693 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.123508  3582 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.144322  3582 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.154115  3327 tablet_bootstrap.cc:654] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.171857  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:28.172602  3326 tablet_bootstrap.cc:654] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.172603  3209 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.174575  3582 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:28.187244  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:28.196480  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:28.204500  3279 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:28.208909  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:28.209522  3282 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.207231  3693 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:28.201628  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:28.214699  3176 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:28.215711  3207 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.215615  3600 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.243865  3209 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:28.246407  3100 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:28.264233  3285 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:28.265805  3693 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.275768  3207 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:28.269991  3693 raft_consensus.cc:697] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:28.278855  3600 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:28.279610  3693 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.284433  3100 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:28.287707  3688 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.289618  3326 tablet_bootstrap.cc:492] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:28.292330  3326 ts_tablet_manager.cc:1403] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.271s	user 0.012s	sys 0.022s
I20260709 13:15:28.258772  3725 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.312956  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:28.313658  3285 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.321631  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:28.322445  3133 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.297336  3282 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:28.348656  3285 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:28.305183  3725 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:28.350369  3326 raft_consensus.cc:359] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.355695  3133 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:28.372390  3326 raft_consensus.cc:385] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.370410  3688 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:28.369611  3693 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.372720  3326 raft_consensus.cc:740] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.377902  3688 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.380039  3326 consensus_queue.cc:260] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.386755  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:28.384979  3326 ts_tablet_manager.cc:1434] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.092s	user 0.003s	sys 0.003s
I20260709 13:15:28.389901  3326 tablet_bootstrap.cc:492] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:28.386708  3327 tablet_bootstrap.cc:492] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:28.391153  3327 ts_tablet_manager.cc:1403] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.339s	user 0.023s	sys 0.003s
I20260709 13:15:28.402405  3725 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.415361  3327 raft_consensus.cc:359] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.416138  3327 raft_consensus.cc:385] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.416411  3327 raft_consensus.cc:740] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.417270  3327 consensus_queue.cc:260] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.430649  3327 ts_tablet_manager.cc:1434] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.039s	user 0.000s	sys 0.006s
W20260709 13:15:28.439675  3082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:28.420648  3725 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:28.444947  3327 tablet_bootstrap.cc:492] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:28.449054  3725 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.475775  3326 tablet_bootstrap.cc:654] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.479650  3693 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.491508  3688 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.499403  3688 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:28.503738  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 49514.6us
I20260709 13:15:28.514042  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:28.507009  3650 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:15:28.515130  3688 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:28.512650  3760 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.516156  3760 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:28.516743  3100 leader_election.cc:343] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.517942  3689 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.520684  3689 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.535526  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:28.536481  3209 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:28.537545  3326 tablet_bootstrap.cc:492] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:28.538056  3326 ts_tablet_manager.cc:1403] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.148s	user 0.016s	sys 0.007s
I20260709 13:15:28.538689  3327 tablet_bootstrap.cc:654] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.539286  3100 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:28.529510  3689 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:28.545451  3688 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.546052  3688 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.546763  3688 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.545965  3031 catalog_manager.cc:5697] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.540000  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:28.548118  3278 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:28.528998  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:28.550865  3285 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:28.553609  3760 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:28.559240  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:28.560416  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:28.561069  3285 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 0.
I20260709 13:15:28.562301  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:28.564805  3580 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.565232  3580 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.565655  3580 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.567368  3688 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.572439  3101 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:28.573913  3648 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.574333  3648 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.575920  3133 raft_consensus.cc:2393] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:28.578905  3327 tablet_bootstrap.cc:492] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:28.577360  3648 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.581434  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:28.582312  3688 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:28.623255  3327 ts_tablet_manager.cc:1403] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.179s	user 0.021s	sys 0.020s
I20260709 13:15:28.625706  3327 raft_consensus.cc:359] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.626348  3327 raft_consensus.cc:385] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.626573  3327 raft_consensus.cc:740] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.625239  3580 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.627482  3326 raft_consensus.cc:359] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.628098  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:28.628373  3326 raft_consensus.cc:385] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.628736  3208 raft_consensus.cc:2393] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 1: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:28.628876  3285 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.628892  3326 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.630210  3326 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.633646  3650 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.638908  3285 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:28.639830  3326 ts_tablet_manager.cc:1434] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.101s	user 0.015s	sys 0.001s
I20260709 13:15:28.641119  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:28.641844  3326 tablet_bootstrap.cc:492] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: Bootstrap starting.
I20260709 13:15:28.641896  3133 raft_consensus.cc:2393] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:28.646358  3648 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.648860  3326 tablet_bootstrap.cc:654] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.649271  3327 consensus_queue.cc:260] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.648790  3648 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:28.651708  3327 ts_tablet_manager.cc:1434] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:15:28.652792  3327 tablet_bootstrap.cc:492] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:28.654670  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:28.655500  3284 raft_consensus.cc:2393] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:28.656497  3326 tablet_bootstrap.cc:492] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: No bootstrap required, opened a new log
I20260709 13:15:28.657060  3326 ts_tablet_manager.cc:1403] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.001s
I20260709 13:15:28.657195  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:28.657586  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:28.658139  3725 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:28.660318  3326 raft_consensus.cc:359] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:28.660547  3100 leader_election.cc:343] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.660490  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:28.661425  3326 raft_consensus.cc:385] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.661427  3284 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.662699  3326 raft_consensus.cc:740] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.670627  3326 consensus_queue.cc:260] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.673069  3326 ts_tablet_manager.cc:1434] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.003s
I20260709 13:15:28.673638  3327 tablet_bootstrap.cc:654] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.678635  3327 tablet_bootstrap.cc:492] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:28.679180  3327 ts_tablet_manager.cc:1403] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 13:15:28.681972  3327 raft_consensus.cc:359] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.682761  3327 raft_consensus.cc:385] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.683053  3327 raft_consensus.cc:740] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.681651  3034 catalog_manager.cc:5697] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.683738  3327 consensus_queue.cc:260] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.685868  3327 ts_tablet_manager.cc:1434] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:28.686865  3327 tablet_bootstrap.cc:492] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928: Bootstrap starting.
I20260709 13:15:28.692581  3327 tablet_bootstrap.cc:654] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.693662  3648 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.661134  3580 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:28.715335  3101 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:28.716254  3648 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.716892  3648 raft_consensus.cc:697] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:28.717662  3284 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:28.718430  3648 consensus_queue.cc:237] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.740577  3101 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:28.742813  3688 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.743360  3688 raft_consensus.cc:697] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:28.744270  3688 consensus_queue.cc:237] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.762229  3772 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.762790  3772 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.764977  3772 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:28.767877  3034 catalog_manager.cc:5697] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.774372  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:28.775995  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:28.776739  3133 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 0.
W20260709 13:15:28.776871  3249 leader_election.cc:343] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.782446  3327 tablet_bootstrap.cc:492] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928: No bootstrap required, opened a new log
I20260709 13:15:28.782982  3327 ts_tablet_manager.cc:1403] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928: Time spent bootstrapping tablet: real 0.096s	user 0.039s	sys 0.033s
I20260709 13:15:28.784291  3250 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:28.787158  3711 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.787971  3711 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.790602  3711 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.795431  3763 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.802031  3327 raft_consensus.cc:359] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.802781  3327 raft_consensus.cc:385] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.803053  3327 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.806555  3327 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.831197  3327 ts_tablet_manager.cc:1434] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 13:15:28.837509  3763 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.838590  3763 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.841756  3763 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:28.845422  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:28.846344  3278 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:28.847154  3711 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.849697  3101 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:28.850478  3730 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.851173  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:28.851784  3206 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 0.
I20260709 13:15:28.853170  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:28.852830  3031 catalog_manager.cc:5697] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.856038  3031 catalog_manager.cc:5697] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.857579  3689 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.858435  3208 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.869352  3689 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.869757  3689 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.857209  3711 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:28.880990  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:28.887079  3133 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.920202  3208 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:28.920230  3689 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.943599  3689 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:28.908710  3788 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:15:28.946071  3694 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.947961  3133 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:28.949985  3249 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:28.951828  3716 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.952365  3716 raft_consensus.cc:697] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:28.953370  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:28.953327  3716 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:28.954056  3279 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.974359  3031 catalog_manager.cc:5697] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.977411  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:28.978003  3208 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.985855  3208 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:28.987229  3279 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:28.990411  3101 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:28.992684  3649 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.993193  3649 raft_consensus.cc:697] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:28.994000  3649 consensus_queue.cc:237] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:29.012601  3787 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:29.016821  3031 catalog_manager.cc:5697] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.033221  3789 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.033792  3789 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:29.035895  3789 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:29.036759  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:29.037043  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:29.037544  3284 raft_consensus.cc:2393] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 1: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:29.038763  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:29.039458  3789 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.045153  3789 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.057556  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:29.066917  3796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:29.070320  3795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:29.072502  3798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:29.073873  2025 server_base.cc:1061] running on GCE node
I20260709 13:15:29.076861  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:29.077180  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:29.077412  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783602929077392 us; error 0 us; skew 500 ppm
I20260709 13:15:29.078127  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:29.081867  2025 webserver.cc:533] Webserver started at http://127.1.250.68:39119/ using document root <none> and password file <none>
I20260709 13:15:29.082516  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:29.082737  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:29.083128  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:29.084656  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-3-root/instance:
uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
format_stamp: "Formatted at 2026-07-09 13:15:29 on dist-test-slave-g4pn"
I20260709 13:15:29.090543  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:29.094157  3803 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:29.095255  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:15:29.095580  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-3-root
uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
format_stamp: "Formatted at 2026-07-09 13:15:29 on dist-test-slave-g4pn"
I20260709 13:15:29.095978  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:29.137030  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:29.138798  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:29.142557  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:29.145380  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:29.145648  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:29.146000  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:29.146165  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:29.181648  3694 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:29.205128  3704 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:29.262698  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.68:40703
I20260709 13:15:29.262710  3867 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.68:40703 every 8 connection(s)
I20260709 13:15:29.270804  2025 auto_leader_rebalancer-test.cc:384] add a tserver: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:29.281278  3694 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:29.292505  3694 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:29.299624  3868 heartbeater.cc:344] Connected to a master server at 127.1.250.126:33381
I20260709 13:15:29.300086  3868 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:29.301134  3868 heartbeater.cc:507] Master 127.1.250.126:33381 requested a full tablet report, sending...
I20260709 13:15:29.303514  3034 ts_manager.cc:194] Registered new tserver with Master: 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:29.305373  3034 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55102
I20260709 13:15:29.388747  3772 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:29.406863  3772 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:15:29.419099  3694 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:29.445401  3649 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:29.541349  3134 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:29.548753  3206 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:29.548785  3279 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:29.551937  3649 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:29.553324  3689 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.575635  3649 raft_consensus.cc:2955] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
W20260709 13:15:29.578011  3102 consensus_peers.cc:597] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9d10d3c525b541649db9c882a1398789. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:29.577318  3209 raft_consensus.cc:2955] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:29.583798  3279 raft_consensus.cc:2955] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:29.592084  3134 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:29.597434  3031 catalog_manager.cc:5697] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.611229  3284 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:29.613174  3209 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:29.613556  3102 consensus_peers.cc:597] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f5212495b02454ba6ddf4c62cf58b04. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:29.614085  3649 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.614957  3704 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.624135  3763 raft_consensus.cc:2955] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:29.626055  3284 raft_consensus.cc:2955] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:29.633293  3208 raft_consensus.cc:2955] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:29.671207  3208 consensus_queue.cc:237] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:29.678004  3034 catalog_manager.cc:5697] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.685611  3284 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:29.685798  3133 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:29.688338  3787 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.690680  3787 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.702308  3789 raft_consensus.cc:2955] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:29.703856  3284 raft_consensus.cc:2955] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:29.707144  3133 raft_consensus.cc:2955] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
W20260709 13:15:29.713832  3177 consensus_peers.cc:597] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f97b7c75c06648e2b8f08f69dcb106af. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:29.726257  3209 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:29.732748  3034 catalog_manager.cc:5697] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
W20260709 13:15:29.736001  3177 consensus_peers.cc:597] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ce6e7e8eeb846ab832cf477e2ba0b35. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:29.737536  3284 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:29.738308  3134 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:29.739874  3580 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.741214  3789 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.759471  3580 raft_consensus.cc:2955] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:29.765265  3133 raft_consensus.cc:2955] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:29.773252  3284 raft_consensus.cc:2955] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:29.776129  3034 catalog_manager.cc:5697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.059612  3897 ts_tablet_manager.cc:933] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323)
I20260709 13:15:30.072471  3897 tablet_copy_client.cc:323] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.65:41323
I20260709 13:15:30.082229  3901 ts_tablet_manager.cc:933] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323)
I20260709 13:15:30.094863  3901 tablet_copy_client.cc:323] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.65:41323
I20260709 13:15:30.108666  3146 tablet_copy_service.cc:140] P fc48eecc27554cb58b15193cd442b1d3: Received BeginTabletCopySession request for tablet 9d10d3c525b541649db9c882a1398789 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:57442)
I20260709 13:15:30.109365  3146 tablet_copy_service.cc:161] P fc48eecc27554cb58b15193cd442b1d3: Beginning new tablet copy session on tablet 9d10d3c525b541649db9c882a1398789 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:57442: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-9d10d3c525b541649db9c882a1398789
I20260709 13:15:30.109508  3145 tablet_copy_service.cc:140] P fc48eecc27554cb58b15193cd442b1d3: Received BeginTabletCopySession request for tablet 5f5212495b02454ba6ddf4c62cf58b04 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:57442)
I20260709 13:15:30.113827  3145 tablet_copy_service.cc:161] P fc48eecc27554cb58b15193cd442b1d3: Beginning new tablet copy session on tablet 5f5212495b02454ba6ddf4c62cf58b04 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:57442: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-5f5212495b02454ba6ddf4c62cf58b04
I20260709 13:15:30.121546  3903 ts_tablet_manager.cc:933] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:30.125247  3146 tablet_copy_source_session.cc:215] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:30.129606  3897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d10d3c525b541649db9c882a1398789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:30.130985  3145 tablet_copy_source_session.cc:215] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:30.134650  3901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5212495b02454ba6ddf4c62cf58b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:30.142951  3903 tablet_copy_client.cc:323] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.66:42299
I20260709 13:15:30.161019  3221 tablet_copy_service.cc:140] P 43b01d5a97e149008d543a6615219928: Received BeginTabletCopySession request for tablet f97b7c75c06648e2b8f08f69dcb106af from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:38892)
I20260709 13:15:30.161659  3221 tablet_copy_service.cc:161] P 43b01d5a97e149008d543a6615219928: Beginning new tablet copy session on tablet f97b7c75c06648e2b8f08f69dcb106af from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:38892: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-f97b7c75c06648e2b8f08f69dcb106af
I20260709 13:15:30.165010  3897 tablet_copy_client.cc:806] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:30.166208  3897 tablet_copy_client.cc:670] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:30.172465  3901 tablet_copy_client.cc:806] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:30.173568  3901 tablet_copy_client.cc:670] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:30.172701  3897 tablet_copy_client.cc:538] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:30.173437  3221 tablet_copy_source_session.cc:215] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:30.179581  3901 tablet_copy_client.cc:538] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:30.179611  3903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97b7c75c06648e2b8f08f69dcb106af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:30.184932  3897 tablet_bootstrap.cc:492] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:30.188593  3901 tablet_bootstrap.cc:492] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:30.213312  3903 tablet_copy_client.cc:806] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:30.214015  3903 tablet_copy_client.cc:670] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:30.221185  3901 tablet_bootstrap.cc:492] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:30.222332  3901 tablet_bootstrap.cc:492] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:30.223199  3901 ts_tablet_manager.cc:1403] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.035s	user 0.024s	sys 0.004s
I20260709 13:15:30.226099  3903 tablet_copy_client.cc:538] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:30.226339  3901 raft_consensus.cc:359] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:30.227658  3901 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:30.228539  3901 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:30.232931  3897 tablet_bootstrap.cc:492] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:30.234134  3897 tablet_bootstrap.cc:492] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:30.234865  3897 ts_tablet_manager.cc:1403] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.050s	user 0.030s	sys 0.015s
I20260709 13:15:30.237373  3901 ts_tablet_manager.cc:1434] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:15:30.237402  3868 heartbeater.cc:499] Master 127.1.250.126:33381 was elected leader, sending a full tablet report...
I20260709 13:15:30.240939  3145 tablet_copy_service.cc:342] P fc48eecc27554cb58b15193cd442b1d3: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-5f5212495b02454ba6ddf4c62cf58b04 received from {username='slave'} at 127.0.0.1:57442
I20260709 13:15:30.241464  3145 tablet_copy_service.cc:434] P fc48eecc27554cb58b15193cd442b1d3: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-5f5212495b02454ba6ddf4c62cf58b04 on tablet 5f5212495b02454ba6ddf4c62cf58b04 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:30.239781  3897 raft_consensus.cc:359] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:30.242357  3897 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:30.245661  3903 tablet_bootstrap.cc:492] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:30.248255  3897 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:30.250953  3897 ts_tablet_manager.cc:1434] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:15:30.252674  3145 tablet_copy_service.cc:342] P fc48eecc27554cb58b15193cd442b1d3: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-9d10d3c525b541649db9c882a1398789 received from {username='slave'} at 127.0.0.1:57442
I20260709 13:15:30.253135  3145 tablet_copy_service.cc:434] P fc48eecc27554cb58b15193cd442b1d3: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-9d10d3c525b541649db9c882a1398789 on tablet 9d10d3c525b541649db9c882a1398789 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:30.274878  3903 tablet_bootstrap.cc:492] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:30.276439  3903 tablet_bootstrap.cc:492] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:30.277025  3903 ts_tablet_manager.cc:1403] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.000s
I20260709 13:15:30.279425  3903 raft_consensus.cc:359] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:30.280046  3903 raft_consensus.cc:740] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:30.280651  3903 consensus_queue.cc:260] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:30.282784  3903 ts_tablet_manager.cc:1434] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:30.285112  3221 tablet_copy_service.cc:342] P 43b01d5a97e149008d543a6615219928: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-f97b7c75c06648e2b8f08f69dcb106af received from {username='slave'} at 127.0.0.1:38892
I20260709 13:15:30.285564  3221 tablet_copy_service.cc:434] P 43b01d5a97e149008d543a6615219928: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-f97b7c75c06648e2b8f08f69dcb106af on tablet f97b7c75c06648e2b8f08f69dcb106af with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:30.297127  3903 ts_tablet_manager.cc:933] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:30.299758  3903 tablet_copy_client.cc:323] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.66:42299
I20260709 13:15:30.301787  3221 tablet_copy_service.cc:140] P 43b01d5a97e149008d543a6615219928: Received BeginTabletCopySession request for tablet 6ce6e7e8eeb846ab832cf477e2ba0b35 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:38892)
I20260709 13:15:30.302264  3221 tablet_copy_service.cc:161] P 43b01d5a97e149008d543a6615219928: Beginning new tablet copy session on tablet 6ce6e7e8eeb846ab832cf477e2ba0b35 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:38892: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-6ce6e7e8eeb846ab832cf477e2ba0b35
I20260709 13:15:30.316088  3221 tablet_copy_source_session.cc:215] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:30.319379  3903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce6e7e8eeb846ab832cf477e2ba0b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:30.335538  3903 tablet_copy_client.cc:806] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:30.336187  3903 tablet_copy_client.cc:670] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:30.341056  3903 tablet_copy_client.cc:538] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:30.351346  3903 tablet_bootstrap.cc:492] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:30.369292  3903 tablet_bootstrap.cc:492] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:30.370081  3903 tablet_bootstrap.cc:492] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:30.370654  3903 ts_tablet_manager.cc:1403] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 13:15:30.372915  3903 raft_consensus.cc:359] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:30.373612  3903 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:30.374171  3903 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:30.376453  3903 ts_tablet_manager.cc:1434] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:30.378587  3221 tablet_copy_service.cc:342] P 43b01d5a97e149008d543a6615219928: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-6ce6e7e8eeb846ab832cf477e2ba0b35 received from {username='slave'} at 127.0.0.1:38892
I20260709 13:15:30.378986  3221 tablet_copy_service.cc:434] P 43b01d5a97e149008d543a6615219928: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-6ce6e7e8eeb846ab832cf477e2ba0b35 on tablet 6ce6e7e8eeb846ab832cf477e2ba0b35 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:30.461066  3842 raft_consensus.cc:1217] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:30.589759  3842 raft_consensus.cc:1217] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:30.620046  3842 raft_consensus.cc:1217] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:30.778775  3842 raft_consensus.cc:1217] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:30.971884  3694 raft_consensus.cc:1064] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:30.974037  3694 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:30.987358  3842 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:30.989032  3694 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:30.991225  3279 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:30.992883  3209 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:30.994550  3694 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:30.996312  3694 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.010494  3763 raft_consensus.cc:2955] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.012320  3842 raft_consensus.cc:2955] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.016239  3208 raft_consensus.cc:2955] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.023670  3279 raft_consensus.cc:2955] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.027858  3032 catalog_manager.cc:5697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.046834  3649 raft_consensus.cc:1064] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:31.050859  3649 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:31.068121  3842 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.071738  3279 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.072588  3694 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.075904  3208 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.077520  3704 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.081013  3763 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:31.110440  3134 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:31.120962  3209 raft_consensus.cc:2955] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.115515  3704 raft_consensus.cc:2955] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.167218  3030 catalog_manager.cc:5697] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.168973  3912 raft_consensus.cc:1064] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:31.146724  3278 raft_consensus.cc:2955] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.204206  3842 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:15:31.206645  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 44733us
I20260709 13:15:31.207437  3912 consensus_queue.cc:237] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:15:31.211311  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 83108.6us
I20260709 13:15:31.216064  3694 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:15:31.234058  3279 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:31.251930  3787 raft_consensus.cc:1064] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:31.260375  3787 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:31.271592  3841 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.281792  3928 raft_consensus.cc:2955] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:15:31.285326  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 83862.3us
I20260709 13:15:31.286679  3841 raft_consensus.cc:2955] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.276233  3912 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:15:31.298527  3840 raft_consensus.cc:2955] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.312219  3279 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.312736  3133 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.314076  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5f5212495b02454ba6ddf4c62cf58b04 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:31.315255  3896 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.323572  3133 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:31.326256  3896 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.337941  3030 catalog_manager.cc:5697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.339932  3842 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.344496  3935 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.356197  3279 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.364660  3208 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:31.375877  3932 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:31.377015  3130 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.377570  3199 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f5212495b02454ba6ddf4c62cf58b04 with delete_type TABLET_DATA_TOMBSTONED (TS 43b01d5a97e149008d543a6615219928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:31.387754  3840 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:31.375517  3921 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:15:31.388846  3926 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:31.390133  3704 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:31.410352  3208 raft_consensus.cc:2955] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.407809  3927 raft_consensus.cc:2955] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.414316  3930 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.436261  3134 raft_consensus.cc:2955] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.444921  3840 raft_consensus.cc:2955] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.445392  3932 raft_consensus.cc:2955] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.460656  3031 catalog_manager.cc:5697] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.485899  3279 raft_consensus.cc:2955] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.498685  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d10d3c525b541649db9c882a1398789 with delete_type TABLET_DATA_TOMBSTONED (TS 48080cf0460346769ab046a4f9457aa5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33888
I20260709 13:15:31.508821  3941 tablet_replica.cc:333] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:15:31.514283  3031 catalog_manager.cc:5697] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.540648  3946 tablet_replica.cc:333] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:15:31.541852  3946 raft_consensus.cc:2243] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.542802  3946 raft_consensus.cc:2272] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.548012  3946 ts_tablet_manager.cc:1916] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:31.550822  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9d10d3c525b541649db9c882a1398789 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:31.556020  3930 raft_consensus.cc:2955] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.559459  3841 raft_consensus.cc:2955] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.582656  3285 raft_consensus.cc:2955] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.563256  3278 raft_consensus.cc:2955] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.586761  3133 raft_consensus.cc:2955] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.596597  3840 raft_consensus.cc:2955] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.629148  3210 consensus_queue.cc:237] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:31.631557  3034 catalog_manager.cc:5697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.634079  3941 raft_consensus.cc:2243] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.634891  3941 raft_consensus.cc:2272] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.649787  3941 ts_tablet_manager.cc:1916] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:31.656287  3840 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:31.658319  3932 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:31.665835  3278 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:31.674703  3840 raft_consensus.cc:2955] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.683457  3210 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:31.684155  3946 ts_tablet_manager.cc:1929] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:31.684777  3946 log.cc:1199] T 9d10d3c525b541649db9c882a1398789 P 48080cf0460346769ab046a4f9457aa5: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root/wals/9d10d3c525b541649db9c882a1398789
I20260709 13:15:31.667743  3932 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:15:31.686769  3787 raft_consensus.cc:2955] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.689713  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 9d10d3c525b541649db9c882a1398789 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:31.689960  3941 ts_tablet_manager.cc:1929] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:31.690398  3941 log.cc:1199] T 5f5212495b02454ba6ddf4c62cf58b04 P 43b01d5a97e149008d543a6615219928: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root/wals/5f5212495b02454ba6ddf4c62cf58b04
I20260709 13:15:31.691489  3841 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:31.693053  3930 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:31.693347  3285 raft_consensus.cc:2955] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.699112  3019 catalog_manager.cc:5028] TS 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): tablet 5f5212495b02454ba6ddf4c62cf58b04 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:31.703610  3133 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:31.706216  3032 catalog_manager.cc:5697] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.710150  3932 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:31.725960  3940 raft_consensus.cc:2955] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.727550  3117 tablet_service.cc:1558] Processing DeleteTablet for tablet f97b7c75c06648e2b8f08f69dcb106af with delete_type TABLET_DATA_TOMBSTONED (TS fc48eecc27554cb58b15193cd442b1d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49668
I20260709 13:15:31.734607  3133 raft_consensus.cc:2955] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.739113  3841 raft_consensus.cc:2955] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:31.753538  3947 tablet_replica.cc:333] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:15:31.754583  3947 raft_consensus.cc:2243] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.755537  3947 raft_consensus.cc:2272] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.757512  3019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6ce6e7e8eeb846ab832cf477e2ba0b35 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:31.758308  3019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f97b7c75c06648e2b8f08f69dcb106af with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:31.763559  3947 ts_tablet_manager.cc:1916] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:31.776571  3032 catalog_manager.cc:5697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:31.783236  3947 ts_tablet_manager.cc:1929] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:31.785796  3947 log.cc:1199] T f97b7c75c06648e2b8f08f69dcb106af P fc48eecc27554cb58b15193cd442b1d3: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-0-root/wals/f97b7c75c06648e2b8f08f69dcb106af
I20260709 13:15:31.789371  3020 catalog_manager.cc:5028] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): tablet f97b7c75c06648e2b8f08f69dcb106af (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:31.803536  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ce6e7e8eeb846ab832cf477e2ba0b35 with delete_type TABLET_DATA_TOMBSTONED (TS 48080cf0460346769ab046a4f9457aa5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33888
I20260709 13:15:31.804571  3946 tablet_replica.cc:333] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:15:31.812872  3946 raft_consensus.cc:2243] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.813607  3946 raft_consensus.cc:2272] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.817040  3946 ts_tablet_manager.cc:1916] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:31.827859  3946 ts_tablet_manager.cc:1929] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:31.828194  3946 log.cc:1199] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 48080cf0460346769ab046a4f9457aa5: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root/wals/6ce6e7e8eeb846ab832cf477e2ba0b35
I20260709 13:15:31.829582  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 6ce6e7e8eeb846ab832cf477e2ba0b35 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:33.264119  3951 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.264853  3951 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.267349  3951 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.325438  3961 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.327163  3961 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.335991  3961 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.353979  3896 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.382085  3896 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.384954  3787 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.386132  3942 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.386044  3787 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.386673  3942 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.388049  3787 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.388374  3948 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.362746  3958 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.363365  3954 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.364212  3933 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:33.389026  3948 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.393246  3927 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.394042  3927 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.394716  3948 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.398135  3927 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.362010  3962 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.399235  3962 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.401445  3933 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.404309  3933 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.405107  3954 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.407253  3954 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.365406  3911 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.408763  3911 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.413048  3965 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.413650  3965 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.415789  3965 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.417780  3911 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.388744  3942 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.389112  3958 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.424880  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.425040  3958 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.427932  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.430341  3959 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.430929  3959 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.430943  3962 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.434026  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.434985  3964 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.384903  3896 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.435549  3964 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.440519  3964 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.437371  3952 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.441282  3952 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.443723  3952 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.444274  3952 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.444280  3950 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.445227  3950 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.444768  3958 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:33.451130  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.432987  3959 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.448222  3958 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.456768  3942 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.457605  3942 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.460017  3963 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.460300  3959 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.460743  3963 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.461051  3959 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.440439  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.436708  3787 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.463514  3963 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.480091  3951 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.476956  3896 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.465971  3957 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.488459  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.477917  3964 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.489727  3951 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.491546  3964 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.492776  3949 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.493378  3949 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.466305  3965 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.494622  3965 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.474606  3962 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.495726  3949 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.495611  3962 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.445032  3952 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.484370  3927 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:33.489465  3963 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.492779  3932 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.498293  3927 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.490517  3958 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.483825  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.493780  3964 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.504827  3970 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.505160  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.511294  3964 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.511333  3970 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:33.511955  3964 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.514109  3970 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:33.490072  3896 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.516062  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.463968  3911 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.517509  3911 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.498431  3952 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.466585  3959 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.519695  3911 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.490249  3787 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.521353  3962 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.518419  3927 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.523793  3942 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.515004  3932 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.485766  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.490424  3957 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.528246  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.528939  3962 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:33.477764  3953 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.532618  3911 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:33.534353  3911 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.535095  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.536486  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.536821  3911 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.538700  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.539058  3957 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.523007  3963 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.528694  3896 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.541287  3963 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.526520  3972 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.542002  3972 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.545677  3972 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.542526  3932 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.532114  3962 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.543490  3965 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.547963  3896 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.554342  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.544332  3963 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.556449  3968 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.576890  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.577239  3948 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.577844  3948 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.572171  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:33.601802  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 43660.7us
I20260709 13:15:33.576952  3963 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:33.548290  3971 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.605525  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.605592  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.514667  3964 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.623353  3974 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.624573  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.619199  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.628885  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.603551  3932 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.625958  3970 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.607350  3961 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:33.614766  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.638775  3951 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.549321  3953 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.601374  3896 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.628446  3972 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.632515  3964 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.652048  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.653380  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.657426  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.658401  3959 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.659070  3960 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.658982  3959 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.639616  3932 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.666267  3973 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.654556  3972 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.588229  3968 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:33.688841  3157 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2500 after lost signal to thread 2028
I20260709 13:15:33.652602  3962 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.652146  3951 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.642954  3974 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:33.645684  3961 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.667181  3973 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.628505  3971 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:33.691905  3932 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.656554  3964 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.722043  3948 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.723044  3787 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.723219  3896 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.725020  3974 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.647852  3970 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.725561  3961 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.725562  3950 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.732401  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.727061  3942 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:33.727160  3959 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.741535  3976 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.741670  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:33.760448  3841 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:33.735515  3953 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.730486  3957 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:33.707299  3951 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.733009  3968 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:15:33.739769  3157 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc340 after lost signal to thread 3068
W20260709 13:15:33.745018  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 119123us
I20260709 13:15:33.742031  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.734360  3932 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.690354  3960 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.744656  3896 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.760787  3964 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.775705  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.777624  3207 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:33.777663  3896 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.769202  3976 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.768186  3957 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.784510  3957 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.786139  3951 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.782461  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.786973  3963 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:33.787797  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.789021  3971 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.771736  3972 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.787832  3896 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.750286  3942 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.784585  3976 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:15:33.795635  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 165621us
I20260709 13:15:33.796347  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.798061  3960 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.799126  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.799062  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.801891  3970 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.778517  3932 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.816391  3963 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:33.817049  3963 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:33.817705  3932 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.804177  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.818652  3962 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:33.819126  3962 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.819542  3963 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:33.820933  3962 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.822990  3942 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:15:33.804831  3157 debug-util.cc:398] Leaking SignalData structure 0x7b08001f36e0 after lost signal to thread 3160
I20260709 13:15:33.802450  3978 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.789161  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.801621  3981 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.812994  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.812625  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.814445  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.814819  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.815050  3971 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:33.805299  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.815464  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.834009  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.834678  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.846777  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.837715  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.831321  3970 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.839249  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.839468  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.839577  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.861542  3971 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:33.840167  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.866207  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.866854  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.867314  3971 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.842008  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.867694  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.868274  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.825064  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.869896  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.870440  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.871474  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.853343  3177 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:33.836357  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.831039  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.874902  3972 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:33.875320  3972 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.838584  3973 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.861142  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.863448  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.875650  3972 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.878300  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.846823  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.883486  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.852872  3932 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.872822  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:33.882535  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.899609  3932 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.908901  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.910009  3932 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:15:33.911019  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 54862.1us
I20260709 13:15:33.862674  3957 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:33.907491  3980 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:33.880129  3896 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.880440  3961 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:15:33.895938  3157 debug-util.cc:398] Leaking SignalData structure 0x7b080031de60 after lost signal to thread 3235
W20260709 13:15:33.914830  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 331893us
I20260709 13:15:33.846657  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.858793  3978 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.917948  3960 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:33.889051  3970 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.917053  3957 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.940339  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.947795  3957 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:33.949854  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.926882  3967 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:33.949630  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.918530  3896 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.956715  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.925875  3961 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.933218  3960 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.860647  3981 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.961422  3896 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.972827  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.973245  3978 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.977658  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.978775  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.970803  3972 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:33.952777  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.982426  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.982611  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.984937  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.985198  3960 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.987147  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.985852  3981 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:33.987537  3100 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:33.933997  3980 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.983469  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:33.989655  3100 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:33.992439  3100 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:33.995359  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.996341  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.989133  3958 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:33.997888  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.997565  3972 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:33.993474  3928 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:33.994027  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.005614  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:15:34.007964  3980 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:34.010305  3970 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:34.011453  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.006040  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:33.972172  3967 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:33.999269  3958 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:34.014048  3966 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.014386  3958 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.026774  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.030773  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:34.033357  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.033668  3967 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:34.025731  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.034519  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.032794  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.037226  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.043179  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.044440  3961 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:34.045826  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.047508  3277 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:34.048396  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.049821  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.048609  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.044946  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.052139  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.054595  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.058377  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:34.071620  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.072628  3971 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.075234  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.075173  3958 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:34.078950  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:34.080267  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 85262.8us
W20260709 13:15:34.082249  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 86561.5us
I20260709 13:15:34.082496  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:34.083483  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.084367  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:34.086014  3958 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:34.085934  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:34.087611  3100 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:34.088424  3921 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.089008  3100 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:34.090029  3988 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.091205  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.093506  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:34.093683  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:34.094123  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:34.095372  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.097491  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:34.099309  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:34.103682  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.104032  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.106307  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.106990  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.107276  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.107604  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.108372  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.108686  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.108791  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.109476  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.110529  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.110886  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:34.111371  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.110886  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.115293  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.118934  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.120669  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.122267  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.122619  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:34.132298  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:34.132715  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.134328  3979 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.135648  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.136379  3979 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.137043  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:34.137676  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.138422  3979 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.141875  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.144002  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.145237  3979 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.146585  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.147406  3979 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.150306  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.151497  3979 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.152566  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.153440  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.152915  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:34.154462  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.155191  3979 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.156056  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.156275  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.156416  3130 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:34.156931  3979 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.158946  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.159624  3979 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.161026  3176 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.161707  3979 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.163852  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.164614  3979 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.167914  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.168462  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:34.168687  3979 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.169029  3176 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.169795  3981 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.170138  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.170583  3249 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.171169  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.172040  3960 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.172123  3981 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.173197  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.173913  3979 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.174252  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.175098  3979 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.175441  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.176270  3979 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.176652  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.177281  3961 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.178090  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.177464  3979 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.179160  3176 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.183499  3979 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.183854  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.184599  3979 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:34.184986  3176 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.185740  3979 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.180110  3249 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.178804  3981 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.186127  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:34.186094  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.187811  3979 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.188163  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.188868  3979 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.189244  3961 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.189334  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.190212  3979 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.190626  3249 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.190626  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.191560  3979 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.192242  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.193424  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.194185  3981 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.194305  3979 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.195353  3176 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.196468  3176 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.197170  3981 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.197798  3981 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.198798  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.200146  3979 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:34.200536  3979 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:34.200904  3979 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.202908  3961 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.208160  3979 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:34.199827  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.209772  3981 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.210822  3979 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:34.210840  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.211040  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.211745  3961 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.212407  3979 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.212492  3176 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.209591  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.214350  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.215138  3981 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.215514  3961 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.215826  3979 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.218263  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:34.227079  3176 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.227909  3979 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.229600  3249 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.230361  3963 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.231966  3249 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.232798  3963 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.233603  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.233817  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.234512  3981 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.238026  3963 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.240175  3249 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.241503  3963 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.243271  3206 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:34.244930  3989 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:34.245913  3990 raft_consensus.cc:3055] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:34.246272  3990 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:34.247269  3249 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.247072  3990 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:34.248135  3963 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.248502  3990 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.249431  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.250276  3963 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.251500  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.256975  3963 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.259330  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.260075  3130 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:34.261329  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:34.261421  3963 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:34.258239  3249 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.262565  3963 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:34.263674  3963 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:34.264927  3963 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:34.266363  3963 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.275871  3249 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.276914  3967 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.277741  3967 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.279026  3101 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:34.279744  3990 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.278961  3249 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.281220  3967 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.283335  3249 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.286499  3101 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:34.287226  3961 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.288559  3958 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.300706  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:34.301460  3958 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.301918  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.302639  3961 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.303728  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.304330  3961 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.307538  3249 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:15:34.308158  3961 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.308549  3249 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.312635  3961 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.313059  3249 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.318150  3806 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:34.319295  3971 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:34.319674  3971 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:34.320075  3971 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.319813  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.320320  3961 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.321811  3249 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.322801  3961 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.323927  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.326897  3961 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.328111  3249 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.331597  3971 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:34.334116  3961 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.335532  3176 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.336519  3981 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.342645  3971 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:34.343308  3971 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.343938  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:34.350271  3208 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:34.351759  3990 consensus_queue.cc:1059] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.352744  3990 raft_consensus.cc:3055] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:34.353055  3990 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:34.353832  3990 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:34.358754  3990 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.362102  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:34.367080  3284 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:34.370682  3130 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:34.373106  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:34.382220  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:34.383386  3981 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.384560  3806 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:34.385732  3993 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:34.386270  3993 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:15:34.387189  3993 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:15:34.416846  3251 consensus_peers.cc:597] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d7eb1bec1634d2784b28588ef1161c0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:34.421422  3130 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:34.425163  3976 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:34.428076  3210 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:34.431306  3961 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.417420  3030 catalog_manager.cc:5697] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 2 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:34.456605  3969 raft_consensus.cc:2955] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:34.467133  3136 raft_consensus.cc:2955] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:34.492378  3208 raft_consensus.cc:2955] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:34.534235  3031 catalog_manager.cc:5697] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.548674  3284 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:15:34.569161  3251 consensus_peers.cc:597] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e51511dc4ca4db4817c3216d9d1db6e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:34.579372  3208 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:34.582752  3961 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:34.587674  3136 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:34.589393  3961 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:34.605142  3976 raft_consensus.cc:2955] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:34.608103  3208 raft_consensus.cc:2955] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:34.620106  3136 raft_consensus.cc:2955] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:34.621325  3130 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:34.633255  3032 catalog_manager.cc:5697] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:34.639669  3102 consensus_peers.cc:597] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 30f88ddc17f44a3084db05c84e5e6a81. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:34.641378  3284 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:34.643074  3989 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.644539  3208 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:34.647163  3966 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.671475  3282 raft_consensus.cc:2955] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:34.667461  3966 raft_consensus.cc:2955] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:34.690704  3032 catalog_manager.cc:5697] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:34.696434  3208 raft_consensus.cc:2955] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:34.704051  3282 consensus_queue.cc:237] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:34.726927  3210 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:34.728379  3251 consensus_peers.cc:597] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de07cb03de034f1bae53ef08d27db7a7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:34.728302  3136 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:34.729534  3969 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.731096  3967 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.754034  3208 raft_consensus.cc:2955] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:34.751137  3967 raft_consensus.cc:2955] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:34.860466  3034 catalog_manager.cc:5697] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:34.851656  3130 raft_consensus.cc:2955] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:34.986459  3128 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:34.991175  4014 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:35.090068  4017 ts_tablet_manager.cc:933] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323)
I20260709 13:15:35.092221  3208 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:35.100484  4015 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:35.131759  4020 ts_tablet_manager.cc:933] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:35.174913  4021 ts_tablet_manager.cc:933] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:35.172302  4017 tablet_copy_client.cc:323] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.65:41323
I20260709 13:15:35.188925  3145 tablet_copy_service.cc:140] P fc48eecc27554cb58b15193cd442b1d3: Received BeginTabletCopySession request for tablet 30f88ddc17f44a3084db05c84e5e6a81 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:57442)
I20260709 13:15:35.191406  3145 tablet_copy_service.cc:161] P fc48eecc27554cb58b15193cd442b1d3: Beginning new tablet copy session on tablet 30f88ddc17f44a3084db05c84e5e6a81 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:57442: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-30f88ddc17f44a3084db05c84e5e6a81
I20260709 13:15:35.238628  3145 tablet_copy_source_session.cc:215] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:35.247895  4020 tablet_copy_client.cc:323] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:15:35.251724  3295 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet 4d7eb1bec1634d2784b28588ef1161c0 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:15:35.252456  3295 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet 4d7eb1bec1634d2784b28588ef1161c0 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-4d7eb1bec1634d2784b28588ef1161c0
I20260709 13:15:35.271080  4028 ts_tablet_manager.cc:933] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:35.273468  4028 tablet_copy_client.cc:323] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:15:35.275454  3294 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet de07cb03de034f1bae53ef08d27db7a7 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:15:35.276046  3294 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet de07cb03de034f1bae53ef08d27db7a7 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-de07cb03de034f1bae53ef08d27db7a7
I20260709 13:15:35.281113  4017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f88ddc17f44a3084db05c84e5e6a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:35.290815  4021 tablet_copy_client.cc:323] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:15:35.294094  3293 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet 9e51511dc4ca4db4817c3216d9d1db6e from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:15:35.294888  3293 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet 9e51511dc4ca4db4817c3216d9d1db6e from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-9e51511dc4ca4db4817c3216d9d1db6e
I20260709 13:15:35.297040  3295 tablet_copy_source_session.cc:215] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:35.303748  3293 tablet_copy_source_session.cc:215] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:35.310999  3294 tablet_copy_source_session.cc:215] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:35.321736  4020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7eb1bec1634d2784b28588ef1161c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:35.328229  4021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e51511dc4ca4db4817c3216d9d1db6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:35.334542  4028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de07cb03de034f1bae53ef08d27db7a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:35.385583  4017 tablet_copy_client.cc:806] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:35.386305  4017 tablet_copy_client.cc:670] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:35.398675  4017 tablet_copy_client.cc:538] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:35.405647  4028 tablet_copy_client.cc:806] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:35.406348  4028 tablet_copy_client.cc:670] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:35.407210  4020 tablet_copy_client.cc:806] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:35.412770  4017 tablet_bootstrap.cc:492] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:35.414021  4028 tablet_copy_client.cc:538] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:35.417304  4021 tablet_copy_client.cc:806] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:35.414746  4020 tablet_copy_client.cc:670] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:35.421447  4020 tablet_copy_client.cc:538] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:35.423513  4021 tablet_copy_client.cc:670] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:35.453624  4021 tablet_copy_client.cc:538] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:35.492367  4020 tablet_bootstrap.cc:492] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:35.505378  3989 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.506245  3989 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:35.508718  3989 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:35.510526  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:35.511262  3210 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:15:35.512320  4021 tablet_bootstrap.cc:492] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:35.517923  3100 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:35.519641  3989 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:35.520044  3989 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.520390  3989 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:35.522200  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:35.549117  4028 tablet_bootstrap.cc:492] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:35.561586  3989 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:35.563819  3989 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:35.565457  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:35.566078  3211 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:35.567365  4020 tablet_bootstrap.cc:492] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:35.568373  4020 tablet_bootstrap.cc:492] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:35.569140  4020 ts_tablet_manager.cc:1403] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.077s	user 0.023s	sys 0.009s
I20260709 13:15:35.576530  3211 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:15:35.580601  3100 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:35.581528  4013 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:35.582041  4013 raft_consensus.cc:697] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:35.582401  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:35.583117  4013 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:35.593170  4020 raft_consensus.cc:359] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:35.594135  4020 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:35.584908  4017 tablet_bootstrap.cc:492] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:35.594836  4020 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:35.595728  4017 tablet_bootstrap.cc:492] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:35.596575  4017 ts_tablet_manager.cc:1403] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.184s	user 0.020s	sys 0.013s
I20260709 13:15:35.598888  4020 ts_tablet_manager.cc:1434] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:15:35.600834  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-4d7eb1bec1634d2784b28588ef1161c0 received from {username='slave'} at 127.0.0.1:52014
I20260709 13:15:35.601359  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-4d7eb1bec1634d2784b28588ef1161c0 on tablet 4d7eb1bec1634d2784b28588ef1161c0 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:35.619163  4017 raft_consensus.cc:359] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:35.650553  4017 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:35.652845  4017 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:35.647198  4021 tablet_bootstrap.cc:492] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:35.657907  4021 tablet_bootstrap.cc:492] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:35.660501  4021 ts_tablet_manager.cc:1403] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.148s	user 0.021s	sys 0.014s
I20260709 13:15:35.659550  4017 ts_tablet_manager.cc:1434] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.003s
I20260709 13:15:35.658008  3034 catalog_manager.cc:5697] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:35.668951  4021 raft_consensus.cc:359] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:35.673076  4021 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:35.675655  3145 tablet_copy_service.cc:342] P fc48eecc27554cb58b15193cd442b1d3: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-30f88ddc17f44a3084db05c84e5e6a81 received from {username='slave'} at 127.0.0.1:57442
I20260709 13:15:35.676143  3145 tablet_copy_service.cc:434] P fc48eecc27554cb58b15193cd442b1d3: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-30f88ddc17f44a3084db05c84e5e6a81 on tablet 30f88ddc17f44a3084db05c84e5e6a81 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:35.675174  4021 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:35.691499  4021 ts_tablet_manager.cc:1434] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.003s
I20260709 13:15:35.696379  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-9e51511dc4ca4db4817c3216d9d1db6e received from {username='slave'} at 127.0.0.1:52014
I20260709 13:15:35.696849  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-9e51511dc4ca4db4817c3216d9d1db6e on tablet 9e51511dc4ca4db4817c3216d9d1db6e with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:35.706908  4028 tablet_bootstrap.cc:492] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:35.707901  4028 tablet_bootstrap.cc:492] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:35.708616  4028 ts_tablet_manager.cc:1403] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.179s	user 0.020s	sys 0.011s
I20260709 13:15:35.712517  4028 raft_consensus.cc:359] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:35.713490  4028 raft_consensus.cc:740] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:35.714162  4028 consensus_queue.cc:260] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:35.719201  4028 ts_tablet_manager.cc:1434] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:15:35.721567  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-de07cb03de034f1bae53ef08d27db7a7 received from {username='slave'} at 127.0.0.1:52014
I20260709 13:15:35.722018  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-de07cb03de034f1bae53ef08d27db7a7 on tablet de07cb03de034f1bae53ef08d27db7a7 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:35.732676  3841 raft_consensus.cc:1217] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:35.774297  3977 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.774959  3977 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:35.777347  3977 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:35.778638  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:35.779191  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:35.779385  3211 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:35.780016  3128 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:15:35.782106  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:35.782891  3977 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:35.783392  3977 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.783735  3977 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:35.791867  3977 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:35.794080  3977 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:35.795563  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:35.796181  3211 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:35.800277  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:35.812412  3128 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:35.803167  3211 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:15:35.809590  3841 raft_consensus.cc:1217] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:35.828665  3249 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:35.831223  3969 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:35.831866  3969 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:35.833983  3969 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:35.853509  3128 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:15:35.866879  3032 catalog_manager.cc:5697] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:35.898257  3969 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:35.900501  3969 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:35.903409  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:35.903625  3969 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:35.904189  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:35.909147  3211 raft_consensus.cc:2368] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3.
I20260709 13:15:35.913210  3249 leader_election.cc:400] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3.
I20260709 13:15:35.913544  3249 leader_election.cc:403] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:35.914429  3969 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:35.926183  3969 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3.
I20260709 13:15:35.998271  3841 raft_consensus.cc:1217] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:36.121351  3211 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:36.122995  3989 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:36.166204  3276 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:36.168234  3990 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:36.194630  3961 raft_consensus.cc:1064] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:36.200441  3961 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:36.222012  3841 raft_consensus.cc:1217] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:36.258734  3208 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:36.260253  3969 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:36.305275  3128 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:36.357571  3210 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:15:36.378096  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 53970.4us
I20260709 13:15:36.380371  4049 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:36.386941  3977 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:15:36.399029  3841 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:15:36.476123  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 88126.4us
W20260709 13:15:36.525336  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 61363.2us
W20260709 13:15:36.546113  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 129191us
I20260709 13:15:36.581387  4052 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:15:36.591980  3136 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:36.646992  3969 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:36.690075  4052 raft_consensus.cc:1064] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:36.693710  4051 raft_consensus.cc:1064] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:36.696292  4051 consensus_queue.cc:237] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:36.698678  4052 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:36.720086  4062 raft_consensus.cc:2955] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:36.729336  3841 raft_consensus.cc:2955] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:36.746145  3840 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:36.753129  4057 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:36.755016  4055 raft_consensus.cc:1064] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:36.760704  3211 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:36.762343  4057 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:36.766665  4055 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:36.771744  3032 catalog_manager.cc:5697] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:36.775425  3204 raft_consensus.cc:2955] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:36.804940  3128 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:36.812163  4057 raft_consensus.cc:2955] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:36.813845  3211 raft_consensus.cc:2955] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:36.826534  3840 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:36.831117  3202 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:36.834282  3977 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:36.835377  4062 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:36.836647  3961 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:36.846839  3131 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:36.863790  3841 raft_consensus.cc:2955] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:36.869974  3838 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:36.871698  4048 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:36.885236  4062 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:15:36.903380  3210 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:36.919868  3279 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:36.925575  4078 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:15:36.938208  3130 raft_consensus.cc:2955] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:36.940975  4012 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:36.942790  4049 raft_consensus.cc:2955] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:36.952287  3206 raft_consensus.cc:2955] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:36.953641  3127 raft_consensus.cc:2955] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.029774  3838 raft_consensus.cc:2955] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.042420  3131 raft_consensus.cc:2955] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.046128  3034 catalog_manager.cc:5697] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.048316  4078 raft_consensus.cc:2955] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.057040  3211 raft_consensus.cc:2955] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.059196  3279 raft_consensus.cc:2955] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.075485  3030 catalog_manager.cc:5697] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.108206  3838 raft_consensus.cc:2955] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.127238  3279 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:37.129298  3276 consensus_queue.cc:237] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:37.135036  3841 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:37.135586  3277 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:37.137557  4062 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:37.145833  3840 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:37.149646  3127 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:37.151451  3961 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:37.155001  3211 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:37.157588  3977 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:37.160992  4051 raft_consensus.cc:2955] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.162827  3131 raft_consensus.cc:2955] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.164610  3031 catalog_manager.cc:5697] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.167309  4057 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:37.175657  3841 raft_consensus.cc:2955] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.192870  3211 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:37.194419  4052 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:37.194286  3969 raft_consensus.cc:2955] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.212980  3032 catalog_manager.cc:5697] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.213096  3840 raft_consensus.cc:2955] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.221330  3211 raft_consensus.cc:2955] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.226064  3199 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e51511dc4ca4db4817c3216d9d1db6e with delete_type TABLET_DATA_TOMBSTONED (TS 43b01d5a97e149008d543a6615219928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:37.233968  3841 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:37.235805  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9e51511dc4ca4db4817c3216d9d1db6e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:37.246933  4056 raft_consensus.cc:2955] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.249614  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet de07cb03de034f1bae53ef08d27db7a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:37.280432  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4d7eb1bec1634d2784b28588ef1161c0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:37.283886  3131 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:37.255946  4049 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:15:37.289851  3211 raft_consensus.cc:2955] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.298933  3277 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:37.300945  4012 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:37.309952  3838 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:37.312358  4087 tablet_replica.cc:333] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:15:37.314814  3031 catalog_manager.cc:5697] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.313737  4087 raft_consensus.cc:2243] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.316819  4050 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:37.334079  3117 tablet_service.cc:1558] Processing DeleteTablet for tablet de07cb03de034f1bae53ef08d27db7a7 with delete_type TABLET_DATA_TOMBSTONED (TS fc48eecc27554cb58b15193cd442b1d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49668
I20260709 13:15:37.337698  4058 raft_consensus.cc:2955] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.354507  3838 raft_consensus.cc:2955] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.354236  3031 catalog_manager.cc:5697] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.364820  4088 tablet_replica.cc:333] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:15:37.364161  3284 raft_consensus.cc:2955] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.366003  4088 raft_consensus.cc:2243] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.366837  4088 raft_consensus.cc:2272] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.371140  4088 ts_tablet_manager.cc:1916] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:37.372028  3034 catalog_manager.cc:5697] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.392931  4087 raft_consensus.cc:2272] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.327361  3840 raft_consensus.cc:2955] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:37.396162  3199 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f88ddc17f44a3084db05c84e5e6a81 with delete_type TABLET_DATA_TOMBSTONED (TS 43b01d5a97e149008d543a6615219928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:37.403017  3117 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d7eb1bec1634d2784b28588ef1161c0 with delete_type TABLET_DATA_TOMBSTONED (TS fc48eecc27554cb58b15193cd442b1d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49668
I20260709 13:15:37.396829  4087 ts_tablet_manager.cc:1916] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:37.406519  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 30f88ddc17f44a3084db05c84e5e6a81 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:37.432399  4088 ts_tablet_manager.cc:1929] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:37.433049  4088 log.cc:1199] T de07cb03de034f1bae53ef08d27db7a7 P fc48eecc27554cb58b15193cd442b1d3: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-0-root/wals/de07cb03de034f1bae53ef08d27db7a7
I20260709 13:15:37.443710  4087 ts_tablet_manager.cc:1929] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:37.444410  4087 log.cc:1199] T 9e51511dc4ca4db4817c3216d9d1db6e P 43b01d5a97e149008d543a6615219928: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root/wals/9e51511dc4ca4db4817c3216d9d1db6e
I20260709 13:15:37.446707  3019 catalog_manager.cc:5028] TS 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): tablet 9e51511dc4ca4db4817c3216d9d1db6e (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:37.448182  4087 tablet_replica.cc:333] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:15:37.449916  4087 raft_consensus.cc:2243] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.450867  4087 raft_consensus.cc:2272] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.451574  4088 tablet_replica.cc:333] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:15:37.451522  3020 catalog_manager.cc:5028] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): tablet de07cb03de034f1bae53ef08d27db7a7 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:37.452978  4088 raft_consensus.cc:2243] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.453778  4088 raft_consensus.cc:2272] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.456977  4087 ts_tablet_manager.cc:1916] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:37.458103  4088 ts_tablet_manager.cc:1916] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:37.476150  4087 ts_tablet_manager.cc:1929] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:37.476666  4087 log.cc:1199] T 30f88ddc17f44a3084db05c84e5e6a81 P 43b01d5a97e149008d543a6615219928: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root/wals/30f88ddc17f44a3084db05c84e5e6a81
I20260709 13:15:37.476766  4088 ts_tablet_manager.cc:1929] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:37.477289  4088 log.cc:1199] T 4d7eb1bec1634d2784b28588ef1161c0 P fc48eecc27554cb58b15193cd442b1d3: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-0-root/wals/4d7eb1bec1634d2784b28588ef1161c0
I20260709 13:15:37.478363  3019 catalog_manager.cc:5028] TS 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): tablet 30f88ddc17f44a3084db05c84e5e6a81 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:37.479537  3020 catalog_manager.cc:5028] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): tablet 4d7eb1bec1634d2784b28588ef1161c0 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:38.492543  3131 consensus_queue.cc:237] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:15:38.500044  3102 consensus_peers.cc:597] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3af680172a5440a2bfa7e8a99ea9c1fc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.500268  3210 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:38.500597  3279 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:38.501879  4047 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:38.502748  4078 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:38.518280  4078 raft_consensus.cc:2955] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:38.537060  3277 raft_consensus.cc:2955] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:38.539516  3206 consensus_queue.cc:237] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:38.539573  3210 raft_consensus.cc:2955] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:38.551410  3034 catalog_manager.cc:5697] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:38.590626  3177 consensus_peers.cc:597] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 56db43db40f644309c6db08523b1b033. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.623585  3279 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:38.627665  4063 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:38.657855  4102 raft_consensus.cc:2955] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:38.666630  3130 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:38.668449  4063 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:38.668758  3277 raft_consensus.cc:2955] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:38.684248  3130 raft_consensus.cc:2955] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:38.692595  3277 consensus_queue.cc:237] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:38.717005  3206 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:38.719291  4052 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:38.722049  3251 consensus_peers.cc:597] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ccc7fa450cf74c28bef080a5f5dc8fa8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.724912  3030 catalog_manager.cc:5697] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.741230  4056 raft_consensus.cc:2955] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:38.743121  3210 raft_consensus.cc:2955] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:38.761804  3130 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:38.766669  3031 catalog_manager.cc:5697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:38.770284  3277 consensus_queue.cc:237] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:38.774480  4099 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:38.789448  3206 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:38.789981  3131 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:38.796923  3251 consensus_peers.cc:597] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 386629ac4b1c40a2973b2650d0165bc3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.798261  4098 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:38.800496  3128 raft_consensus.cc:2955] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:38.807229  4052 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:38.827742  4098 raft_consensus.cc:2955] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:38.835151  3128 raft_consensus.cc:2955] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:38.852408  3210 raft_consensus.cc:2955] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:38.856844  3031 catalog_manager.cc:5697] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:38.954692  4114 ts_tablet_manager.cc:933] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323)
I20260709 13:15:38.969893  4114 tablet_copy_client.cc:323] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.65:41323
I20260709 13:15:38.971666  3145 tablet_copy_service.cc:140] P fc48eecc27554cb58b15193cd442b1d3: Received BeginTabletCopySession request for tablet 3af680172a5440a2bfa7e8a99ea9c1fc from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:57442)
I20260709 13:15:38.972563  3145 tablet_copy_service.cc:161] P fc48eecc27554cb58b15193cd442b1d3: Beginning new tablet copy session on tablet 3af680172a5440a2bfa7e8a99ea9c1fc from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:57442: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-3af680172a5440a2bfa7e8a99ea9c1fc
I20260709 13:15:38.983446  3145 tablet_copy_source_session.cc:215] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:38.987140  4114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af680172a5440a2bfa7e8a99ea9c1fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.006404  4114 tablet_copy_client.cc:806] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:39.007193  4114 tablet_copy_client.cc:670] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:39.012027  4114 tablet_copy_client.cc:538] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:39.021852  4114 tablet_bootstrap.cc:492] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:39.054656  4114 tablet_bootstrap.cc:492] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:39.055694  4114 tablet_bootstrap.cc:492] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:39.056484  4114 ts_tablet_manager.cc:1403] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.012s
I20260709 13:15:39.059489  4114 raft_consensus.cc:359] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:39.060379  4114 raft_consensus.cc:740] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:39.061053  4114 consensus_queue.cc:260] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:39.063748  4114 ts_tablet_manager.cc:1434] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 13:15:39.065868  3145 tablet_copy_service.cc:342] P fc48eecc27554cb58b15193cd442b1d3: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-3af680172a5440a2bfa7e8a99ea9c1fc received from {username='slave'} at 127.0.0.1:57442
I20260709 13:15:39.066533  3145 tablet_copy_service.cc:434] P fc48eecc27554cb58b15193cd442b1d3: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-3af680172a5440a2bfa7e8a99ea9c1fc on tablet 3af680172a5440a2bfa7e8a99ea9c1fc with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:39.133718  4114 ts_tablet_manager.cc:933] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:39.146157  4114 tablet_copy_client.cc:323] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.66:42299
I20260709 13:15:39.148350  3221 tablet_copy_service.cc:140] P 43b01d5a97e149008d543a6615219928: Received BeginTabletCopySession request for tablet 56db43db40f644309c6db08523b1b033 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:38892)
I20260709 13:15:39.148929  3221 tablet_copy_service.cc:161] P 43b01d5a97e149008d543a6615219928: Beginning new tablet copy session on tablet 56db43db40f644309c6db08523b1b033 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:38892: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-56db43db40f644309c6db08523b1b033
I20260709 13:15:39.157487  3221 tablet_copy_source_session.cc:215] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:39.162334  4114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56db43db40f644309c6db08523b1b033. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.180896  4114 tablet_copy_client.cc:806] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:39.181587  4114 tablet_copy_client.cc:670] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:39.186358  4114 tablet_copy_client.cc:538] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:39.196370  4114 tablet_bootstrap.cc:492] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:39.223819  4118 ts_tablet_manager.cc:933] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:39.232959  4114 tablet_bootstrap.cc:492] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:39.237577  4114 tablet_bootstrap.cc:492] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:39.240473  4114 ts_tablet_manager.cc:1403] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.009s
I20260709 13:15:39.239562  4118 tablet_copy_client.cc:323] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:15:39.242239  3294 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet ccc7fa450cf74c28bef080a5f5dc8fa8 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:15:39.242816  3294 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet ccc7fa450cf74c28bef080a5f5dc8fa8 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-ccc7fa450cf74c28bef080a5f5dc8fa8
I20260709 13:15:39.244899  4114 raft_consensus.cc:359] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:39.246070  4114 raft_consensus.cc:740] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:39.246833  4114 consensus_queue.cc:260] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:39.249459  4114 ts_tablet_manager.cc:1434] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:39.253885  3221 tablet_copy_service.cc:342] P 43b01d5a97e149008d543a6615219928: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-56db43db40f644309c6db08523b1b033 received from {username='slave'} at 127.0.0.1:38892
I20260709 13:15:39.254362  3221 tablet_copy_service.cc:434] P 43b01d5a97e149008d543a6615219928: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-56db43db40f644309c6db08523b1b033 on tablet 56db43db40f644309c6db08523b1b033 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:39.290086  3294 tablet_copy_source_session.cc:215] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:39.303628  4118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc7fa450cf74c28bef080a5f5dc8fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.342567  4118 tablet_copy_client.cc:806] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:39.343233  4118 tablet_copy_client.cc:670] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:39.345840  3840 raft_consensus.cc:1217] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:39.369355  4118 tablet_copy_client.cc:538] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:39.379750  4114 ts_tablet_manager.cc:933] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:39.384418  4118 tablet_bootstrap.cc:492] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:39.409337  4114 tablet_copy_client.cc:323] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:15:39.412330  3294 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet 386629ac4b1c40a2973b2650d0165bc3 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:15:39.412896  3294 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet 386629ac4b1c40a2973b2650d0165bc3 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-386629ac4b1c40a2973b2650d0165bc3
I20260709 13:15:39.421679  3294 tablet_copy_source_session.cc:215] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:39.430245  4114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386629ac4b1c40a2973b2650d0165bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.444525  4118 tablet_bootstrap.cc:492] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:39.445637  4118 tablet_bootstrap.cc:492] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:39.446600  4118 ts_tablet_manager.cc:1403] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.019s
I20260709 13:15:39.450354  4118 raft_consensus.cc:359] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:39.451332  4118 raft_consensus.cc:740] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:39.452056  4118 consensus_queue.cc:260] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:39.454711  4118 ts_tablet_manager.cc:1434] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:15:39.470752  4114 tablet_copy_client.cc:806] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:39.471551  4114 tablet_copy_client.cc:670] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:39.474442  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-ccc7fa450cf74c28bef080a5f5dc8fa8 received from {username='slave'} at 127.0.0.1:52014
I20260709 13:15:39.475172  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-ccc7fa450cf74c28bef080a5f5dc8fa8 on tablet ccc7fa450cf74c28bef080a5f5dc8fa8 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:39.480444  4114 tablet_copy_client.cc:538] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:39.493474  4114 tablet_bootstrap.cc:492] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:39.625008  3840 raft_consensus.cc:1217] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:39.644855  4114 tablet_bootstrap.cc:492] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:39.645812  4114 tablet_bootstrap.cc:492] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:39.646471  4114 ts_tablet_manager.cc:1403] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.153s	user 0.033s	sys 0.028s
I20260709 13:15:39.649693  4114 raft_consensus.cc:359] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:39.650760  4114 raft_consensus.cc:740] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:39.651541  4114 consensus_queue.cc:260] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:39.656442  4114 ts_tablet_manager.cc:1434] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:39.658291  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-386629ac4b1c40a2973b2650d0165bc3 received from {username='slave'} at 127.0.0.1:52014
I20260709 13:15:39.658754  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-386629ac4b1c40a2973b2650d0165bc3 on tablet 386629ac4b1c40a2973b2650d0165bc3 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:39.750310  3838 raft_consensus.cc:1217] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:39.881851  3838 raft_consensus.cc:1217] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:39.934060  4095 raft_consensus.cc:1064] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:39.936933  4095 consensus_queue.cc:237] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:39.954016  3838 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:39.955869  4047 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:39.968046  3211 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:39.985858  4095 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:40.010092  3284 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:15:40.102769  4127 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:15:40.118289  4131 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:40.126385  4131 raft_consensus.cc:2955] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.129907  3840 raft_consensus.cc:2955] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:15:40.144524  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 51643.2us
I20260709 13:15:40.157719  4089 raft_consensus.cc:1064] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:40.156788  3204 raft_consensus.cc:2955] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.160172  4089 consensus_queue.cc:237] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:40.163173  3030 catalog_manager.cc:5697] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.197749  3840 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:40.199430  3130 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:40.200949  4063 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:40.203132  4063 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:15:40.208371  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 55485.8us
W20260709 13:15:40.295514  4137 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.079s	user 0.014s	sys 0.000s
I20260709 13:15:40.304765  3278 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:40.313810  4102 raft_consensus.cc:2955] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.333866  4129 raft_consensus.cc:1064] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:40.332742  4135 raft_consensus.cc:1064] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:40.328181  3840 raft_consensus.cc:2955] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.336675  4135 consensus_queue.cc:237] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:40.337256  4129 consensus_queue.cc:237] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:40.345070  3279 raft_consensus.cc:2955] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:15:40.355144  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 45849us
I20260709 13:15:40.358361  3210 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:40.360145  4099 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:40.363883  3130 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:40.367744  4099 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:40.368104  3841 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:40.379526  4102 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:40.384722  3130 raft_consensus.cc:2955] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.406426  4099 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:40.440136  3211 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:40.442082  3841 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:40.444262  3128 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:40.446790  4052 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:40.449371  4136 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:40.449816  4099 raft_consensus.cc:2955] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.453593  4056 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:40.462097  3278 raft_consensus.cc:2955] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.488722  3211 raft_consensus.cc:2955] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.529815  3131 raft_consensus.cc:2955] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.541873  3840 raft_consensus.cc:2955] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.593348  4136 raft_consensus.cc:2955] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.608773  3128 raft_consensus.cc:2955] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.615377  3033 catalog_manager.cc:5697] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.615945  3204 raft_consensus.cc:2955] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.617568  3033 catalog_manager.cc:5697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.610800  3841 raft_consensus.cc:2955] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.637029  3131 consensus_queue.cc:237] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:40.649456  3210 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:40.650408  3840 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:40.657126  4121 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:40.658048  4124 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:40.671767  4131 raft_consensus.cc:2955] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.677352  3841 raft_consensus.cc:2955] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.692836  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3af680172a5440a2bfa7e8a99ea9c1fc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:40.690402  3210 raft_consensus.cc:2955] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.708829  3204 consensus_queue.cc:237] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:40.713208  3276 consensus_queue.cc:237] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:15:40.719622  3020 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 3af680172a5440a2bfa7e8a99ea9c1fc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:15:40.724033  3030 catalog_manager.cc:5697] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.732028  3030 catalog_manager.cc:5697] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.741787  3840 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:40.749027  3838 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:40.744958  3128 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:40.751920  3128 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:40.753710  4063 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:40.754400  4140 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:40.750677  4136 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:15:40.756062  4099 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:40.764904  4099 raft_consensus.cc:2955] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.765363  4063 raft_consensus.cc:2955] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.767920  3131 raft_consensus.cc:2955] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.779969  3841 raft_consensus.cc:2955] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.783452  3130 raft_consensus.cc:2955] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.791121  3019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 56db43db40f644309c6db08523b1b033 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:40.790803  3840 raft_consensus.cc:2955] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.819969  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 3af680172a5440a2bfa7e8a99ea9c1fc with delete_type TABLET_DATA_TOMBSTONED (TS 48080cf0460346769ab046a4f9457aa5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33888
I20260709 13:15:40.827872  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ccc7fa450cf74c28bef080a5f5dc8fa8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:40.828811  4153 tablet_replica.cc:333] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:15:40.829968  4153 raft_consensus.cc:2243] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:40.830814  4153 raft_consensus.cc:2272] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:40.833168  3276 consensus_queue.cc:237] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:40.843726  4153 ts_tablet_manager.cc:1916] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:40.846604  3838 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:40.848276  4099 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:40.850584  3033 catalog_manager.cc:5697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.852159  3033 catalog_manager.cc:5697] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.858664  4130 raft_consensus.cc:2955] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.859958  3838 raft_consensus.cc:2955] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.863082  3206 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:40.865275  4052 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:40.877257  3199 tablet_service.cc:1558] Processing DeleteTablet for tablet ccc7fa450cf74c28bef080a5f5dc8fa8 with delete_type TABLET_DATA_TOMBSTONED (TS 43b01d5a97e149008d543a6615219928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:40.881312  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 56db43db40f644309c6db08523b1b033 with delete_type TABLET_DATA_TOMBSTONED (TS 48080cf0460346769ab046a4f9457aa5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33888
I20260709 13:15:40.884126  4153 ts_tablet_manager.cc:1929] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:40.889331  4153 log.cc:1199] T 3af680172a5440a2bfa7e8a99ea9c1fc P 48080cf0460346769ab046a4f9457aa5: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root/wals/3af680172a5440a2bfa7e8a99ea9c1fc
I20260709 13:15:40.885581  4154 tablet_replica.cc:333] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:15:40.891276  4154 raft_consensus.cc:2243] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:40.892087  4154 raft_consensus.cc:2272] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:40.891479  3204 raft_consensus.cc:2955] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.900079  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 3af680172a5440a2bfa7e8a99ea9c1fc (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:40.903797  4153 tablet_replica.cc:333] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:15:40.904928  4153 raft_consensus.cc:2243] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:40.905213  4154 ts_tablet_manager.cc:1916] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:40.909134  4153 raft_consensus.cc:2272] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:40.912686  4153 ts_tablet_manager.cc:1916] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:40.917268  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 386629ac4b1c40a2973b2650d0165bc3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:40.944316  4154 ts_tablet_manager.cc:1929] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:40.944924  4154 log.cc:1199] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 43b01d5a97e149008d543a6615219928: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root/wals/ccc7fa450cf74c28bef080a5f5dc8fa8
I20260709 13:15:40.947258  3019 catalog_manager.cc:5028] TS 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): tablet ccc7fa450cf74c28bef080a5f5dc8fa8 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:40.947229  4153 ts_tablet_manager.cc:1929] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:40.947546  3033 catalog_manager.cc:5697] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:40.982764  4153 log.cc:1199] T 56db43db40f644309c6db08523b1b033 P 48080cf0460346769ab046a4f9457aa5: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root/wals/56db43db40f644309c6db08523b1b033
I20260709 13:15:41.015837  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 56db43db40f644309c6db08523b1b033 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:41.027922  3117 tablet_service.cc:1558] Processing DeleteTablet for tablet 386629ac4b1c40a2973b2650d0165bc3 with delete_type TABLET_DATA_TOMBSTONED (TS fc48eecc27554cb58b15193cd442b1d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49668
I20260709 13:15:41.035154  4155 tablet_replica.cc:333] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:15:41.037218  4155 raft_consensus.cc:2243] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:41.038105  4155 raft_consensus.cc:2272] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:41.041832  4155 ts_tablet_manager.cc:1916] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:41.057425  4155 ts_tablet_manager.cc:1929] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:41.057893  4155 log.cc:1199] T 386629ac4b1c40a2973b2650d0165bc3 P fc48eecc27554cb58b15193cd442b1d3: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-0-root/wals/386629ac4b1c40a2973b2650d0165bc3
I20260709 13:15:41.059285  3020 catalog_manager.cc:5028] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): tablet 386629ac4b1c40a2973b2650d0165bc3 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:42.111290  3128 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:42.117372  3285 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:42.118330  3204 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:42.118899  4152 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:42.119964  3102 consensus_peers.cc:597] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 528677c11f624ca18f75db1e739e29d6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:42.120026  4094 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:42.135305  4158 raft_consensus.cc:2955] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:42.140509  3206 raft_consensus.cc:2955] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:42.140089  3285 raft_consensus.cc:2955] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:42.159020  3033 catalog_manager.cc:5697] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:42.166319  3128 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:42.174271  3285 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:42.175096  3102 consensus_peers.cc:597] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d7a98c6990948fab7c20936964c4d3e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:42.175272  3206 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:42.176545  4158 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:42.177626  4152 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:42.188297  4158 raft_consensus.cc:2955] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:42.191176  3276 raft_consensus.cc:2955] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:42.194852  3206 raft_consensus.cc:2955] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:42.203801  3204 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:42.213747  3032 catalog_manager.cc:5697] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
W20260709 13:15:42.222115  3177 consensus_peers.cc:597] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b7ab044361f54dae84978720aac3998c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:42.222796  3128 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:42.224956  3276 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:42.225452  4102 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:42.228075  4063 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:42.236919  4169 raft_consensus.cc:2955] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:42.238312  3128 raft_consensus.cc:2955] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:42.240869  3276 raft_consensus.cc:2955] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:42.253800  3128 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:42.259786  3033 catalog_manager.cc:5697] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
W20260709 13:15:42.267933  3102 consensus_peers.cc:597] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 404209c6105f4945b077c33471d63370. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:42.269500  3206 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:42.270555  3276 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:42.271678  4158 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:42.273389  4094 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:42.282372  4157 raft_consensus.cc:2955] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:42.283941  3204 raft_consensus.cc:2955] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:42.298712  3276 raft_consensus.cc:2955] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:42.301376  3033 catalog_manager.cc:5697] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.561311  4175 ts_tablet_manager.cc:933] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323)
I20260709 13:15:42.563920  4175 tablet_copy_client.cc:323] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.65:41323
I20260709 13:15:42.565691  3145 tablet_copy_service.cc:140] P fc48eecc27554cb58b15193cd442b1d3: Received BeginTabletCopySession request for tablet 528677c11f624ca18f75db1e739e29d6 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:57442)
I20260709 13:15:42.566159  3145 tablet_copy_service.cc:161] P fc48eecc27554cb58b15193cd442b1d3: Beginning new tablet copy session on tablet 528677c11f624ca18f75db1e739e29d6 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:57442: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-528677c11f624ca18f75db1e739e29d6
I20260709 13:15:42.572779  3145 tablet_copy_source_session.cc:215] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:42.576045  4175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528677c11f624ca18f75db1e739e29d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.593875  4175 tablet_copy_client.cc:806] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:42.594456  4175 tablet_copy_client.cc:670] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:42.599958  4175 tablet_copy_client.cc:538] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:42.608592  4175 tablet_bootstrap.cc:492] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:42.631021  4175 tablet_bootstrap.cc:492] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:42.632128  4175 tablet_bootstrap.cc:492] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:42.632843  4175 ts_tablet_manager.cc:1403] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.006s
I20260709 13:15:42.636014  4175 raft_consensus.cc:359] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:42.636875  4175 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:42.637527  4175 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:42.639941  4175 ts_tablet_manager.cc:1434] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:15:42.642292  3145 tablet_copy_service.cc:342] P fc48eecc27554cb58b15193cd442b1d3: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-528677c11f624ca18f75db1e739e29d6 received from {username='slave'} at 127.0.0.1:57442
I20260709 13:15:42.642697  3145 tablet_copy_service.cc:434] P fc48eecc27554cb58b15193cd442b1d3: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-528677c11f624ca18f75db1e739e29d6 on tablet 528677c11f624ca18f75db1e739e29d6 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:42.701786  4175 ts_tablet_manager.cc:933] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323)
I20260709 13:15:42.703456  4175 tablet_copy_client.cc:323] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.65:41323
I20260709 13:15:42.705289  3145 tablet_copy_service.cc:140] P fc48eecc27554cb58b15193cd442b1d3: Received BeginTabletCopySession request for tablet 2d7a98c6990948fab7c20936964c4d3e from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:57442)
I20260709 13:15:42.705809  3145 tablet_copy_service.cc:161] P fc48eecc27554cb58b15193cd442b1d3: Beginning new tablet copy session on tablet 2d7a98c6990948fab7c20936964c4d3e from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:57442: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-2d7a98c6990948fab7c20936964c4d3e
I20260709 13:15:42.714708  3145 tablet_copy_source_session.cc:215] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:42.718443  4175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d7a98c6990948fab7c20936964c4d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.730396  4175 tablet_copy_client.cc:806] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:42.730933  4175 tablet_copy_client.cc:670] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:42.735108  4175 tablet_copy_client.cc:538] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:42.746080  4175 tablet_bootstrap.cc:492] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:42.777308  4175 tablet_bootstrap.cc:492] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:42.778239  4175 tablet_bootstrap.cc:492] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:42.778899  4175 ts_tablet_manager.cc:1403] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.033s	user 0.026s	sys 0.003s
I20260709 13:15:42.781924  4175 raft_consensus.cc:359] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:42.782761  4175 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:42.783378  4175 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:42.785715  4175 ts_tablet_manager.cc:1434] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:42.787395  4180 ts_tablet_manager.cc:933] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:42.787940  3145 tablet_copy_service.cc:342] P fc48eecc27554cb58b15193cd442b1d3: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-2d7a98c6990948fab7c20936964c4d3e received from {username='slave'} at 127.0.0.1:57442
I20260709 13:15:42.788369  3145 tablet_copy_service.cc:434] P fc48eecc27554cb58b15193cd442b1d3: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-2d7a98c6990948fab7c20936964c4d3e on tablet 2d7a98c6990948fab7c20936964c4d3e with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:42.803416  4175 ts_tablet_manager.cc:933] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323)
I20260709 13:15:42.815402  4180 tablet_copy_client.cc:323] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.66:42299
I20260709 13:15:42.817334  3221 tablet_copy_service.cc:140] P 43b01d5a97e149008d543a6615219928: Received BeginTabletCopySession request for tablet b7ab044361f54dae84978720aac3998c from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:38892)
I20260709 13:15:42.817920  3221 tablet_copy_service.cc:161] P 43b01d5a97e149008d543a6615219928: Beginning new tablet copy session on tablet b7ab044361f54dae84978720aac3998c from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:38892: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-b7ab044361f54dae84978720aac3998c
I20260709 13:15:42.818876  4175 tablet_copy_client.cc:323] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.65:41323
I20260709 13:15:42.821329  3145 tablet_copy_service.cc:140] P fc48eecc27554cb58b15193cd442b1d3: Received BeginTabletCopySession request for tablet 404209c6105f4945b077c33471d63370 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:57442)
I20260709 13:15:42.822000  3145 tablet_copy_service.cc:161] P fc48eecc27554cb58b15193cd442b1d3: Beginning new tablet copy session on tablet 404209c6105f4945b077c33471d63370 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:57442: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-404209c6105f4945b077c33471d63370
I20260709 13:15:42.832101  3145 tablet_copy_source_session.cc:215] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:42.832888  3221 tablet_copy_source_session.cc:215] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:42.835351  4175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404209c6105f4945b077c33471d63370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.840080  4180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ab044361f54dae84978720aac3998c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.865494  4175 tablet_copy_client.cc:806] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:42.866784  4175 tablet_copy_client.cc:670] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:42.869033  4180 tablet_copy_client.cc:806] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:42.869694  4180 tablet_copy_client.cc:670] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:42.871986  4175 tablet_copy_client.cc:538] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:42.873783  4180 tablet_copy_client.cc:538] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:42.883771  4180 tablet_bootstrap.cc:492] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:42.885728  4175 tablet_bootstrap.cc:492] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:42.938463  4180 tablet_bootstrap.cc:492] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:42.939517  4180 tablet_bootstrap.cc:492] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:42.940282  4180 ts_tablet_manager.cc:1403] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.011s
I20260709 13:15:42.954255  4180 raft_consensus.cc:359] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:42.955219  4180 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:42.959025  4180 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:42.963423  4180 ts_tablet_manager.cc:1434] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.002s
I20260709 13:15:42.965353  3221 tablet_copy_service.cc:342] P 43b01d5a97e149008d543a6615219928: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-b7ab044361f54dae84978720aac3998c received from {username='slave'} at 127.0.0.1:38892
I20260709 13:15:42.965775  3221 tablet_copy_service.cc:434] P 43b01d5a97e149008d543a6615219928: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-b7ab044361f54dae84978720aac3998c on tablet b7ab044361f54dae84978720aac3998c with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:42.989475  3841 raft_consensus.cc:1217] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:43.000641  4175 tablet_bootstrap.cc:492] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:43.001585  4175 tablet_bootstrap.cc:492] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:43.002336  4175 ts_tablet_manager.cc:1403] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.117s	user 0.051s	sys 0.057s
I20260709 13:15:43.005237  4175 raft_consensus.cc:359] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:43.006074  4175 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:43.006712  4175 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:43.012425  4175 ts_tablet_manager.cc:1434] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:15:43.014904  3145 tablet_copy_service.cc:342] P fc48eecc27554cb58b15193cd442b1d3: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-404209c6105f4945b077c33471d63370 received from {username='slave'} at 127.0.0.1:57442
I20260709 13:15:43.015357  3145 tablet_copy_service.cc:434] P fc48eecc27554cb58b15193cd442b1d3: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-404209c6105f4945b077c33471d63370 on tablet 404209c6105f4945b077c33471d63370 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:43.222078  3841 raft_consensus.cc:1217] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:43.270357  3841 raft_consensus.cc:1217] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:43.326985  3841 raft_consensus.cc:1217] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:43.504932  4152 raft_consensus.cc:1064] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:43.507448  4152 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:43.513222  3838 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:43.515159  4094 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:43.515614  3210 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:43.517997  3276 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:43.518656  4152 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:43.527335  4158 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:43.533414  4094 raft_consensus.cc:2955] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:43.537185  3838 raft_consensus.cc:2955] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:43.551875  3276 raft_consensus.cc:2955] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:43.554497  3204 raft_consensus.cc:2955] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:43.558876  3032 catalog_manager.cc:5697] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:43.602286  3128 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:43.614763  3838 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:43.615506  3276 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:43.617218  4158 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:43.618582  4152 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:43.620910  4158 raft_consensus.cc:1064] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:43.626359  4158 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:43.628572  4188 raft_consensus.cc:2955] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:43.632107  3841 raft_consensus.cc:2955] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:43.641896  3276 raft_consensus.cc:2955] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:43.654655  3278 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:43.656033  3206 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:43.656287  4157 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:43.658630  4152 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:43.666081  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 528677c11f624ca18f75db1e739e29d6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:43.669190  3838 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:43.675940  4152 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:43.676434  3033 catalog_manager.cc:5697] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.715018  4152 raft_consensus.cc:2955] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:43.722285  3199 tablet_service.cc:1558] Processing DeleteTablet for tablet 528677c11f624ca18f75db1e739e29d6 with delete_type TABLET_DATA_TOMBSTONED (TS 43b01d5a97e149008d543a6615219928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:43.722127  3278 raft_consensus.cc:2955] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:43.730216  3206 raft_consensus.cc:2955] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:43.753566  3841 raft_consensus.cc:2955] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:43.766624  4197 raft_consensus.cc:1064] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:43.773355  4183 raft_consensus.cc:1064] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
W20260709 13:15:43.775038  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.774329  4197 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:43.775668  4183 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:43.759804  3031 catalog_manager.cc:5697] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.791988  3840 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:43.792968  3285 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:43.793702  4197 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:43.798637  4152 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:43.806200  4201 tablet_replica.cc:333] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:15:43.804466  3128 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:43.810987  3206 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:43.815904  4152 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:43.820919  3131 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:43.826794  4201 raft_consensus.cc:2243] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:43.826979  3210 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:43.827711  4201 raft_consensus.cc:2272] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.830054  4063 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:43.840162  3285 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:43.841763  4063 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:43.849869  3841 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:43.851275  4201 ts_tablet_manager.cc:1916] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:43.844090  4157 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:15:43.868016  4063 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:43.902923  3841 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:15:43.936323  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 51382.9us
W20260709 13:15:43.937980  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 98001.6us
I20260709 13:15:43.997298  4152 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:15:44.007870  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 108268us
I20260709 13:15:44.030190  4201 ts_tablet_manager.cc:1929] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:44.030925  4201 log.cc:1199] T 528677c11f624ca18f75db1e739e29d6 P 43b01d5a97e149008d543a6615219928: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root/wals/528677c11f624ca18f75db1e739e29d6
I20260709 13:15:44.033876  3019 catalog_manager.cc:5028] TS 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): tablet 528677c11f624ca18f75db1e739e29d6 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:44.036880  3840 raft_consensus.cc:2955] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.037535  4197 raft_consensus.cc:2955] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.053959  4218 raft_consensus.cc:2955] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.055668  3278 raft_consensus.cc:2955] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:15:44.056842  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 119679us
I20260709 13:15:44.066296  3034 catalog_manager.cc:5697] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:15:44.069725  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 174325us
I20260709 13:15:44.081292  4063 raft_consensus.cc:2955] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.090358  3206 raft_consensus.cc:2955] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.102151  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 404209c6105f4945b077c33471d63370 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:44.109368  3031 catalog_manager.cc:5697] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.119644  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 404209c6105f4945b077c33471d63370 with delete_type TABLET_DATA_TOMBSTONED (TS 48080cf0460346769ab046a4f9457aa5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33888
I20260709 13:15:44.122855  3840 raft_consensus.cc:2955] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.140416  3131 raft_consensus.cc:2955] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.144490  3841 raft_consensus.cc:2955] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.149296  4221 tablet_replica.cc:333] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:15:44.150682  4221 raft_consensus.cc:2243] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.154381  4221 raft_consensus.cc:2272] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.160926  4221 ts_tablet_manager.cc:1916] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:44.156843  3031 catalog_manager.cc:5697] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:44.163915  3278 raft_consensus.cc:2955] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.188354  3211 raft_consensus.cc:2955] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.222510  3210 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:44.236528  4221 ts_tablet_manager.cc:1929] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:44.258751  3128 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:44.263154  3840 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:44.273451  4217 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:44.282588  3841 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:44.285641  4219 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:44.287282  3278 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:44.288727  4169 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:44.293881  4063 raft_consensus.cc:2955] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:15:44.300778  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 59698.6us
I20260709 13:15:44.307240  4219 raft_consensus.cc:2955] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.309960  3840 raft_consensus.cc:2955] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.313105  3838 raft_consensus.cc:2955] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.323108  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d7a98c6990948fab7c20936964c4d3e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:44.329294  3019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b7ab044361f54dae84978720aac3998c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:44.338812  3285 raft_consensus.cc:2955] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.334467  3031 catalog_manager.cc:5697] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:44.339986  3033 catalog_manager.cc:5697] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:44.361951  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d7a98c6990948fab7c20936964c4d3e with delete_type TABLET_DATA_TOMBSTONED (TS 48080cf0460346769ab046a4f9457aa5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33888
I20260709 13:15:44.356992  4221 log.cc:1199] T 404209c6105f4945b077c33471d63370 P 48080cf0460346769ab046a4f9457aa5: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root/wals/404209c6105f4945b077c33471d63370
I20260709 13:15:44.365027  3204 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:44.369760  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 404209c6105f4945b077c33471d63370 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:44.369869  4221 tablet_replica.cc:333] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:15:44.383452  3117 tablet_service.cc:1558] Processing DeleteTablet for tablet b7ab044361f54dae84978720aac3998c with delete_type TABLET_DATA_TOMBSTONED (TS fc48eecc27554cb58b15193cd442b1d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49668
I20260709 13:15:44.387173  4221 raft_consensus.cc:2243] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.387001  4219 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:44.392325  4221 raft_consensus.cc:2272] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.404415  4221 ts_tablet_manager.cc:1916] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:44.406250  4222 tablet_replica.cc:333] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:15:44.408146  3204 raft_consensus.cc:2955] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:44.410377  4222 raft_consensus.cc:2243] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.411425  4222 raft_consensus.cc:2272] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.416527  4222 ts_tablet_manager.cc:1916] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:44.424607  4221 ts_tablet_manager.cc:1929] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:44.425197  4221 log.cc:1199] T 2d7a98c6990948fab7c20936964c4d3e P 48080cf0460346769ab046a4f9457aa5: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root/wals/2d7a98c6990948fab7c20936964c4d3e
I20260709 13:15:44.429114  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 2d7a98c6990948fab7c20936964c4d3e (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:44.433513  4222 ts_tablet_manager.cc:1929] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:44.433930  4222 log.cc:1199] T b7ab044361f54dae84978720aac3998c P fc48eecc27554cb58b15193cd442b1d3: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-0-root/wals/b7ab044361f54dae84978720aac3998c
I20260709 13:15:44.435274  3020 catalog_manager.cc:5028] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): tablet b7ab044361f54dae84978720aac3998c (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
W20260709 13:15:45.054796  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 43716.9us
I20260709 13:15:45.468789  3128 consensus_queue.cc:237] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:45.477911  3206 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:45.477954  3277 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:45.478727  3102 consensus_peers.cc:597] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 432d705ff69845aaac398233202f4081. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:45.479599  4226 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:45.480598  4228 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:45.491288  4226 raft_consensus.cc:2955] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:45.493032  3206 raft_consensus.cc:2955] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:45.501605  3277 raft_consensus.cc:2955] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:45.519659  3033 catalog_manager.cc:5697] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:45.527547  3277 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:45.541606  3206 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:45.543159  3251 consensus_peers.cc:597] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 37a53418fbf14b998493923afc272c3c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:45.543349  4186 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:45.543725  3128 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:45.546252  4210 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:45.562402  4186 raft_consensus.cc:2955] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:45.570149  3128 raft_consensus.cc:2955] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:45.570798  3211 raft_consensus.cc:2955] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:45.586427  3277 consensus_queue.cc:237] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:45.595429  3031 catalog_manager.cc:5697] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.623641  3204 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:45.625723  4213 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:45.626601  3128 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:45.629751  4213 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:45.633466  3251 consensus_peers.cc:597] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2222d9a550a4cdaa84c7bf97a7ab954. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:45.646996  4186 raft_consensus.cc:2955] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:45.648962  3128 raft_consensus.cc:2955] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:45.656106  3206 raft_consensus.cc:2955] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:45.739009  3034 catalog_manager.cc:5697] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
W20260709 13:15:45.808060  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45524.5us
I20260709 13:15:45.810817  3206 consensus_queue.cc:237] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:15:45.819060  3177 consensus_peers.cc:597] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66614160a1bf4bb49ea02007f6679b0f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:45.819739  3277 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:45.821237  4225 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:45.834877  4247 raft_consensus.cc:2955] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:45.836757  3278 raft_consensus.cc:2955] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:45.850103  3130 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:45.853259  4225 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:45.855427  3034 catalog_manager.cc:5697] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.860215  3130 raft_consensus.cc:2955] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:45.902381  4254 ts_tablet_manager.cc:933] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323)
I20260709 13:15:45.910555  4254 tablet_copy_client.cc:323] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.65:41323
I20260709 13:15:45.912993  3145 tablet_copy_service.cc:140] P fc48eecc27554cb58b15193cd442b1d3: Received BeginTabletCopySession request for tablet 432d705ff69845aaac398233202f4081 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:57442)
I20260709 13:15:45.913655  3145 tablet_copy_service.cc:161] P fc48eecc27554cb58b15193cd442b1d3: Beginning new tablet copy session on tablet 432d705ff69845aaac398233202f4081 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:57442: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-432d705ff69845aaac398233202f4081
I20260709 13:15:45.922511  3145 tablet_copy_source_session.cc:215] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:45.926137  4254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432d705ff69845aaac398233202f4081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:45.941315  4254 tablet_copy_client.cc:806] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:45.941917  4254 tablet_copy_client.cc:670] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:45.948410  4254 tablet_copy_client.cc:538] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:45.957471  4254 tablet_bootstrap.cc:492] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:45.978756  4254 tablet_bootstrap.cc:492] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:45.979856  4254 tablet_bootstrap.cc:492] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:45.980623  4254 ts_tablet_manager.cc:1403] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 13:15:45.983940  4257 ts_tablet_manager.cc:933] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:45.984012  4254 raft_consensus.cc:359] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:45.985242  4254 raft_consensus.cc:740] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:45.986065  4254 consensus_queue.cc:260] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:45.988600  4257 tablet_copy_client.cc:323] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:15:45.989758  4254 ts_tablet_manager.cc:1434] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:15:45.990818  3294 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet 37a53418fbf14b998493923afc272c3c from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:15:45.991391  3294 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet 37a53418fbf14b998493923afc272c3c from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-37a53418fbf14b998493923afc272c3c
I20260709 13:15:45.992403  3145 tablet_copy_service.cc:342] P fc48eecc27554cb58b15193cd442b1d3: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-432d705ff69845aaac398233202f4081 received from {username='slave'} at 127.0.0.1:57442
I20260709 13:15:45.992872  3145 tablet_copy_service.cc:434] P fc48eecc27554cb58b15193cd442b1d3: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-432d705ff69845aaac398233202f4081 on tablet 432d705ff69845aaac398233202f4081 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:46.003108  3294 tablet_copy_source_session.cc:215] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:46.006747  4257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a53418fbf14b998493923afc272c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:46.024297  4257 tablet_copy_client.cc:806] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:46.024927  4257 tablet_copy_client.cc:670] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:46.034721  4257 tablet_copy_client.cc:538] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:46.044566  4257 tablet_bootstrap.cc:492] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:46.067322  4257 tablet_bootstrap.cc:492] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:46.068439  4257 tablet_bootstrap.cc:492] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:46.069757  4257 ts_tablet_manager.cc:1403] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.006s
I20260709 13:15:46.073691  4257 raft_consensus.cc:359] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:46.074699  4257 raft_consensus.cc:740] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:46.075819  4257 consensus_queue.cc:260] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:46.077814  4257 ts_tablet_manager.cc:1434] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:15:46.080945  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-37a53418fbf14b998493923afc272c3c received from {username='slave'} at 127.0.0.1:52014
I20260709 13:15:46.081488  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-37a53418fbf14b998493923afc272c3c on tablet 37a53418fbf14b998493923afc272c3c with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:46.096271  4257 ts_tablet_manager.cc:933] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:46.098630  4257 tablet_copy_client.cc:323] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:15:46.100200  3294 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet d2222d9a550a4cdaa84c7bf97a7ab954 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:15:46.100742  3294 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet d2222d9a550a4cdaa84c7bf97a7ab954 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-d2222d9a550a4cdaa84c7bf97a7ab954
I20260709 13:15:46.109248  3294 tablet_copy_source_session.cc:215] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:46.113183  4257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2222d9a550a4cdaa84c7bf97a7ab954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:46.128245  4257 tablet_copy_client.cc:806] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:46.129300  4257 tablet_copy_client.cc:670] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:46.133005  4257 tablet_copy_client.cc:538] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:46.142200  4257 tablet_bootstrap.cc:492] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:46.190608  4257 tablet_bootstrap.cc:492] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:46.191812  4257 tablet_bootstrap.cc:492] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:46.192595  4257 ts_tablet_manager.cc:1403] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.051s	user 0.034s	sys 0.014s
I20260709 13:15:46.195387  4257 raft_consensus.cc:359] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:46.196414  4257 raft_consensus.cc:740] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:46.197229  4257 consensus_queue.cc:260] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:46.199549  4257 ts_tablet_manager.cc:1434] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:46.201218  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-d2222d9a550a4cdaa84c7bf97a7ab954 received from {username='slave'} at 127.0.0.1:52014
I20260709 13:15:46.201674  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-d2222d9a550a4cdaa84c7bf97a7ab954 on tablet d2222d9a550a4cdaa84c7bf97a7ab954 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:46.247222  4257 ts_tablet_manager.cc:933] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:46.248827  4257 tablet_copy_client.cc:323] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.66:42299
I20260709 13:15:46.250447  3221 tablet_copy_service.cc:140] P 43b01d5a97e149008d543a6615219928: Received BeginTabletCopySession request for tablet 66614160a1bf4bb49ea02007f6679b0f from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:38892)
I20260709 13:15:46.250977  3221 tablet_copy_service.cc:161] P 43b01d5a97e149008d543a6615219928: Beginning new tablet copy session on tablet 66614160a1bf4bb49ea02007f6679b0f from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:38892: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-66614160a1bf4bb49ea02007f6679b0f
I20260709 13:15:46.259650  3221 tablet_copy_source_session.cc:215] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:46.263981  4257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66614160a1bf4bb49ea02007f6679b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:46.280577  4257 tablet_copy_client.cc:806] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:46.282131  4257 tablet_copy_client.cc:670] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:46.287003  4257 tablet_copy_client.cc:538] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:46.294361  4257 tablet_bootstrap.cc:492] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:46.311090  4257 tablet_bootstrap.cc:492] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:46.312085  4257 tablet_bootstrap.cc:492] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:46.312745  4257 ts_tablet_manager.cc:1403] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 13:15:46.315460  4257 raft_consensus.cc:359] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:46.316354  4257 raft_consensus.cc:740] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:46.316912  4257 consensus_queue.cc:260] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:46.318984  4257 ts_tablet_manager.cc:1434] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:15:46.325335  3221 tablet_copy_service.cc:342] P 43b01d5a97e149008d543a6615219928: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-66614160a1bf4bb49ea02007f6679b0f received from {username='slave'} at 127.0.0.1:38892
I20260709 13:15:46.325788  3221 tablet_copy_service.cc:434] P 43b01d5a97e149008d543a6615219928: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-66614160a1bf4bb49ea02007f6679b0f on tablet 66614160a1bf4bb49ea02007f6679b0f with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:46.406850  3838 raft_consensus.cc:1217] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:46.467772  3840 raft_consensus.cc:1217] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:46.630407  3840 raft_consensus.cc:1217] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:46.774549  3840 raft_consensus.cc:1217] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:46.876583  4228 raft_consensus.cc:1064] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:46.878975  4228 consensus_queue.cc:237] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:46.891244  3840 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:46.894006  4249 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:46.895143  3277 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:46.914397  3204 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:46.916086  4249 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:46.918424  4249 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:46.930794  4249 raft_consensus.cc:2955] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:46.942508  3204 raft_consensus.cc:2955] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:46.950325  3278 raft_consensus.cc:2955] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:46.951658  3840 raft_consensus.cc:2955] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:46.968257  4213 raft_consensus.cc:1064] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:46.969875  3031 catalog_manager.cc:5697] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:46.971567  4213 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:47.005034  3206 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:47.005393  3130 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:47.007261  4244 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:47.008666  4264 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:47.007272  3840 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:47.014964  4213 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:47.062330  4277 raft_consensus.cc:1064] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:47.067853  4277 consensus_queue.cc:237] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:47.078095  3204 raft_consensus.cc:2955] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.075627  4278 raft_consensus.cc:2955] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.105660  3206 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:47.107470  3840 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:47.108115  4244 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:47.118599  4244 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:15:47.139061  3130 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:47.142355  3130 raft_consensus.cc:2955] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.154400  3838 raft_consensus.cc:2955] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.158712  4264 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:47.180207  3128 consensus_queue.cc:237] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:47.175834  4278 raft_consensus.cc:2955] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.186482  3131 raft_consensus.cc:2955] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.196014  3841 raft_consensus.cc:2955] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.202049  3032 catalog_manager.cc:5697] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.210213  3838 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:47.213627  4249 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:47.224584  3277 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:47.226928  4250 raft_consensus.cc:2955] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.235262  3277 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:47.236143  3838 raft_consensus.cc:2955] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.250197  3206 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:47.254267  3840 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:47.254139  4264 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:47.256134  4228 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:47.258765  3206 raft_consensus.cc:2955] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.269449  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 432d705ff69845aaac398233202f4081 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:47.281220  4281 raft_consensus.cc:2955] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.281509  3032 catalog_manager.cc:5697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.282666  3211 raft_consensus.cc:2955] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.297947  3279 consensus_queue.cc:237] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:47.301132  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 37a53418fbf14b998493923afc272c3c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:47.300762  3278 raft_consensus.cc:2955] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.312336  3128 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:47.316879  4264 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:47.318913  4244 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:47.321857  3840 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:47.332259  3840 raft_consensus.cc:2955] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.339828  4244 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:47.341490  3031 catalog_manager.cc:5697] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.343006  4278 raft_consensus.cc:2955] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.352200  3130 raft_consensus.cc:2955] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.354977  4242 raft_consensus.cc:1064] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:47.357877  4242 consensus_queue.cc:237] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:47.346053  3031 catalog_manager.cc:5697] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.370740  3840 raft_consensus.cc:2955] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.384331  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d2222d9a550a4cdaa84c7bf97a7ab954 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:47.389901  3838 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:47.392491  4225 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:47.394589  3278 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:47.396538  3130 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:47.397063  4242 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:47.399127  4242 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:47.408136  3117 tablet_service.cc:1558] Processing DeleteTablet for tablet 37a53418fbf14b998493923afc272c3c with delete_type TABLET_DATA_TOMBSTONED (TS fc48eecc27554cb58b15193cd442b1d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49668
I20260709 13:15:47.409548  3199 tablet_service.cc:1558] Processing DeleteTablet for tablet 432d705ff69845aaac398233202f4081 with delete_type TABLET_DATA_TOMBSTONED (TS 43b01d5a97e149008d543a6615219928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:47.421679  3034 catalog_manager.cc:5697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.427430  4295 tablet_replica.cc:333] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:15:47.431845  4295 raft_consensus.cc:2243] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:47.434451  4295 raft_consensus.cc:2272] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:47.441141  4295 ts_tablet_manager.cc:1916] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:47.445214  3199 tablet_service.cc:1558] Processing DeleteTablet for tablet d2222d9a550a4cdaa84c7bf97a7ab954 with delete_type TABLET_DATA_TOMBSTONED (TS 43b01d5a97e149008d543a6615219928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:47.450922  4225 raft_consensus.cc:2955] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.453608  3840 raft_consensus.cc:2955] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.468636  3031 catalog_manager.cc:5697] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.474351  4294 tablet_replica.cc:333] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:15:47.477113  4294 raft_consensus.cc:2243] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:47.478121  4294 raft_consensus.cc:2272] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:47.479300  4295 ts_tablet_manager.cc:1929] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:47.479991  4295 log.cc:1199] T 432d705ff69845aaac398233202f4081 P 43b01d5a97e149008d543a6615219928: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root/wals/432d705ff69845aaac398233202f4081
I20260709 13:15:47.482414  3019 catalog_manager.cc:5028] TS 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): tablet 432d705ff69845aaac398233202f4081 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:47.483022  4295 tablet_replica.cc:333] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:15:47.484527  4295 raft_consensus.cc:2243] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:47.485637  4295 raft_consensus.cc:2272] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:47.502803  4294 ts_tablet_manager.cc:1916] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:47.532423  4294 ts_tablet_manager.cc:1929] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:47.532960  4294 log.cc:1199] T 37a53418fbf14b998493923afc272c3c P fc48eecc27554cb58b15193cd442b1d3: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-0-root/wals/37a53418fbf14b998493923afc272c3c
I20260709 13:15:47.535388  3020 catalog_manager.cc:5028] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): tablet 37a53418fbf14b998493923afc272c3c (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:47.546672  4295 ts_tablet_manager.cc:1916] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:15:47.553004  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 76899.9us
I20260709 13:15:47.555135  3130 raft_consensus.cc:2955] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.559067  3278 raft_consensus.cc:2955] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.583766  3206 consensus_queue.cc:237] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:47.590554  3840 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:47.592483  4225 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:47.599643  4290 raft_consensus.cc:2955] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.603338  3131 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:47.604991  4296 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:47.613340  3840 raft_consensus.cc:2955] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.613278  4295 ts_tablet_manager.cc:1929] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:47.620067  3131 raft_consensus.cc:2955] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:47.638705  4295 log.cc:1199] T d2222d9a550a4cdaa84c7bf97a7ab954 P 43b01d5a97e149008d543a6615219928: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root/wals/d2222d9a550a4cdaa84c7bf97a7ab954
I20260709 13:15:47.639917  3019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66614160a1bf4bb49ea02007f6679b0f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:47.646908  3019 catalog_manager.cc:5028] TS 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): tablet d2222d9a550a4cdaa84c7bf97a7ab954 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:47.649747  3033 catalog_manager.cc:5697] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New cstate: current_term: 1 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.669939  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 66614160a1bf4bb49ea02007f6679b0f with delete_type TABLET_DATA_TOMBSTONED (TS 48080cf0460346769ab046a4f9457aa5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33888
I20260709 13:15:47.676131  4298 tablet_replica.cc:333] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:15:47.677381  4298 raft_consensus.cc:2243] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:47.678330  4298 raft_consensus.cc:2272] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:47.682623  4298 ts_tablet_manager.cc:1916] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:47.698899  4298 ts_tablet_manager.cc:1929] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:47.699281  4298 log.cc:1199] T 66614160a1bf4bb49ea02007f6679b0f P 48080cf0460346769ab046a4f9457aa5: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root/wals/66614160a1bf4bb49ea02007f6679b0f
I20260709 13:15:47.701112  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 66614160a1bf4bb49ea02007f6679b0f (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:48.740017  3278 consensus_queue.cc:237] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:15:48.747082  3251 consensus_peers.cc:597] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7177cc3a5e547a3b1bef3c6c3c3a368. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:48.747467  3211 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:48.747949  3131 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:48.749439  4244 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:48.750488  4278 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:48.761590  4281 raft_consensus.cc:2955] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:48.763275  3131 raft_consensus.cc:2955] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:48.767400  3206 raft_consensus.cc:2955] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:48.780665  3034 catalog_manager.cc:5697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:48.788479  3131 consensus_queue.cc:237] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:15:48.801429  3102 consensus_peers.cc:597] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5881853d6b7b4e038027c4a93fdc0b41. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:48.804088  3211 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:48.805766  3278 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:48.806294  4249 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:48.807125  4288 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:48.843849  4299 raft_consensus.cc:2955] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:48.862296  3206 raft_consensus.cc:2955] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:48.878876  3278 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:48.872169  3285 raft_consensus.cc:2955] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:48.883711  3031 catalog_manager.cc:5697] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:48.893467  3251 consensus_peers.cc:597] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aded29f2cce84c3c8e2a5337dce77bde. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:48.897534  3211 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:48.899091  4244 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:48.900118  3130 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:48.901885  4244 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:48.934855  4244 raft_consensus.cc:2955] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:48.940084  3211 raft_consensus.cc:2955] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:48.945343  3131 raft_consensus.cc:2955] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:48.952607  3278 consensus_queue.cc:237] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:48.959573  3031 catalog_manager.cc:5697] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.997346  3211 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:48.998588  3251 consensus_peers.cc:597] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4f37f97e44445a8978d2cde7a9c9c58. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:48.999183  4278 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:49.000278  3131 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:49.003624  4278 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:49.021418  4244 raft_consensus.cc:2955] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:49.023769  3211 raft_consensus.cc:2955] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:49.025642  3131 raft_consensus.cc:2955] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:49.040773  3033 catalog_manager.cc:5697] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:49.202225  4318 ts_tablet_manager.cc:933] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:49.204478  4318 tablet_copy_client.cc:323] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:15:49.206583  3294 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet c7177cc3a5e547a3b1bef3c6c3c3a368 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:15:49.207150  3294 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet c7177cc3a5e547a3b1bef3c6c3c3a368 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-c7177cc3a5e547a3b1bef3c6c3c3a368
I20260709 13:15:49.215967  3294 tablet_copy_source_session.cc:215] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:49.219969  4318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7177cc3a5e547a3b1bef3c6c3c3a368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:49.255563  4318 tablet_copy_client.cc:806] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:49.260373  4318 tablet_copy_client.cc:670] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:49.264567  4318 tablet_copy_client.cc:538] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:49.265043  4320 ts_tablet_manager.cc:933] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323)
I20260709 13:15:49.269816  4320 tablet_copy_client.cc:323] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.65:41323
I20260709 13:15:49.271850  3145 tablet_copy_service.cc:140] P fc48eecc27554cb58b15193cd442b1d3: Received BeginTabletCopySession request for tablet 5881853d6b7b4e038027c4a93fdc0b41 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:57442)
I20260709 13:15:49.272550  3145 tablet_copy_service.cc:161] P fc48eecc27554cb58b15193cd442b1d3: Beginning new tablet copy session on tablet 5881853d6b7b4e038027c4a93fdc0b41 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:57442: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-5881853d6b7b4e038027c4a93fdc0b41
I20260709 13:15:49.275054  4318 tablet_bootstrap.cc:492] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:49.280447  3145 tablet_copy_source_session.cc:215] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:49.285936  4320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5881853d6b7b4e038027c4a93fdc0b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:49.303689  4318 tablet_bootstrap.cc:492] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:49.304682  4318 tablet_bootstrap.cc:492] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:49.305470  4318 ts_tablet_manager.cc:1403] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.005s
I20260709 13:15:49.308774  4318 raft_consensus.cc:359] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:49.310034  4318 raft_consensus.cc:740] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:49.310767  4318 consensus_queue.cc:260] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:49.313511  4318 ts_tablet_manager.cc:1434] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:15:49.315390  4320 tablet_copy_client.cc:806] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:49.315862  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-c7177cc3a5e547a3b1bef3c6c3c3a368 received from {username='slave'} at 127.0.0.1:52014
I20260709 13:15:49.316079  4320 tablet_copy_client.cc:670] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:49.316367  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-c7177cc3a5e547a3b1bef3c6c3c3a368 on tablet c7177cc3a5e547a3b1bef3c6c3c3a368 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:49.323498  4320 tablet_copy_client.cc:538] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:49.334583  4320 tablet_bootstrap.cc:492] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:49.358806  4320 tablet_bootstrap.cc:492] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:49.359715  4320 tablet_bootstrap.cc:492] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:49.360366  4320 ts_tablet_manager.cc:1403] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.000s
I20260709 13:15:49.362934  4320 raft_consensus.cc:359] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:49.363569  4320 raft_consensus.cc:740] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:49.364178  4320 consensus_queue.cc:260] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:49.366410  4320 ts_tablet_manager.cc:1434] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:15:49.368819  3145 tablet_copy_service.cc:342] P fc48eecc27554cb58b15193cd442b1d3: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-5881853d6b7b4e038027c4a93fdc0b41 received from {username='slave'} at 127.0.0.1:57442
I20260709 13:15:49.369395  3145 tablet_copy_service.cc:434] P fc48eecc27554cb58b15193cd442b1d3: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-5881853d6b7b4e038027c4a93fdc0b41 on tablet 5881853d6b7b4e038027c4a93fdc0b41 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:49.431965  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:49.469117  4320 ts_tablet_manager.cc:933] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:49.480568  4320 tablet_copy_client.cc:323] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:15:49.482244  3294 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet aded29f2cce84c3c8e2a5337dce77bde from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:15:49.482838  3294 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet aded29f2cce84c3c8e2a5337dce77bde from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-aded29f2cce84c3c8e2a5337dce77bde
I20260709 13:15:49.504742  3294 tablet_copy_source_session.cc:215] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:49.509797  4320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aded29f2cce84c3c8e2a5337dce77bde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:49.563047  4318 ts_tablet_manager.cc:933] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:49.564605  4320 tablet_copy_client.cc:806] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:49.565550  4320 tablet_copy_client.cc:670] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:49.576606  4320 tablet_copy_client.cc:538] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:49.577031  4318 tablet_copy_client.cc:323] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:15:49.580559  3294 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet b4f37f97e44445a8978d2cde7a9c9c58 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:15:49.581194  3294 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet b4f37f97e44445a8978d2cde7a9c9c58 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-b4f37f97e44445a8978d2cde7a9c9c58
I20260709 13:15:49.587175  3130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e805018f85b41fc88644215be011084"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:15:49.588086  3130 raft_consensus.cc:606] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:49.589859  3294 tablet_copy_source_session.cc:215] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:49.596345  3130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:15:49.597072  3130 raft_consensus.cc:606] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:15:49.598026  4318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f37f97e44445a8978d2cde7a9c9c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:49.602311  3130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:15:49.603080  3130 raft_consensus.cc:606] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:49.607158  3130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:15:49.607834  3130 raft_consensus.cc:606] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:15:49.608146  4320 tablet_bootstrap.cc:492] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:49.620791  4318 tablet_copy_client.cc:806] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:49.621426  4318 tablet_copy_client.cc:670] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:49.623299  3130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:15:49.626008  3130 raft_consensus.cc:606] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:15:49.627029  4318 tablet_copy_client.cc:538] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:49.628795  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:49.630926  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:49.637660  4318 tablet_bootstrap.cc:492] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:49.652153  4320 tablet_bootstrap.cc:492] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:49.653270  4320 tablet_bootstrap.cc:492] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:49.654084  4320 ts_tablet_manager.cc:1403] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.007s
I20260709 13:15:49.657171  4320 raft_consensus.cc:359] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:49.658025  4320 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:49.658735  4320 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:49.661569  4320 ts_tablet_manager.cc:1434] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:15:49.662048  4318 tablet_bootstrap.cc:492] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:49.662987  4318 tablet_bootstrap.cc:492] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:49.663715  4318 ts_tablet_manager.cc:1403] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.008s
I20260709 13:15:49.666719  4318 raft_consensus.cc:359] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:49.668352  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-aded29f2cce84c3c8e2a5337dce77bde received from {username='slave'} at 127.0.0.1:52014
I20260709 13:15:49.668953  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-aded29f2cce84c3c8e2a5337dce77bde on tablet aded29f2cce84c3c8e2a5337dce77bde with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:49.669330  4318 raft_consensus.cc:740] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:49.670117  4318 consensus_queue.cc:260] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:49.675469  4318 ts_tablet_manager.cc:1434] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:15:49.679546  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-b4f37f97e44445a8978d2cde7a9c9c58 received from {username='slave'} at 127.0.0.1:52014
I20260709 13:15:49.680011  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-b4f37f97e44445a8978d2cde7a9c9c58 on tablet b4f37f97e44445a8978d2cde7a9c9c58 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:49.684060  4288 raft_consensus.cc:993] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:15:49.684504  4288 raft_consensus.cc:1081] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Signalling peer 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:15:49.688534  3277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e805018f85b41fc88644215be011084"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:33906
I20260709 13:15:49.689199  3277 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:49.689545  3277 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.697443  3277 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:49.702756  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:49.702958  3277 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:49.703534  3131 raft_consensus.cc:3055] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:49.703999  3131 raft_consensus.cc:740] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:49.704802  3131 consensus_queue.cc:260] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:49.705953  3131 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.707579  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:49.708179  3204 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.714972  3131 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:15:49.715770  3204 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:15:49.716817  3250 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:49.717751  4317 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:49.718269  4317 raft_consensus.cc:697] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:49.719106  4317 consensus_queue.cc:237] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:49.730914  3031 catalog_manager.cc:5697] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:49.760555  3838 raft_consensus.cc:1217] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:49.800966  3838 raft_consensus.cc:1217] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:49.811887  4299 raft_consensus.cc:993] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:15:49.812397  4249 raft_consensus.cc:1081] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Signalling peer 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:15:49.814668  3838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81"
dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:54892
I20260709 13:15:49.815268  3838 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:49.815659  3838 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.824167  3838 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:49.840925  3838 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:49.841468  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:49.842128  3277 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.843366  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:49.843967  3131 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:49.844265  3131 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:49.845171  3131 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:49.846473  3131 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.849296  3277 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:49.850883  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:49.851830  4090 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:49.858567  3131 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:49.859184  4288 raft_consensus.cc:993] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:15:49.859766  4288 raft_consensus.cc:1081] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:15:49.860157  4090 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:15:49.861323  4249 raft_consensus.cc:993] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:15:49.861158  4090 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:49.861796  4228 raft_consensus.cc:1081] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:15:49.862740  3211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:15:49.863268  3211 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:49.863606  3211 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.866640  3204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:15:49.867237  3204 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:49.867574  3204 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.874290  3204 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:49.877315  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:49.878398  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:49.878623  3131 raft_consensus.cc:3055] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:49.878978  3277 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.879138  3131 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:49.880060  3131 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:49.881265  3131 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.886106  3204 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:49.888473  3277 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:49.889374  3211 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:49.890201  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:49.891453  4316 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:49.892299  4316 raft_consensus.cc:697] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:49.893359  4316 consensus_queue.cc:237] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:49.898872  3131 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:49.903905  3031 catalog_manager.cc:5697] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 2 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:49.907435  3211 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:49.908859  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:49.909446  3277 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.909883  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:49.910461  3128 raft_consensus.cc:3055] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:49.910740  3128 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:49.911489  3128 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:49.912737  3128 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.919198  3277 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:49.918758  3034 catalog_manager.cc:5697] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:49.920447  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:49.921366  4316 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:49.922040  4316 raft_consensus.cc:697] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:49.923216  4316 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:49.924777  3128 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:49.938365  3034 catalog_manager.cc:5697] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:49.976734  3838 raft_consensus.cc:1217] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:50.104481  3838 raft_consensus.cc:1217] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:50.129395  3131 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:50.130604  4338 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:50.147701  3211 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:50.153658  4244 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:50.155153  4249 raft_consensus.cc:993] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:15:50.155649  4249 raft_consensus.cc:1081] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:15:50.157450  4228 raft_consensus.cc:1064] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:50.161432  4228 consensus_queue.cc:237] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:50.169389  3204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:15:50.170171  3204 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:50.170591  3204 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:50.180482  3204 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:50.183560  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:50.184152  3277 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:50.182548  3204 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:50.196941  3278 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.200001  4249 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.200699  3277 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:50.201510  3838 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.202993  4249 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:15:50.207406  3204 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.210310  4249 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:50.211229  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:50.212168  3131 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:50.212543  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:50.213492  4296 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:50.214093  4296 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:50.212550  3131 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:50.231438  3131 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:50.215023  4296 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:50.232918  3131 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:50.269975  3278 raft_consensus.cc:2955] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.286613  3031 catalog_manager.cc:5697] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:50.256281  4299 raft_consensus.cc:2955] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.291383  3838 raft_consensus.cc:2955] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.336473  3031 catalog_manager.cc:5697] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.344611  3131 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:50.353211  3211 raft_consensus.cc:2955] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.379199  3131 consensus_queue.cc:237] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:50.439514  3279 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:50.441792  3130 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:50.391834  3278 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:50.461591  4351 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:50.462546  4296 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:50.474538  3278 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:50.477906  4090 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:50.481786  4296 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:50.483336  4338 raft_consensus.cc:1064] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:50.494617  3838 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:50.498132  4299 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:50.513216  4244 raft_consensus.cc:1064] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:50.512986  4228 raft_consensus.cc:2955] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.515632  4244 consensus_queue.cc:237] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:50.518374  3204 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:50.518489  4338 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:50.520015  3131 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:50.521790  4316 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:50.524751  4350 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:15:50.544574  3204 raft_consensus.cc:2955] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:15:50.552253  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 92837.5us
I20260709 13:15:50.589324  3838 raft_consensus.cc:2955] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.597815  3840 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.600163  4356 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.602062  3132 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:50.626241  3211 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.633551  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:50.649335  3841 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.650436  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5881853d6b7b4e038027c4a93fdc0b41 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:15:50.651818  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 75544.8us
I20260709 13:15:50.652038  4338 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.654352  4317 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.655735  3204 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.628767  4359 raft_consensus.cc:1064] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:50.658818  3131 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:50.660717  4296 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:50.675729  3130 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.683521  4358 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:50.679715  4372 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:50.691413  3131 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.674256  4359 consensus_queue.cc:237] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:50.711591  4358 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:50.725649  3279 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:50.727738  4358 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:50.728343  4349 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:50.739686  4373 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:15:50.752358  3034 catalog_manager.cc:5697] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index 3 to 4, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New cstate: current_term: 1 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.791543  4338 raft_consensus.cc:2955] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.796355  3211 raft_consensus.cc:2955] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.809484  3841 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.814524  3204 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.833562  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 5881853d6b7b4e038027c4a93fdc0b41 with delete_type TABLET_DATA_TOMBSTONED (TS 48080cf0460346769ab046a4f9457aa5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33888
I20260709 13:15:50.840185  4378 tablet_replica.cc:333] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:15:50.841311  4378 raft_consensus.cc:2243] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.847342  4354 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:50.849538  3132 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.855043  4359 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.858018  4317 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.857637  3132 raft_consensus.cc:2955] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.859278  4364 raft_consensus.cc:2955] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.862377  3841 raft_consensus.cc:2955] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.867084  3204 raft_consensus.cc:2955] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.918874  3840 raft_consensus.cc:2955] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.930225  4378 raft_consensus.cc:2272] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.935241  4378 ts_tablet_manager.cc:1916] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:50.938759  3031 catalog_manager.cc:5697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:50.945844  3033 catalog_manager.cc:5697] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.965384  3840 raft_consensus.cc:2955] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.961755  4364 raft_consensus.cc:2955] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.974457  3130 raft_consensus.cc:2955] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.983239  3277 consensus_queue.cc:237] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:50.989286  3208 raft_consensus.cc:2955] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:50.994333  3211 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:50.995739  4338 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:50.999433  3131 raft_consensus.cc:2955] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:51.003154  3841 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:51.005113  4364 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:15:51.010298  4354 raft_consensus.cc:2955] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:51.030053  3202 raft_consensus.cc:2955] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:51.041864  3032 catalog_manager.cc:5697] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.053226  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c7177cc3a5e547a3b1bef3c6c3c3a368 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:51.057824  4378 ts_tablet_manager.cc:1929] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:51.058404  4378 log.cc:1199] T 5881853d6b7b4e038027c4a93fdc0b41 P 48080cf0460346769ab046a4f9457aa5: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root/wals/5881853d6b7b4e038027c4a93fdc0b41
I20260709 13:15:51.060094  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 5881853d6b7b4e038027c4a93fdc0b41 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:51.060750  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:51.085891  3838 raft_consensus.cc:2955] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:51.086544  3276 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:51.100472  3131 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:51.101042  3279 consensus_queue.cc:237] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:51.102013  4356 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:51.100570  3033 catalog_manager.cc:5697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:51.111534  3840 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:51.112881  4364 raft_consensus.cc:2955] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:51.118943  3841 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:51.118947  3132 raft_consensus.cc:2955] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:51.126295  4359 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:51.128331  4359 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:51.132798  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aded29f2cce84c3c8e2a5337dce77bde with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:51.136524  3838 raft_consensus.cc:2955] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:51.140151  3117 tablet_service.cc:1558] Processing DeleteTablet for tablet c7177cc3a5e547a3b1bef3c6c3c3a368 with delete_type TABLET_DATA_TOMBSTONED (TS fc48eecc27554cb58b15193cd442b1d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49668
I20260709 13:15:51.140659  3208 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:51.142206  4367 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:51.143391  3031 catalog_manager.cc:5697] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index 3 to 4, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:51.151930  3204 raft_consensus.cc:2955] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:51.153385  4354 raft_consensus.cc:2955] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:51.165249  4384 tablet_replica.cc:333] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:15:51.166375  4384 raft_consensus.cc:2243] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:51.167704  4384 raft_consensus.cc:2272] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:51.169183  3199 tablet_service.cc:1558] Processing DeleteTablet for tablet aded29f2cce84c3c8e2a5337dce77bde with delete_type TABLET_DATA_TOMBSTONED (TS 43b01d5a97e149008d543a6615219928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:51.169848  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b4f37f97e44445a8978d2cde7a9c9c58 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:51.172093  3841 raft_consensus.cc:2955] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:51.175714  4384 ts_tablet_manager.cc:1916] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:51.221578  3033 catalog_manager.cc:5697] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index 3 to 4, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.233714  4384 ts_tablet_manager.cc:1929] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:51.235766  4384 log.cc:1199] T c7177cc3a5e547a3b1bef3c6c3c3a368 P fc48eecc27554cb58b15193cd442b1d3: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-0-root/wals/c7177cc3a5e547a3b1bef3c6c3c3a368
I20260709 13:15:51.241171  3020 catalog_manager.cc:5028] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): tablet c7177cc3a5e547a3b1bef3c6c3c3a368 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:51.244431  3117 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f37f97e44445a8978d2cde7a9c9c58 with delete_type TABLET_DATA_TOMBSTONED (TS fc48eecc27554cb58b15193cd442b1d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49668
I20260709 13:15:51.246651  4384 tablet_replica.cc:333] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:15:51.247653  4384 raft_consensus.cc:2243] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:51.248382  4384 raft_consensus.cc:2272] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:51.252130  4384 ts_tablet_manager.cc:1916] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:51.254489  3132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:15:51.255273  3132 raft_consensus.cc:606] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:15:51.259058  3132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:15:51.259714  3132 raft_consensus.cc:606] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:15:51.267277  3132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "772d700b048349bf9547efac6befb60d"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:15:51.267932  3132 raft_consensus.cc:606] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:51.270880  4384 ts_tablet_manager.cc:1929] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:51.271413  4384 log.cc:1199] T b4f37f97e44445a8978d2cde7a9c9c58 P fc48eecc27554cb58b15193cd442b1d3: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-0-root/wals/b4f37f97e44445a8978d2cde7a9c9c58
I20260709 13:15:51.273452  3020 catalog_manager.cc:5028] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): tablet b4f37f97e44445a8978d2cde7a9c9c58 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:51.279748  3130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:15:51.280400  3130 raft_consensus.cc:606] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:15:51.289153  3132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:15:51.289780  3132 raft_consensus.cc:606] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:51.291031  4385 tablet_replica.cc:333] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:15:51.292297  4385 raft_consensus.cc:2243] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:51.293219  4385 raft_consensus.cc:2272] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:51.294087  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:51.297612  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:51.299889  4385 ts_tablet_manager.cc:1916] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:51.313777  4385 ts_tablet_manager.cc:1929] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:51.314069  4385 log.cc:1199] T aded29f2cce84c3c8e2a5337dce77bde P 43b01d5a97e149008d543a6615219928: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root/wals/aded29f2cce84c3c8e2a5337dce77bde
I20260709 13:15:51.315382  3019 catalog_manager.cc:5028] TS 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): tablet aded29f2cce84c3c8e2a5337dce77bde (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:15:51.370851  4361 raft_consensus.cc:993] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:15:51.371368  4299 raft_consensus.cc:1081] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Signalling peer 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:15:51.372822  3276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "772d700b048349bf9547efac6befb60d"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:33906
I20260709 13:15:51.373374  3276 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:51.373667  3276 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.379581  3276 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:51.383136  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:51.383882  3132 raft_consensus.cc:3055] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:51.383980  3276 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:51.384287  3132 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:51.384918  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:51.385486  3208 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.385258  3132 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:51.386634  3132 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.392133  3208 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:15:51.393436  3132 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:15:51.393541  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:51.395094  4356 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:51.396186  4356 raft_consensus.cc:697] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:51.397010  4356 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:51.406066  3033 catalog_manager.cc:5697] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 3 to 4, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 4 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.448848  4361 raft_consensus.cc:993] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:15:51.449463  4249 raft_consensus.cc:1081] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:15:51.450850  3204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:15:51.451375  3204 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:51.451707  3204 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.459041  3204 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:51.461035  3204 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:51.461884  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:51.462106  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:51.462597  3132 raft_consensus.cc:3055] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.462726  3276 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.462936  3132 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:51.463763  3132 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:51.464823  3132 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.469434  3276 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:51.470575  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:51.471333  4316 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:51.471772  4316 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:51.472198  3132 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:51.472591  4316 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:51.483595  3033 catalog_manager.cc:5697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:51.594776  4361 raft_consensus.cc:993] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:15:51.595939  4361 raft_consensus.cc:1081] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:15:51.597504  3204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:15:51.598038  3204 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:51.598372  3204 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.605187  3204 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:51.606978  3204 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:51.608085  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:51.608254  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:51.608996  3276 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.609040  3132 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.609555  3132 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:51.610291  3132 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:51.611444  3132 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.615742  3276 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:51.616816  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:51.617497  4316 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:51.618000  4316 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:51.618727  3132 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:51.618857  4316 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:51.628144  3033 catalog_manager.cc:5697] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:51.715183  4249 raft_consensus.cc:993] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:15:51.715657  4249 raft_consensus.cc:1081] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Signalling peer 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:15:51.719133  3276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:33906
I20260709 13:15:51.719673  3276 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:51.720001  4299 raft_consensus.cc:993] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:15:51.720019  3276 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.720589  4249 raft_consensus.cc:1081] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:15:51.722030  3208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:15:51.722488  3208 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:51.722774  3208 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.726933  3276 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:51.728168  3208 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:51.729323  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:51.729547  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:51.729887  3130 raft_consensus.cc:3055] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.730010  3204 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.730218  3130 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:51.730671  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:51.730720  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:51.731272  3132 raft_consensus.cc:3055] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.730978  3130 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:51.731458  3279 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.731503  3132 raft_consensus.cc:740] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:51.732048  3130 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.732481  3132 consensus_queue.cc:260] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:51.733474  3132 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.734354  3276 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:51.737290  3208 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:51.738358  3130 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:15:51.741550  3279 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:51.742666  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:51.742883  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:51.743461  4316 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:51.744114  4316 raft_consensus.cc:697] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:51.744189  4354 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:51.744994  4354 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:51.745249  4316 consensus_queue.cc:237] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:51.745934  4354 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:51.750792  3132 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:51.759073  3204 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:15:51.761274  3033 catalog_manager.cc:5697] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:51.764554  3034 catalog_manager.cc:5697] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.853905  3132 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:51.855305  4354 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:51.878273  3204 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:51.879493  4354 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:52.014174  3279 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:52.015404  4351 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.025996  3130 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:52.027465  4351 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.028234  3132 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:52.030053  4351 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.046563  3279 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:52.048210  4397 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.254546  3130 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:52.256479  4354 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.265569  3208 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:52.267035  4354 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.298477  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:52.334120  3279 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:52.340739  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:52.341914  3251 consensus_peers.cc:597] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 772d700b048349bf9547efac6befb60d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.342002  3130 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:52.344677  3208 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:52.346611  4367 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:52.350121  4367 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:52.357265  4354 raft_consensus.cc:2955] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:52.366355  3204 raft_consensus.cc:2955] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:52.375373  3130 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:52.376904  4397 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.377991  3279 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:52.379997  3132 raft_consensus.cc:2955] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:52.380896  4397 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:52.391247  3276 consensus_queue.cc:237] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:52.406797  3034 catalog_manager.cc:5697] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index -1 to 4, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 4 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:52.414907  3251 consensus_peers.cc:597] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f4a8a614fca4531aab11f5963396f62. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.417546  3208 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:52.418404  3127 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:52.420290  4356 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.422775  4356 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.445461  4405 raft_consensus.cc:2955] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:52.452672  3208 raft_consensus.cc:2955] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:52.502288  3204 consensus_queue.cc:237] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:15:52.509268  3177 consensus_peers.cc:597] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 023c1461b69c46bdb3c42ee16f303ea2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.513168  3279 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:52.513592  3127 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:52.514771  4400 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:52.516860  3032 catalog_manager.cc:5697] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:52.517172  3127 raft_consensus.cc:2955] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:52.523415  4397 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:52.534400  3277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37a53418fbf14b998493923afc272c3c"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:15:52.534976  3277 raft_consensus.cc:606] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:52.540984  4397 raft_consensus.cc:2955] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:52.546015  3130 raft_consensus.cc:2955] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:52.546289  3277 raft_consensus.cc:2955] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:52.579295  3279 consensus_queue.cc:237] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:52.587499  3032 catalog_manager.cc:5697] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index -1 to 3, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 2 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:52.608058  3204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56db43db40f644309c6db08523b1b033"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:50254
I20260709 13:15:52.598826  3202 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:52.608745  3204 raft_consensus.cc:606] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:52.599422  3127 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:52.601091  3251 consensus_peers.cc:597] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e1a4d71ef0f4287999b5ee60fe02740. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.611024  4367 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.621333  4367 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.624416  3127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:15:52.625382  3127 raft_consensus.cc:606] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:52.629675  3202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:50254
I20260709 13:15:52.630256  3202 raft_consensus.cc:606] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:52.641306  3202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:50254
I20260709 13:15:52.641861  3202 raft_consensus.cc:606] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:52.641996  4367 raft_consensus.cc:2955] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:52.645334  3279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:15:52.645965  3279 raft_consensus.cc:606] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:52.648232  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:15:52.650297  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:52.649957  3204 raft_consensus.cc:2955] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:52.666726  3033 catalog_manager.cc:5697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:52.671155  3132 raft_consensus.cc:2955] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:15:52.739452  4423 ts_tablet_manager.cc:933] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:52.745357  4423 tablet_copy_client.cc:323] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:15:52.747390  3294 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet 772d700b048349bf9547efac6befb60d from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:15:52.747952  3294 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet 772d700b048349bf9547efac6befb60d from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-772d700b048349bf9547efac6befb60d
I20260709 13:15:52.756933  3294 tablet_copy_source_session.cc:215] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:52.760711  4423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772d700b048349bf9547efac6befb60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.782958  4423 tablet_copy_client.cc:806] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:52.784765  4423 tablet_copy_client.cc:670] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:52.816740  4423 tablet_copy_client.cc:538] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:53.685901  4427 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:53.686712  4427 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:53.689409  4427 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:53.797832  4429 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:15:53.798774  4429 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:53.856643  4429 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:53.857352  4429 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:53.857963  4429 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:53.862711  4299 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:53.863411  4299 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:53.888463  4299 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:53.937686  4299 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:53.938401  4299 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.032307  4429 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.033108  4429 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.033776  4429 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:53.940831  4299 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.050930  4299 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.051637  4299 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:54.067476  4427 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.068143  4427 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.070385  4427 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.077747  4299 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.077610  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 776) took 1242 ms. Trace:
I20260709 13:15:54.078505  4299 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.078925  4299 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.078460  3130 rpcz_store.cc:276] 0709 13:15:52.835636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.076493 (+1240857us) service_pool.cc:224] Handling call
0709 13:15:54.076976 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:54.077229 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.077261 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:54.077312 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:54.077357 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.077425 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.077543 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:54.080744  4299 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.082548  4299 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.082989  4299 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:54.085785  4299 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.086823  4429 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.089349  4430 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.089856  4430 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.091970  4430 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.092461  4430 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.092935  4430 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.095094  4430 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.096158  4299 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.096817  4299 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.095789  4429 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.097851  4429 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.099092  4423 tablet_bootstrap.cc:492] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:54.099045  4299 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.103045  4429 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.109040  4430 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.111711  4418 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.112388  4418 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.109678  4430 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.115176  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 868) took 1277 ms. Trace:
I20260709 13:15:54.116386  4430 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.116446  4433 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.117482  4433 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.118136  4430 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.118669  4430 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.119699  4433 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.119974  4356 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.120553  4356 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.115876  3202 rpcz_store.cc:276] 0709 13:15:52.837610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.840550 (+  2940us) service_pool.cc:224] Handling call
0709 13:15:52.840976 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.841239 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.841283 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.841355 (+    72us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:52.841397 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.841477 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.115080 (+1273603us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:54.127326  4356 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.119994  4427 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.128304  4432 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.128120  4356 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.128901  4432 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.130204  4435 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.131469  4432 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.130908  4435 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.132639  4429 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.133558  4429 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.136449  4429 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.132637  4432 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.128816  4427 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:54.137969  4356 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.139804  4354 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.115192  4418 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.142359  4418 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.141265  4432 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.142658  4437 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.142874  4418 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.144143  4432 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.145117  4418 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.147799  4430 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.149375  4356 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.142087  4354 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.160312  4354 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.141515  4427 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.166740  4429 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.143723  4437 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.169466  4429 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.172422  4433 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.172542  4354 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.173461  4354 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.175575  4430 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.176214  4430 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.176496  4356 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.177033  4356 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.173384  4433 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.180702  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.181128  4354 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.181725  4429 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.181854  4356 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.182211  4433 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.179111  4434 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:15:54.183135  4434 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.186655  4434 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.187345  4437 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.183898  4435 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.187775  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.184896  4430 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.201480  4423 tablet_bootstrap.cc:492] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:54.203860  4423 tablet_bootstrap.cc:492] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:54.204280  4366 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.204600  4423 ts_tablet_manager.cc:1403] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.106s	user 0.025s	sys 0.006s
I20260709 13:15:54.204878  4366 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.205595  4430 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:15:54.206213  4430 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.208282  4423 raft_consensus.cc:359] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:54.208889  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.209529  4435 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.210058  4432 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.210795  4432 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.211335  4366 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.212083  4366 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.213267  4430 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.212604  4366 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.214823  4432 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.210201  4435 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.215862  4366 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.209168  4423 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:54.216789  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.216828  4435 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.217624  3276 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:54.217976  4423 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:54.218853  4440 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.219372  4440 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.221065  4366 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.221567  4366 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.222746  4440 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.223440  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:54.224177  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:54.225396  3157 debug-util.cc:398] Leaking SignalData structure 0x7b0800314800 after lost signal to thread 2028
I20260709 13:15:54.228273  4405 raft_consensus.cc:993] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: : Instructing follower 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:15:54.228897  4405 raft_consensus.cc:1081] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Signalling peer 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:15:54.230059  4440 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.230611  4440 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.231465  3840 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde"
dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:58470
I20260709 13:15:54.232179  3840 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:54.232595  3840 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.236034  4433 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.236668  4433 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.238219  4356 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.238905  4433 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.238736  4356 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.241225  4316 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.241897  4316 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.242715  4418 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.243216  4418 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.244280  4316 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.245795  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:54.246392  3838 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:54.247018  4427 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.247582  4427 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.249807  4316 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.250479  4316 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.252485  4316 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.254434  4438 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.254587  4405 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.255043  4436 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.255189  4434 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.254985  4438 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.255712  4434 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.257181  4438 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.257936  4434 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.255622  4436 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.258142  4418 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.259872  4436 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.255046  4405 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.262871  4405 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.262818  4418 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.263499  4418 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.265424  4418 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.272056  4437 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.273622  4249 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.275682  4249 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.277455  4249 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.278163  4437 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.284682  4427 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.298529  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.298372  3840 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.299202  3284 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:54.240900  4356 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.289816  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.300643  3277 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:54.304929  4299 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.305523  4299 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.307329  4444 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.308144  4444 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.307422  4299 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:15:54.314319  3157 debug-util.cc:398] Leaking SignalData structure 0x7b08002be880 after lost signal to thread 3068
I20260709 13:15:54.317049  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.290172  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.291255  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:54.294075  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.318523  3279 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:15:54.318986  3278 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:15:54.320654  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:54.321759  4354 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.322268  4354 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.328244  4421 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.318548  4436 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.329126  4421 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.331523  4421 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.332084  4397 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.332605  4397 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.334133  4354 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.294414  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.334865  4397 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.336850  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.337154  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.337718  3282 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:54.300848  3840 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.340590  4444 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.341198  4444 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.341717  4444 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.343125  4435 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.343655  4435 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.340535  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.347754  4299 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.352890  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.353801  3278 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:54.294919  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.329840  4436 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.365172  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.366361  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.366758  4436 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.366950  3285 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:54.367458  3282 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:54.364681  4351 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.347906  4418 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.369390  4351 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.369635  4418 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.365111  4435 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.371366  4435 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.371513  4351 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.372058  4351 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.372074  4436 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.372121  4435 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.372917  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.373030  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.348076  4400 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.373617  3279 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
W20260709 13:15:54.373679  3157 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5c20 after lost signal to thread 3160
I20260709 13:15:54.372704  4436 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:54.375054  3157 debug-util.cc:398] Leaking SignalData structure 0x7b08000ab720 after lost signal to thread 3235
I20260709 13:15:54.376016  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:54.382339  3838 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:54.373677  4356 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.380242  4299 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.380831  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.403156  3276 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:15:54.343930  4444 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.385579  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:54.232788  4440 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:15:54.382872  3157 debug-util.cc:398] Leaking SignalData structure 0x7b0800333880 after lost signal to thread 3309
I20260709 13:15:54.380122  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:54.405828  4249 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:15:54.445521  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 65476.1us
I20260709 13:15:54.445470  4249 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.384506  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.446722  3278 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:15:54.411464  3841 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:54.412529  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.275051  4366 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.414222  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.273576  4432 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.369266  4397 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.425734  4299 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.463732  4451 ts_tablet_manager.cc:933] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.372455  4418 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.448702  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.486263  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:54.491499  3157 debug-util.cc:398] Leaking SignalData structure 0x7b080033ee80 after lost signal to thread 3867
I20260709 13:15:54.494539  4249 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.446281  4444 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.509559  4444 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.420804  4437 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.517454  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.517755  4299 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.468338  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.517520  4249 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.520473  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.491143  4432 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.521806  4249 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.405336  4351 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.416020  4356 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.535308  3251 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:54.536221  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.536813  3206 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:54.518438  4299 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:54.490016  4440 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.526528  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.537727  3204 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:54.402923  4400 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.540231  4316 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.541033  4316 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.510265  3837 raft_consensus.cc:1217] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:15:54.550204  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.550926  3206 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:54.554302  4316 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.554836  4316 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.554785  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:54.555562  3208 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:54.522568  4437 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.528350  4432 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.557096  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.559315  3130 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:54.527196  4427 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:15:54.557488  3276 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:54.558189  4249 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.513072  4397 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.534741  4418 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.562067  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:54.560544  4316 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.565141  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.573839  3206 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:54.568507  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.569410  4249 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.574802  3210 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:54.575076  4249 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.543483  4430 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.570164  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.569468  3251 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:54.574826  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.577167  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.546070  4435 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.578493  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:54.552937  4438 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.583031  4316 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.584164  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.584347  4249 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.585801  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.582271  4430 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.573609  4427 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.590133  4356 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.590955  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.591148  4427 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.591574  3136 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:54.592717  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.593039  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:54.546283  4440 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.593765  3841 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:15:54.573853  4429 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.597471  4448 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.598037  4429 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:54.578117  4354 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.575685  4418 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:54.599849  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.600984  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.598098  4448 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.602550  4446 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.603013  4442 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.651990  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.603083  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.603513  4452 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.569355  4437 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.587560  4405 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.596307  4356 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.604382  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.649792  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.651160  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.666457  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.591181  4430 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:15:54.659009  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 75860.6us
I20260709 13:15:54.663545  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.603847  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.671026  4433 raft_consensus.cc:993] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: : Instructing follower 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:15:54.671805  4433 raft_consensus.cc:1081] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Signalling peer 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:15:54.603897  4450 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:15:54.674070  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 450695us
I20260709 13:15:54.674260  4443 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.641571  4366 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.588114  4438 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.683919  4366 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.685632  3279 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:54.677309  3838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37a53418fbf14b998493923afc272c3c"
dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:58470
I20260709 13:15:54.674787  4443 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.691736  4438 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.692945  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.678190  4444 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.678617  4423 ts_tablet_manager.cc:1434] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.474s	user 0.058s	sys 0.058s
I20260709 13:15:54.641405  4429 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.679160  4400 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.679206  4299 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.679837  4351 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.640635  4447 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.699470  4445 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.699707  4447 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.699496  4453 ts_tablet_manager.cc:933] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.680214  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:54.680214  4437 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.664628  4397 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.681722  4440 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.661638  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.675889  4442 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.686544  3838 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:54.728344  3838 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.689792  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.604910  4354 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.695420  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.657938  4446 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.701588  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.731849  3204 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:54.680720  4356 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.709625  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:15:54.713740  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.714550  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.721851  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.722245  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.692552  4443 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.727397  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.664460  4405 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.729614  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:54.700120  4445 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.732542  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.853484  3211 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:54.663888  4452 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.843053  3206 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:54.855628  3282 raft_consensus.cc:3055] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:54.831053  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:54.857555  4366 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:54.674103  4450 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.857470  4455 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.856159  3282 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:54.849572  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.831130  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:54.876356  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 166883us
I20260709 13:15:54.877336  3805 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:54.879006  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:54.700120  4447 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.717861  4436 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.885594  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.885377  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.885876  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.918303  3130 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:15:54.858687  4405 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.729728  4351 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:54.917459  3282 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.930099  3282 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.731695  4354 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.884215  4440 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.743980  3806 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:54.884296  4366 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.921247  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:54.922773  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 43876.3us
I20260709 13:15:54.923493  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:54.744225  4397 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:54.926913  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.916723  4455 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.932056  3838 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:54.934770  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:55.057199  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.971864  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.104420  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:54.921748  3202 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:55.255985  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.252318  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.958563  3836 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.257649  4397 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:54.969431  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:54.934000  4440 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:55.074393  4442 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.288677  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.202451  4356 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:54.940017  4453 tablet_copy_client.cc:323] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:15:55.268680  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.276257  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.035944  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:15:54.988617  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 260173us
I20260709 13:15:54.968875  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:15:55.286450  4432 consensus_meta.cc:287] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.710s	user 0.005s	sys 0.015s
I20260709 13:15:55.068462  4450 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.287386  4460 ts_tablet_manager.cc:933] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:55.287484  4397 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.303871  4405 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.306064  4405 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:54.967012  4437 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.278028  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:54.971161  4451 tablet_copy_client.cc:323] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:15:55.306713  4437 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:54.971237  4418 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.307869  4437 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.261720  4443 raft_consensus.cc:2764] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:15:55.309494  4455 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.086058  4448 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.263763  3838 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.255407  4366 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:55.131145  4445 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:55.311048  4447 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.173269  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:55.013046  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:55.311820  4366 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.934587  4351 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:55.296201  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:54.967255  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:55.313378  4447 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:55.314144  4351 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.348814  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.351450  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.351735  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:54.937525  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.352799  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.355358  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.252279  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.357302  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.358784  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.359786  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.360364  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.358055  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.355471  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.293016  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.353351  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.285930  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.259687  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.285624  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.285100  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.298684  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.288085  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.291841  3282 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:55.297307  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.299913  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.298398  3805 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:55.294611  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:55.410594  3210 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:15:54.969802  4446 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:55.130890  4452 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.299485  4432 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.416903  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.302070  4354 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.434190  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.439751  4354 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:55.352653  3136 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:55.364424  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.356940  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.404035  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:55.441804  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.442448  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.442657  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.443802  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.363854  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.408804  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.409258  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.445215  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.445683  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.446300  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.447108  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.447659  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.409776  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.448594  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.405571  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-772d700b048349bf9547efac6befb60d received from {username='slave'} at 127.0.0.1:52014
I20260709 13:15:55.410017  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.449527  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-772d700b048349bf9547efac6befb60d on tablet 772d700b048349bf9547efac6befb60d with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:55.449968  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.289553  4440 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.451436  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.452988  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.453516  4448 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.453982  4448 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:55.454401  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.455566  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:55.456249  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 157815us
I20260709 13:15:55.457458  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.454438  4448 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.408054  3209 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:55.417501  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.311173  4460 tablet_copy_client.cc:323] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.66:42299
I20260709 13:15:55.461877  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.412827  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.444061  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.360822  3132 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:55.420680  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 869) took 1045 ms. Trace:
I20260709 13:15:55.465971  3202 rpcz_store.cc:276] 0709 13:15:54.374910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.382089 (+  7179us) service_pool.cc:224] Handling call
0709 13:15:55.418883 (+1036794us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54003750d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:15:55.420489 (+  1606us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841698048}
I20260709 13:15:55.467532  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.420837  4432 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.423066  3840 raft_consensus.cc:1240] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.424115  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.425239  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:55.426136  3279 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.427176  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.427489  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.467720  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.470012  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.470022  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.434130  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:55.291944  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.410519  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:55.472244  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 46104.2us
I20260709 13:15:55.456765  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.452740  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.459833  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.457546  3805 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:15:55.481943  3805 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:15:55.485401  4432 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.490844  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.466457  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.495954  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:55.496649  3293 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet 7f4a8a614fca4531aab11f5963396f62 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:15:55.496007  3294 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet 8e1a4d71ef0f4287999b5ee60fe02740 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:15:55.505565  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:55.505980  3293 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet 7f4a8a614fca4531aab11f5963396f62 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-7f4a8a614fca4531aab11f5963396f62
I20260709 13:15:55.508206  4437 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.510665  4437 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.510530  4440 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.510854  3294 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet 8e1a4d71ef0f4287999b5ee60fe02740 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-8e1a4d71ef0f4287999b5ee60fe02740
I20260709 13:15:55.512607  4440 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.514384  4366 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.516152  4366 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:55.497277  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:55.498795  4448 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.502331  4432 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:55.517460  4432 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.518188  3283 raft_consensus.cc:3055] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.518270  4448 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.518700  3283 raft_consensus.cc:740] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:55.519841  3283 consensus_queue.cc:260] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.540887  3283 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.535770  4442 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.546911  4442 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:55.547453  4442 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.537763  4463 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:15:55.531441  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 49622.7us
I20260709 13:15:55.557753  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.558897  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:55.561765  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:55.563396  4463 raft_consensus.cc:697] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:15:55.563862  3806 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:55.564678  4463 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.567070  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.565274  4437 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.567436  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.548884  3294 tablet_copy_source_session.cc:215] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:55.569741  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.570029  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.572607  3293 tablet_copy_source_session.cc:215] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:15:55.573057  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 49500.2us
I20260709 13:15:55.583618  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.585568  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:55.586156  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 50614us
I20260709 13:15:55.586565  3279 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 2: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:15:55.592058  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.598031  4451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4a8a614fca4531aab11f5963396f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:55.573446  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:55.602792  3204 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.575253  4442 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.623136  4442 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:55.636336  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:55.606492  3221 tablet_copy_service.cc:140] P 43b01d5a97e149008d543a6615219928: Received BeginTabletCopySession request for tablet 023c1461b69c46bdb3c42ee16f303ea2 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:38892)
I20260709 13:15:55.614069  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:55.614205  4453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1a4d71ef0f4287999b5ee60fe02740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:55.617206  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:55.573738  3249 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:55.624420  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:55.626591  3177 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:55.629931  3840 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.635167  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:55.636407  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:55.640605  3283 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:55.641108  3221 tablet_copy_service.cc:161] P 43b01d5a97e149008d543a6615219928: Beginning new tablet copy session on tablet 023c1461b69c46bdb3c42ee16f303ea2 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:38892: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-023c1461b69c46bdb3c42ee16f303ea2
I20260709 13:15:55.643905  4354 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:55.649822  3279 raft_consensus.cc:2393] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 2: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:55.650897  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:55.651674  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:55.653702  4447 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:55.654094  4447 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:15:55.654465  4447 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.660166  4445 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.660660  4445 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:55.661226  4445 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.666967  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.670784  3806 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:55.673385  4437 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:55.673949  4437 raft_consensus.cc:697] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:15:55.674887  4437 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:15:55.678642  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 64788.6us
I20260709 13:15:55.678987  4418 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.679546  4418 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:55.680051  4418 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.682363  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:55.682462  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:15:55.673384  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 99817.4us
I20260709 13:15:55.690305  3840 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.690511  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:15:55.697520  3806 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.509s (SENT) [suppressed 1 similar messages]
W20260709 13:15:55.700058  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 48543.5us
I20260709 13:15:55.712568  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:55.712910  4450 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.714872  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:55.715793  4450 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:55.716226  4450 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:55.716593  4450 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.716956  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:55.718009  4356 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:55.692330  3221 tablet_copy_source_session.cc:215] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:55.689635  4432 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.718791  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:15:55.720197  3135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:54126
W20260709 13:15:55.720826  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 94295.9us
I20260709 13:15:55.716240  4405 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.721779  4405 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:55.722180  4405 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.699513  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:55.720968  3135 raft_consensus.cc:606] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:55.690235  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:55.728039  3100 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:55.729135  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:15:55.731842  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:15:55.734483  4445 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:55.734720  3032 catalog_manager.cc:5697] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 1 to 2, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 2 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:55.721014  4432 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:55.743829  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:55.751600  4356 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.752056  4356 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:55.752055  4405 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:55.752687  4356 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.700693  4447 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.763552  4445 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:55.764429  3279 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:55.767741  3204 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:55.755113  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:15:55.768790  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 71307.8us
I20260709 13:15:55.769567  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:55.770438  4463 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.770825  3805 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:55.771307  4463 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.771570  4442 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.773017  3805 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:15:55.773810  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45886.5us
I20260709 13:15:55.776696  4447 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:55.777733  4465 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:55.778371  4465 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:55.778776  4465 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.781842  4405 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:55.783639  4453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58470 (request call id 281) took 1408 ms. Trace:
I20260709 13:15:55.790820  3805 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:55.780912  4432 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:15:55.806384  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 62669.1us
I20260709 13:15:55.794893  4442 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.803048  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:55.802577  4460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023c1461b69c46bdb3c42ee16f303ea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:55.817273  4446 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.799728  4451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58470 (request call id 280) took 1423 ms. Trace:
I20260709 13:15:55.821024  4451 rpcz_store.cc:276] 0709 13:15:54.375098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.375215 (+   117us) service_pool.cc:224] Handling call
0709 13:15:54.506387 (+131172us) ts_tablet_manager.cc:934] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
0709 13:15:55.595856 (+1089469us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:55.678264 (+ 82408us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:55.678419 (+   155us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:55.708643 (+ 30224us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:55.709034 (+   391us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:55.766795 (+ 57761us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:55.798187 (+ 31392us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":43924,"tablet-copy.queue_time_us":87866,"thread_start_us":454198,"threads_started":2}
I20260709 13:15:55.819931  3249 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:15:55.824410  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 49407.1us
I20260709 13:15:55.825692  3249 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:55.825969  4445 consensus_queue.cc:1059] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:55.826565  4447 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.784080  4453 rpcz_store.cc:276] 0709 13:15:54.375391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.410952 (+ 35561us) service_pool.cc:224] Handling call
0709 13:15:54.700785 (+289833us) ts_tablet_manager.cc:934] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
0709 13:15:55.612389 (+911604us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:55.688903 (+ 76514us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:55.701061 (+ 12158us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:55.782803 (+ 81742us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:55.783110 (+   307us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:55.783412 (+   302us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:55.783532 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":5529,"tablet-copy.queue_time_us":102670,"thread_start_us":119581,"threads_started":2}
I20260709 13:15:55.828645  4405 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.829104  4445 raft_consensus.cc:3055] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.829604  4445 raft_consensus.cc:740] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:55.829710  4453 tablet_copy_client.cc:806] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:55.830721  4453 tablet_copy_client.cc:670] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:55.830776  4445 consensus_queue.cc:260] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.812352  4356 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:55.834824  4445 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.835120  4452 raft_consensus.cc:993] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:15:55.835578  4452 raft_consensus.cc:1081] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Signalling peer 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:15:55.836032  4405 raft_consensus.cc:1064] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:15:55.836787  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:15:55.828066  3250 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:55.843300  4442 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:55.824059  4451 tablet_copy_client.cc:806] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:55.846406  4432 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:55.849260  4432 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:15:55.850359  4432 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.851527  4432 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.851306  3102 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:15:55.853335  4354 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.853740  4354 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:55.854074  4354 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.854358  3102 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:55.844398  4418 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:55.848658  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:55.840176  4405 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.859159  4351 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.859357  4453 tablet_copy_client.cc:538] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:55.857604  4450 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:55.863238  4450 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.872874  4356 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:55.882302  4465 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:55.883018  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:55.864548  4451 tablet_copy_client.cc:670] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:55.877885  4470 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:55.902796  4473 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:55.905205  4472 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:55.903908  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 56129.4us
W20260709 13:15:55.906070  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 59041.6us
W20260709 13:15:55.909819  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 53737us
I20260709 13:15:55.910777  4447 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:55.912050  4354 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:55.864188  4445 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:55.915625  3840 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:55.914705  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 98226.4us
I20260709 13:15:55.919727  4354 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:55.920469  3249 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:55.912091  4418 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.923334  4465 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:55.923748  4477 consensus_queue.cc:1059] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:15:55.915467  4450 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.914175  4472 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:55.935964  4472 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.939654  4462 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.946192  4477 raft_consensus.cc:3055] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.963611  4477 raft_consensus.cc:740] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:15:55.967965  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.964574  4477 consensus_queue.cc:260] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:55.975384  4477 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.985648  3102 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:15:55.989353  3837 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:55.992933  4451 tablet_copy_client.cc:538] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:55.927744  4445 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:55.935091  4418 consensus_queue.cc:1059] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:15:55.934715  4447 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.004117  4418 raft_consensus.cc:3055] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.004522  4418 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:56.012111  4479 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:56.015129  4481 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:56.015234  4450 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:56.016049  4481 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:56.016325  4450 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:55.932852  4473 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.024179  3176 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:56.033430  4450 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:56.011162  4405 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:15:56.043951  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45911.3us
I20260709 13:15:56.046597  4431 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.044831  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:56.038406  4453 tablet_bootstrap.cc:492] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:56.058545  4432 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:56.062356  4450 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:56.062760  4432 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:56.062989  4450 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.064095  4356 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:56.057548  4465 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.064733  4356 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.030783  4418 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:15:56.074327  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 50246.9us
W20260709 13:15:56.127488  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 46278.5us
W20260709 13:15:56.092638  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.132092  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.075033  4445 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:56.072757  4418 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.066924  4356 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:56.073163  4473 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:15:56.136303  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 150740us
I20260709 13:15:56.126139  4472 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:56.153309  4472 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:56.138337  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.138480  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.139153  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.065035  4432 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:56.157063  3101 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.158249  3279 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:56.158568  3101 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:56.125947  4442 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:56.144570  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:15:56.141921  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 221778us
I20260709 13:15:56.168249  3202 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.074124  4447 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:56.073244  4446 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:56.171649  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:56.174886  4432 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:15:56.175794  4442 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:56.177961  4442 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:56.071710  4405 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:56.181610  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:56.182837  3281 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 2: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:56.183387  3249 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:56.185990  4447 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.188364  4405 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:56.184787  3249 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:56.190296  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:56.191350  4452 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:56.191744  4452 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:56.192217  4452 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.191679  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.193648  4431 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.193801  3129 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.197139  4460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54908 (request call id 184) took 1341 ms. Trace:
I20260709 13:15:56.197336  4447 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.198145  4447 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.198549  4447 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:56.200290  4471 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.201926  4477 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:56.198925  4447 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.202366  4477 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:56.202811  4477 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.207854  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:15:56.208976  3835 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.209782  3249 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:56.210206  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:56.210821  4405 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.211315  4405 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:56.211715  4405 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.212266  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:56.213240  3134 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.215195  4446 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:15:56.194944  3101 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.215672  4446 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.216259  4471 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:56.216533  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.216820  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:56.217522  3132 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:15:56.217797  3101 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:56.217347  3840 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc"
dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:54892
I20260709 13:15:56.218613  3840 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:56.219132  3840 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.222326  3134 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:56.231191  3840 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:56.197576  4460 rpcz_store.cc:276] 0709 13:15:54.855351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.855517 (+   166us) service_pool.cc:224] Handling call
0709 13:15:55.307379 (+451862us) ts_tablet_manager.cc:934] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
0709 13:15:55.792397 (+485018us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:55.926177 (+133780us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:55.926374 (+   197us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:56.196308 (+269934us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:56.196579 (+   271us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:56.196926 (+   347us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:56.197055 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":269,"tablet-copy.queue_time_us":402939,"thread_start_us":197479,"threads_started":2}
I20260709 13:15:56.234084  4460 tablet_copy_client.cc:806] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:56.234617  4460 tablet_copy_client.cc:670] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:56.210875  3131 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.065320  4465 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:56.084009  4450 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:56.236683  3840 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:56.239313  4446 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:56.248322  4471 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.282291  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.283979  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.285246  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.285737  3208 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:56.286068  4446 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:56.249914  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.286528  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.286870  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.287509  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.287850  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.250594  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.251015  3202 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:15:56.254412  3281 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:56.249287  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:56.290148  4472 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.290576  4472 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:56.255116  4447 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.290972  4463 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:56.295854  3211 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:56.290994  4472 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.257788  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:56.297963  3134 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:56.298027  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:56.259829  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.262635  3835 raft_consensus.cc:1240] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 3. Ops: []
I20260709 13:15:56.262508  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.265113  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.268687  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.276103  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.282589  4471 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:56.291185  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.256034  4451 tablet_bootstrap.cc:492] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:56.291733  4465 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.295759  4447 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:56.257213  4405 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:56.311589  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.292495  3131 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:15:56.307096  4481 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:56.345393  3283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:15:56.325064  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:56.328969  3208 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:56.323386  4397 consensus_queue.cc:1059] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:56.352818  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:56.353495  3136 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.346021  3283 raft_consensus.cc:606] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:56.316625  4471 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.268808  4452 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.325961  4356 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:56.310974  4483 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:15:56.361018  4354 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:56.362666  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.368208  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:15:56.371795  4480 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:56.372355  4480 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.372980  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:56.373216  4354 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.373476  4487 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:56.373940  4487 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:56.374321  4487 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:56.374984  4354 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:56.373898  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:56.356463  4482 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.385469  4479 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:56.385628  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.390990  4477 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:56.365617  4351 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:56.414413  4354 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:56.394994  4446 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:56.421290  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:56.423745  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.428087  4354 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.428793  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:56.432363  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:56.388288  4356 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.425207  3129 raft_consensus.cc:1240] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:56.434978  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.415416  4450 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:56.419229  4483 raft_consensus.cc:3055] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.438529  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:15:56.437533  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 146447us
I20260709 13:15:56.436769  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.440019  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:56.443907  3284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:15:56.409624  4479 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.447695  4354 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:56.450083  4405 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:56.451156  3203 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:15:56.394425  4470 consensus_queue.cc:1059] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:15:56.444489  3284 raft_consensus.cc:606] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:15:56.454198  4354 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:56.437696  4450 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:56.438870  4483 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:15:56.457973  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 46014.9us
I20260709 13:15:56.453193  4474 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:56.453485  3832 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.467842  4354 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.425685  4351 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:56.464628  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:56.469030  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:56.459723  4431 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.461843  4450 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.480278  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.483367  4470 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.483827  4470 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:56.484202  4470 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.484267  4356 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:56.485908  4354 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:56.483093  3101 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.476432  4431 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:56.487562  4446 raft_consensus.cc:697] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:56.499323  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:56.467957  4462 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:15:56.500877  4492 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:56.493314  4452 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:56.504138  4472 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.496680  4431 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.509812  4487 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.504339  4483 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:56.486733  4474 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:56.516193  4482 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:56.516444  4452 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.515802  4477 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:56.534423  4431 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.539271  3136 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:15:56.539561  4354 consensus_queue.cc:1059] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:56.547253  4472 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:56.536464  4492 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:15:56.550931  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 86412.6us
I20260709 13:15:56.552544  3176 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:56.539696  4452 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:56.585322  4483 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.588910  4452 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.601967  4480 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:56.602592  4493 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:15:56.606231  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 161408us
I20260709 13:15:56.610033  3249 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:15:56.610780  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 128113us
I20260709 13:15:56.612640  4493 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:56.632068  4487 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:56.622414  4431 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:56.613646  4450 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.622429  4474 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:56.605140  4446 consensus_queue.cc:237] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:56.639536  3249 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:56.628473  4492 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.643658  4474 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.643937  4502 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.627370  4479 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:56.644984  3249 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:56.646251  4474 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:56.647543  4470 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.647833  3249 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:56.648332  4450 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:56.648670  4474 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:56.651448  4481 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:56.653434  4479 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:56.653528  4491 raft_consensus.cc:3055] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.653898  4479 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:56.654049  4491 raft_consensus.cc:740] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:56.654904  4479 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.656317  4479 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.659395  4481 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:15:56.663261  4473 raft_consensus.cc:3055] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:56.663683  4473 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:56.664446  4473 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.685335  4493 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:56.686658  4455 raft_consensus.cc:3055] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.687863  3249 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:15:56.687067  4455 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:56.691498  4356 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.691911  4455 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:56.693068  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:56.693287  4455 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.701344  4473 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.713032  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.693886  4356 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:56.715404  3202 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:56.713429  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.719357  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.719364  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:56.719866  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.729329  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:15:56.731683  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 232364us
I20260709 13:15:56.734434  3835 raft_consensus.cc:1240] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 3. Ops: []
I20260709 13:15:56.743360  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:56.744273  3832 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:15:56.743904  4483 consensus_queue.cc:1059] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:56.746910  4474 raft_consensus.cc:993] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: : Instructing follower 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:15:56.747432  4474 raft_consensus.cc:1081] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Signalling peer 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:15:56.731335  4356 raft_consensus.cc:697] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:56.756968  4356 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:56.757221  4452 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.761412  3837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e"
dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:58470
I20260709 13:15:56.784982  4405 raft_consensus.cc:3055] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.763422  4465 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.766069  4470 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:56.767645  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:56.741847  4445 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:15:56.784340  4351 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:56.782522  4471 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.785871  4405 raft_consensus.cc:740] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:56.785245  4491 consensus_queue.cc:260] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:56.792229  4470 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:56.793342  4491 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.793617  4470 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:56.794493  3133 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:56.796453  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.786054  3837 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:15:56.798228  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.796034  4470 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.798846  3101 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:56.808732  4465 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:56.806102  4453 tablet_bootstrap.cc:492] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:15:56.825207  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.813334  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 214605us
I20260709 13:15:56.799696  4405 consensus_queue.cc:260] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:56.800871  3837 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.828486  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.829499  4505 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:56.839738  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.840433  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 228897us
W20260709 13:15:56.841339  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.846984  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.847808  4465 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:56.848201  4354 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:56.853456  4354 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:56.848474  3101 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.846568  3100 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:56.857240  4405 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.853616  4505 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:56.865960  4354 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.868774  4497 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.866190  4453 tablet_bootstrap.cc:492] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:56.867827  4465 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:56.879827  4354 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:56.867535  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.877167  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:15:56.868075  4505 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.889219  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:56.878705  4471 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:56.902861  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.914727  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.916189  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.917357  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.919049  3101 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.920116  4482 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:56.920980  4482 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:56.912460  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.888619  4453 ts_tablet_manager.cc:1403] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.884s	user 0.031s	sys 0.017s
I20260709 13:15:56.924328  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.891099  4483 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.929402  3101 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.888223  4465 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:56.899258  4497 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.903251  4493 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.944531  3101 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.945703  4503 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:56.884083  4452 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:56.933190  4482 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.933000  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.934900  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.936447  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:56.955215  4483 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.956322  4462 raft_consensus.cc:2955] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:56.959425  3202 raft_consensus.cc:2955] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:56.962188  4470 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:56.963142  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.977142  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.979259  3211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7ab044361f54dae84978720aac3998c"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:50254
I20260709 13:15:56.980110  3211 raft_consensus.cc:606] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:56.981475  3211 raft_consensus.cc:614] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:56.987902  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.989008  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:56.995656  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:56.997941  3132 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:56.983516  4493 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.985121  4452 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:57.000514  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.001159  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.001344  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.001950  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.011838  3128 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:57.014319  3131 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:57.000590  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.001951  3133 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:56.998533  4455 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.004343  3033 catalog_manager.cc:5697] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 2, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 2 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:57.009385  3211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:50254
I20260709 13:15:57.017163  3211 raft_consensus.cc:606] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:57.009827  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.012676  3134 raft_consensus.cc:2368] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3.
I20260709 13:15:57.017670  3033 catalog_manager.cc:5697] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 2, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.021245  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:57.022835  3136 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:57.022974  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:57.023911  3127 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:57.024267  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:57.025596  4453 raft_consensus.cc:359] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:57.026379  4470 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:57.034489  4486 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:57.028504  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:57.029404  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.034904  4486 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:57.040757  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.040693  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.044068  3136 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:57.033255  4455 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:57.046241  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:57.048820  4506 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.050318  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.026412  4453 raft_consensus.cc:740] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:57.049376  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:57.060580  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.061558  4442 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.062238  4442 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:57.064886  4442 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:57.067345  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:57.068454  3281 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:15:57.070238  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:57.071348  4442 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:57.071815  4442 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.072239  4442 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:57.027443  3837 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:57.044901  4486 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:57.090206  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 48282.7us
I20260709 13:15:57.091324  3127 raft_consensus.cc:2393] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 2: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:57.095590  4453 consensus_queue.cc:260] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:57.096364  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:57.095691  3836 raft_consensus.cc:2955] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:15:57.091657  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:57.011029  4465 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:57.098753  3211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:50254
I20260709 13:15:57.049908  4455 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:57.089428  3133 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:57.099511  3211 raft_consensus.cc:606] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:57.081977  4493 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.101941  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:57.102813  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:57.098434  4442 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:57.098107  4482 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.101882  4455 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.100569  4450 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.133915  3136 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:57.124909  3128 raft_consensus.cc:2368] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3.
I20260709 13:15:57.200954  3209 raft_consensus.cc:1240] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:57.144240  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 44601.3us
I20260709 13:15:57.166186  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:57.146555  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:15:57.497552  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.288797  3206 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:15:57.216027  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.134927  4453 ts_tablet_manager.cc:1434] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.196s	user 0.009s	sys 0.000s
W20260709 13:15:57.374476  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.137420  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:57.490653  4354 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:57.125679  3835 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:57.126866  4418 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.254606  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.514890  3134 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
W20260709 13:15:57.496172  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:57.216596  4513 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:15:57.253438  4506 raft_consensus.cc:993] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: : Instructing follower 48080cf0460346769ab046a4f9457aa5 to start an election
W20260709 13:15:57.441998  4492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.029s	sys 0.018s
I20260709 13:15:57.245806  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:57.154984  3211 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:57.517731  4354 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:57.274179  4505 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:57.515038  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:57.534854  4397 raft_consensus.cc:1081] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Signalling peer 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:15:57.535399  4505 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:57.536057  4445 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:57.152344  3837 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:57.537366  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.525035  4479 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:57.537988  3136 raft_consensus.cc:2376] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2. Re-sending same reply.
I20260709 13:15:57.538303  4479 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:57.540005  3281 raft_consensus.cc:3055] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:57.540508  3281 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:15:57.522060  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.513886  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:57.153698  3129 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:57.148038  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:57.531191  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:57.279785  3806 leader_election.cc:336] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.509s (SENT)
W20260709 13:15:57.525384  4492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.036s	sys 0.022s
I20260709 13:15:57.555824  4442 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:15:57.570681  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 56882.5us
W20260709 13:15:57.503438  4453 ts_tablet_manager.cc:1467] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Tablet startup took 573ms
I20260709 13:15:57.147548  3832 raft_consensus.cc:1217] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:57.556262  3840 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:15:57.562618  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:57.562394  3033 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.019s
W20260709 13:15:57.568910  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 191259us
I20260709 13:15:57.499214  4455 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:57.573823  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:57.583995  3033 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.001s	sys 0.020s
W20260709 13:15:57.585660  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.563437  4487 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.584723  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:57.568873  4463 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.592597  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 920) took 1164 ms. Trace:
I20260709 13:15:57.597435  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.593014  3209 rpcz_store.cc:276] 0709 13:15:56.424271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.424390 (+   119us) service_pool.cc:224] Handling call
0709 13:15:56.430706 (+  6316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.489252 (+1058546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.588302 (+ 99050us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54001d8154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:15:57.588457 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1770799872}
I20260709 13:15:57.598448  3134 raft_consensus.cc:2393] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 2: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:57.575798  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:57.599704  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:57.589247  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:57.596119  4446 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.614212  3136 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:15:57.587548  4405 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 13:15:57.615636  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 87052.2us
I20260709 13:15:57.611094  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:15:57.622933  3177 consensus_peers.cc:597] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:57.620606  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:57.627182  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:57.604485  4442 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.632184  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:57.621330  4462 consensus_meta.cc:287] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.000s
W20260709 13:15:57.603969  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 324222us
I20260709 13:15:57.598990  4463 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:57.624063  4418 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.644049  3176 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:57.641021  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.645576  3136 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:57.638187  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:57.635248  4493 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:57.647683  4522 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:15:57.638465  4527 consensus_queue.cc:1059] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:15:57.658046  4455 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:57.662370  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.664796  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:57.668499  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.669263  3136 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:57.672461  4455 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:57.672784  3806 leader_election.cc:336] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.561s (SENT)
I20260709 13:15:57.672883  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:57.673226  4455 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:57.674391  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:57.674162  4455 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:57.675670  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:57.672036  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.678725  3134 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:57.678799  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:57.576469  4453 ts_tablet_manager.cc:1469] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Trace:
0709 13:15:54.375391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.410952 (+ 35561us) service_pool.cc:224] Handling call
0709 13:15:54.700785 (+289833us) ts_tablet_manager.cc:934] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
0709 13:15:55.612389 (+911604us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:55.688903 (+ 76514us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:55.701061 (+ 12158us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:55.782803 (+ 81742us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:55.783110 (+   307us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:55.783412 (+   302us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:55.783532 (+   120us) inbound_call.cc:177] Queueing success response
0709 13:15:56.004856 (+221324us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:15:56.938708 (+933852us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:15:57.003139 (+ 64431us) tablet_replica.cc:261] Starting instrumentation
0709 13:15:57.003736 (+   597us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":5529,"mutex_wait_us":372,"raft.queue_time_us":1913,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":2903,"tablet-copy.queue_time_us":102670,"tablet-download-pool.queue_time_us":187,"tablet-download-pool.run_cpu_time_us":1551,"tablet-download-pool.run_wall_time_us":27712,"thread_start_us":119581,"threads_started":2}
I20260709 13:15:57.682672  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.683558  4351 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.677376  4492 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.684486  4351 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.676847  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:57.693238  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:57.695025  3128 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.677001  4455 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:57.699054  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:57.703271  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.703349  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:57.710788  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:57.711752  3131 raft_consensus.cc:2376] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2. Re-sending same reply.
I20260709 13:15:57.671383  4528 consensus_queue.cc:1059] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:15:57.716087  4354 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:15:57.701557  3836 consensus_meta.cc:287] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.604s	user 0.013s	sys 0.000s
I20260709 13:15:57.702168  4495 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.737023  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:57.743862  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:57.744674  3134 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:57.760442  4463 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:15:57.764084  4486 consensus_meta.cc:287] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.664s	user 0.012s	sys 0.000s
I20260709 13:15:57.765808  3133 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:57.767242  4473 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.767755  4473 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:57.769722  4473 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:57.770156  4473 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:57.770604  4473 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:57.772610  4487 raft_consensus.cc:993] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: : Instructing follower 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:15:57.773132  4487 raft_consensus.cc:1081] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Signalling peer 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:15:57.764519  4486 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:57.713361  3127 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:57.720971  4455 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:57.783987  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:15:57.801573  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 161891us
W20260709 13:15:57.815492  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 76923.6us
I20260709 13:15:57.816404  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:57.823391  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:57.825313  4351 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.739867  4528 consensus_queue.cc:1243] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 2.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:15:57.830756  3208 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:15:57.831391  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 187733us
I20260709 13:15:57.831462  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:57.833714  3207 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.835152  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:57.835884  4473 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:57.836724  4538 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:57.837276  4538 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:57.839787  4538 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:57.841516  4530 raft_consensus.cc:3055] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:57.841760  4486 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:57.841921  4530 raft_consensus.cc:740] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:57.842993  3128 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
W20260709 13:15:57.832420  3806 leader_election.cc:336] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.525s (SENT)
I20260709 13:15:57.853842  4532 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:57.855346  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:57.854470  4532 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:57.857461  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:57.842954  4530 consensus_queue.cc:260] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:57.858021  3279 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:57.858073  4532 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:57.858530  4530 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.859126  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:57.859802  3833 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:15:57.855623  3806 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:15:57.862640  3806 leader_election.cc:336] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.673s (SENT)
I20260709 13:15:57.835927  3205 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:15:57.868227  3203 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:57.869555  4463 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.870642  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:57.871673  3277 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:57.877761  4486 consensus_queue.cc:1059] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:57.879374  4486 consensus_queue.cc:1059] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.880612  4455 raft_consensus.cc:3055] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:57.881009  4455 raft_consensus.cc:740] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:57.881891  4455 consensus_queue.cc:260] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:57.883373  4455 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.888605  3279 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
W20260709 13:15:57.889182  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.890164  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-8e1a4d71ef0f4287999b5ee60fe02740 received from {username='slave'} at 127.0.0.1:52014
I20260709 13:15:57.890645  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-8e1a4d71ef0f4287999b5ee60fe02740 on tablet 8e1a4d71ef0f4287999b5ee60fe02740 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:57.891078  3207 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:15:57.891741  3129 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:57.894438  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:15:57.898469  4451 tablet_bootstrap.cc:492] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:57.898923  4479 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:57.899430  4451 tablet_bootstrap.cc:492] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:57.900369  4451 ts_tablet_manager.cc:1403] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 1.645s	user 0.034s	sys 0.020s
I20260709 13:15:57.895442  4442 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:15:57.910646  4528 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:57.913465  4450 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:57.914296  4450 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:57.915915  3251 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:57.905905  4460 tablet_copy_client.cc:538] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:57.919914  4531 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:57.920439  4531 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.920893  4531 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.896288  4463 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 13:15:58.020778  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.119565  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 212332us
I20260709 13:15:58.133513  4445 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.134176  4445 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:58.179773  4540 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.180527  4540 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:58.107615  4463 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:58.277144  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:58.477962  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:15:58.501235  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.501554  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:58.502346  3279 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
W20260709 13:15:58.502645  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.503998  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.504594  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.506630  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:58.507272  3277 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:58.192931  4532 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:58.512306  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:58.513614  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:58.507716  4445 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:58.516276  3284 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
W20260709 13:15:58.639457  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 111450us
I20260709 13:15:58.218863  4463 raft_consensus.cc:697] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:15:58.672125  3276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:33896
I20260709 13:15:58.680147  3276 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:58.680546  3276 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:58.681277  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.702446  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:58.700610  3278 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:15:58.711468  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:58.712461  3279 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:58.573153  4532 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:58.798046  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:58.764693  3276 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:58.833141  4540 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:58.837199  3278 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:58.835053  3835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.035s	sys 0.059s
I20260709 13:15:58.846275  3276 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:58.847949  3285 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:58.838238  4450 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:58.846670  4541 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:15:58.864027  4442 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.016s	sys 0.059s
W20260709 13:15:58.864493  4442 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.016s	sys 0.059s
I20260709 13:15:58.864946  4442 consensus_queue.cc:1243] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:58.856966  3280 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:58.883388  3279 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
W20260709 13:15:58.888058  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 359608us
W20260709 13:15:58.845742  3835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.035s	sys 0.060s
I20260709 13:15:58.865566  4442 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.897047  3278 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:58.862558  4541 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:58.862150  4463 consensus_queue.cc:237] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:15:58.897485  3806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.029s	sys 0.073s
W20260709 13:15:58.927882  3806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.030s	sys 0.073s
I20260709 13:15:58.897856  4442 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:58.932497  4532 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:58.934479  3806 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:58.935711  4546 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:58.935333  4451 raft_consensus.cc:359] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:58.936085  4546 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.936175  4451 raft_consensus.cc:740] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:58.936453  4546 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.936924  4451 consensus_queue.cc:260] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:58.942945  3835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 339) took 1109 ms. Trace:
I20260709 13:15:58.943400  3835 rpcz_store.cc:276] 0709 13:15:57.833794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.841591 (+  7797us) service_pool.cc:224] Handling call
0709 13:15:57.841952 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.842355 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.842399 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.842982 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:15:58.897101 (+1054119us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:58.898603 (+  1502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.900408 (+  1805us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.942665 (+ 42257us) raft_consensus.cc:1685] finished
0709 13:15:58.942684 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.942855 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1541,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":8130,"thread_start_us":1049131,"threads_started":1,"wal-append.queue_time_us":1091203}
W20260709 13:15:58.946866  4531 consensus_meta.cc:287] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.025s	user 0.007s	sys 0.004s
I20260709 13:15:58.950969  4531 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:58.953233  4460 tablet_bootstrap.cc:492] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:15:58.955000  4535 raft_consensus.cc:3055] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:58.955482  4535 raft_consensus.cc:740] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:58.950397  3285 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:58.929400  3836 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:58.944167  4546 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:58.955221  4442 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:58.963357  4535 consensus_queue.cc:260] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:58.964196  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:58.964455  4535 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.966823  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:58.956708  4541 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:58.962180  4531 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:58.975517  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:58.976413  3278 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:58.971122  4445 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:15:58.981597  3806 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:58.977835  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:15:58.982815  4545 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:58.983434  4545 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.983922  4545 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.983515  3281 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:58.974315  4442 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:58.982887  3835 raft_consensus.cc:2393] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:15:58.992435  3281 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:58.993682  4451 ts_tablet_manager.cc:1434] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 1.093s	user 0.018s	sys 0.026s
W20260709 13:15:58.994017  4451 ts_tablet_manager.cc:1467] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Tablet startup took 1093ms
I20260709 13:15:58.996348  4442 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:15:59.002254  4442 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.003579  4546 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.004348  4450 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:59.004910  4450 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.005414  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:59.006126  3278 raft_consensus.cc:2393] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:59.006489  4545 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.007275  4450 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.008915  4545 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.013127  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:59.013676  3278 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.014371  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:59.015611  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:59.020488  3278 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:15:59.021064  3832 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 2: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:15:59.021946  3835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af"
dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:54908
I20260709 13:15:59.022517  3835 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:15:58.994287  4451 ts_tablet_manager.cc:1469] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Trace:
0709 13:15:54.375098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.375215 (+   117us) service_pool.cc:224] Handling call
0709 13:15:54.506387 (+131172us) ts_tablet_manager.cc:934] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
0709 13:15:55.595856 (+1089469us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:55.678264 (+ 82408us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:55.678419 (+   155us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:55.708643 (+ 30224us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:55.709034 (+   391us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:55.766795 (+ 57761us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:55.798187 (+ 31392us) inbound_call.cc:177] Queueing success response
0709 13:15:56.255592 (+457405us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:15:57.900774 (+1645182us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:15:57.912913 (+ 12139us) tablet_replica.cc:261] Starting instrumentation
0709 13:15:58.838039 (+925126us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":43924,"mutex_wait_us":4224,"raft.queue_time_us":20302,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":5222,"tablet-copy.queue_time_us":87866,"tablet-download-pool.queue_time_us":13627,"tablet-download-pool.run_cpu_time_us":1545,"tablet-download-pool.run_wall_time_us":68183,"thread_start_us":501121,"threads_started":3}
I20260709 13:15:59.023500  3806 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:59.025540  4550 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:59.025578  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-7f4a8a614fca4531aab11f5963396f62 received from {username='slave'} at 127.0.0.1:52014
I20260709 13:15:59.026291  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-7f4a8a614fca4531aab11f5963396f62 on tablet 7f4a8a614fca4531aab11f5963396f62 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:59.026347  4550 raft_consensus.cc:697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:15:59.029397  3281 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:59.028205  4550 consensus_queue.cc:237] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.022789  3835 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:59.034739  4527 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:15:59.041975  3835 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:15:59.043524  3281 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52014 (request call id 76) took 1798 ms (client timeout 1836 ms). Trace:
I20260709 13:15:59.044219  3832 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:59.044143  3281 rpcz_store.cc:269] 0709 13:15:57.245340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.245493 (+   153us) service_pool.cc:224] Handling call
0709 13:15:58.983116 (+1737623us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4c0015d040. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3ba4bba20 00007fb3ba4cca29 00007fb3ba492644 00007fb3ba4b9f2d 00007fb3ba4b9b93 00007fb3bc1ea18b 00007fb3bc1eacb5 00007fb3bc1e5f30 00007fb3bc1e77de 00007fb3bc1f327c 00007fb3c11b4b17
0709 13:15:59.043432 (+ 60316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30798080}
I20260709 13:15:59.050056  4486 consensus_queue.cc:1059] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:59.050464  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:59.051096  4486 raft_consensus.cc:3055] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:59.051281  4545 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:59.051578  4486 raft_consensus.cc:740] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:59.052093  4545 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:15:59.053385  4545 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.072964  3835 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.073208  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:59.073967  3281 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.078929  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 1846) took 1320 ms. Trace:
I20260709 13:15:59.079351  3209 rpcz_store.cc:276] 0709 13:15:57.758886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.759019 (+   133us) service_pool.cc:224] Handling call
0709 13:15:57.759278 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.994448 (+1235170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.994478 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:58.994517 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:58.994544 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.078662 (+ 84118us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540019f854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:15:59.078715 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.078849 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2840165120}
W20260709 13:15:59.081549  3806 leader_election.cc:336] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.520s (SENT)
I20260709 13:15:59.081902  3281 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:59.083243  3806 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:59.084129  4546 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:59.084616  4546 raft_consensus.cc:697] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:15:59.085614  4546 consensus_queue.cc:237] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:15:59.100220  3806 leader_election.cc:336] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.707s (SENT)
I20260709 13:15:59.100713  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.101796  4442 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:59.104123  3806 leader_election.cc:336] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.743s (SENT)
W20260709 13:15:59.105170  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.106304  4405 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.107108  4446 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:59.106884  4405 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:59.107596  4446 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.109066  4405 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:15:59.109145  3806 leader_election.cc:336] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.804s (SENT)
I20260709 13:15:59.109874  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.111105  4546 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.113826  4446 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.114548  4446 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.115097  4446 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.119115  4446 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:59.119827  4509 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.120412  4509 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:15:59.122064  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.122753  4509 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:59.120134  4446 raft_consensus.cc:3055] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:59.123929  3837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 342) took 1206 ms. Trace:
I20260709 13:15:59.125242  3837 rpcz_store.cc:276] 0709 13:15:57.917869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.918041 (+   172us) service_pool.cc:224] Handling call
0709 13:15:59.123576 (+1205535us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b5400794428. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1118aa1 00007fb3c1193ebc 00007fb3c11c908c 00007fb3c11b393b 00007fb3c11b33d2 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c
0709 13:15:59.123849 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114756992}
I20260709 13:15:59.123975  4446 raft_consensus.cc:740] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:15:59.132546  3806 leader_election.cc:336] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.838s (SENT)
I20260709 13:15:59.133232  3806 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.138938  4546 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:59.139711  3806 leader_election.cc:336] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.868s (SENT)
W20260709 13:15:59.141436  3806 leader_election.cc:336] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.976s (SENT)
I20260709 13:15:59.141834  3806 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.144977  4545 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:59.145288  3806 leader_election.cc:336] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.163s (SENT)
I20260709 13:15:59.145748  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.139711  4564 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:59.147917  4564 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:59.150166  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 44542.8us
I20260709 13:15:59.139843  4556 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:59.154999  4545 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.154505  4509 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:59.156083  4509 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.158974  4509 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:59.159688  4563 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.160385  4563 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.163173  4563 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:59.164165  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:59.165133  3835 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:59.169500  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:59.171201  4556 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.173552  4556 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:15:59.174718  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.174961  3177 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:15:59.175531  4560 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:59.175868  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:59.176198  4560 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.176743  4556 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:59.177814  4519 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.177340  4556 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:59.178359  4519 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:59.178340  4560 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.184638  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.184724  4560 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:59.186985  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.187788  3206 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:15:59.185983  4450 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:59.189244  4450 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.189580  4450 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.190950  4542 raft_consensus.cc:3055] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:59.191344  4542 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:15:59.181162  4519 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.192665  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.180940  4564 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.194172  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.195396  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:59.195991  3211 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:59.196282  3211 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:59.199105  3203 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:59.199280  4542 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.200359  4542 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.200626  3211 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.201560  3211 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:59.210481  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.216176  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.217399  4509 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:59.217473  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.217868  4509 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:59.218237  4561 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:59.218669  4561 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:59.219035  4561 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.219300  4564 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:59.219879  4564 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.220247  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.220888  3208 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:15:59.218263  4509 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.221995  4564 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.222512  4564 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.222893  4564 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.215029  4450 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.231937  4450 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:59.238597  4564 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:59.242801  4556 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.247979  4509 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.185892  4560 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.236109  4561 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:15:59.257503  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 65683.8us
I20260709 13:15:59.264083  4560 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:59.265990  4561 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.267519  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.268198  3131 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.270850  4509 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.274051  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.276762  4564 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:59.277366  4565 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.277335  4564 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.277897  3128 raft_consensus.cc:1240] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.277968  4565 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.279331  3129 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:59.279686  4565 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.280011  4556 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.280421  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.280486  4556 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.279621  4564 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.282466  3128 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:59.284024  3128 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:59.282523  4556 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:59.285840  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.286682  3205 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:15:59.290042  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.290251  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.291092  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.291427  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.291801  3128 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:59.292544  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.294039  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.295424  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.296947  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.298388  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.299669  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.288822  3131 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:15:59.300335  3136 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:59.300279  3127 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.301724  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.302567  3211 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:15:59.303802  3128 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.303937  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.305178  3127 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:59.307001  3127 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.308840  3127 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:59.309057  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.310070  3132 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:15:59.310501  3127 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:59.312047  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.313238  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.312738  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.319017  3205 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:59.311599  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.318585  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.337455  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.344609  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.349407  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.349833  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.346083  3128 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:59.351549  3131 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.351991  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.352743  3133 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:59.355428  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.344241  4570 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:59.346846  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.352129  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.360745  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.346460  3134 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.361796  3131 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.363229  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.363812  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.366050  3133 raft_consensus.cc:2376] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3. Re-sending same reply.
I20260709 13:15:59.366601  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.366849  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.367288  3131 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:59.367947  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.368019  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.368470  3134 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:15:59.345974  3132 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:15:59.369200  3133 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.369788  4570 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.374492  3127 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.365406  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.373184  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.378700  3128 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:59.380203  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.383199  3131 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:59.419144  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.426945  3131 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:15:59.429910  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.390761  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.437052  3203 raft_consensus.cc:2393] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 3: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:59.437443  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.392743  4570 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.393605  4540 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:15:59.438678  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.438594  4540 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.439706  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.440415  3131 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:59.440795  4540 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:59.441030  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.441896  3131 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 2: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:15:59.443110  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.444231  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.445298  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.446070  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.446540  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.446858  3132 raft_consensus.cc:2368] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3.
I20260709 13:15:59.447932  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.396481  4561 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.450276  4561 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.452121  4561 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:59.396950  4560 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:59.397430  4566 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:59.397864  4571 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:59.453476  4566 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.453614  4571 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.455873  4566 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:15:59.398303  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 179431us
I20260709 13:15:59.453009  4560 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.457016  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.458614  4560 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:59.459502  4560 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:59.415179  4446 consensus_queue.cc:260] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:59.379693  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.460502  4446 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.460927  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:15:59.461319  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:59.429906  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:59.462643  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.462361  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:15:59.462990  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.463362  3128 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:59.465025  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.464381  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.432412  4460 tablet_bootstrap.cc:492] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.390048  3127 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:15:59.467331  4460 tablet_bootstrap.cc:492] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:15:59.468149  4460 ts_tablet_manager.cc:1403] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.515s	user 0.042s	sys 0.042s
W20260709 13:15:59.464416  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.470057  3127 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:59.470662  3279 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.471093  4570 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.471618  4570 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.471509  4460 raft_consensus.cc:359] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:59.400138  4509 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:59.410562  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.472442  4460 raft_consensus.cc:740] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:15:59.472911  3207 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 3: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:59.472664  4509 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.455886  4571 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:59.459754  4560 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:59.423540  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.472002  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:59.474797  4509 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.475605  4460 consensus_queue.cc:260] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:15:59.473796  4570 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:59.477334  4560 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:59.455969  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.478463  4460 ts_tablet_manager.cc:1434] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:15:59.478775  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.479378  3207 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:15:59.480501  3100 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:15:59.481201  3285 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.482082  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:59.482914  4509 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:59.483446  4509 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:59.484634  4509 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.485671  3211 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:59.489094  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.489866  3203 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:15:59.491940  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:59.492586  3205 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.468325  3132 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.494810  3285 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.495704  4556 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:59.496096  4556 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.496449  4556 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.501700  3285 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.505133  3841 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Advancing to term 2
I20260709 13:15:59.506819  3279 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:15:59.508988  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:15:59.509707  3842 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.512223  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:59.513069  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.513979  3281 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.515682  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.516116  3281 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.516515  3135 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:59.517957  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:59.522496  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:59.524356  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.524675  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:59.525193  3130 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:15:59.525673  3834 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 2: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:15:59.526408  3205 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:15:59.528158  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:59.529532  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:59.529932  3834 raft_consensus.cc:1217] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:15:59.530958  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:59.532356  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:59.533025  3832 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:15:59.534416  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:59.536429  3834 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.538003  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.539436  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:15:59.541021  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.541632  3203 raft_consensus.cc:2393] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:15:59.543866  4528 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.544354  4528 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.549290  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:59.549787  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:59.546958  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:59.551080  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.552085  3205 raft_consensus.cc:2393] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:59.546978  4528 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:15:59.554252  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:59.554392  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:59.555007  3285 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 2: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:59.557569  3837 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:59.559661  4560 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.563437  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:59.565763  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:59.566339  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:59.567111  3278 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 2: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:59.567598  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:59.568202  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:59.568717  3278 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:59.568819  3836 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
W20260709 13:15:59.567621  3806 leader_election.cc:336] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.637s (SENT)
I20260709 13:15:59.569710  3249 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:59.569726  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:59.570006  3806 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.570588  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:59.570960  3280 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 2: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:59.572889  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:59.574712  4486 consensus_queue.cc:260] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.573288  4542 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.551231  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:15:59.577301  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:15:59.577836  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:59.578418  4486 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.580039  3205 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.582358  4570 consensus_queue.cc:1059] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:59.583561  4570 raft_consensus.cc:3055] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:59.539816  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:15:59.584137  4570 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:59.585125  4528 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:59.585686  3280 raft_consensus.cc:1240] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.585949  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.593231  4542 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.587248  4479 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:59.587303  4570 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.594113  4479 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:59.594588  4479 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.594601  4570 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.596591  3177 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:15:59.588073  3102 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:15:59.589200  4543 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.014s	sys 0.015s
W20260709 13:15:59.597841  4543 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.014s	sys 0.015s
I20260709 13:15:59.602147  4560 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:15:59.604226  3211 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.594640  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:59.589864  4556 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.611953  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:59.626960  3249 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:59.609854  3250 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:15:59.623612  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.628610  3211 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.629491  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:59.629840  3208 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:59.629770  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:59.631176  3285 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:15:59.583647  3842 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:15:59.612267  4560 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:59.634811  3249 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:15:59.644381  3250 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.647430  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.647778  3805 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:15:59.645711  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:59.649238  3285 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:15:59.649605  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.650491  3128 raft_consensus.cc:2376] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2. Re-sending same reply.
I20260709 13:15:59.651326  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:59.652153  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.626668  4550 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:59.653451  3128 raft_consensus.cc:2368] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 4.
W20260709 13:15:59.653609  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 43546.9us
I20260709 13:15:59.654263  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:59.654655  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.655370  3128 raft_consensus.cc:2376] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2. Re-sending same reply.
I20260709 13:15:59.656206  4583 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.656529  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.656606  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.618434  4509 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:15:59.657454  3128 raft_consensus.cc:2368] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 3. Current term is 4.
I20260709 13:15:59.657807  3250 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.658183  4583 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.658936  3250 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.665831  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.668064  3133 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.633672  4540 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:59.678350  3208 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.675868  4540 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.680199  4540 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.683265  3177 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:15:59.643199  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:59.646476  4462 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:59.646597  4560 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:59.635627  4547 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.686247  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.633284  4546 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:15:59.691747  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:59.652531  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:59.676132  4527 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.682926  4356 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.671244  4528 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:59.690804  3032 catalog_manager.cc:5697] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 2, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:59.694952  3033 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38234 (request call id 257) took 2712 ms. Trace:
I20260709 13:15:59.660594  4550 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:15:59.695819  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:15:59.703645  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:59.692945  3221 tablet_copy_service.cc:342] P 43b01d5a97e149008d543a6615219928: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-023c1461b69c46bdb3c42ee16f303ea2 received from {username='slave'} at 127.0.0.1:38892
I20260709 13:15:59.690447  4509 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:15:59.710227  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.697834  4560 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.713783  4450 consensus_queue.cc:1059] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:59.714468  3130 raft_consensus.cc:1240] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:59.690265  4572 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:15:59.712307  3285 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 2: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:15:59.717253  4547 raft_consensus.cc:2764] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:15:59.717487  3281 raft_consensus.cc:2410] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:59.708364  4550 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.712393  3250 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.703087  4542 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:59.713245  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.703258  4563 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.705330  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:59.702498  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:15:59.703702  4566 consensus_queue.cc:1059] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:15:59.717396  4572 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.732306  4356 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.706820  3033 rpcz_store.cc:276] 0709 13:15:56.976240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.976384 (+   144us) service_pool.cc:224] Handling call
0709 13:15:59.688495 (+2712111us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:57.637249 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:57.651053 (+ 13804us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:57.651091 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:15:57.651110 (+    19us) tablet.cc:662] Decoding operations
0709 13:15:57.651540 (+   430us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:57.651620 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:57.651650 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:15:57.651981 (+   331us) tablet.cc:701] Row locks acquired
0709 13:15:57.652002 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:15:57.652148 (+   146us) write_op.cc:270] Start()
0709 13:15:57.652268 (+   120us) write_op.cc:276] Timestamp: P: 1783602957652107 usec, L: 0
0709 13:15:57.652291 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:15:57.656925 (+  4634us) log.cc:844] Serialized 913 byte log entry
0709 13:15:58.892890 (+1235965us) op_driver.cc:464] REPLICATION: finished
0709 13:15:59.521124 (+628234us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3b90e50ac 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bfc25ef0
0709 13:15:59.589328 (+ 68204us) write_op.cc:301] APPLY: starting
0709 13:15:59.589407 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:59.589549 (+   142us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:59.589587 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:59.590078 (+   491us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:59.590295 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:15:59.590360 (+    65us) write_op.cc:312] APPLY: finished
0709 13:15:59.590596 (+   236us) log.cc:844] Serialized 29 byte log entry
0709 13:15:59.636229 (+ 45633us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:59.647530 (+ 11301us) write_op.cc:454] Released schema lock
0709 13:15:59.653493 (+  5963us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:59.691121 (+ 37628us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:59.694201 (+  3080us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":696172,"apply.run_cpu_time_us":12929,"apply.run_wall_time_us":90236,"num_ops":2,"prepare.queue_time_us":557000,"prepare.run_cpu_time_us":104910,"prepare.run_wall_time_us":221499,"raft.queue_time_us":963613,"raft.run_cpu_time_us":30254,"raft.run_wall_time_us":738193,"replication_time_us":1215977,"spinlock_wait_cycles":62933376,"thread_start_us":1573577,"threads_started":5,"wal-append.queue_time_us":263041,"wal-append.run_cpu_time_us":10107,"wal-append.run_wall_time_us":1239143}]]}
I20260709 13:15:59.724777  4528 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:15:59.802701  4528 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.807102  4462 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.807776  4462 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.734583  4579 consensus_queue.cc:1059] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 13:15:59.811578  4519 raft_consensus.cc:3055] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:59.812130  4519 raft_consensus.cc:740] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:15:59.813572  4519 consensus_queue.cc:260] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.816623  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:59.817586  3281 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:15:59.756699  4446 raft_consensus.cc:3055] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:59.820119  4446 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:59.821311  4446 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.823659  4566 raft_consensus.cc:3055] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:59.824194  4566 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:59.791783  4582 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:59.831990  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 119659us
I20260709 13:15:59.753290  3221 tablet_copy_service.cc:434] P 43b01d5a97e149008d543a6615219928: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-023c1461b69c46bdb3c42ee16f303ea2 on tablet 023c1461b69c46bdb3c42ee16f303ea2 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:15:59.833317  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 120161us
I20260709 13:15:59.837111  3208 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:59.832993  3250 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.830330  4542 raft_consensus.cc:697] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:15:59.848538  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 128444us
W20260709 13:15:59.839686  3806 leader_election.cc:336] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.854s (SENT)
I20260709 13:15:59.842525  3034 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55102 (request call id 132) took 1995 ms. Trace:
I20260709 13:15:59.851569  3806 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.855621  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:15:59.856266  3283 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:15:59.852386  3250 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:15:59.840862  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 186618us
I20260709 13:15:59.852995  3285 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:59.862329  3278 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:59.851224  3034 rpcz_store.cc:276] 0709 13:15:57.703334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.704465 (+  1131us) service_pool.cc:224] Handling call
0709 13:15:57.892930 (+188465us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54000a87d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc159090 00007fb3bc1f7f3a 00007fb3c1fae1cc 00007fb3c20ac37e 00007fb3c056d2a4 00007fb3c056d232 00007fb3c056d161 00007fb3c056d0dc 00007fb3c056c392 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:15:59.698573 (+1805643us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":429562624}
W20260709 13:15:59.863447  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 228736us
I20260709 13:15:59.866367  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.870500  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:15:59.870748  3806 leader_election.cc:400] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 4.
I20260709 13:15:59.847232  4547 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.871568  3279 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:59.871657  3806 leader_election.cc:403] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:59.873786  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.899900  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.900939  3128 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:15:59.902025  3207 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:15:59.903437  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.904266  3128 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
W20260709 13:15:59.906358  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 209029us
I20260709 13:15:59.909420  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:15:59.910583  3206 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:59.912678  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 324675us
I20260709 13:15:59.912731  3202 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.918941  3211 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.867676  4546 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.931912  3806 leader_election.cc:400] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 3. Current term is 4.
I20260709 13:15:59.933004  3806 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.919749  3128 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:59.844383  4566 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:15:59.867635  4356 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.921679  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:15:59.876086  4572 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:59.873991  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:15:59.924588  3279 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.926729  4569 consensus_queue.cc:1059] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:59.948628  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:15:59.948670  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 78253.8us
I20260709 13:15:59.970845  3176 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.872551  4556 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:15:59.875587  3281 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:59.929998  3034 catalog_manager.cc:5697] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 2 to 3, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:59.873852  4584 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.954237  3207 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:59.905031  4545 raft_consensus.cc:3055] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:15:59.976676  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 111503us
I20260709 13:15:59.977250  3034 catalog_manager.cc:5697] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 2 to 3, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:15:59.975414  4356 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:59.950819  4509 raft_consensus.cc:697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:15:59.873708  4592 consensus_queue.cc:1059] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 13:15:59.983162  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:15:59.928478  4486 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:15:59.951202  4571 consensus_queue.cc:1059] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:15:59.949932  4581 consensus_queue.cc:1059] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 13:15:59.979857  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.993872  3133 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:59.966851  4586 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.991137  3135 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:15:59.993839  4566 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:00.004045  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 57420.6us
I20260709 13:15:59.985831  3280 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.982410  4356 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:15:59.975001  4546 consensus_queue.cc:1059] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:15:59.969828  4550 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:15:59.969187  4479 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:00.009341  4593 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:59.998505  4591 consensus_queue.cc:1059] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:15:59.993197  4582 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.981318  4545 raft_consensus.cc:740] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:00.013983  3206 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:15:59.990869  4519 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.995863  4561 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:00.039841  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 67466.2us
I20260709 13:16:00.042876  3250 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:00.044386  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:15:59.984777  4588 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:15:59.979729  4542 consensus_queue.cc:237] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:00.024857  4356 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:00.039896  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 59607.9us
I20260709 13:16:00.022428  4560 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:00.048318  4563 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:00.068873  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 64121us
W20260709 13:16:00.071938  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45229.1us
I20260709 13:16:00.078634  3250 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:00.080211  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:00.037453  4587 consensus_queue.cc:1059] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:16:00.073401  4601 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.084178  4601 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:00.055755  4590 consensus_queue.cc:1059] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:16:00.068120  3837 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:00.082706  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 83714.6us
I20260709 13:16:00.094774  3249 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:00.074679  4572 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:00.111809  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:00.113499  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 134696us
W20260709 13:16:00.119989  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 47147.6us
W20260709 13:16:00.119695  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 49344.1us
I20260709 13:16:00.114959  3250 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:00.118201  4528 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:00.135579  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.055361  4509 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:00.137770  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 73169.9us
I20260709 13:16:00.076905  4592 consensus_queue.cc:1059] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:16:00.119225  4572 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:00.146796  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:00.148277  4580 raft_consensus.cc:3055] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.148473  4612 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.148900  4479 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:00.149508  4603 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:16:00.149600  4560 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:00.150333  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.134337  4591 raft_consensus.cc:3055] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.148747  4580 raft_consensus.cc:740] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:00.154388  3250 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:00.139623  4590 raft_consensus.cc:3055] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.127468  4556 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:16:00.166939  3832 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:00.163831  3176 leader_election.cc:400] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3.
I20260709 13:16:00.167876  3176 leader_election.cc:403] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:00.143276  4527 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.155365  4591 raft_consensus.cc:740] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:00.165580  4596 consensus_queue.cc:1059] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:16:00.165627  4580 consensus_queue.cc:260] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:00.175318  4580 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.157601  4599 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.086874  4545 consensus_queue.cc:260] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:00.162513  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:00.105720  4601 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:00.160111  4528 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.180269  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:00.181526  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:00.163645  4590 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:00.215224  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:00.216288  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:00.217659  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:00.219089  3102 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:16:00.223181  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 60746.2us
I20260709 13:16:00.157881  4602 consensus_queue.cc:1059] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:16:00.158429  4588 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:16:00.223968  3250 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:00.226687  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 63914.5us
I20260709 13:16:00.180531  4560 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.214383  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:00.231319  3129 raft_consensus.cc:1240] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:00.223819  4579 consensus_queue.cc:1059] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:16:00.235463  3128 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:00.225682  4545 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.238194  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:00.180572  4550 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:00.240438  3250 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:00.241257  4605 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3.
I20260709 13:16:00.178215  4587 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:16:00.254210  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:00.257781  3805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.019s	sys 0.012s
W20260709 13:16:00.258133  3805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.019s	sys 0.012s
W20260709 13:16:00.258628  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 610916us
I20260709 13:16:00.260061  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:00.267836  3250 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:00.269984  3250 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:16:00.271037  3232 debug-util.cc:398] Leaking SignalData structure 0x7b080009fbc0 after lost signal to thread 2028
W20260709 13:16:00.272395  3232 debug-util.cc:398] Leaking SignalData structure 0x7b0800085e00 after lost signal to thread 3068
W20260709 13:16:00.273941  3232 debug-util.cc:398] Leaking SignalData structure 0x7b080038f1e0 after lost signal to thread 3160
I20260709 13:16:00.275842  4606 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:16:00.278924  4606 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:00.275336  3232 debug-util.cc:398] Leaking SignalData structure 0x7b080028ef00 after lost signal to thread 3235
W20260709 13:16:00.281409  3232 debug-util.cc:398] Leaking SignalData structure 0x7b080022e000 after lost signal to thread 3236
W20260709 13:16:00.282989  3232 debug-util.cc:398] Leaking SignalData structure 0x7b0800209f60 after lost signal to thread 3309
I20260709 13:16:00.243078  4527 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.289235  4611 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.292196  4601 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:00.296512  3840 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:00.296223  3250 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:00.253700  4599 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.226877  4572 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:00.285356  4528 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.312999  4607 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.283738  4550 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:00.323500  4599 consensus_queue.cc:1059] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:00.313408  4597 raft_consensus.cc:3055] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.329386  4597 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:00.330433  4597 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:00.332077  3130 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:00.269503  4566 consensus_queue.cc:1059] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:16:00.310626  4611 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:00.418758  4614 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:16:00.332139  4519 raft_consensus.cc:3055] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.665614  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:00.332919  4550 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:00.666342  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:00.722118  4584 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:16:00.469367  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 333052us
I20260709 13:16:00.665619  3279 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:00.665225  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:00.476415  4597 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.666594  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:00.716348  4527 raft_consensus.cc:3055] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.727669  4527 raft_consensus.cc:740] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:00.690142  4356 consensus_meta.cc:287] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.012s
I20260709 13:16:00.715878  4486 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:00.729768  4528 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.730162  4486 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:00.682170  4591 consensus_queue.cc:260] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:00.666860  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:00.337500  4590 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:00.733835  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:00.665000  4578 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:16:00.665419  4571 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:16:00.614915  3806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.008s	sys 0.003s
I20260709 13:16:00.668476  4556 consensus_queue.cc:1059] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:00.396310  4587 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:00.608126  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.752339  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.754967  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:00.421274  3232 debug-util.cc:398] Leaking SignalData structure 0x7b080034b4c0 after lost signal to thread 3867
I20260709 13:16:00.395836  4572 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.693475  4561 raft_consensus.cc:3055] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:00.424737  4598 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:00.421765  4608 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.392408  4613 raft_consensus.cc:1064] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:16:00.374675  4611 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.394593  4610 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:00.395166  4446 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:00.558859  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 407388us
I20260709 13:16:00.811704  3100 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:00.333194  4607 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:00.716179  4592 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:00.728830  4356 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:00.687939  4579 raft_consensus.cc:3055] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.733043  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:00.736012  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:00.736752  4486 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:00.737558  4547 consensus_meta.cc:287] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.840s	user 0.007s	sys 0.007s
I20260709 13:16:00.735340  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:00.723022  4601 raft_consensus.cc:1064] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:16:00.728634  4527 consensus_queue.cc:260] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:00.741202  3806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.009s	sys 0.004s
I20260709 13:16:00.716857  4519 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:00.738680  4583 consensus_meta.cc:287] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.080s	user 0.021s	sys 0.015s
W20260709 13:16:00.745187  4540 consensus_meta.cc:287] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.060s	user 0.020s	sys 0.019s
W20260709 13:16:00.735276  4462 consensus_meta.cc:287] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.917s	user 0.018s	sys 0.006s
I20260709 13:16:00.739279  4571 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:00.743914  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:00.815685  4598 raft_consensus.cc:697] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:00.816835  3285 raft_consensus.cc:2368] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3.
I20260709 13:16:00.723769  4584 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:00.866415  3099 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.010s	sys 0.009s
I20260709 13:16:00.776832  4561 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:00.778728  4591 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.816381  4592 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:00.826156  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 91020us
I20260709 13:16:00.872529  3101 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:00.830444  4547 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.808437  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:00.811533  4611 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.816351  4556 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:00.849404  3251 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.025s	sys 0.019s
I20260709 13:16:00.817915  4579 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:00.817250  4607 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:00.877427  4580 consensus_meta.cc:287] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.702s	user 0.004s	sys 0.008s
W20260709 13:16:00.830470  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 878152us
I20260709 13:16:00.834208  4610 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:00.848037  4608 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:16:00.846863  4569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.000s	sys 0.020s
W20260709 13:16:00.890074  3251 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.025s	sys 0.019s
I20260709 13:16:00.862929  4583 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:00.827258  4613 raft_consensus.cc:1068] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Unable to promote non-voter 0930e3e7657c43bcaaa5b0778f3e08cf: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:16:00.866876  3099 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.010s	sys 0.009s
I20260709 13:16:00.873651  4592 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.872786  4566 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:00.900261  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 581886us
I20260709 13:16:00.809393  4587 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:00.862977  4540 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:00.901459  3135 consensus_meta.cc:287] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.660s	user 0.014s	sys 0.004s
W20260709 13:16:00.901757  4569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.000s	sys 0.021s
I20260709 13:16:00.889317  4486 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:00.921274  4356 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:00.923305  4545 consensus_meta.cc:287] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.001s
W20260709 13:16:00.924865  4627 log.cc:927] Time spent T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.064s	user 0.001s	sys 0.001s
W20260709 13:16:00.929910  3176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.021s	sys 0.051s
W20260709 13:16:00.951846  3176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.021s	sys 0.052s
W20260709 13:16:00.952184  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 692137us
W20260709 13:16:00.927750  4612 consensus_meta.cc:287] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.779s	user 0.011s	sys 0.002s
I20260709 13:16:00.919596  4580 raft_consensus.cc:3055] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.953358  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:00.925783  4565 raft_consensus.cc:3055] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.865285  4598 consensus_queue.cc:237] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:00.928727  4560 consensus_meta.cc:287] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.003s
I20260709 13:16:00.921758  4561 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:00.959764  4623 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.947324  4587 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:00.975759  4602 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.001s	sys 0.012s
W20260709 13:16:00.976263  4602 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.001s	sys 0.012s
I20260709 13:16:00.913218  4519 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:00.902422  4582 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 13:16:00.940121  4606 consensus_meta.cc:287] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.659s	user 0.005s	sys 0.007s
I20260709 13:16:00.948115  4486 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:00.923911  4609 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:00.925675  4596 raft_consensus.cc:3055] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.894945  4462 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:00.895335  4556 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:00.928869  3135 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:00.917740  4566 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.002614  4566 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:00.953596  4545 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 4.
I20260709 13:16:01.003023  4486 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:01.003360  4545 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:00.903072  4608 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:01.005308  4586 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:16:00.953981  3837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 282) took 1019 ms. Trace:
I20260709 13:16:00.962004  4580 raft_consensus.cc:740] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:00.985407  4584 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:00.965844  4565 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:00.967878  4550 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:00.967374  4605 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:00.986097  4563 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:00.970453  4560 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.964365  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:00.960457  4581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.000s	sys 0.015s
W20260709 13:16:00.990427  4615 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:16:01.018363  4563 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:16:01.019483  4581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.000s	sys 0.015s
W20260709 13:16:00.991119  3134 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.009s	sys 0.055s
I20260709 13:16:00.920819  4622 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:16:00.925189  4579 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:00.969655  4613 consensus_queue.cc:1059] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:16:00.965621  4612 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.986847  4561 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.006011  3837 rpcz_store.cc:276] 0709 13:15:59.934227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.945849 (+ 11622us) service_pool.cc:224] Handling call
0709 13:15:59.976476 (+ 30627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:00.118861 (+142385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.928994 (+810133us) spinlock_profiling.cc:243] Waited 82.9 ms on lock 0x7b540002d5d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:00.950893 (+ 21899us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190718208}
I20260709 13:16:01.011457  4556 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:00.992332  4606 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.031090  4462 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:00.989904  4624 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.992985  4596 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:00.971660  4571 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:01.021027  3134 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.009s	sys 0.055s
W20260709 13:16:01.022099  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 57818us
I20260709 13:16:01.034060  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:01.021597  4605 raft_consensus.cc:697] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:01.020586  4563 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:01.011562  4608 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:01.017938  4609 raft_consensus.cc:697] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:01.029500  4604 raft_consensus.cc:3055] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:01.029562  4540 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:01.030323  4580 consensus_queue.cc:260] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.013211  4620 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:16:01.037461  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:01.004520  4592 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.025831  4486 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:01.040710  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 125) took 1119 ms. Trace:
I20260709 13:16:01.032881  4596 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.059513  4568 raft_consensus.cc:1064] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:16:01.032534  4601 consensus_queue.cc:237] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:01.059993  4568 raft_consensus.cc:1068] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Unable to promote non-voter 0930e3e7657c43bcaaa5b0778f3e08cf: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:01.039393  4606 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.059134  3134 rpcz_store.cc:276] 0709 13:15:59.919176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.919284 (+   108us) service_pool.cc:224] Handling call
0709 13:15:59.967644 (+ 48360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:00.051837 (+ 84193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:00.051863 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:00.052267 (+   404us) log.cc:844] Serialized 26 byte log entry
0709 13:16:00.248649 (+196382us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:01.038405 (+789756us) log.cc:844] Serialized 14 byte log entry
0709 13:16:01.038711 (+   306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.038806 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:01.038857 (+    51us) raft_consensus.cc:1685] finished
0709 13:16:01.038874 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:01.039026 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57374,"raft.queue_time_us":100168,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":7550,"thread_start_us":1003081,"threads_started":3,"wal-append.queue_time_us":659141}
I20260709 13:16:01.060148  4596 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.056182  3203 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:01.063153  4486 raft_consensus.cc:697] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:01.062930  4613 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.069883  4527 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.987087  4610 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.075380  4579 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.060765  4571 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.078166  4486 consensus_queue.cc:237] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.065296  4604 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:01.058697  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:01.089311  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.039543  4565 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.058665  4609 consensus_queue.cc:237] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.101976  3176 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.106416  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.113268  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:01.125308  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 228493us
I20260709 13:16:01.131798  3285 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:16:01.133872  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.137451  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.138651  4606 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:01.138891  4629 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 13:16:01.139546  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.146912  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 482384us
I20260709 13:16:01.152465  4593 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.153633  3249 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:01.154588  4540 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:01.155148  4540 raft_consensus.cc:697] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:01.156725  4595 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:01.094241  4605 consensus_queue.cc:237] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.157847  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:01.159595  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:01.159983  3203 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:01.107424  4560 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.156072  4540 consensus_queue.cc:237] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.110294  4568 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.109908  4592 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:01.161365  4565 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.167738  4629 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.172842  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:01.184527  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.187646  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.188266  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.190492  4606 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.190970  4606 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:01.140831  4550 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:16:01.165107  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.163863  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.207136  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:01.209712  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:01.210865  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:01.210947  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:01.213835  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.162267  4582 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:16:01.173578  4572 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:01.227017  4622 raft_consensus.cc:476] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:16:01.227701  4568 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.234987  3176 leader_election.cc:400] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3.
W20260709 13:16:01.229403  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 356933us
I20260709 13:16:01.224157  4450 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.243322  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:01.152971  4593 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.240113  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.235561  3176 leader_election.cc:403] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:01.236971  4622 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.272481  3204 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
W20260709 13:16:01.277408  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.277742  4542 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:01.278506  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 50254.5us
I20260709 13:16:01.278262  4542 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.279848  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:01.280455  3840 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:01.281389  4542 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:01.281494  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:01.282600  4528 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.283080  4528 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.286787  3102 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:01.279296  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:01.267832  4597 consensus_meta.cc:287] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.537s	user 0.000s	sys 0.013s
I20260709 13:16:01.312633  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:01.312983  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:01.238590  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:01.314000  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:01.317585  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:01.258701  4563 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:01.245275  4564 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:01.322675  3285 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:01.323515  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.285488  4623 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.238816  4572 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.326924  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:01.326179  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:01.271492  4636 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.157321  4595 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:01.353634  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 66936.1us
I20260709 13:16:01.289222  4629 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3.
W20260709 13:16:01.357018  3250 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.796s (SENT) [suppressed 47 similar messages]
I20260709 13:16:01.332327  3277 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 2: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:01.358486  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.391726  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.395159  3101 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.099151  4604 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.333403  3282 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:01.312773  4446 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.314306  4542 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:16:01.307899  4622 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.332352  4620 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:01.386528  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.331058  4564 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.354815  4606 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:01.357676  4568 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.397938  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.359443  4592 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:01.399875  4631 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.360512  4623 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.401841  3206 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:01.259140  4630 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:01.377619  4528 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:01.328255  4563 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.377282  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:01.415557  3132 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:01.415493  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:01.416471  3131 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:01.362951  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:01.420984  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:01.456611  3204 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:01.456746  3277 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:16:01.401916  4556 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.400667  4597 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.400854  4602 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:16:01.441598  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 43775.6us
I20260709 13:16:01.453867  3208 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:01.400460  4636 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.443580  4592 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.462977  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:01.462636  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:01.493492  3132 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:01.493916  3282 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 2: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:01.494257  4593 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:01.440204  4568 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.483956  3277 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:01.466672  3135 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.398881  4611 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:01.485137  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.449278  4579 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.485008  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:01.509109  4563 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:01.510502  4564 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:01.513976  3101 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.466204  3205 raft_consensus.cc:2376] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2. Re-sending same reply.
I20260709 13:16:01.491940  4638 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:01.496153  4592 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.536172  3282 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:01.486606  4604 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.519438  4556 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:01.455152  4631 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.540822  4542 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:01.544539  3282 raft_consensus.cc:1240] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:16:01.537863  4563 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:01.533751  4629 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.552373  4570 raft_consensus.cc:3055] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:01.552882  4570 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:01.555477  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.455420  4630 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.543860  4606 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.544896  4572 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:01.590782  4540 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.595721  4606 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.595803  4540 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.596659  4630 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:01.596799  3841 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:01.600293  4540 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:01.620648  4462 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:01.622902  4519 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.539633  4638 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.589331  4593 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:01.549468  4542 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:01.624480  4613 consensus_meta.cc:287] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.544s	user 0.002s	sys 0.006s
I20260709 13:16:01.597934  4606 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:01.615797  4528 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.561981  4629 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:01.653187  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.627246  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:01.656834  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 142933us
W20260709 13:16:01.663609  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 306831us
W20260709 13:16:01.647346  4650 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:16:01.656559  4613 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.600937  4570 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.681906  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.688143  3101 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:01.652949  4540 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:16:01.651613  4593 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:01.697922  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.688454  4645 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.146s	user 0.001s	sys 0.001s
I20260709 13:16:01.675324  4606 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:01.664142  4528 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:01.693913  4651 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:16:01.686926  4595 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:01.691573  4599 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.692939  4618 raft_consensus.cc:3055] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:01.698212  3101 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.692796  4568 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:01.681702  4609 consensus_queue.cc:1059] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:16:01.698175  4634 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.723188  4636 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:01.733721  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.727375  4611 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:01.698980  4641 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:01.735296  4631 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:01.730769  4635 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:16:01.729650  3101 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.721174  4570 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:01.750643  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.730489  4617 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:01.728317  4618 raft_consensus.cc:740] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:01.742173  4462 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:01.728363  4599 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.753801  4641 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:16:01.759301  4649 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
W20260709 13:16:01.758154  4646 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:16:01.784866  4641 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.751039  4634 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:01.758237  4607 consensus_meta.cc:287] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.856s	user 0.009s	sys 0.007s
I20260709 13:16:01.786703  4607 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.721263  4606 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:01.820160  3279 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:01.824949  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 95360.3us
I20260709 13:16:01.826442  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.829891  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:01.832655  4656 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.004s
W20260709 13:16:01.832841  4653 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.071s	user 0.003s	sys 0.000s
I20260709 13:16:01.829556  4617 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:01.835219  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:01.819842  4631 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:01.825654  4601 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.841615  3101 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:01.830844  4596 consensus_meta.cc:287] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.007s
I20260709 13:16:01.845890  4629 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:01.862660  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:01.889788  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.845705  4617 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:01.893204  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 51711us
I20260709 13:16:01.906013  3210 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:01.906462  3101 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:01.834725  4609 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:01.897377  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:01.831576  4542 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:01.839430  4662 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.075s	user 0.003s	sys 0.000s
W20260709 13:16:01.893829  3250 leader_election.cc:336] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.084s (SENT)
I20260709 13:16:01.907717  4519 raft_consensus.cc:2764] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:01.823088  4462 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.839768  4593 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:01.917812  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:01.918578  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:01.934213  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:01.919793  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:01.921347  4659 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.077s	user 0.000s	sys 0.003s
W20260709 13:16:01.914516  4571 consensus_meta.cc:287] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.820s	user 0.014s	sys 0.000s
W20260709 13:16:01.913739  4560 consensus_meta.cc:287] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.742s	user 0.013s	sys 0.002s
I20260709 13:16:01.914069  4595 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:16:01.927911  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 1882) took 1090 ms. Trace:
I20260709 13:16:01.845317  4601 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.928894  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:01.930776  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:01.913857  4527 consensus_meta.cc:287] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.829s	user 0.012s	sys 0.003s
I20260709 13:16:01.917804  4564 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:01.935752  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:01.912060  4545 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:16:01.938203  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:01.932314  4607 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:01.912654  4617 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:01.892942  4665 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.892927  4509 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.928944  4597 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.942179  4528 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:01.946982  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:01.947664  3132 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:01.944705  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:01.958477  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:01.942871  3209 rpcz_store.cc:276] 0709 13:16:00.837420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.837596 (+   176us) service_pool.cc:224] Handling call
0709 13:16:00.838013 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:00.838402 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:00.838441 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:00.850719 (+ 12278us) log.cc:844] Serialized 26 byte log entry
0709 13:16:01.108862 (+258143us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b18003b2720. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:16:01.239435 (+130573us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:01.239490 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.239581 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:01.899583 (+660002us) raft_consensus.cc:1685] finished
0709 13:16:01.899601 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:01.927844 (+ 28243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15275,"raft.queue_time_us":8136,"raft.run_cpu_time_us":3605,"raft.run_wall_time_us":43452,"spinlock_wait_cycles":8663680,"thread_start_us":130343,"threads_started":1,"wal-append.queue_time_us":641557}
I20260709 13:16:01.959260  3132 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:01.955315  4634 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:01.846256  4618 consensus_queue.cc:260] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.941490  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:01.956610  4665 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.952303  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:01.961818  3277 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:01.963016  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:01.964037  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:01.964319  4665 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:01.965504  4597 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.960103  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:01.944094  4560 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.967550  4597 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:01.967389  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:01.968482  4599 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:01.937124  4641 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:01.967592  3277 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:01.949365  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:01.945966  3136 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:01.957362  3838 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:16:01.933355  4540 consensus_queue.cc:1059] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:16:01.968364  3132 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:01.973510  3250 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:01.953348  4617 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.972265  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:01.976717  3132 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:01.931306  4592 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.977596  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:01.978128  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:01.980474  3136 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.980715  3251 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:01.982095  3278 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:01.983268  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:01.984565  3278 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:01.984699  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:01.976215  4606 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:01.987963  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:01.986729  3250 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:01.989116  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:01.989378  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:01.989745  3132 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:01.954039  4564 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.991194  3136 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:01.992291  4564 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:01.992163  4563 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.993222  4570 consensus_queue.cc:1059] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.993443  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:01.993621  4563 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:01.994026  4563 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:01.987241  4607 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:01.995275  4607 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.994771  4563 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:01.995640  4607 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.996218  4563 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.991218  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:01.998766  3132 raft_consensus.cc:2393] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:01.999734  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:02.000458  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:01.980120  4528 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:02.004184  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:01.957732  4509 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:01.990140  4597 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:02.004956  4628 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:02.005719  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.006512  4462 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:01.987244  4664 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:02.018829  3135 consensus_meta.cc:287] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.003s
I20260709 13:16:02.019518  3135 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:01.987672  4596 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:02.020025  4596 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:01.987135  4636 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:01.984102  4600 raft_consensus.cc:3055] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:02.008328  3032 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38226 (request call id 249) took 4419 ms. Trace:
I20260709 13:16:02.011428  3250 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:02.012326  4540 raft_consensus.cc:2764] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:16:02.003115  4599 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:02.020367  4509 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:02.032136  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.034763  4641 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:02.008713  4611 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.036371  4611 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.020936  4638 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:02.032795  3133 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:02.038615  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.039290  3133 raft_consensus.cc:2393] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:02.017108  3132 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:02.025041  3130 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:02.026108  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.043221  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.043483  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:02.043944  3130 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:02.044541  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.044656  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.044911  4611 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:02.021358  3032 rpcz_store.cc:276] 0709 13:15:57.583402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.586834 (+  3432us) service_pool.cc:224] Handling call
0709 13:16:02.001741 (+4414907us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:59.979541 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:00.008346 (+ 28805us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:00.008381 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:16:00.008397 (+    16us) tablet.cc:662] Decoding operations
0709 13:16:00.008737 (+   340us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:00.008808 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:00.008840 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:00.009029 (+   189us) tablet.cc:701] Row locks acquired
0709 13:16:00.009049 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:16:00.009214 (+   165us) write_op.cc:270] Start()
0709 13:16:00.009323 (+   109us) write_op.cc:276] Timestamp: P: 1783602960009168 usec, L: 0
0709 13:16:00.009344 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:16:00.009976 (+   632us) log.cc:844] Serialized 595 byte log entry
0709 13:16:00.986991 (+977015us) op_driver.cc:464] REPLICATION: finished
0709 13:16:01.487302 (+500311us) write_op.cc:301] APPLY: starting
0709 13:16:01.495989 (+  8687us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:01.509206 (+ 13217us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:01.509373 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:01.509690 (+   317us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:01.509902 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:16:01.509965 (+    63us) write_op.cc:312] APPLY: finished
0709 13:16:01.510182 (+   217us) log.cc:844] Serialized 23 byte log entry
0709 13:16:01.510391 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:01.510482 (+    91us) write_op.cc:454] Released schema lock
0709 13:16:01.510530 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:01.510967 (+   437us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:01.511004 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4,"reported_tablets":1,"spinlock_wait_cycles":4992,"child_traces":[["op",{"apply.queue_time_us":456138,"apply.run_cpu_time_us":2055,"apply.run_wall_time_us":27094,"num_ops":1,"prepare.queue_time_us":217279,"prepare.run_cpu_time_us":2679,"prepare.run_wall_time_us":38997,"replication_time_us":960219,"thread_start_us":352993,"threads_started":2}]]}
I20260709 13:16:02.045336  3134 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:02.020576  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.027968  4462 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.046172  4606 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:02.046883  4606 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.029251  4590 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.049857  4606 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:02.050346  4606 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:02.021009  4556 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:02.020447  4596 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.013149  4665 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.053341  3135 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:02.053356  4665 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:02.054411  4665 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:02.031683  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.057642  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:02.057760  3128 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:02.057662  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:02.010561  4550 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.026917  4622 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:02.020879  4600 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:02.045359  3130 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:02.053885  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.040072  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.062901  3133 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:02.063172  3204 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:02.064317  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:02.065732  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:02.023072  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:02.067099  3204 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:02.067672  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:02.067720  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 44720us
I20260709 13:16:02.068585  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:02.069753  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:02.070099  3250 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:02.072573  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:02.072921  3210 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:02.073311  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:02.073882  3208 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:02.075539  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:02.076159  3276 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:02.072044  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:02.076172  3250 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:02.077330  3209 raft_consensus.cc:2393] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:02.072784  4540 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:02.077562  3250 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:02.079268  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:02.081411  3209 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:02.082966  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:02.085750  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.087973  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.088536  3134 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:02.083611  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:02.090885  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:02.091028  3209 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:02.061820  4509 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.062141  4550 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.069324  4599 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:02.094135  4622 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:02.096698  4622 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:02.096735  4602 raft_consensus.cc:3055] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:02.097177  4622 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.097266  4602 raft_consensus.cc:740] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:02.098268  4602 consensus_queue.cc:260] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.099462  4602 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.077776  4528 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:02.077732  4636 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:02.086894  4585 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:02.087004  4593 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.081913  4527 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.075070  4556 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.072599  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:02.110160  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:02.084522  4664 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:02.112636  3134 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:02.029211  4617 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.082369  4540 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:02.100255  4550 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.131901  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.121362  3209 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:16:02.102363  4611 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.133589  3127 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:02.127296  3277 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
W20260709 13:16:02.134408  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 51501.6us
I20260709 13:16:02.135003  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:02.135391  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:02.113471  3135 raft_consensus.cc:2955] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:02.126863  3205 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:02.071939  4606 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:02.146039  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.117419  4636 raft_consensus.cc:697] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:02.116247  4527 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.149381  3134 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:02.110399  4509 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.151190  3249 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:02.157339  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:02.174017  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:02.137102  4540 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:02.176241  4527 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.115229  4607 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.187888  4679 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.188463  4679 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.188607  3250 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:02.188985  4679 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.191080  4616 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:02.197245  4680 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:02.154395  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:02.124224  4556 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.175109  4638 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.211855  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:02.211406  3284 raft_consensus.cc:2368] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3.
I20260709 13:16:02.198747  4561 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.199062  4674 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.212996  4674 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:02.213406  4674 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.213578  4585 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.199010  4528 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:02.225759  4528 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:02.226342  4528 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:02.225697  4674 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.229293  4586 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:02.220366  4527 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.114354  4600 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.222440  4606 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:02.222698  4462 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:02.224244  4509 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:02.161731  4664 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:16:02.224891  3211 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:02.229924  4586 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.214032  4585 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.197693  4680 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:02.230017  4638 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.233367  4556 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:02.235551  4674 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:02.214673  4596 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.212989  4561 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.245208  4585 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.258988  4638 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:02.259513  4678 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:02.284070  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:02.247675  4680 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.284896  3282 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:02.260994  4601 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:02.261902  4607 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:02.261936  4664 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:02.262003  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:02.262650  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.263722  4509 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:02.267864  4550 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.271749  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:02.271950  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:02.241679  4617 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:02.275416  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:02.322017  3841 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:02.242740  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:02.277243  4595 consensus_queue.cc:1059] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:02.238797  4636 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.336014  4550 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:02.321414  4607 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.249643  4600 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.336841  4607 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.258849  4527 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:02.290575  3136 raft_consensus.cc:2393] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 2: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:02.297806  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:02.308262  3131 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:02.334098  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:02.321231  4509 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.335479  4638 raft_consensus.cc:3055] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:16:02.286474  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.343570  4550 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.357674  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:02.346277  4607 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:02.385406  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:02.386009  3131 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.386580  4622 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.388742  4622 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:02.340637  4611 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:02.380008  4550 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.402832  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:02.398044  3842 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.372707  4599 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.372224  4527 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.419606  3842 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:02.372916  4638 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:02.390062  4618 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.425839  3131 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:16:02.347438  4679 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.428184  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.425235  4599 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.434870  4606 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.435812  4599 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:02.435496  4606 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.437995  4606 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:02.440876  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:02.443475  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.444114  3128 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:02.444608  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:02.444947  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:02.445047  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.449412  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.445878  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.445411  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:02.450682  3134 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:02.445562  3128 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:02.450018  3135 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:02.453059  3176 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:02.421940  4527 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.446200  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:02.402485  4550 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.446560  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:02.445523  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:02.459635  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.459823  3205 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.460258  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:02.461051  3128 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:02.461263  4545 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:02.461414  4643 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:02.462028  4545 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:02.462446  4545 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.462776  4545 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:02.464030  3209 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:02.430322  4665 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.467270  3205 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:02.467494  4665 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:02.467204  4542 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:02.468528  4586 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:02.474226  4509 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:02.459208  4527 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.450018  3100 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:02.432248  3280 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:02.456923  4620 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:02.481630  4593 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:02.507165  4561 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:02.507193  4563 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:02.505815  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 55862.9us
I20260709 13:16:02.495688  4545 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.472325  4680 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.506414  4596 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:02.455206  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:02.546864  3276 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
W20260709 13:16:02.559908  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.496975  4540 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:02.568073  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 52718.2us
I20260709 13:16:02.572311  3282 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:02.572206  4593 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.596252  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:02.596963  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 49344.7us
I20260709 13:16:02.607295  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:02.607780  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:02.570123  4680 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:02.606784  4593 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.612028  4593 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:02.618521  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:02.619087  3276 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:02.619892  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:02.526290  4595 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.626470  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:02.659484  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:02.504096  4638 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.665222  3276 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:02.732141  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:02.732828  3276 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:02.703579  4545 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:02.733738  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:02.734900  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:02.735581  3276 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:02.735661  4527 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.736570  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:02.569911  4540 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:02.706357  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 78251.4us
I20260709 13:16:02.738250  4679 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:02.738421  3276 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:02.711661  3129 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:02.738636  4634 raft_consensus.cc:3055] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:16:02.720706  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 92962.5us
I20260709 13:16:02.738960  3100 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:02.739099  4634 raft_consensus.cc:740] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:02.721405  4595 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:02.730232  3281 consensus_meta.cc:287] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.002s
I20260709 13:16:02.739969  3281 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:02.740063  4634 consensus_queue.cc:260] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.740549  3100 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:02.708837  4528 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:02.740602  3281 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52014 (request call id 93) took 1610 ms (client timeout 2055 ms). Trace:
W20260709 13:16:02.746767  3281 rpcz_store.cc:269] 0709 13:16:01.130005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.135286 (+  5281us) service_pool.cc:224] Handling call
0709 13:16:02.149832 (+1014546us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b5800160e98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caeee 0000000000375939 00007fb3c113e1e0 00007fb3c12070c4 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:02.740536 (+590704us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8790400}
I20260709 13:16:02.741274  4595 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:02.741353  4569 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:02.730718  4606 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:02.742684  3132 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:02.742847  4596 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:02.743281  4563 consensus_queue.cc:1059] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:16:02.753252  3250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.019s	sys 0.018s
I20260709 13:16:02.745283  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.745332  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:02.755139  3285 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:02.743717  4527 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:02.755621  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:02.756736  3250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.020s	sys 0.018s
I20260709 13:16:02.757459  4670 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:02.757537  3281 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:02.748049  4618 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:02.760403  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 522890us
I20260709 13:16:02.765992  3250 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:02.750396  4634 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.767261  3250 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:02.750638  4606 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:02.748610  4509 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:16:02.761688  4545 raft_consensus.cc:2764] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
W20260709 13:16:02.785986  3211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 971) took 1569 ms (client timeout 2023 ms). Trace:
W20260709 13:16:02.786532  3211 rpcz_store.cc:269] 0709 13:16:01.210228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.210724 (+   496us) service_pool.cc:224] Handling call
0709 13:16:02.779385 (+1568661us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400196254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:02.779527 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2327169408}
I20260709 13:16:02.767269  3837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 365) took 1610 ms. Trace:
I20260709 13:16:02.760823  4670 raft_consensus.cc:697] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:02.751952  4610 consensus_queue.cc:1059] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:16:02.771458  4636 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:16:02.779834  4540 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:02.800288  4596 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.781384  4606 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.800864  4596 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.803001  4592 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:02.803136  4596 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:02.793617  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.770975  4618 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:02.804083  3133 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:02.804703  4618 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:02.805552  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.800307  4545 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:02.806205  4545 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:02.808264  4585 consensus_meta.cc:287] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.513s	user 0.005s	sys 0.006s
I20260709 13:16:02.808640  4585 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.809767  3278 raft_consensus.cc:2368] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3.
I20260709 13:16:02.810846  4545 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:02.791944  3837 rpcz_store.cc:276] 0709 13:16:01.151463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.161716 (+ 10253us) service_pool.cc:224] Handling call
0709 13:16:01.180004 (+ 18288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:01.396472 (+216468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:01.404806 (+  8334us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:01.412088 (+  7282us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:01.421570 (+  9482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.750817 (+1329247us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400668ad4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:02.752371 (+  1554us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.762106 (+  9735us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419470208}
I20260709 13:16:02.813304  3101 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:02.769649  4679 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.797422  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.797967  4528 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:02.798842  4670 consensus_queue.cc:237] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.819324  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.814522  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:02.822311  3806 leader_election.cc:400] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3.
W20260709 13:16:02.815857  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.815999  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.818071  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.823668  3128 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:02.817667  4527 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.819296  4596 raft_consensus.cc:2764] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:02.832633  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:02.834600  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.835525  3132 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:16:02.837271  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:02.837518  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:02.789042  4593 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:02.828737  4545 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:02.840477  4545 raft_consensus.cc:697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:02.840588  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:02.841580  4545 consensus_queue.cc:237] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.845276  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:02.846172  3279 raft_consensus.cc:2368] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3.
I20260709 13:16:02.818611  4585 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:02.848361  3277 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:02.818109  4679 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.843519  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:02.838873  4527 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:02.850203  3127 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:02.851650  4527 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:02.852629  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:02.853824  3281 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:02.854539  3806 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:02.856467  3284 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:02.790434  4561 consensus_queue.cc:1059] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:16:02.858554  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:02.859508  3282 raft_consensus.cc:2393] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 2: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:02.860762  3806 leader_election.cc:400] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3.
I20260709 13:16:02.868264  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:02.869127  3136 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.867744  4622 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:02.870553  4622 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:02.875962  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:02.876727  3132 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.860262  4679 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.883688  3101 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:16:02.888931  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.896468  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.875586  4622 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.904006  3249 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:02.849038  4593 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.864003  4643 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:16:02.922120  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:02.923408  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:02.924381  4664 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:02.924810  4664 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:02.925189  4664 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.902196  4563 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.932260  4563 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:02.932642  4563 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.867280  4550 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.934237  3838 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:02.935207  4550 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:02.884641  4595 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:16:02.936450  4595 raft_consensus.cc:3055] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:02.936836  4595 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:02.937784  4595 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:02.939378  4595 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.965554  3136 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:02.966854  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:02.967549  3136 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.919092  4610 raft_consensus.cc:3055] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:16:02.983609  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.987170  3251 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:02.987864  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:02.989141  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:02.989650  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:02.999758  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:03.000532  3134 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:03.001941  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:03.002709  3134 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:03.004046  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:03.004334  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:03.009481  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:03.010313  3133 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
W20260709 13:16:03.000501  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 250910us
I20260709 13:16:03.021557  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:03.023360  3250 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:03.021871  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:03.025349  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:03.025779  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.026000  3134 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.027410  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:03.027856  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:03.028034  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:03.029974  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:03.031888  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:03.032409  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:03.031893  3838 raft_consensus.cc:1240] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:03.033209  3835 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:02.999346  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.023921  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:03.068423  4680 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:03.069959  4680 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.070421  4680 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:03.068668  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 45379.1us
I20260709 13:16:03.000603  4610 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:03.072141  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:03.073009  3133 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:03.012027  4689 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.078948  3211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34318
I20260709 13:16:03.081952  3134 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:03.086002  3211 raft_consensus.cc:606] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:16:03.088764  3136 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:03.091445  3209 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:03.021605  4585 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:03.038837  4616 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:03.097721  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:03.110765  4693 raft_consensus.cc:3055] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:03.111436  4693 raft_consensus.cc:740] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:03.114135  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:03.114846  3133 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:03.121057  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:03.124619  3133 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.135443  3132 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:03.067574  4592 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.110109  3206 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:16:03.021670  4606 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:03.073536  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:03.169649  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:03.163932  3133 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
W20260709 13:16:03.171475  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 304878us
I20260709 13:16:03.109561  4540 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:03.197606  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:03.199005  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:03.219515  3204 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.155599  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:03.200765  3835 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
W20260709 13:16:03.203109  4683 log.cc:927] Time spent T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.420s	user 0.002s	sys 0.000s
I20260709 13:16:03.210139  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:03.222143  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 200663us
I20260709 13:16:03.199832  3836 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:03.219604  3210 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:03.220109  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.224248  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:03.225097  3206 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:03.223008  3128 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:03.217196  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:03.155544  4617 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.227335  3283 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:03.223345  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:03.245931  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 173868us
I20260709 13:16:03.251030  3250 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:03.251775  3283 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
W20260709 13:16:03.305419  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 54447.1us
I20260709 13:16:03.305881  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 1903) took 1066 ms. Trace:
I20260709 13:16:03.226275  4550 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:03.112542  4693 consensus_queue.cc:260] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:03.218042  4509 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:03.254303  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:03.307713  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 53458.4us
I20260709 13:16:03.158488  4592 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:03.226405  4691 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:03.310068  3250 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:03.312239  3250 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:03.313180  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:03.308877  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:03.320384  3204 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:03.321925  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:03.322811  3204 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:03.234095  3203 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:03.227236  4668 consensus_queue.cc:1059] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:16:03.306372  3283 rpcz_store.cc:276] 0709 13:16:02.239864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.240020 (+   156us) service_pool.cc:224] Handling call
0709 13:16:03.216953 (+976933us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b5800160e98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:03.305817 (+ 88864us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5847424}
I20260709 13:16:03.311790  4585 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:03.241225  4617 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:03.311156  4509 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:03.318519  4528 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:03.217216  4610 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:03.326439  4527 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:03.389710  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 80902.4us
I20260709 13:16:03.399751  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:03.365629  4699 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.393590  3204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34318
I20260709 13:16:03.369108  4693 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:03.385321  4634 consensus_meta.cc:287] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.614s	user 0.005s	sys 0.008s
I20260709 13:16:03.366032  4698 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:16:03.396421  4682 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:16:03.370406  4689 raft_consensus.cc:697] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:03.412184  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 188887us
I20260709 13:16:03.384701  4593 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:03.385506  4585 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.418288  3128 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:03.410826  4636 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:03.402061  4540 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:03.403980  4608 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:03.392213  4528 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.400722  3249 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:03.386564  4701 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:03.423211  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:03.325634  4550 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:03.327342  4691 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:03.404739  4527 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:03.425612  4679 consensus_meta.cc:287] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.005s
I20260709 13:16:03.425360  4569 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.395538  4563 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:03.418746  4664 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:03.428659  4636 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:03.449635  4595 consensus_meta.cc:287] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.002s
I20260709 13:16:03.449069  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:03.452638  4679 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:03.434036  4528 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.431869  4610 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.439308  4702 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.551105  4702 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:03.515322  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 156216us
I20260709 13:16:03.446755  4592 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:03.546614  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 97630.4us
I20260709 13:16:03.415478  4699 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:03.554394  3177 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:03.554629  4702 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:03.516728  4606 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:03.429353  4585 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:03.433287  4701 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:03.538544  4709 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:16:03.419485  4509 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:03.560869  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.549785  4692 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 13:16:03.560094  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:03.589186  3206 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:03.434702  4527 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.423346  4698 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:03.541304  4696 log.cc:927] Time spent T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:16:03.476979  4705 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.558908  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:03.542074  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 87660.5us
I20260709 13:16:03.537623  4710 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:03.541782  4636 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.594230  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:03.565207  4702 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:03.603159  3206 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:03.603302  4702 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.603859  4702 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:03.536545  4716 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:03.605791  4716 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.606200  4716 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.565060  4701 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:03.561029  4634 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:03.601250  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:03.602247  4617 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:03.594954  3210 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
W20260709 13:16:03.598973  4680 consensus_meta.cc:287] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.000s
I20260709 13:16:03.588162  4540 raft_consensus.cc:697] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:03.549753  4569 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:03.842449  4680 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:03.842980  4540 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:03.844060  4569 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:03.844651  4680 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:03.609521  4620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.004s	sys 0.015s
I20260709 13:16:03.614110  4710 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:03.846272  4620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.004s	sys 0.016s
I20260709 13:16:03.847944  4710 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:03.630234  4622 consensus_meta.cc:287] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.699s	user 0.013s	sys 0.000s
I20260709 13:16:03.594660  4689 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:03.630914  4723 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:03.632445  4698 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:03.848640  4622 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:03.848869  4723 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:03.851022  4622 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:03.851218  4723 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:03.624024  3835 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
W20260709 13:16:03.637447  4697 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:16:03.609856  4704 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:03.852891  3833 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 2: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:03.853058  4704 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.853575  4704 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.645447  4703 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:03.857414  4703 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:03.615283  4634 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:03.859656  4634 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.679724  4527 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.608153  4527 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:03.681133  4716 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.611703  4716 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:03.684613  4705 raft_consensus.cc:697] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:03.694742  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:03.696228  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:03.698380  4701 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:03.697490  4702 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:03.791278  3204 raft_consensus.cc:606] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Received request to transfer leadership
W20260709 13:16:04.619207  4695 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 1.084s	user 0.003s	sys 0.015s
I20260709 13:16:04.613051  4569 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.799383  3034 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38218 (request call id 240) took 3877 ms. Trace:
W20260709 13:16:03.633232  4707 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:16:03.625144  4721 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:03.695252  4528 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:03.670333  4563 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:04.663921  4563 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.677615  4585 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:03.683442  4638 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.724821  4580 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:03.692165  4550 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:03.689227  4664 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:04.683241  4550 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:03.680797  4679 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:03.909922  4723 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.652137  4691 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:04.699244  4509 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:03.830930  4688 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 1.036s	user 0.000s	sys 0.007s
I20260709 13:16:03.910569  4689 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:03.704159  4636 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.113260  4703 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:04.117216  4704 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.711385  4636 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:04.711978  4704 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:04.128821  4717 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.495s	user 0.003s	sys 0.000s
I20260709 13:16:04.155932  3100 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:04.713923  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 559971us
I20260709 13:16:04.714687  3100 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:04.715097  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:04.716233  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 998) took 1622 ms. Trace:
I20260709 13:16:04.664588  4563 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:04.716588  3202 rpcz_store.cc:276] 0709 13:16:03.094149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.094531 (+   382us) service_pool.cc:224] Handling call
0709 13:16:03.110586 (+ 16055us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.301205 (+190619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.301234 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:03.301664 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.428606 (+126942us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:03.428644 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.428715 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:04.128261 (+699546us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:04.715934 (+587673us) raft_consensus.cc:1685] finished
0709 13:16:04.715956 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.716176 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":300643,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":11738,"spinlock_wait_cycles":10189056,"thread_start_us":250078,"threads_started":2,"wal-append.queue_time_us":287930}
I20260709 13:16:04.719089  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:04.719877  3202 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:04.164289  4728 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.180922  4715 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.187435  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:04.192170  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.720968  4728 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:04.721652  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.722124  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.197042  4719 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.723074  3249 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:04.197687  4711 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:04.210966  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 652082us
I20260709 13:16:04.724938  4636 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:04.725509  4728 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:04.725875  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:04.215423  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:04.725947  4636 raft_consensus.cc:697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:04.727314  3211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1000) took 1608 ms (client timeout 1837 ms). Trace:
W20260709 13:16:04.727692  3211 rpcz_store.cc:269] 0709 13:16:03.118756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.120686 (+  1930us) service_pool.cc:224] Handling call
0709 13:16:04.215240 (+1094554us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b5800102f98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:04.727233 (+511993us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50071936}
I20260709 13:16:04.728298  3176 leader_election.cc:400] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3.
I20260709 13:16:04.228012  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 974) took 1362 ms. Trace:
I20260709 13:16:04.238628  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 992) took 1156 ms. Trace:
I20260709 13:16:04.730063  4618 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:04.729058  3208 rpcz_store.cc:276] 0709 13:16:03.082973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.084007 (+  1034us) service_pool.cc:224] Handling call
0709 13:16:03.151460 (+ 67453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.151911 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.151950 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:03.171274 (+ 19324us) log.cc:844] Serialized 556 byte log entry
0709 13:16:03.597476 (+426202us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:03.597532 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.597631 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:04.238300 (+640669us) raft_consensus.cc:1685] finished
0709 13:16:04.238332 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.238544 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792,"thread_start_us":379598,"threads_started":1,"wal-append.queue_time_us":445617,"wal-append.run_cpu_time_us":2929,"wal-append.run_wall_time_us":1009725}
I20260709 13:16:04.730684  4618 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.729897  4636 consensus_queue.cc:237] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:04.257965  4740 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:04.731117  4618 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:04.260998  3833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 292) took 1231 ms (client timeout 1631 ms). Trace:
I20260709 13:16:04.271493  4616 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.731294  4606 consensus_queue.cc:1059] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:04.731388  4740 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.732055  4616 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.732578  4592 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:04.730734  4711 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.733129  4592 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.291201  3836 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:04.728742  3130 rpcz_store.cc:276] 0709 13:16:02.865413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.865956 (+   543us) service_pool.cc:224] Handling call
0709 13:16:02.874686 (+  8730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.875076 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.875115 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:02.879621 (+  4506us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.155130 (+275509us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:03.155200 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.155308 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:04.227636 (+1072328us) raft_consensus.cc:1685] finished
0709 13:16:04.227667 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.227930 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":541,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":4648,"thread_start_us":275002,"threads_started":1,"wal-append.queue_time_us":464860}
I20260709 13:16:04.302881  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:04.301319  4720 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:04.304657  4727 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:04.736311  4703 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:04.736476  4720 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.736907  4703 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:04.736797  3833 rpcz_store.cc:269] 0709 13:16:03.029543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.029678 (+   135us) service_pool.cc:224] Handling call
0709 13:16:04.260710 (+1231032us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b540056bb54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:04.260908 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890241280}
I20260709 13:16:04.736533  4727 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.738467  4703 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.739248  4720 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:04.740316  4711 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:04.740427  4727 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:04.304844  4724 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:04.741284  4724 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.741338  4716 raft_consensus.cc:3055] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:04.741798  4724 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.304936  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:04.744302  3134 raft_consensus.cc:2393] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 4: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:04.306134  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:04.307682  4668 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.308020  4608 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.307165  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:04.308341  4710 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.746524  4608 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:04.747249  4710 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.748186  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:04.309973  3128 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:04.309023  4600 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.311133  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:04.318727  3102 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:04.749346  3135 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:04.749920  4704 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:04.336128  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:04.339743  3177 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:04.750968  4563 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:04.372354  4545 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:04.385607  4634 consensus_meta.cc:287] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.525s	user 0.017s	sys 0.000s
I20260709 13:16:04.336746  4742 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:04.328619  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.337404  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:04.583571  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 124873us
I20260709 13:16:04.487376  4680 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.752609  4742 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.752530  4545 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:04.752249  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 412564us
I20260709 13:16:04.583834  4670 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:04.754223  4680 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:04.755435  4670 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:04.756399  4545 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:04.582667  3203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 1904) took 1024 ms. Trace:
I20260709 13:16:04.757431  4670 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:04.584882  4699 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:04.758493  4699 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:04.758677  4742 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:04.758863  4699 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.759250  4699 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.759296  4679 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.759838  4679 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:04.745318  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:04.585747  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 114334us
I20260709 13:16:04.588717  4586 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:04.613543  3205 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.768458  4586 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:04.618191  3204 raft_consensus.cc:614] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:04.770982  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:04.771178  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:04.772213  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34318 (request call id 73) took 1422 ms. Trace:
I20260709 13:16:04.623483  3129 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:04.620352  4569 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:04.620350  3034 rpcz_store.cc:276] 0709 13:15:59.921724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.921961 (+   237us) service_pool.cc:224] Handling call
0709 13:16:03.799325 (+3877364us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:00.010434 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:00.010948 (+   514us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:00.010978 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:16:00.010996 (+    18us) tablet.cc:662] Decoding operations
0709 13:16:00.067049 (+ 56053us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:00.070918 (+  3869us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:00.071807 (+   889us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:16:00.137102 (+ 65295us) tablet.cc:701] Row locks acquired
0709 13:16:00.138655 (+  1553us) write_op.cc:260] PREPARE: finished
0709 13:16:00.145068 (+  6413us) write_op.cc:270] Start()
0709 13:16:00.159283 (+ 14215us) write_op.cc:276] Timestamp: P: 1783602960143371 usec, L: 0
0709 13:16:00.159324 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:16:00.216494 (+ 57170us) log.cc:844] Serialized 919 byte log entry
0709 13:16:02.447502 (+2231008us) op_driver.cc:464] REPLICATION: finished
0709 13:16:03.067425 (+619923us) write_op.cc:301] APPLY: starting
0709 13:16:03.077982 (+ 10557us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:03.108470 (+ 30488us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:03.198499 (+ 90029us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:03.198909 (+   410us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:03.199070 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:16:03.199112 (+    42us) write_op.cc:312] APPLY: finished
0709 13:16:03.199311 (+   199us) log.cc:844] Serialized 29 byte log entry
0709 13:16:03.381211 (+181900us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:03.389657 (+  8446us) write_op.cc:454] Released schema lock
0709 13:16:03.392896 (+  3239us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:03.443009 (+ 50113us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:03.443049 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":564488,"apply.run_cpu_time_us":20051,"apply.run_wall_time_us":411170,"num_ops":2,"prepare.queue_time_us":16128,"prepare.run_cpu_time_us":4065,"prepare.run_wall_time_us":219659,"replication_time_us":2285484,"thread_start_us":488009,"threads_started":2,"wal-append.queue_time_us":223153}]]}
I20260709 13:16:04.630532  4527 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.630892  4678 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.639482  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:04.640519  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:04.640774  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:04.641878  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:04.837546  3283 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:04.650020  4540 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.650826  4595 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:04.759243  4742 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:04.657423  4751 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.683990  4550 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:04.688691  4542 raft_consensus.cc:3055] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:04.689802  4723 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:04.692214  3248 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.238s	user 0.005s	sys 0.017s
W20260709 13:16:04.880473  3248 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.426s	user 0.005s	sys 0.017s
I20260709 13:16:04.689253  4585 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:04.695782  4528 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:04.707371  4689 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.224236  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 986) took 1241 ms. Trace:
I20260709 13:16:04.728621  3176 leader_election.cc:403] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:04.721014  4715 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:04.724736  4719 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.271628  4741 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.303983  3136 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:04.735090  3836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 251) took 1171 ms. Trace:
I20260709 13:16:04.735679  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:04.735920  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 433074us
I20260709 13:16:04.729941  4721 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:16:04.741832  4716 raft_consensus.cc:740] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:04.749516  4710 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:04.521136  4749 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:04.949790  3306 debug-util.cc:398] Leaking SignalData structure 0x7b0800130c20 after lost signal to thread 2028
I20260709 13:16:04.954336  4749 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:04.956074  3306 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4220 after lost signal to thread 3068
I20260709 13:16:04.749284  4600 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.734238  4592 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.962535  3207 raft_consensus.cc:2393] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:04.613848  4705 consensus_queue.cc:237] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.617975  4702 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:04.617921  4701 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:04.790704  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:04.799507  4586 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:04.814355  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:04.813568  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:04.981865  3128 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.817689  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:04.752568  4634 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:04.772601  3204 rpcz_store.cc:276] 0709 13:16:03.350231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.359871 (+  9640us) service_pool.cc:224] Handling call
0709 13:16:04.771986 (+1412115us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54001d8154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1e9853 00007fb3c11b760a 00007fb3ba73d7d4 00007fb3ba73d762 00007fb3ba73d691 00007fb3ba73d60c 00007fb3ba73c8c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:04.772128 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893501696}
I20260709 13:16:04.983273  3210 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.836977  3284 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.756880  4680 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:04.858824  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:04.654470  3033 catalog_manager.cc:5697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 1 to 3, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 3 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:04.862376  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 146838us
I20260709 13:16:04.774626  4727 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:04.868860  4540 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.879294  3135 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:04.775792  4616 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:04.871819  4542 raft_consensus.cc:740] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:04.997592  4542 consensus_queue.cc:260] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:04.998621  4542 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:04.820552  4704 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.888337  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:04.888978  3206 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:04.858093  4744 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.886873  3133 rpcz_store.cc:276] 0709 13:16:02.982801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.171221 (+188420us) service_pool.cc:224] Handling call
0709 13:16:03.171610 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.409815 (+238205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.409861 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:03.417760 (+  7899us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.453432 (+ 35672us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:03.453490 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.223809 (+770319us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b5400183154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:04.223868 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:04.223911 (+    43us) raft_consensus.cc:1685] finished
0709 13:16:04.223919 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.224178 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":9826,"spinlock_wait_cycles":546337024,"thread_start_us":12316,"threads_started":1,"wal-append.queue_time_us":232811,"wal-append.run_cpu_time_us":6558,"wal-append.run_wall_time_us":1021631}
W20260709 13:16:04.891404  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 572735us
W20260709 13:16:04.892441  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 164119us
I20260709 13:16:05.007743  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:04.868311  4569 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.013782  3249 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:05.020423  3210 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:05.020309  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:04.746471  4668 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.022995  4540 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:05.023218  4668 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:05.023694  3207 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1001) took 1902 ms (client timeout 1759 ms). Trace:
I20260709 13:16:04.900381  3836 rpcz_store.cc:276] 0709 13:16:03.564026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.565958 (+  1932us) service_pool.cc:224] Handling call
0709 13:16:04.290687 (+724729us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:16:04.290961 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.734807 (+443846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.735026 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2812160}
I20260709 13:16:04.874998  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 891) took 2060 ms. Trace:
I20260709 13:16:04.866653  3280 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:04.953177  3130 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:04.865947  4678 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.884193  4691 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 13:16:04.860321  4527 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.863687  4618 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:04.999666  4608 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:05.024080  3207 rpcz_store.cc:269] 0709 13:16:03.121553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.121712 (+   159us) service_pool.cc:224] Handling call
0709 13:16:03.696078 (+574366us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b5800102f98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:05.023486 (+1327408us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b5400248454. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:05.023619 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803674240}
I20260709 13:16:04.980842  3211 raft_consensus.cc:2393] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:04.773494  4670 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.873924  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:04.963089  3250 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:04.885785  4742 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:04.969307  3306 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4340 after lost signal to thread 3082
I20260709 13:16:04.952286  4740 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.000244  3132 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:04.950459  4741 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:04.901674  4711 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3.
W20260709 13:16:05.004276  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 346157us
I20260709 13:16:05.005106  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:05.006204  4550 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.006323  4719 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:04.865058  4720 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:05.021265  3277 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:05.031097  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.003063  4586 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.033169  3834 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:04.757237  3203 rpcz_store.cc:276] 0709 13:16:03.558608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.560389 (+  1781us) service_pool.cc:224] Handling call
0709 13:16:03.596484 (+ 36095us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:04.297308 (+700824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:04.297341 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:04.297875 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:16:04.576368 (+278493us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:04.576414 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.576488 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:04.582417 (+  5929us) raft_consensus.cc:1685] finished
0709 13:16:04.582443 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.582599 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":700353,"raft.queue_time_us":711262,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":278062,"threads_started":1,"wal-append.queue_time_us":277339}
I20260709 13:16:05.036007  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:05.050752  3202 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:04.985879  3033 catalog_manager.cc:5697] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 4 to 5, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:04.875401  4595 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:05.098766  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.000995  4755 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.055979  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 93028.6us
I20260709 13:16:05.152449  3250 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:05.024807  4757 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.999940  4727 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.069717  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:05.158876  3208 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.040445  4540 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:16:05.003103  4545 consensus_queue.cc:1175] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fc48eecc27554cb58b15193cd442b1d3" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:16:05.079610  3276 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.074388  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.053285  3279 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:05.086959  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:05.148173  3278 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:05.073315  4742 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:05.149530  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 161257us
I20260709 13:16:05.177273  3100 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:05.178776  3281 raft_consensus.cc:2393] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:05.179008  4689 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:05.067827  4608 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:05.179960  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:05.180721  3281 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.151626  3128 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:05.045910  4701 consensus_queue.cc:1059] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:16:04.891372  4751 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.027105  4716 consensus_queue.cc:260] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.162338  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.069269  4617 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.155015  3127 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:16:05.216890  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.159811  3033 catalog_manager.cc:5697] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:05.016103  4704 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.056708  4670 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.171046  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.079787  3205 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
W20260709 13:16:05.186002  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 178097us
I20260709 13:16:05.192495  4580 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:05.157637  4622 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.166324  3306 debug-util.cc:398] Leaking SignalData structure 0x7b080037bd80 after lost signal to thread 3160
I20260709 13:16:05.196385  3128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:16:05.028781  4744 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:05.158013  4745 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:05.082990  4720 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:05.180084  4756 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:16:05.221004  3202 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:16:05.205966  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.158587  4703 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:05.195225  3280 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.296128  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.028844  3129 rpcz_store.cc:276] 0709 13:16:02.814886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.817742 (+  2856us) service_pool.cc:224] Handling call
0709 13:16:04.622949 (+1805207us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b5800002798. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caeee 0000000000375939 00007fb3c113e1e0 00007fb3c12070c4 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:16:04.623119 (+   170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.790303 (+167184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.867639 (+ 77336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10862848}
I20260709 13:16:05.191431  4710 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.158669  4755 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.238365  4723 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:05.279583  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:05.310144  3277 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.279511  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.311686  3279 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:05.312553  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:05.280349  3205 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 993) took 2191 ms (client timeout 1712 ms). Trace:
I20260709 13:16:05.280871  4600 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.231676  4608 raft_consensus.cc:697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:05.241287  4691 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:05.276578  3306 debug-util.cc:398] Leaking SignalData structure 0x7b0800397aa0 after lost signal to thread 3161
I20260709 13:16:05.228724  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.146929  4749 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.275686  4580 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.272756  4606 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.308189  4710 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.395972  4636 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:05.313920  3279 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.401315  4636 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.403620  4636 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:05.403692  4710 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:05.344869  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.401302  4723 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.404687  3202 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:05.238075  4689 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:16:05.404800  4723 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:05.406785  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.407027  4723 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:05.407646  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 168195us
I20260709 13:16:05.407955  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:05.283900  4760 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:05.347788  4680 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.352247  4608 consensus_queue.cc:237] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.353091  4691 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.354434  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 993) took 1043 ms. Trace:
I20260709 13:16:05.355377  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 145) took 1049 ms. Trace:
I20260709 13:16:05.441207  3127 rpcz_store.cc:276] 0709 13:16:04.305779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.305903 (+   124us) service_pool.cc:224] Handling call
0709 13:16:05.355193 (+1049290us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540032e1d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:05.355299 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779426176}
I20260709 13:16:05.349404  4703 raft_consensus.cc:697] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:05.443447  4691 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.443735  4703 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.444608  4741 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:05.415161  3203 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:05.445312  4618 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.446099  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.446762  3203 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:16:05.232009  4617 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.432124  3132 rpcz_store.cc:276] 0709 13:16:04.311301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.747845 (+436544us) service_pool.cc:224] Handling call
0709 13:16:05.354254 (+606409us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54003f7d54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:05.354370 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577788672}
I20260709 13:16:05.447778  3131 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
W20260709 13:16:05.315068  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.161755  4757 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.298010  4745 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:05.339856  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.408463  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:05.409024  4580 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:05.313302  3205 rpcz_store.cc:269] 0709 13:16:03.084509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.098301 (+ 13792us) service_pool.cc:224] Handling call
0709 13:16:03.694568 (+596267us) spinlock_profiling.cc:243] Waited 9.24 ms on lock 0x7b5800102f98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:05.272314 (+1577746us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21251840}
I20260709 13:16:05.457114  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:05.457420  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 49040.2us
I20260709 13:16:05.458150  3102 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:05.458220  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.458899  3205 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:05.410169  3202 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.231076  3033 catalog_manager.cc:5697] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 1 to 3, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 3 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:05.459781  3102 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:05.284190  4622 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.447732  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:05.462635  4749 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.417443  3278 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:05.463047  4751 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:05.424145  3279 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:05.464274  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.430377  4527 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:05.434986  4755 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.435807  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:05.473920  4720 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:05.473928  3832 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:16:05.475113  4704 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:05.432199  4680 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.436360  4727 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:05.437863  4761 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:16:05.350095  4715 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:05.422851  4758 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.439914  4742 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:05.414984  3306 debug-util.cc:398] Leaking SignalData structure 0x7b080037da20 after lost signal to thread 3235
I20260709 13:16:05.401574  4606 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.453104  3277 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:05.429195  4760 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:05.455760  4699 consensus_meta.cc:287] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.696s	user 0.011s	sys 0.001s
I20260709 13:16:05.464394  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.421739  3284 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:05.464903  3279 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:05.425330  4540 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:05.505692  3282 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.466421  4744 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.465250  4741 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:05.471374  3834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 391) took 2610 ms. Trace:
I20260709 13:16:05.501121  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:05.471961  4745 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:05.509233  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.510283  3284 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:05.511137  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.511639  4595 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.511921  3284 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:16:05.456315  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:05.480639  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:05.513504  3840 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:05.461794  4618 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.508416  3834 rpcz_store.cc:276] 0709 13:16:02.861271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.862961 (+  1690us) service_pool.cc:224] Handling call
0709 13:16:02.865716 (+  2755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.149040 (+2283324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.471109 (+322069us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b5400721854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:05.471289 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4957078272}
I20260709 13:16:05.489709  4757 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:05.489916  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:05.518911  3285 raft_consensus.cc:2376] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4. Re-sending same reply.
I20260709 13:16:05.491751  4680 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:05.466722  4749 consensus_queue.cc:1059] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:16:05.460467  4670 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.504778  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:05.511349  3842 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:05.488992  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:05.515338  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:05.524876  3838 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
W20260709 13:16:05.520186  4542 consensus_meta.cc:287] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.519s	user 0.013s	sys 0.012s
I20260709 13:16:05.507839  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:05.527189  4724 consensus_meta.cc:287] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.785s	user 0.012s	sys 0.005s
I20260709 13:16:05.508708  4699 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.529453  4679 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:05.503846  4758 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.529939  4724 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.523692  4749 consensus_queue.cc:1243] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer 0930e3e7657c43bcaaa5b0778f3e08cf log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:16:05.539417  4509 consensus_meta.cc:287] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.840s	user 0.012s	sys 0.010s
I20260709 13:16:05.539738  4699 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:05.539916  4693 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.538733  4540 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.540558  4693 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.541493  4724 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.542315  4716 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.544620  4760 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:05.546043  4592 consensus_meta.cc:287] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.559s	user 0.018s	sys 0.000s
I20260709 13:16:05.548524  4758 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.462571  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.581528  3209 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:05.465876  3102 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:05.584215  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.584920  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.586516  3128 raft_consensus.cc:606] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:05.581923  3205 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:05.587232  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:05.589378  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.589521  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.451309  3130 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
W20260709 13:16:05.592275  3130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 992) took 1281 ms (client timeout 1524 ms). Trace:
W20260709 13:16:05.593052  3130 rpcz_store.cc:269] 0709 13:16:04.311040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.735347 (+424307us) service_pool.cc:224] Handling call
0709 13:16:05.591950 (+856603us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.595665  3205 raft_consensus.cc:2410] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:05.597258  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.515534  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.598783  3279 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:05.599967  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.600086  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.488003  3202 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:05.600839  3284 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:05.602087  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.602401  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.602912  3284 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:16:05.603434  3202 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:05.463130  3203 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.606639  3284 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.415727  3208 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:05.477463  3177 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:05.608503  3284 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.609902  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.546448  4592 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.612833  3134 raft_consensus.cc:2368] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3.
W20260709 13:16:05.609836  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 132241us
I20260709 13:16:05.612717  3285 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:05.586758  3277 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:05.591131  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:05.617218  3285 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:05.604774  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.600787  3279 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:05.614228  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.608517  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.648612  3284 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:05.627465  3285 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:05.461143  3033 catalog_manager.cc:5697] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 1 to 2, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 2 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:05.652570  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:05.651127  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.653347  4710 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.642818  4592 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.643877  4724 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:05.688901  4724 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.691890  4724 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:05.683583  3306 debug-util.cc:398] Leaking SignalData structure 0x7b080036c320 after lost signal to thread 3309
I20260709 13:16:05.692476  3203 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:05.693347  3205 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
W20260709 13:16:05.694026  3306 debug-util.cc:398] Leaking SignalData structure 0x7b080036a0c0 after lost signal to thread 3867
W20260709 13:16:05.694435  3306 debug-util.cc:398] Leaking SignalData structure 0x7b0800230960 after lost signal to thread 3868
W20260709 13:16:05.696820  3306 debug-util.cc:398] Leaking SignalData structure 0x7b08001dcb60 after lost signal to thread 4687
W20260709 13:16:05.647192  3805 leader_election.cc:336] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.871s (SENT)
I20260709 13:16:05.691179  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:05.685912  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:05.698305  3100 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:05.646183  4758 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.702065  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:05.702853  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 86016.5us
I20260709 13:16:05.700665  3202 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:16:05.707204  4710 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.712090  3835 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:05.713454  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 247536us
I20260709 13:16:05.712183  4545 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:05.718170  4622 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.720382  4634 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:05.723416  4678 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:05.723351  3206 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:05.725709  3280 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:05.721854  4545 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.727522  4545 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.727754  4740 raft_consensus.cc:3055] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:05.739313  4740 raft_consensus.cc:740] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:05.741119  4740 consensus_queue.cc:260] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.743647  4740 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.745275  4592 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:05.745846  4592 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:05.746141  3131 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 138) took 3001 ms (client timeout 2173 ms). Trace:
I20260709 13:16:05.746302  4592 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:05.746582  3131 rpcz_store.cc:269] 0709 13:16:02.744811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.744952 (+   141us) service_pool.cc:224] Handling call
0709 13:16:05.745720 (+3000768us) spinlock_profiling.cc:243] Waited 2.69 s on lock 0x7b5400068bd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:05.745932 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6194887936}
I20260709 13:16:05.748632  4758 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:05.751569  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:05.751796  3134 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 991) took 1441 ms (client timeout 1804 ms). Trace:
I20260709 13:16:05.751868  4580 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:05.722172  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 47868.6us
W20260709 13:16:05.752378  3134 rpcz_store.cc:269] 0709 13:16:04.310810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.745041 (+434231us) service_pool.cc:224] Handling call
0709 13:16:05.751518 (+1006477us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54003f8254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:05.751729 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956688128}
I20260709 13:16:05.752631  3132 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:16:05.753531  3177 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
W20260709 13:16:05.755775  3176 connection.cc:256] RPC call timeout handler was delayed by -2.2851194590000432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
I20260709 13:16:05.755895  4699 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:05.756408  3176 connection.cc:256] RPC call timeout handler was delayed by -2.2716194590000214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
I20260709 13:16:05.760103  4721 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:05.760896  4721 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.722429  3805 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:05.757020  3176 connection.cc:256] RPC call timeout handler was delayed by -2.2245836079998753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
I20260709 13:16:05.730116  3208 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:05.710469  4585 raft_consensus.cc:2955] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:05.726653  3033 catalog_manager.cc:5697] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 1 to 2, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 2 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:05.766574  3176 connection.cc:256] RPC call timeout handler was delayed by -2.2245836079998753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
W20260709 13:16:05.737564  3281 consensus_meta.cc:287] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.520s	user 0.013s	sys 0.017s
I20260709 13:16:05.756446  4699 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.767949  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:05.768301  3281 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:05.768944  3127 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
W20260709 13:16:05.735980  3209 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1002) took 2585 ms (client timeout 2160 ms). Trace:
W20260709 13:16:05.769666  3209 rpcz_store.cc:269] 0709 13:16:03.151017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.154076 (+  3059us) service_pool.cc:224] Handling call
0709 13:16:04.187282 (+1033206us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b5800102f98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:05.735589 (+1548307us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b5400225e54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:05.735833 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1979256960}
I20260709 13:16:05.767668  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:05.749702  4758 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.768302  4699 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.777829  3131 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:16:05.777233  3033 catalog_manager.cc:5697] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 2 to 3, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:16:05.767041  3176 connection.cc:256] RPC call timeout handler was delayed by -2.2005194590001338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
I20260709 13:16:05.783824  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:05.784806  3132 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:05.763860  3835 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
W20260709 13:16:05.787384  3176 connection.cc:256] RPC call timeout handler was delayed by -2.0079194590000498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
I20260709 13:16:05.787351  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:05.772521  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:05.789875  3176 connection.cc:256] RPC call timeout handler was delayed by -1.9863194590000148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
I20260709 13:16:05.790156  3128 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:05.770920  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:05.790324  3176 connection.cc:256] RPC call timeout handler was delayed by -1.9545836079998935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
W20260709 13:16:05.791388  3176 connection.cc:256] RPC call timeout handler was delayed by -1.9365836079998644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
I20260709 13:16:05.790267  3211 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:16:05.791785  3176 connection.cc:256] RPC call timeout handler was delayed by -1.9248836079998455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 13:16:05.792152  3176 connection.cc:256] RPC call timeout handler was delayed by -1.8474836079999477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
I20260709 13:16:05.771991  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:05.794430  4721 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.795423  4606 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.796454  4622 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.797255  3127 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:16:05.795691  4758 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:05.798122  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 151187us
I20260709 13:16:05.801906  3100 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:05.803406  4758 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:05.804016  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:05.804276  4758 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:05.805310  4760 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:05.805943  4760 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.806347  4760 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.806949  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:05.808068  3128 raft_consensus.cc:2376] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2. Re-sending same reply.
I20260709 13:16:05.810335  3102 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:05.811883  4749 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.814014  4758 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.812927  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:05.817157  3176 connection.cc:256] RPC call timeout handler was delayed by -1.8384836079999332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 13:16:05.825043  3176 connection.cc:256] RPC call timeout handler was delayed by -1.6962836079999306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
I20260709 13:16:05.769798  4724 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.827304  3127 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:16:05.828987  3836 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:05.837755  4670 consensus_queue.cc:1059] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:16:05.831796  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.839143  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.839913  4595 raft_consensus.cc:3055] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:05.840472  4595 raft_consensus.cc:740] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:05.840744  4724 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:05.842358  4617 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:05.842526  3100 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:05.842185  4595 consensus_queue.cc:260] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.844182  4595 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.832756  4760 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.830103  4542 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:05.855197  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.857540  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.859331  4702 raft_consensus.cc:3055] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:05.859779  4702 raft_consensus.cc:740] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:05.861241  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:05.860930  4702 consensus_queue.cc:260] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.861883  3209 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.862072  4702 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:05.863806  4699 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.867815  3206 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:05.850907  4617 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:05.874040  3211 raft_consensus.cc:2955] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:05.876258  4710 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.876451  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:05.877368  3205 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.879215  4592 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:05.886034  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.887153  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:05.888684  4693 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.888756  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:05.870115  4617 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.894877  4617 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.896589  3177 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:05.894054  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:05.897367  4693 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.899626  3836 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:05.872112  4622 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:16:05.901000  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.892135  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.882306  3250 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:05.908098  3209 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:05.908253  3205 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:05.908921  3835 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.913414  4540 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:05.914321  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 58251.7us
I20260709 13:16:05.914649  3208 raft_consensus.cc:2410] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:16:05.916195  4592 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.916455  3250 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:05.917399  4766 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:05.917821  4766 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:05.918293  4766 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:05.921545  3203 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:05.922087  4749 consensus_queue.cc:1059] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:05.923085  4741 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.925637  3806 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:05.925839  4580 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.926944  4755 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:05.926209  4749 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.927774  4755 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.928210  4749 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.930474  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.913944  4540 raft_consensus.cc:697] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:05.931264  4757 raft_consensus.cc:3055] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:05.933420  4757 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:05.933918  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:05.934890  3837 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:05.934484  4757 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.935024  4755 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:05.936610  4757 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:05.937326  3100 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:05.938192  4749 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.942296  4749 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:05.941329  3206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:50254
I20260709 13:16:05.947049  3206 raft_consensus.cc:606] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:05.940907  4755 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:05.943212  3205 raft_consensus.cc:2410] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:16:05.946256  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.942039  4540 consensus_queue.cc:237] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.914973  4760 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.953193  4545 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:05.925912  4741 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.933810  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:05.954957  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 49771.4us
I20260709 13:16:05.955116  3203 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:05.956147  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:05.957443  4545 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.953604  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:05.957659  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:05.958660  3210 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.958990  3837 raft_consensus.cc:2368] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4.
I20260709 13:16:05.959939  3206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:50254
I20260709 13:16:05.960510  3206 raft_consensus.cc:606] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:05.960842  3206 raft_consensus.cc:614] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:05.961942  3204 raft_consensus.cc:3055] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:05.962329  3204 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:05.963348  3204 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.964231  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:05.964432  3204 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.946228  4622 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
W20260709 13:16:05.965860  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.967334  3206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:50254
I20260709 13:16:05.967447  4760 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.968107  4618 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.968401  4760 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.967724  4742 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:05.968760  4618 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.969262  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:05.969476  4742 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.970890  4618 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.971662  4742 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.971763  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:05.972645  3127 raft_consensus.cc:2393] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:05.972594  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:05.968081  3206 raft_consensus.cc:606] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:05.976017  3206 raft_consensus.cc:614] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:05.976197  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:05.973382  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:05.957955  4749 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:05.974105  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.974936  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:05.978341  3131 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:05.975123  3130 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:05.978683  4749 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:05.975346  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:05.980144  3127 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:05.981243  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.976974  3132 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.981823  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:05.982736  3134 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.975608  4741 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.970917  4760 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:05.950008  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.988406  3202 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:05.990413  3209 raft_consensus.cc:2410] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:05.991480  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:05.989638  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:05.995795  3132 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:05.947760  4721 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:06.002975  3204 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:06.004350  4586 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.006856  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:06.005666  3806 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.008301  3206 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:06.007892  4586 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.011722  4586 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.011633  4622 raft_consensus.cc:2764] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:16:06.012864  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 57140.1us
I20260709 13:16:06.015142  4744 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:06.017880  3805 leader_election.cc:336] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.178s (SENT)
I20260709 13:16:06.018362  3805 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:06.018463  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:06.018633  4716 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:06.006803  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:06.019510  4622 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:06.019965  3127 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.019989  4509 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:06.008235  4699 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:06.023140  3132 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.024878  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.022379  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:06.025952  3211 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.998803  4592 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.032536  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.035054  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.036540  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:06.037058  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:06.037266  3130 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:06.029305  4721 raft_consensus.cc:697] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:06.041219  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.043458  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.044090  3206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:50254
I20260709 13:16:06.044530  3206 raft_consensus.cc:606] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:06.044790  3206 raft_consensus.cc:614] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:06.039167  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:06.045868  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:06.046196  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:06.046656  3129 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.048295  4710 raft_consensus.cc:3055] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:06.048965  4710 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:06.045881  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:06.046254  3131 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:06.051966  3133 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.053028  3209 raft_consensus.cc:2410] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:06.052863  3100 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.034096  4758 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.054615  3207 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:06.055205  4622 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:06.058915  4622 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:06.058252  3204 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.066725  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.067544  3209 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 3: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:06.068434  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.057199  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:06.062556  4755 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.064699  4622 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:06.075750  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:06.079025  3100 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.082000  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.059674  4592 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.086552  3210 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:06.087569  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.076895  4755 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.088986  4755 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.077987  3836 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.093752  4740 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.094247  4740 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.094673  4740 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.094956  4545 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.095386  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:06.095417  4545 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.096263  4545 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.096642  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:06.089393  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:06.075783  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:06.099210  3285 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.067814  4766 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.058916  4710 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:06.101163  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.105233  4760 raft_consensus.cc:3055] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:06.060729  4721 consensus_queue.cc:237] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.106011  3133 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:06.097956  3835 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
W20260709 13:16:06.117818  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 79972.6us
I20260709 13:16:06.100142  3100 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.108008  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:06.070345  4758 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.110201  3131 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:06.110023  4710 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.121450  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:06.121795  4586 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.111334  4592 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:06.109865  3211 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:06.122622  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:06.122499  4550 raft_consensus.cc:2764] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:16:06.108290  4693 raft_consensus.cc:993] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: : Instructing follower 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:16:06.127252  4693 raft_consensus.cc:1081] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Signalling peer 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:16:06.128599  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.129470  3135 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:06.108353  4760 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:06.131163  4760 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.132737  4760 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.125614  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.131651  3832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35"
dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:54908
I20260709 13:16:06.140489  3832 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:06.141048  3832 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.141701  3249 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:06.143437  3249 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:06.124982  3207 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:06.144348  3249 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:06.124435  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.135475  3130 raft_consensus.cc:2393] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 3: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:06.139194  3134 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:06.145234  3133 raft_consensus.cc:2393] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 3: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:06.147128  4586 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:06.149674  4785 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:16:06.150151  4741 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:06.150733  4741 raft_consensus.cc:697] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:06.151703  4741 consensus_queue.cc:237] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.155326  4766 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:06.156406  3127 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:06.157941  4540 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:06.161339  3838 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:06.169608  4540 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:16:06.163134  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 63071.7us
I20260709 13:16:06.170259  4540 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.171021  3806 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:06.171161  3176 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:06.171496  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.171960  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:06.173213  4699 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:06.165297  4545 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.123454  4744 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:06.190912  4542 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:06.173903  4699 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:16:06.194860  3205 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:06.197887  4617 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:06.199154  3136 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.198040  4540 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.199877  3204 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:06.180692  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:06.201485  3100 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.205423  3132 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
W20260709 13:16:06.205541  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 61266.6us
I20260709 13:16:06.203621  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:06.200452  4592 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:06.207824  4592 raft_consensus.cc:697] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:06.207048  3177 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:06.207824  3285 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:06.209860  4699 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:06.210166  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:06.210045  4592 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.210871  4744 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:06.211187  3835 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 3: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:06.211460  4744 raft_consensus.cc:697] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:06.215557  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.216259  3204 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
W20260709 13:16:06.216367  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 44461.8us
I20260709 13:16:06.199541  4586 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:06.217455  4580 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:06.218771  4754 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:06.219007  4580 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:06.219197  4754 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.219588  4754 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.220367  3129 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:06.221240  4527 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.220224  4580 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.221822  4527 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.223901  4527 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:06.221235  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.227504  4527 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.228585  4527 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.212723  4585 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.232658  3128 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:06.237838  4678 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:06.238628  3100 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.238435  4678 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.240059  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.240752  3127 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:06.242434  3102 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.243146  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.243497  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.244069  3127 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:16:06.245113  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 72091.4us
I20260709 13:16:06.244866  4742 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:06.246403  4742 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.246771  4742 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.247689  3836 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:06.253175  4678 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:06.256166  3177 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:06.256937  4699 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:06.239231  4740 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.257454  4699 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:06.258555  4699 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.259371  4740 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:06.260332  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:06.260622  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:06.261052  3282 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:06.261533  3281 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:06.262346  4758 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:06.262864  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:06.229242  4744 consensus_queue.cc:237] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.263351  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:06.265013  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:06.265762  3282 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:06.265506  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:06.267200  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.237140  4585 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.267100  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:06.275539  4585 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.278571  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:06.281570  3102 leader_election.cc:400] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4.
I20260709 13:16:06.279453  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:06.279345  4693 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:06.278857  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:06.282405  3102 leader_election.cc:403] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:06.283100  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.285495  3276 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:06.286211  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:06.275930  4617 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:06.289402  3102 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:16:06.291314  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 52781.9us
I20260709 13:16:06.279578  4758 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.292618  3282 raft_consensus.cc:2368] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4.
I20260709 13:16:06.293680  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.279682  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.295553  3134 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:06.292318  4693 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.274441  4755 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.297500  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:06.298326  3205 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.298555  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.297101  3100 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.285889  4757 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.303408  4527 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:06.290047  3127 raft_consensus.cc:2955] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:06.305570  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:06.306203  3204 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.294598  4758 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.308228  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.308367  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.309275  3207 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:06.310154  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:06.311489  3102 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:06.301424  4740 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:06.301728  3129 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:06.310842  4758 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.323925  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:06.334975  4693 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:06.335575  4617 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:06.337059  4617 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.337493  4617 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.338833  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:06.339831  3100 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:06.340775  3134 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:06.346350  3136 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:06.323140  4760 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:06.349680  3205 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:06.333272  4540 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:06.355527  3100 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.354851  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.356769  3134 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 4: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:06.351938  4693 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:06.350081  4545 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:06.363916  3249 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:06.314543  4622 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.355340  4527 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:16:06.353497  4742 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.369328  4742 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:06.369669  3837 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:06.366179  4693 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:16:06.358002  4705 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:06.371776  4705 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.372372  4705 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.365254  4618 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:06.377163  4618 raft_consensus.cc:697] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:06.378492  4793 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:16:06.378221  4618 consensus_queue.cc:237] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:06.380236  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:06.381053  3205 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.382062  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:06.382447  3128 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:06.353462  4678 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:06.357327  4592 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.388614  3204 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:06.390590  3205 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:06.397406  3100 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.401522  3100 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.350850  3832 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.409572  4742 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:06.410493  4742 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:06.396821  4527 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:06.411491  4527 raft_consensus.cc:697] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:06.411767  4742 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.413232  4634 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:06.412552  4527 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.413774  4634 raft_consensus.cc:697] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:06.414669  4634 consensus_queue.cc:237] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.417241  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.418169  3136 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:06.419445  3842 raft_consensus.cc:1240] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:06.419243  4678 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:06.382068  4791 log.cc:927] Time spent T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.076s	user 0.001s	sys 0.003s
W20260709 13:16:06.421959  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.424306  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.427579  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:06.429154  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.429960  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.430672  3128 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:06.430121  3832 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:06.431536  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:06.434612  4792 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:16:06.435859  3251 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:06.431623  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.439044  3128 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:06.430282  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:06.406646  4760 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:06.446827  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:06.446753  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:06.448658  3205 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.436810  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:06.474251  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 57495.2us
I20260709 13:16:06.475471  3131 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
W20260709 13:16:06.479059  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 112798us
I20260709 13:16:06.479372  3205 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
W20260709 13:16:06.475152  3805 leader_election.cc:336] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.657s (SENT)
I20260709 13:16:06.480669  3100 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.483327  3128 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:06.484756  3132 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:06.485479  3127 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:06.447841  4678 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:06.475880  3836 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:06.476167  4699 raft_consensus.cc:2764] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:06.477253  4724 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:16:06.488313  3130 raft_consensus.cc:2376] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4. Re-sending same reply.
I20260709 13:16:06.481874  4540 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:06.482170  4755 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:06.482263  4760 raft_consensus.cc:697] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:06.504161  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.502964  4754 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.503176  4766 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:16:06.503072  4580 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:06.508852  4760 consensus_queue.cc:237] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.510424  3129 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:06.487771  4741 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.503542  4540 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.518985  4724 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:06.538364  4678 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:06.539016  4678 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.527949  4580 raft_consensus.cc:697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:06.529522  4540 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:06.548465  4622 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:06.559554  3205 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:06.561103  4585 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.561635  4742 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:06.563060  3285 raft_consensus.cc:2368] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4.
I20260709 13:16:06.564801  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.565778  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.566596  4699 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:06.567231  4699 raft_consensus.cc:697] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:06.568351  4699 consensus_queue.cc:237] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:06.570464  4705 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.574375  4678 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:06.552104  4617 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.577541  4617 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:06.578322  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:06.589061  3204 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.591293  4592 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:06.579295  4754 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:06.532539  4741 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.585408  4585 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:06.592203  4795 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.248s	user 0.003s	sys 0.000s
I20260709 13:16:06.604270  3204 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:06.551246  4724 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:06.606781  3100 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.606896  4710 consensus_queue.cc:1059] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:06.607909  4710 raft_consensus.cc:3055] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:06.608407  4710 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:06.573022  4705 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:06.609530  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.610230  3208 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:06.611209  4710 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.612377  4710 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.610241  4580 consensus_queue.cc:237] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.634089  4622 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.634371  4811 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:06.635407  4811 raft_consensus.cc:697] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:06.635248  4622 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.617044  4741 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:06.642882  4622 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:06.634083  3100 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:06.653205  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 125598us
I20260709 13:16:06.654096  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.597002  4693 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:06.664341  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:06.665202  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 180214us
I20260709 13:16:06.640343  4724 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.686921  3204 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:06.686481  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.660907  4617 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:06.696929  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 54217us
I20260709 13:16:06.702394  3133 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:06.636669  4811 consensus_queue.cc:237] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.709841  3249 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:06.688212  4721 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.690985  4617 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.663642  4758 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.688954  4744 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:06.708452  4757 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4.
I20260709 13:16:06.719964  4758 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:06.731154  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 44755.4us
I20260709 13:16:06.714265  4617 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.708784  4592 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:06.716576  4678 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:06.736322  4699 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:06.738175  4699 raft_consensus.cc:697] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:06.739434  4699 consensus_queue.cc:237] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.743263  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.743572  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.743922  3211 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:06.729293  4693 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:06.745970  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:06.746923  4634 consensus_queue.cc:1059] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:06.748544  3208 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:06.714335  4721 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.722926  4705 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:16:06.761379  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:06.773506  3842 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.766844  4540 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.767721  4585 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.751996  4678 raft_consensus.cc:697] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:06.769901  4810 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.770136  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:06.770566  4766 consensus_queue.cc:1059] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:06.771762  4814 raft_consensus.cc:3055] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:06.790177  4766 raft_consensus.cc:3055] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:06.788703  4758 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:06.796169  4766 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:06.781224  4585 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:06.796941  4585 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.789741  3101 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:06.797016  4678 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.798487  3101 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:06.792295  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.800055  4757 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:06.800554  4757 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:06.794025  4814 raft_consensus.cc:740] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:06.801937  4796 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:06.802376  4796 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.803262  4796 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.802331  4814 consensus_queue.cc:260] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.797158  4766 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.806691  4766 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.772887  4693 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.801553  4757 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.812841  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:06.836174  4758 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:06.830233  3250 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.632s (SENT) [suppressed 23 similar messages]
I20260709 13:16:06.838474  4758 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:06.839469  4758 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.838510  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:06.847064  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 119539us
W20260709 13:16:06.847880  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.848156  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:06.849259  4622 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:06.850199  4622 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:06.851969  4622 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.852313  4796 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.865024  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:06.866364  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 53710.3us
I20260709 13:16:06.869428  3209 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:06.871182  3209 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:06.873725  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 43559.8us
I20260709 13:16:06.874868  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:06.876367  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.877276  3202 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
W20260709 13:16:06.882551  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.858832  4744 raft_consensus.cc:697] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:06.882656  3206 raft_consensus.cc:2368] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3.
I20260709 13:16:06.883518  3210 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:06.916533  3204 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:06.924527  3101 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:06.926290  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.927088  3210 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:06.928195  3282 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:06.929677  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:06.932019  3838 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:06.933812  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:06.936501  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.941643  4741 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.942297  4741 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:06.945498  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.946645  3202 raft_consensus.cc:2410] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:06.944747  4741 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:06.946571  3842 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:06.947851  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:06.948462  3102 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:06.927896  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:06.949342  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:06.949536  4741 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:06.950104  4741 raft_consensus.cc:697] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:06.953233  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:06.954324  3204 raft_consensus.cc:2410] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:06.957710  3206 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:16:06.957828  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:06.927817  4820 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.016907  3209 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:06.939275  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:06.950953  4741 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:07.017679  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 129265us
I20260709 13:16:07.044351  4820 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:07.068763  3836 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:06.949379  4617 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:07.022739  3832 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:07.069841  4744 consensus_queue.cc:237] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:06.939380  4760 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:06.978931  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:07.019979  3202 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
W20260709 13:16:07.129894  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 177993us
I20260709 13:16:07.142786  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:07.143755  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.154443  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 82845.7us
I20260709 13:16:07.127000  4825 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 13:16:07.162767  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.161295  3805 leader_election.cc:336] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.111s (SENT)
I20260709 13:16:07.130589  4585 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:07.169612  4617 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:07.173434  4826 raft_consensus.cc:3055] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:07.143635  4796 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:07.179986  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.185487  3805 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:07.177672  3835 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:07.196105  3285 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:07.198235  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.199556  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.188510  4826 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:07.201768  4819 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.455s	user 0.003s	sys 0.006s
I20260709 13:16:07.201875  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:07.202708  3202 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:07.203629  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:07.204124  3202 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.204959  4814 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:07.206920  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:07.213527  3101 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:07.210734  4829 log.cc:927] Time spent T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.189s	user 0.000s	sys 0.011s
I20260709 13:16:07.214548  4796 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.201970  4826 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:07.216135  4826 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.226593  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:07.227573  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 66327.9us
I20260709 13:16:07.228324  3202 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:07.187549  4545 consensus_queue.cc:1059] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:16:07.220979  4617 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:07.232961  3202 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.220247  4760 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.238180  4754 consensus_queue.cc:1059] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:16:07.239356  4754 raft_consensus.cc:3055] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:07.239737  4754 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:07.250016  3207 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.253115  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:07.243319  4622 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:07.263413  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:07.242730  4760 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:07.236953  4634 consensus_queue.cc:1059] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:16:07.278230  4634 raft_consensus.cc:3055] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:07.278666  4634 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:07.279361  4760 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:07.279582  4634 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:07.260877  4820 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:07.270100  4721 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:07.281672  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:07.281010  4634 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.271252  4617 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:07.271731  4741 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:16:07.271298  4830 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.423s	user 0.002s	sys 0.000s
I20260709 13:16:07.282445  3832 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:07.300673  3102 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:07.301590  4585 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:07.301988  4580 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.302590  4580 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:07.305670  4580 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:07.290688  3806 leader_election.cc:336] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.525s (SENT)
I20260709 13:16:07.297325  4741 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:07.308224  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.309855  4741 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:07.291971  4760 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:07.136469  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:07.305998  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:07.311589  4817 log.cc:927] Time spent T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.557s	user 0.000s	sys 0.008s
I20260709 13:16:07.312789  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:07.306329  4758 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:07.315339  4758 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.315764  4758 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.322646  3202 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:07.323884  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:07.323962  3281 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:07.325026  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.325232  3207 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:07.325604  3202 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:07.326161  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:07.326400  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.327446  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.328064  3202 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:07.329933  3202 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:07.330312  3211 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:07.331013  3249 leader_election.cc:400] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3.
I20260709 13:16:07.331332  3249 leader_election.cc:403] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:16:07.331499  3211 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:07.331432  4814 consensus_queue.cc:1059] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:07.332430  4810 consensus_queue.cc:1059] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:07.332805  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:07.333117  4820 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:07.333468  4825 consensus_queue.cc:1059] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:07.334549  4814 raft_consensus.cc:3055] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:07.334815  4820 raft_consensus.cc:3055] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:07.334944  4814 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:07.335264  4820 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:07.335806  4814 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:07.336133  4820 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:07.337643  3249 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:07.338531  3249 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:07.339563  4678 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:07.339941  4678 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:07.340291  4678 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:07.340565  4705 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:07.340375  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:07.342101  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.345177  4540 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:07.345252  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.345821  3832 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:07.346794  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.347385  3203 raft_consensus.cc:2376] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2. Re-sending same reply.
I20260709 13:16:07.348721  4545 consensus_queue.cc:1059] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:07.349185  4766 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:07.349912  4545 raft_consensus.cc:3055] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:07.350369  4545 raft_consensus.cc:740] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:07.351382  4545 consensus_queue.cc:260] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:07.333236  4810 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.327373  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:07.270340  4754 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:07.372509  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.340385  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:07.352815  4545 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.374596  3249 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:07.381995  3805 leader_election.cc:336] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.525s (SENT)
I20260709 13:16:07.382544  3805 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:07.352941  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:07.336979  4814 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:07.390965  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 127592us
I20260709 13:16:07.339591  4825 raft_consensus.cc:3055] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:07.389364  4741 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:07.394601  4834 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.377s	user 0.005s	sys 0.008s
I20260709 13:16:07.398983  3101 leader_election.cc:400] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4.
W20260709 13:16:07.381295  4849 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:16:07.400331  3101 leader_election.cc:400] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4.
I20260709 13:16:07.402038  3101 leader_election.cc:403] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:07.385802  4585 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:07.406353  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.382406  4847 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.391993  4826 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:07.409430  3838 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:07.407896  3100 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:07.393211  4820 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.404904  4622 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:07.408936  3841 raft_consensus.cc:2955] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:07.429924  4808 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:07.432591  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:07.433554  3835 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:07.433996  4699 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:07.435832  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.436654  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.437518  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.438414  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.439177  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.443670  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:07.412113  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:07.445504  4847 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:07.453043  4845 raft_consensus.cc:3055] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:07.398494  4825 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:07.405205  4796 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:07.461367  3209 raft_consensus.cc:2376] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2. Re-sending same reply.
I20260709 13:16:07.395447  4540 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:16:07.395296  4766 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:16:07.409363  4757 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.468670  3211 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.471673  4617 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.406255  4741 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:07.477773  3208 raft_consensus.cc:2410] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:07.409879  4754 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.473064  4827 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:16:07.486415  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 86251.6us
W20260709 13:16:07.487969  3806 leader_election.cc:336] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.677s (SENT)
I20260709 13:16:07.501543  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:07.488611  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 45591.1us
I20260709 13:16:07.405227  4618 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:16:07.458721  4826 raft_consensus.cc:697] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:07.483649  4811 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:07.502162  3208 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:07.515312  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:07.516487  3285 raft_consensus.cc:2410] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:07.519610  3805 leader_election.cc:336] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.677s (SENT)
I20260709 13:16:07.517570  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:07.525969  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 135121us
I20260709 13:16:07.489365  4845 raft_consensus.cc:740] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:07.537564  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:07.544219  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:07.525753  3832 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.525806  4811 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.536273  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.533788  4622 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:07.505131  4617 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:07.573305  4808 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.574568  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:07.575372  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:07.575991  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:07.576552  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:07.576781  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:07.577335  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:07.578222  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:07.608742  3130 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.579556  3132 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:07.580307  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:07.593722  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.553640  4527 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:07.596032  3250 leader_election.cc:336] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.524s (SENT)
W20260709 13:16:07.597997  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 67274us
I20260709 13:16:07.600487  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:07.564193  4811 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.506500  4758 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:07.618994  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:07.610822  3211 raft_consensus.cc:2410] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:07.615079  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.616223  3250 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:07.620576  3127 raft_consensus.cc:2410] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:07.621397  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:07.621984  3127 raft_consensus.cc:2376] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4. Re-sending same reply.
I20260709 13:16:07.622848  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:07.625458  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:07.623826  3129 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.601534  4826 consensus_queue.cc:237] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:07.624691  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:07.636765  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:07.597827  4622 raft_consensus.cc:697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:07.653716  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:07.654072  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:07.654443  3134 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.639461  3209 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:07.649780  3135 raft_consensus.cc:2410] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:07.689268  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:07.673764  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:07.617015  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:07.708040  3128 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:07.706287  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:07.706879  3176 connection.cc:256] RPC call timeout handler was delayed by -1.0895216520000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260709 13:16:07.689630  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:07.709653  3176 connection.cc:256] RPC call timeout handler was delayed by -1.0643216519999896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
I20260709 13:16:07.713416  3283 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:07.718248  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:07.718961  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:07.718248  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 96464.6us
I20260709 13:16:07.719823  3132 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:07.725991  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:07.726145  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:07.727202  3276 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:07.733342  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:07.740087  4855 log.cc:927] Time spent T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:16:07.711175  4841 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:07.780558  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:07.781236  3128 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:07.782243  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:07.783440  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:07.783562  4618 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:07.784212  4618 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:07.787748  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.787921  3208 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:07.743018  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:07.744190  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.608482  4845 consensus_queue.cc:260] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:07.745167  4857 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 13:16:07.746256  4858 log.cc:927] Time spent T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:07.748607  3130 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:07.749346  4622 consensus_queue.cc:237] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:07.720340  3280 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.750456  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:07.820084  3132 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:07.751329  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:07.751536  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:07.761441  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:07.762109  4758 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:07.616653  4825 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:07.763244  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.764598  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 346244us
W20260709 13:16:07.841840  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.766086  3832 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:07.841035  3276 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:07.768312  4741 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:07.769214  4847 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:07.736101  4699 raft_consensus.cc:2764] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:07.773841  3278 raft_consensus.cc:2410] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:07.774034  4617 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:07.775588  3032 catalog_manager.cc:5697] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 2, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.855651  3032 catalog_manager.cc:5697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index 2 to 3, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.651516  4527 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:07.777201  3805 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:07.857838  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 347653us
I20260709 13:16:07.858728  4527 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:07.858837  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:07.709198  4838 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:16:07.859432  3276 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:07.859549  3805 leader_election.cc:336] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.732s (SENT)
I20260709 13:16:07.649755  4808 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:07.861423  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:07.778405  4678 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:07.793191  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.867738  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.868139  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.868439  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.802783  3283 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:16:07.805718  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 87547.5us
I20260709 13:16:07.808449  3806 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:07.814013  3134 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:07.814499  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:07.815866  3209 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:07.869808  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 61485.7us
I20260709 13:16:07.841769  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:07.848784  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:07.852017  3033 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55102 (request call id 133) took 6549 ms. Trace:
I20260709 13:16:07.851909  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:07.872936  3132 raft_consensus.cc:2410] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:07.856649  4757 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4.
I20260709 13:16:07.792303  3128 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:07.862056  3277 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.817242  4814 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:07.889175  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:07.889792  3838 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.871734  3033 rpcz_store.cc:276] 0709 13:16:01.279430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.279583 (+   153us) service_pool.cc:224] Handling call
0709 13:16:07.828991 (+6549408us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:06.134719 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:06.141065 (+  6346us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:06.141151 (+    86us) write_op.cc:435] Acquired schema lock
0709 13:16:06.141196 (+    45us) tablet.cc:662] Decoding operations
0709 13:16:06.142259 (+  1063us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:06.142360 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:06.142401 (+    41us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:16:06.143201 (+   800us) tablet.cc:701] Row locks acquired
0709 13:16:06.143252 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:16:06.143457 (+   205us) write_op.cc:270] Start()
0709 13:16:06.143612 (+   155us) write_op.cc:276] Timestamp: P: 1783602966143396 usec, L: 0
0709 13:16:06.143652 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:16:06.208036 (+ 64384us) log.cc:844] Serialized 2876 byte log entry
0709 13:16:06.507490 (+299454us) op_driver.cc:464] REPLICATION: finished
0709 13:16:06.657155 (+149665us) write_op.cc:301] APPLY: starting
0709 13:16:06.657300 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:06.657601 (+   301us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:06.657812 (+   211us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:06.659040 (+  1228us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:06.659420 (+   380us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:16:06.659507 (+    87us) write_op.cc:312] APPLY: finished
0709 13:16:06.659939 (+   432us) log.cc:844] Serialized 59 byte log entry
0709 13:16:06.660177 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:06.660335 (+   158us) write_op.cc:454] Released schema lock
0709 13:16:06.660408 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:06.699222 (+ 38814us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:06.704993 (+  5771us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10371,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":149231,"apply.run_cpu_time_us":3790,"apply.run_wall_time_us":28974,"num_ops":7,"prepare.queue_time_us":204673,"prepare.run_cpu_time_us":14804,"prepare.run_wall_time_us":164009,"raft.queue_time_us":138125,"raft.run_cpu_time_us":31059,"raft.run_wall_time_us":153806,"replication_time_us":363700,"thread_start_us":458672,"threads_started":4,"wal-append.queue_time_us":113819,"wal-append.run_cpu_time_us":21185,"wal-append.run_wall_time_us":1382881}]]}
I20260709 13:16:07.861451  3127 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:07.892449  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 296443us
I20260709 13:16:07.893493  3127 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:07.877583  3032 catalog_manager.cc:5697] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 2, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.881489  4869 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:16:07.883144  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:07.895663  3284 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:07.884047  3135 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:07.884435  4845 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.884564  3133 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:07.885593  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:07.898259  3279 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.899142  3128 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:07.887048  3130 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.887255  3836 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEARNER]: Advancing to term 4
I20260709 13:16:07.903270  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:07.905614  3134 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 4. Ops: []
I20260709 13:16:07.910655  3133 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:07.913884  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:07.903517  3032 catalog_manager.cc:5697] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.915910  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:07.917055  3283 raft_consensus.cc:2410] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:07.896027  4618 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:07.879602  4825 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.868223  4847 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:07.922695  3132 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:07.922856  3032 catalog_manager.cc:5697] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 3, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 3 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.923857  3130 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
W20260709 13:16:07.903403  4810 consensus_meta.cc:287] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.550s	user 0.005s	sys 0.006s
I20260709 13:16:07.938582  3135 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:07.939036  3130 pending_rounds.cc:85] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 4
I20260709 13:16:07.940454  3032 catalog_manager.cc:5697] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 2 to 3, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 3 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:07.948383  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 57215.2us
I20260709 13:16:07.947789  3032 catalog_manager.cc:5697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 3, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 3 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.949558  3133 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:07.950963  3134 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:07.949671  3032 catalog_manager.cc:5697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 3 to 4, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 4 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.956945  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:07.956779  3032 catalog_manager.cc:5697] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 3, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 3 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.947815  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:07.920887  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:07.959472  3840 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEARNER]: Advancing to term 4
I20260709 13:16:07.959671  3842 raft_consensus.cc:2393] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:07.850553  4749 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:16:07.862051  4811 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:07.963052  4811 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:07.964427  4859 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.114s
I20260709 13:16:07.969664  4808 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:07.972831  4841 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:07.973415  4841 raft_consensus.cc:697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:07.974305  4841 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:07.974771  4678 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:07.896243  3129 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:07.913875  3203 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:16:07.953047  3250 leader_election.cc:336] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.804s (SENT)
W20260709 13:16:07.939162  4545 consensus_meta.cc:287] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.000s
I20260709 13:16:07.997375  3277 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:07.998117  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:07.992766  3032 catalog_manager.cc:5697] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 3, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 3 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.996709  3838 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:07.991811  3276 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:08.017424  3032 catalog_manager.cc:5697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 2 to 3, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 3 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.020833  3840 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEARNER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:08.021911  3283 raft_consensus.cc:2368] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5.
I20260709 13:16:07.938863  4744 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:08.029819  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:08.030102  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:07.989423  3130 pending_rounds.cc:107] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:16:08.034461  3130 raft_consensus.cc:2889] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:07.977502  4810 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3.
I20260709 13:16:08.044106  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:08.058350  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 105337us
I20260709 13:16:08.058244  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.060516  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:08.061329  3277 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:08.060943  3032 catalog_manager.cc:5697] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 3, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 3 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.982169  3280 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:08.070626  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:08.071077  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:08.071528  3283 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:16:08.078925  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 81296.1us
I20260709 13:16:08.079924  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:08.085450  3805 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:08.086723  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:08.087606  3284 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:08.088510  3032 catalog_manager.cc:5697] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 2, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.092163  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:08.092473  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:08.093443  3283 raft_consensus.cc:2410] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:08.098969  3285 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
W20260709 13:16:08.099922  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.010109  4827 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:16:08.101361  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:08.102025  3277 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:08.106092  3250 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:08.108505  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.110785  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:08.111524  3276 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:08.117219  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:08.123123  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:08.123803  3276 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
W20260709 13:16:08.123894  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 232292us
I20260709 13:16:08.124679  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:08.127170  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:08.128029  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:08.128582  3276 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:08.129974  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:08.134450  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 49096.2us
W20260709 13:16:08.138099  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 56177.2us
I20260709 13:16:08.139851  3131 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:08.141897  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:08.142742  3277 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:08.122433  4851 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:08.154567  3250 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:08.164727  3281 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:08.169528  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:08.170370  3207 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:08.175860  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:08.196682  3842 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:08.198441  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:08.204449  3277 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:08.204854  3285 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:08.207713  3285 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:08.208340  3277 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:08.210381  3277 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:08.218380  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:08.232062  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 79039.5us
W20260709 13:16:08.234068  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 86288us
I20260709 13:16:08.234265  3281 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:08.234624  3281 pending_rounds.cc:85] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 1
I20260709 13:16:08.234845  3281 pending_rounds.cc:107] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:08.235061  3281 raft_consensus.cc:2889] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:08.243417  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.250177  3127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:16:08.251485  3127 raft_consensus.cc:606] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.256196  3277 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:08.258976  3285 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:16:08.259538  3285 pending_rounds.cc:85] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 4
I20260709 13:16:08.259824  3285 pending_rounds.cc:107] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:16:08.260123  3285 raft_consensus.cc:2889] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:08.260982  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:08.141794  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:08.262526  3207 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:08.262980  3136 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:08.264719  3278 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:08.152503  4758 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.143913  4873 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:08.144646  4744 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:08.268991  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:08.269268  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:08.154033  4851 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:08.269793  3102 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:08.160372  4678 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.270569  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:08.289402  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:08.283741  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:08.285231  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 130729us
I20260709 13:16:08.245461  4699 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:08.291590  3285 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:08.293105  3278 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:08.293565  3278 pending_rounds.cc:85] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 1
I20260709 13:16:08.293924  3278 pending_rounds.cc:107] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:08.294270  3278 raft_consensus.cc:2889] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:08.289726  3207 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:08.271950  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 122355us
I20260709 13:16:08.239075  4826 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:16:08.306242  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:08.313247  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:08.324265  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:08.325251  3202 raft_consensus.cc:2410] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:08.290570  4851 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:08.327236  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 43627.9us
I20260709 13:16:08.330675  3202 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:08.292575  4766 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:08.338253  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:08.336100  3207 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:08.299180  4757 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:08.282203  4758 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:08.345908  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:08.288959  4744 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:08.298333  4678 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:08.338084  4826 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:08.338724  3203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:50254
I20260709 13:16:08.344623  4749 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:08.378180  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:08.374033  3250 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:08.342795  4545 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:16:08.392683  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:08.365590  4721 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:08.384948  4810 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:08.377238  4766 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:08.424247  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:08.349053  4757 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:08.383991  3203 raft_consensus.cc:606] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.428390  3203 raft_consensus.cc:614] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:08.429972  4757 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:08.427774  4721 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:08.384074  4890 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:08.445523  4827 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:08.445881  4890 consensus_queue.cc:1059] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.446851  4890 raft_consensus.cc:3055] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:08.447209  4890 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:08.447256  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.447551  4758 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:08.448589  3176 leader_election.cc:400] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5.
I20260709 13:16:08.448123  4890 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:08.448900  3176 leader_election.cc:403] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:08.446205  4744 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:08.450330  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 76403.5us
W20260709 13:16:08.414989  4872 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260709 13:16:08.445153  4834 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:08.462116  3250 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:08.415571  4749 raft_consensus.cc:697] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:08.417241  4862 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:08.417207  4699 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:08.485630  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:08.486137  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.454779  4810 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.449666  4585 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.480935  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.417654  4877 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:08.484645  3250 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:08.456297  4827 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:08.455367  4869 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:08.489429  4825 consensus_meta.cc:287] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
W20260709 13:16:08.496887  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 253547us
W20260709 13:16:08.492198  3279 consensus_meta.cc:287] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.573s	user 0.007s	sys 0.004s
I20260709 13:16:08.505779  3279 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:08.506729  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.487644  4890 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:08.494217  3836 consensus_meta.cc:287] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.003s
I20260709 13:16:08.483345  4744 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5.
I20260709 13:16:08.509634  3284 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:16:08.496344  4845 consensus_meta.cc:287] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
I20260709 13:16:08.512066  3282 raft_consensus.cc:2410] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:08.490267  4527 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:08.490924  4810 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:08.503851  4878 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:16:08.490312  4881 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:08.517335  3101 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.520869  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:08.523480  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:08.499063  4883 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:08.497421  4585 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:08.516988  4757 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:08.515898  4699 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:08.491689  4862 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:08.534795  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.536741  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:08.538836  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:08.525975  4864 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:08.540313  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:08.549805  3249 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:08.546415  3176 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:08.550362  3805 leader_election.cc:336] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.750s (SENT)
I20260709 13:16:08.551200  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:08.551750  4894 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:08.552225  4894 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.552608  4894 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:08.552974  4897 log.cc:927] Time spent T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:16:08.553149  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:08.553956  4893 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:16:08.554721  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:08.555495  3206 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
W20260709 13:16:08.555660  4895 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:08.556299  3206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:50254
I20260709 13:16:08.556953  3206 raft_consensus.cc:606] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.557310  3206 raft_consensus.cc:614] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:08.557646  4880 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:08.552728  4887 raft_consensus.cc:2764] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:08.558660  3206 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:08.559671  3206 raft_consensus.cc:3055] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:08.559966  3206 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:16:08.561444  4886 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:16:08.560675  3206 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:08.562150  4585 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:08.562316  3206 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.532277  3836 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEARNER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:08.569571  3211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:50254
I20260709 13:16:08.527354  4749 consensus_queue.cc:237] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:08.538134  4766 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:08.577564  4827 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:08.577870  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 159) took 1003 ms. Trace:
I20260709 13:16:08.578118  4827 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.578436  4862 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:08.530164  4869 raft_consensus.cc:2764] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:08.578588  4827 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.543056  3101 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:08.586300  3206 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:08.586954  3211 raft_consensus.cc:606] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.587407  3211 raft_consensus.cc:614] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:08.589869  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 43488.9us
I20260709 13:16:08.531391  4879 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:08.553016  4876 log.cc:927] Time spent T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:08.602255  3176 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:08.604246  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 61311.9us
I20260709 13:16:08.550033  4580 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:08.614045  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 344284us
I20260709 13:16:08.616937  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.618527  3101 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.619772  4901 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:08.619587  4758 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:08.620056  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:08.620464  4911 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:08.620945  4808 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:08.619643  4796 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:08.623447  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:08.625537  4862 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:08.579133  4678 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:08.633526  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:08.630932  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:08.633837  3102 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:08.578313  3129 rpcz_store.cc:276] 0709 13:16:07.574141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.574283 (+   142us) service_pool.cc:224] Handling call
0709 13:16:08.577693 (+1003410us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b540036abd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:08.577804 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8925568}
I20260709 13:16:08.620939  4901 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:08.598320  4540 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:08.592890  4699 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:08.592432  4887 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:08.643965  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:08.653782  4540 raft_consensus.cc:697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:08.654881  4540 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:08.635468  3832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58470 (request call id 428) took 1278 ms (client timeout 1681 ms). Trace:
I20260709 13:16:08.657233  4870 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:08.657737  4870 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.658110  4870 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:08.658540  3834 consensus_meta.cc:287] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.001s
I20260709 13:16:08.593200  4757 consensus_queue.cc:1059] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:16:08.665058  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1033) took 1084 ms. Trace:
I20260709 13:16:08.671433  3136 rpcz_store.cc:276] 0709 13:16:07.576892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.650760 (+ 73868us) service_pool.cc:224] Handling call
0709 13:16:07.651100 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.263576 (+612476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.661222 (+397646us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54003f8254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:08.661460 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406655360}
I20260709 13:16:08.641956  4811 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:08.659102  4814 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:08.661365  4885 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:08.659551  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:08.658947  3834 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
W20260709 13:16:08.693228  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.696540  3835 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:08.697567  4901 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:08.682041  4617 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:08.678247  4811 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.662809  4796 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:16:08.659289  4527 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:16:08.714623  4896 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:08.715179  4896 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.715580  4896 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:08.715471  4859 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:16:08.657431  3832 rpcz_store.cc:269] 0709 13:16:07.351744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.352651 (+   907us) service_pool.cc:224] Handling call
0709 13:16:08.605242 (+1252591us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540055f854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:08.627311 (+ 22069us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289144704}
I20260709 13:16:08.681806  4814 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.722198  4814 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:08.722803  4911 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:08.722847  4884 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:16:08.720561  3101 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.721308  4592 consensus_queue.cc:1059] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:08.728523  4592 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:08.721463  4760 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.728767  4757 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:08.729774  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 1937) took 1126 ms. Trace:
I20260709 13:16:08.730173  3282 rpcz_store.cc:276] 0709 13:16:07.603530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.607745 (+  4215us) service_pool.cc:224] Handling call
0709 13:16:07.947616 (+339871us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b5800160e98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:08.729524 (+781908us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b540022db54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:08.729691 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293943424}
I20260709 13:16:08.665297  4699 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:08.683795  4885 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.712450  4826 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.712833  4811 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:08.750207  4832 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:16:08.758885  3101 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.684844  4879 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:16:08.762044  4760 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:08.761773  4757 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:08.763572  4879 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.764619  4827 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:08.764824  3101 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:08.766726  4827 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:08.767184  4879 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:08.767724  4879 raft_consensus.cc:697] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:08.768603  4879 consensus_queue.cc:237] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:08.770308  4894 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:08.662433  4887 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:08.760397  4884 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 13:16:08.792074  4913 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.157s	user 0.000s	sys 0.002s
I20260709 13:16:08.792588  4814 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:08.757644  4885 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:08.806599  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 204424us
I20260709 13:16:08.772529  4826 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:08.802855  4760 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.805505  4618 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.805320  4592 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:08.806784  4894 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:08.824859  3805 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:08.828804  4916 consensus_queue.cc:1059] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:16:08.830112  4916 raft_consensus.cc:3055] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:08.830529  4916 raft_consensus.cc:740] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:08.831498  4916 consensus_queue.cc:260] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:08.835439  4847 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:08.815244  4859 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.839483  3129 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:08.839795  4851 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:08.862260  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:08.863240  3206 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:08.866035  3285 raft_consensus.cc:1275] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:08.868589  3276 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:08.870131  3249 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:08.874611  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.824220  4618 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:08.822504  4760 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:08.889673  3284 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:08.878069  3285 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:08.879515  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:08.881956  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:08.882759  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:08.882866  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:08.826141  4592 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:08.896730  4851 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:08.897789  4749 raft_consensus.cc:3055] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:08.918823  4749 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:08.920099  4749 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:08.921212  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.921955  3280 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:08.924111  4618 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:08.875584  4622 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:16:08.867144  4887 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:08.876549  4869 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.879854  4916 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:08.875197  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.891248  4873 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:08.933770  3837 raft_consensus.cc:2410] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:16:08.954463  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:08.972506  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 344950us
I20260709 13:16:08.981003  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:08.981853  3205 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
W20260709 13:16:08.982362  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:08.983925  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 344490us
W20260709 13:16:08.986166  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.001194  3277 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:09.001896  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:09.002329  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:09.015559  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:09.015938  3283 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:09.016305  3283 pending_rounds.cc:85] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 1
I20260709 13:16:09.016268  3207 raft_consensus.cc:2376] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4. Re-sending same reply.
I20260709 13:16:09.016700  3283 pending_rounds.cc:107] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:09.017015  3283 raft_consensus.cc:2889] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:08.875962  4859 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:08.953871  4873 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.952687  4699 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:09.018946  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:09.021379  3284 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:09.022353  3251 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:08.987488  3203 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:09.033562  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:09.038447  3280 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:16:09.039016  4859 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:09.041622  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:09.020432  4886 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:16:09.020387  4890 consensus_meta.cc:287] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.001s
W20260709 13:16:09.035323  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 401568us
I20260709 13:16:08.998510  4618 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:09.049881  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:09.050720  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:09.003072  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:09.055967  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.049144  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:09.115159  3210 raft_consensus.cc:2410] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:09.115520  3284 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:09.032032  4873 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.111896  3207 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:16:08.955040  4869 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:09.123538  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 72932.4us
I20260709 13:16:09.047024  4749 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.136868  3838 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:09.133860  3835 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:09.114130  4744 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:09.150776  3282 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:09.122375  4618 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:09.151391  3177 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
W20260709 13:16:09.134377  4889 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:09.119316  4859 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:09.177054  4618 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:09.178617  4869 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:09.126204  4918 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:09.191926  4933 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:09.192607  4933 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:09.193186  4933 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:09.197820  3279 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.058s	sys 0.115s
W20260709 13:16:09.203598  3279 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.058s	sys 0.115s
I20260709 13:16:09.189062  4869 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.142282  4811 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:09.153257  4887 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:16:09.214129  4721 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:09.222074  4935 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:16:09.211688  4869 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:09.226346  4869 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:09.227389  4869 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:09.228091  4869 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:09.239392  4618 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.190398  4859 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:09.190639  4896 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:09.228181  4811 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:09.243188  4618 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:09.247069  4592 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:09.249402  4810 consensus_meta.cc:287] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.722s	user 0.015s	sys 0.001s
I20260709 13:16:09.169544  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:09.260540  3250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.015s	sys 0.066s
W20260709 13:16:09.261212  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.262976  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 93541.1us
W20260709 13:16:09.262019  3250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.015s	sys 0.066s
I20260709 13:16:09.262203  4721 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:09.265547  4869 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:09.269274  4924 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:16:09.275924  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 634259us
W20260709 13:16:09.270156  4874 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 1.108s	user 0.005s	sys 0.000s
I20260709 13:16:09.271937  4896 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:09.280707  3127 raft_consensus.cc:1275] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:09.280959  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:09.284909  3136 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:09.288159  3100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.065s	sys 0.083s
W20260709 13:16:09.288599  3100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.065s	sys 0.083s
W20260709 13:16:09.289021  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 646040us
I20260709 13:16:09.291625  3130 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:09.291915  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:09.277493  4870 consensus_meta.cc:287] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.008s
W20260709 13:16:09.284883  3840 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.016s	sys 0.052s
W20260709 13:16:09.296624  3840 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.016s	sys 0.052s
I20260709 13:16:09.281908  4622 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.277285  4810 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:09.310674  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 264412us
I20260709 13:16:09.283772  4760 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:09.295645  4754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.027s	sys 0.044s
I20260709 13:16:09.335287  3281 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:09.306841  4870 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:09.186514  3205 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
W20260709 13:16:09.326969  4754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.028s	sys 0.044s
I20260709 13:16:09.340756  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:09.341562  3130 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.345589  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:09.315796  4622 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:09.334343  4936 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.351954  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 64226.8us
I20260709 13:16:09.359342  3209 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:09.349620  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 81969.6us
I20260709 13:16:09.350296  3278 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:09.323835  4873 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:09.345597  3129 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:09.363031  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 86303.9us
I20260709 13:16:09.365988  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:09.347302  4754 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.372865  3131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.007s	sys 0.009s
W20260709 13:16:09.383782  3131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.007s	sys 0.009s
I20260709 13:16:09.373982  3205 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:09.376616  3130 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:09.377499  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 1948) took 1514 ms. Trace:
I20260709 13:16:09.385334  3276 rpcz_store.cc:276] 0709 13:16:07.852883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.140638 (+287755us) service_pool.cc:224] Handling call
0709 13:16:08.144055 (+  3417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.869012 (+724957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.366988 (+497976us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54001775d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:09.367158 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665469312}
I20260709 13:16:09.387073  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:09.387816  3276 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:09.388947  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:09.362720  4862 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.407465  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:09.360076  4896 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:16:09.427330  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:09.431470  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:09.355444  4721 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:16:09.432561  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:09.431486  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:09.437901  3208 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:09.413019  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:09.443351  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:09.446280  3082 auto_rebalancer.cc:893] Removing replace marker failed: Replica 43b01d5a97e149008d543a6615219928 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:16:09.432359  4618 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:09.447060  3082 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:16:09.447398  3082 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:16:09.406220  4929 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:09.360309  4936 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:09.458240  3250 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:09.403605  4744 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:16:09.404245  4754 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:09.406322  4699 consensus_queue.cc:1059] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
W20260709 13:16:09.469624  4923 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:16:09.470296  4810 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:09.408521  4862 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:09.471412  4922 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:16:09.471271  4826 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:09.472271  4931 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:16:09.474072  4936 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:09.429279  4890 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:16:09.450258  4919 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:16:09.479074  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:09.439965  4724 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:16:09.505985  3208 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:09.511478  3276 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:09.452474  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:09.518304  3205 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:16:09.520413  3205 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:16:09.523370  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 185837us
I20260709 13:16:09.448019  4915 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
W20260709 13:16:09.524626  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 179136us
I20260709 13:16:09.496578  4859 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:09.509449  4766 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:09.512006  4929 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:09.548857  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 69864.5us
I20260709 13:16:09.550379  3208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:50254
I20260709 13:16:09.550617  3250 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:09.551205  3208 raft_consensus.cc:606] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:09.551859  3208 raft_consensus.cc:614] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:09.552781  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:09.556306  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:09.561048  3250 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:09.568354  3101 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:09.568722  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:09.569581  3838 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:09.535323  4887 consensus_queue.cc:1059] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:16:09.581481  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:09.554318  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:09.584970  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:09.548157  4936 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:09.565631  4810 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:09.591694  4926 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:16:09.568413  4766 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:09.566097  4622 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:09.578086  4870 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:09.611240  4948 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:09.611843  4948 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.612267  4948 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:09.612773  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 181327us
I20260709 13:16:09.613555  4949 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.614058  4949 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:09.615231  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:09.616297  4949 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:09.517416  4933 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:09.642937  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.547428  4947 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
W20260709 13:16:09.656178  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 95233.7us
I20260709 13:16:09.589495  4896 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:16:09.608381  4873 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:09.606647  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:09.687443  4952 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:09.655109  3832 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:09.697293  4862 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:09.701431  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:09.702076  3131 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:09.702800  4754 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:09.653548  4936 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:09.616899  4949 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:16:09.673795  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:09.707362  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:09.708065  3208 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:09.660185  4899 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:16:09.608865  4811 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:16:09.709661  4811 raft_consensus.cc:3055] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:09.710351  4811 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:09.711303  4811 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:09.713362  4933 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:09.713974  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:09.581184  4929 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:09.661024  3836 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:16:09.678915  4916 consensus_meta.cc:287] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.723s	user 0.006s	sys 0.006s
I20260709 13:16:09.723434  3250 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:09.719551  3208 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:09.727216  3838 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
W20260709 13:16:09.718119  4883 consensus_meta.cc:287] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 1.181s	user 0.012s	sys 0.003s
I20260709 13:16:09.712749  4811 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.734527  3102 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:09.720407  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:09.733009  3834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58470 (request call id 425) took 2390 ms (client timeout 1982 ms). Trace:
W20260709 13:16:09.746626  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 226635us
I20260709 13:16:09.746207  4883 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:09.822147  3834 rpcz_store.cc:269] 0709 13:16:07.342773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.381604 (+ 38831us) service_pool.cc:224] Handling call
0709 13:16:09.732794 (+2351190us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b5400659ad4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:09.732919 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263028480}
I20260709 13:16:09.785032  4585 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:09.841759  4926 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:09.875208  3280 raft_consensus.cc:2393] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:16:09.842038  4885 consensus_meta.cc:287] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.027s	user 0.014s	sys 0.000s
I20260709 13:16:09.868373  4948 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:09.920468  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 265454us
I20260709 13:16:09.979770  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:09.916286  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 348005us
I20260709 13:16:09.985541  3208 raft_consensus.cc:2410] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:09.986573  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:09.979607  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 256251us
I20260709 13:16:09.988300  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:09.979924  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 245502us
I20260709 13:16:09.989050  3208 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:09.990150  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:09.991467  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:09.891633  3132 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.999862  3208 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:09.992745  4760 raft_consensus.cc:1064] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:16:10.003638  4947 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:10.006892  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:09.986639  4929 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:10.016773  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:10.017627  3208 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:10.031190  3132 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:10.068852  3208 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.070611  3208 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:09.893851  4885 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:10.088750  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 81996.5us
I20260709 13:16:10.095772  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:10.009932  4947 consensus_queue.cc:1243] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer 0930e3e7657c43bcaaa5b0778f3e08cf log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:10.068272  4952 raft_consensus.cc:697] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:10.087466  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:10.121002  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.085613  3837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 317) took 1867 ms. Trace:
I20260709 13:16:10.095690  4810 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.139426  3207 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:10.012864  4618 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.096s
I20260709 13:16:10.017202  4754 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 13:16:10.099058  4961 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:10.133705  4796 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.034s	sys 0.026s
I20260709 13:16:10.017352  4940 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:16:10.123363  4966 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.126614  4926 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:16:10.163555  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.142465  4967 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:10.158630  4796 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.035s	sys 0.027s
I20260709 13:16:10.167984  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:10.157238  3280 raft_consensus.cc:2393] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:10.164546  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.164122  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:10.171398  3136 raft_consensus.cc:2376] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3. Re-sending same reply.
I20260709 13:16:10.172609  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.174387  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.142839  4948 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:10.150756  4961 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.163854  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.175822  3133 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:10.175735  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.180092  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.183295  3134 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:10.183439  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:10.184335  3130 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.190050  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:10.191076  3133 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:10.149961  4810 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:10.178619  4961 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.144493  3837 rpcz_store.cc:276] 0709 13:16:08.217795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.218003 (+   208us) service_pool.cc:224] Handling call
0709 13:16:10.018518 (+1800515us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b5400475254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:10.068121 (+ 49603us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1430358912}
I20260709 13:16:10.206223  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:10.215390  3102 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:10.166777  4966 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.234416  4966 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:10.221896  4944 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:10.222723  4949 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:10.227845  4810 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:10.207777  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.199213  4952 consensus_queue.cc:237] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.231564  4545 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:10.240465  4921 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.241024  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:10.275285  3841 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:10.275213  4921 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.242514  3832 pending_rounds.cc:85] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 4
I20260709 13:16:10.276326  3832 pending_rounds.cc:107] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:16:10.276613  3832 raft_consensus.cc:2889] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.277693  4921 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:10.246063  4885 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:10.252025  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.279134  3128 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
W20260709 13:16:10.253804  3210 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1088) took 1392 ms (client timeout 1739 ms). Trace:
I20260709 13:16:10.257959  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 898) took 1376 ms. Trace:
I20260709 13:16:10.262282  3203 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:10.252710  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:10.268325  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:10.269156  3127 raft_consensus.cc:2410] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:10.269860  3130 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:10.271893  3131 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:10.282531  3102 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:10.279729  3210 rpcz_store.cc:269] 0709 13:16:08.861268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.861401 (+   133us) service_pool.cc:224] Handling call
0709 13:16:10.253508 (+1392107us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54003741d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:10.253695 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512048640}
I20260709 13:16:10.279791  3278 rpcz_store.cc:276] 0709 13:16:08.881875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.882505 (+   630us) service_pool.cc:224] Handling call
0709 13:16:10.257704 (+1375199us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54001e9454. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:10.257872 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049733760}
I20260709 13:16:10.288902  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 153) took 1267 ms. Trace:
I20260709 13:16:10.289439  3278 rpcz_store.cc:276] 0709 13:16:09.021994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.288045 (+1266051us) service_pool.cc:224] Handling call
0709 13:16:10.288389 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.288578 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.288600 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.288642 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:10.288673 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.288738 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.288845 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.283905  3203 pending_rounds.cc:85] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 1
I20260709 13:16:10.296372  3278 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:10.300271  4969 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:10.292520  3129 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:10.293011  4879 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:10.314844  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 91678.9us
I20260709 13:16:10.302930  3203 pending_rounds.cc:107] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:10.319689  3249 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:10.323897  3278 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:10.310096  4969 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.288354  4545 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.327943  4921 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.328140  4810 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:10.328634  4810 raft_consensus.cc:697] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:10.328511  4921 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:10.329898  3129 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:10.330641  4921 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:10.331162  4921 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.331617  4921 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:10.333621  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.334950  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.335573  3133 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:10.336977  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.336998  4981 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:10.339071  4921 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:10.339943  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.337922  3130 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:10.338775  4981 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.341743  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1085) took 1484 ms. Trace:
I20260709 13:16:10.342264  3249 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:10.342124  3204 rpcz_store.cc:276] 0709 13:16:08.857498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.857657 (+   159us) service_pool.cc:224] Handling call
0709 13:16:08.888512 (+ 30855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.902132 (+ 13620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.902163 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.902657 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:16:10.229830 (+1327173us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b180007b2e0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:16:10.341297 (+111467us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:10.341341 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.341411 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.341453 (+    42us) raft_consensus.cc:1685] finished
0709 13:16:10.341463 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.341649 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":593,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":24190,"spinlock_wait_cycles":7677312,"thread_start_us":111295,"threads_started":1,"wal-append.queue_time_us":1402023}
I20260709 13:16:10.343895  4678 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:10.344326  4678 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.316772  4879 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:10.345517  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.346385  3278 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:10.318070  3203 raft_consensus.cc:2889] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.348918  3131 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:10.321915  4967 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:10.284396  4944 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.315421  4758 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:16:10.347097  4678 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.322505  4940 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:16:10.345340  4969 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:10.350726  4879 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.383003  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.383891  3128 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:16:10.385061  3135 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:10.385521  4968 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.402s	user 0.004s	sys 0.000s
I20260709 13:16:10.387087  3211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 1996) took 1032 ms. Trace:
I20260709 13:16:10.387439  3211 rpcz_store.cc:276] 0709 13:16:09.354770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.474953 (+120183us) service_pool.cc:224] Handling call
0709 13:16:09.475433 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.475929 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.475957 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.476599 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.915379 (+438780us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:09.915436 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.915536 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.322946 (+407410us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:10.386772 (+ 63826us) raft_consensus.cc:1685] finished
0709 13:16:10.386802 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.387022 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5261,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4813,"spinlock_wait_cycles":32755456,"thread_start_us":379172,"threads_started":1,"wal-append.queue_time_us":470366}
I20260709 13:16:10.388190  4760 consensus_queue.cc:237] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.380697  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:10.390211  4545 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:10.357780  4825 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:16:10.396348  3835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 285) took 1111 ms. Trace:
I20260709 13:16:10.380189  4810 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:10.398243  4678 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.401527  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:10.402696  3133 raft_consensus.cc:2376] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4. Re-sending same reply.
I20260709 13:16:10.396922  3835 rpcz_store.cc:276] 0709 13:16:09.284605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.287137 (+  2532us) service_pool.cc:224] Handling call
0709 13:16:09.316097 (+ 28960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.439807 (+123710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.445458 (+  5651us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.513104 (+ 67646us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.705559 (+192455us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:09.720122 (+ 14563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.395700 (+675578us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b5400000d54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:10.395775 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.395846 (+    71us) raft_consensus.cc:1685] finished
0709 13:16:10.395871 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.396177 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1345,"raft.queue_time_us":10710,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":8995,"spinlock_wait_cycles":121663360,"thread_start_us":151705,"threads_started":1,"wal-append.queue_time_us":209274}
W20260709 13:16:10.426450  3282 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 897) took 1544 ms (client timeout 1995 ms). Trace:
W20260709 13:16:10.427294  3282 rpcz_store.cc:269] 0709 13:16:08.881565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.881700 (+   135us) service_pool.cc:224] Handling call
0709 13:16:10.412866 (+1531166us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54001e00d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:10.426366 (+ 13500us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591646976}
W20260709 13:16:10.429536  4979 log.cc:927] Time spent T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:16:10.430085  3250 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:10.379505  4981 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:10.433876  3250 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:10.358345  4967 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.442974  4967 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:10.442859  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:10.444271  4980 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:10.450462  4981 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:10.394639  4983 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:16:10.457113  3833 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:16:10.475816  3250 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:10.453881  4940 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:16:10.464344  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:10.480005  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:10.474663  4991 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.484638  4944 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:10.491081  3102 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:10.496991  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:10.500520  4944 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.501288  4944 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.501680  4811 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:10.502197  4811 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:10.502648  4811 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.505586  3250 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:10.484529  4540 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:10.499266  4986 log.cc:927] Time spent T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:16:10.485428  4921 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:10.501794  4944 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:10.511389  4961 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:10.513221  3281 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 899) took 1631 ms (client timeout 1501 ms). Trace:
I20260709 13:16:10.519234  3806 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:10.519919  3250 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:10.521548  3281 rpcz_store.cc:269] 0709 13:16:08.882198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.882359 (+   161us) service_pool.cc:224] Handling call
0709 13:16:10.512967 (+1630608us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54004358d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:10.513156 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010374016}
I20260709 13:16:10.526474  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 1977) took 1535 ms. Trace:
I20260709 13:16:10.489563  4991 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.527482  4944 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:10.500917  4969 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.526907  3277 rpcz_store.cc:276] 0709 13:16:08.991538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.020332 (+ 28794us) service_pool.cc:224] Handling call
0709 13:16:09.035104 (+ 14772us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.373748 (+338644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.373792 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.247518 (+873726us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b2c00138fe8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:16:10.248044 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:16:10.317204 (+ 69160us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:10.317264 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.317370 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.526135 (+208765us) raft_consensus.cc:1685] finished
0709 13:16:10.526161 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.526406 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10599,"raft.queue_time_us":205709,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":3466,"spinlock_wait_cycles":13436800,"thread_start_us":396131,"threads_started":2,"wal-append.queue_time_us":126604}
I20260709 13:16:10.528851  4991 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:10.530047  4969 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:10.519079  4825 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:10.534242  3136 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 4: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:10.535362  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:10.536558  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:10.537228  3834 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:10.537438  4961 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:10.532617  4921 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.520316  4980 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:16:10.533876  4825 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.547015  4996 consensus_queue.cc:1059] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:16:10.549023  4545 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:10.553871  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:10.545516  4991 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:10.559859  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2010) took 1123 ms. Trace:
W20260709 13:16:10.561739  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 1.01611e+06us
I20260709 13:16:10.560190  3205 rpcz_store.cc:276] 0709 13:16:09.435985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.524956 (+ 88971us) service_pool.cc:224] Handling call
0709 13:16:09.525367 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.525566 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:09.544601 (+ 19035us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.544941 (+   340us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.559471 (+1014530us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.559529 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:10.559597 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.559672 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.559808 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1010366,"prepare.queue_time_us":59263,"prepare.run_cpu_time_us":148,"prepare.run_wall_time_us":10364}
I20260709 13:16:10.567993  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:10.568073  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:10.570924  3282 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.557963  4545 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.550797  4879 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.553865  4825 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:10.555953  4540 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:10.560909  4810 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:10.535161  4944 consensus_queue.cc:1059] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:16:10.581691  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:10.583930  3249 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:10.585090  3278 raft_consensus.cc:2368] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4.
I20260709 13:16:10.561591  4991 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:10.578502  4724 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:10.591323  4724 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:10.592090  4933 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.592679  4933 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:10.593345  4545 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:10.594605  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:10.595031  4933 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:10.581499  4540 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.598464  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:10.603157  3204 raft_consensus.cc:3055] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:10.603307  3206 raft_consensus.cc:2410] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:16:10.588187  4869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.000s	sys 0.025s
I20260709 13:16:10.595572  4980 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.575765  4699 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:16:10.593788  4724 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:10.585100  4810 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:10.605728  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:10.606398  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:10.603585  3204 raft_consensus.cc:740] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:10.590390  4991 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.588938  4877 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:10.595799  4721 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:10.611307  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 1995) took 1256 ms. Trace:
I20260709 13:16:10.604310  4540 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:10.614516  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:10.616640  3204 consensus_queue.cc:260] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:10.605839  4869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.000s	sys 0.025s
I20260709 13:16:10.604723  4885 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.585391  4978 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.622644  3204 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.615506  3202 rpcz_store.cc:276] 0709 13:16:09.354516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.468228 (+113712us) service_pool.cc:224] Handling call
0709 13:16:09.468701 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.469006 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:09.511950 (+ 42944us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.519630 (+  7680us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.512215 (+992585us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b1800405280. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b9102557 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:16:10.550848 (+ 38633us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b1800405280. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b907cc0a 00007fb3c27bc219 00007fb3b9104a40 00007fb3b90ff4e4 00007fb3b90ff455 00007fb3bc1e7060 00007fb3bc1f9716 00007fb3bc20a287 00007fb3bc20a208
0709 13:16:10.610987 (+ 60139us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.611038 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:10.611075 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.611142 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.611253 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1020055,"prepare.queue_time_us":1026294,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":10899,"raft.queue_time_us":1042124,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":11903,"spinlock_wait_cycles":36480384,"thread_start_us":59890,"threads_started":1}
I20260709 13:16:10.628317  3282 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:10.630085  3210 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:10.614692  4810 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:10.614074  4933 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.638765  4879 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:10.656019  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.618438  4890 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:10.682660  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 163516us
I20260709 13:16:10.684422  5009 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:10.685307  4699 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.685585  3204 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:10.686024  3204 pending_rounds.cc:85] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 1
I20260709 13:16:10.686334  3204 pending_rounds.cc:107] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:10.686623  3204 raft_consensus.cc:2889] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.686087  4699 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.622167  4724 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:10.685011  5009 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.680038  4879 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:10.611985  4811 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.699831  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:10.701658  3841 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:10.621645  4721 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:10.627353  4885 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:10.687868  4969 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.680850  4933 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:10.717558  5001 log.cc:927] Time spent T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:16:10.700337  4901 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:10.703729  4760 consensus_queue.cc:1059] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:16:10.697980  4890 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.703889  4926 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:16:10.618182  4877 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.706523  4879 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.706233  4724 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.719653  4969 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:10.750145  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.750742  4890 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:10.751147  4885 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:10.726482  4814 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:10.744599  5002 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:16:10.743834  4699 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:10.826758  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 936) took 1513 ms. Trace:
I20260709 13:16:10.751366  4890 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.825222  4969 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:10.827170  3132 rpcz_store.cc:276] 0709 13:16:09.280877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.281136 (+   259us) service_pool.cc:224] Handling call
0709 13:16:10.794231 (+1513095us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b5400074c54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:10.794373 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1377348352}
I20260709 13:16:10.723912  4901 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:10.851428  4933 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:10.836902  4985 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:10.878506  5008 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:16:10.850885  4885 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.763415  4721 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:10.858223  4877 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:10.941541  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:11.010594  3841 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.020342  5012 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:11.021051  5012 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:11.021371  4699 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:11.022173  4699 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:11.023727  5012 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:11.024531  5012 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:11.025650  5012 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:11.028343  5012 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:11.030558  4699 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:10.881610  5003 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:10.833911  4724 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:10.882757  5009 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:11.006984  4814 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:10.890892  4811 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:11.000731  4933 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:10.850239  4890 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:11.083465  4879 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:11.084167  3833 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:11.058000  4985 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:11.112424  3127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.062s	sys 0.112s
W20260709 13:16:11.116982  3127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.062s	sys 0.114s
W20260709 13:16:11.116411  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 233594us
I20260709 13:16:11.060091  4540 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.069298  5003 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.010097  4885 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.109839  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:11.089097  4814 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.124464  3177 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:11.122493  3841 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
W20260709 13:16:11.126348  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.096871  4933 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.122208  4916 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:11.121816  5014 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:11.132481  3837 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:16:11.127262  5012 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:11.115336  4810 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.146703  4916 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:11.170001  5011 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:11.140257  4699 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:11.173962  4699 raft_consensus.cc:697] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:11.175582  4890 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:11.139356  3834 consensus_meta.cc:287] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.005s
I20260709 13:16:11.130369  4721 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:16:11.131264  4877 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:16:11.175503  4699 consensus_queue.cc:237] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.186164  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:11.180465  5012 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:11.201710  4814 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:11.203171  5012 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:11.178318  5021 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
W20260709 13:16:11.204071  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.205617  4810 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:11.208222  4969 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.208675  4969 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:11.210342  4969 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.179124  4901 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:11.181988  3834 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:11.210969  5006 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 13:16:11.223433  4825 consensus_meta.cc:287] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.004s
I20260709 13:16:11.225674  5003 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:11.226267  4885 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:11.207285  4916 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:11.235131  3102 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:11.238581  4991 consensus_meta.cc:287] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.617s	user 0.006s	sys 0.006s
I20260709 13:16:11.223884  4825 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.239060  4991 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.243897  4870 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.244732  4879 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:11.245692  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:11.246989  3285 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:11.179270  5014 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:11.251387  3209 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.258134  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:11.259061  3285 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:11.262835  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.264142  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.266136  3278 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:11.276989  3209 raft_consensus.cc:2410] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:16:11.279120  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 152887us
I20260709 13:16:11.279940  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:11.282140  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:11.283542  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.284230  3278 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:16:11.288033  4887 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:11.288578  4887 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:11.289501  4887 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:11.256390  4870 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:11.292101  4825 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:11.290990  3285 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:11.293697  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.264102  5009 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:11.295096  4870 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:11.295545  3203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 1993) took 1941 ms. Trace:
I20260709 13:16:11.295179  5009 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.295948  3203 rpcz_store.cc:276] 0709 13:16:09.353939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.359089 (+  5150us) service_pool.cc:224] Handling call
0709 13:16:10.261688 (+902599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.355766 (+ 94078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.295328 (+939562us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b54003741d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:11.295487 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2015502080}
I20260709 13:16:11.297611  4916 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:11.284936  3209 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 2006) took 1919 ms (client timeout 1592 ms). Trace:
I20260709 13:16:11.261715  4879 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:11.294423  3285 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
W20260709 13:16:11.298128  3209 rpcz_store.cc:269] 0709 13:16:09.365956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.382744 (+ 16788us) service_pool.cc:224] Handling call
0709 13:16:11.245527 (+1862783us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b5800102f98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:11.284866 (+ 39339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15045376}
I20260709 13:16:11.301489  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:11.302388  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.303556  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:11.305665  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:11.307399  5015 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:16:11.302610  3211 raft_consensus.cc:2410] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:11.308048  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.309124  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.309656  3285 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:11.310407  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.311347  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:11.313910  5019 log.cc:927] Time spent T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:16:11.301788  4885 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:11.282533  4540 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:11.342377  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.344223  3806 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:11.410897  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 66786.3us
I20260709 13:16:11.411588  3806 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:11.386674  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:11.321832  3127 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:11.414750  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:11.323539  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:11.415884  3134 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:11.416736  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:11.417313  3134 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:11.322537  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:11.418435  3130 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:11.418723  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:11.419251  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:11.420689  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:11.431142  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:11.433846  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:11.434043  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:11.370384  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:11.436055  3132 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:11.441399  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:11.442473  3134 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:11.444013  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:11.297654  5009 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:11.342051  5021 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:11.319981  4933 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:11.345275  4985 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:11.449615  3130 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:11.393433  4724 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:11.450299  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:11.401895  4991 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:11.432934  4921 consensus_meta.cc:287] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.878s	user 0.003s	sys 0.012s
I20260709 13:16:11.456974  5014 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:11.370234  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:11.446529  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:11.459625  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:11.460795  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:11.432960  5003 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:11.429317  4993 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:11.317914  4916 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:11.463335  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:11.383417  4545 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:16:11.304283  5026 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.159s
I20260709 13:16:11.446195  4885 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:11.472141  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.468724  5021 raft_consensus.cc:697] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:16:11.551014  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 140667us
I20260709 13:16:11.472661  4921 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:11.554929  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 91685.9us
I20260709 13:16:11.563730  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:11.555387  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.565059  3282 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:11.471992  5003 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:11.481536  4993 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.468643  4724 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:11.448920  4879 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.569365  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.544860  4933 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:11.556195  4962 log.cc:927] Time spent T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 1.409s	user 0.010s	sys 0.006s
W20260709 13:16:11.567421  3805 leader_election.cc:336] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.548s (SENT)
I20260709 13:16:11.588555  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 1981) took 2564 ms. Trace:
I20260709 13:16:11.573117  3251 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:11.573634  3249 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:11.581787  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:11.589310  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.563097  4870 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:11.568449  4540 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:11.591209  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.622285  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:11.632097  3277 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:16:11.624563  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 51556.9us
I20260709 13:16:11.562351  4885 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.646780  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:11.638160  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 64612.4us
W20260709 13:16:11.650147  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.625133  3176 leader_election.cc:400] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4.
I20260709 13:16:11.649842  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.572419  5014 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.654260  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:11.571126  5003 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.571070  4993 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.621963  3284 rpcz_store.cc:276] 0709 13:16:09.006146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.116346 (+110200us) service_pool.cc:224] Handling call
0709 13:16:10.425460 (+1309114us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.432786 (+  7326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.432835 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.433530 (+   695us) log.cc:844] Serialized 26 byte log entry
0709 13:16:10.574499 (+140969us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:10.584358 (+  9859us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.584564 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.584634 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.749025 (+164391us) raft_consensus.cc:1685] finished
0709 13:16:10.749052 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.570644 (+821592us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54001e00d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:11.570773 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7911,"prepare.queue_time_us":8221,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":6293,"raft.queue_time_us":12202,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":9223,"spinlock_wait_cycles":2964546944,"thread_start_us":121328,"threads_started":1,"wal-append.queue_time_us":178178}
I20260709 13:16:11.592425  5035 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:11.632285  4826 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:11.573187  5009 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:11.647589  4754 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:11.592233  4991 raft_consensus.cc:3055] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:11.591580  4894 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:16:11.704100  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.648012  4921 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:11.623339  4699 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:16:11.632071  4933 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:11.693814  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 126408us
I20260709 13:16:11.694437  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.709275  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 1982) took 2702 ms. Trace:
I20260709 13:16:11.714049  3284 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:11.688627  4545 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:11.712510  3279 rpcz_store.cc:276] 0709 13:16:09.006470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.557940 (+551470us) service_pool.cc:224] Handling call
0709 13:16:09.579117 (+ 21177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.579563 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.579618 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.580190 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.869593 (+289403us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:09.869656 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.869755 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:11.387217 (+1517462us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:11.698929 (+311712us) raft_consensus.cc:1685] finished
0709 13:16:11.698962 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.709174 (+ 10212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2355,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":9316,"spinlock_wait_cycles":45618048,"thread_start_us":264654,"threads_started":1,"wal-append.queue_time_us":502717}
W20260709 13:16:11.743804  3805 connection.cc:256] RPC call timeout handler was delayed by -1.914154205000159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 13:16:11.744587  3805 connection.cc:256] RPC call timeout handler was delayed by -1.8709730890000174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
I20260709 13:16:11.656263  4969 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.693609  5034 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:11.701439  4991 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:11.661298  4540 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:11.746671  5006 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.879238  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.882625  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.702894  5009 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.713455  4921 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:11.892184  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:11.754742  4964 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:11.899312  3133 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:11.690861  5035 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.895923  4699 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:11.884466  4580 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:11.897118  5031 log.cc:927] Time spent T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
W20260709 13:16:11.897403  5028 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:16:11.897680  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:11.898324  5040 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 13:16:11.755859  5034 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:11.901615  5033 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 13:16:11.903539  5035 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:11.904333  4933 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:11.905313  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:11.906096  4540 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:11.907405  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:11.913692  3131 raft_consensus.cc:2393] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 4: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:11.917654  4956 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:11.920075  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:11.698951  5021 consensus_queue.cc:237] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:11.888813  4757 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:11.934223  5030 log.cc:927] Time spent T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.220s	user 0.002s	sys 0.000s
I20260709 13:16:11.915009  4580 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:11.923748  5032 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 13:16:11.923070  4949 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:11.959501  3206 raft_consensus.cc:2410] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:11.907757  4985 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:11.883035  5006 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.925619  4916 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:11.973315  3208 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:16:11.953339  5039 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:16:11.930078  5034 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.906773  4991 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:11.978441  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 324256us
W20260709 13:16:11.965334  5029 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:16:11.953297  4862 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:11.996196  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:11.997292  3805 connection.cc:256] RPC call timeout handler was delayed by -1.1386047680000502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
I20260709 13:16:11.909818  4964 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:12.026540  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:12.027751  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:12.028313  3281 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:16:12.028846  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:12.029405  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:12.030009  3134 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:12.030287  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:12.031203  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:12.031287  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:12.033879  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:12.034471  3841 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:12.035748  4964 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:12.036401  4964 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:12.036480  5038 log.cc:927] Time spent T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:12.026868  4862 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:12.039320  4862 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:12.039811  4862 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:12.040309  4862 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:12.041436  5050 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.042115  5050 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:12.036933  4964 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:12.046403  4964 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:12.048645  4862 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:12.050254  4580 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:12.051750  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:12.052942  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:12.053709  3285 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:12.054987  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:12.055018  3281 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:12.059427  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:12.061172  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:12.062774  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:11.975435  4757 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:12.070962  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:12.072073  3135 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:12.072788  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:12.073597  3841 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:12.065939  3285 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:12.068897  3281 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:12.069541  3806 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.692s (SENT) [suppressed 17 similar messages]
I20260709 13:16:12.076174  4862 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:12.080377  4862 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:12.080775  4757 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:12.082444  4862 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:12.082998  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:12.086300  4977 raft_consensus.cc:3055] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:12.086727  4977 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:12.087306  4994 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 1.444s	user 0.004s	sys 0.000s
I20260709 13:16:12.087548  4977 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:12.088579  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 1984) took 3067 ms. Trace:
I20260709 13:16:12.088930  3276 rpcz_store.cc:276] 0709 13:16:09.021241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.228257 (+1207016us) service_pool.cc:224] Handling call
0709 13:16:10.228617 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.356621 (+128004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.356658 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.357048 (+   390us) log.cc:844] Serialized 26 byte log entry
0709 13:16:10.428740 (+ 71692us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:10.428776 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.428844 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:11.918781 (+1489937us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:12.088327 (+169546us) raft_consensus.cc:1685] finished
0709 13:16:12.088348 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.088526 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34200,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":183,"spinlock_wait_cycles":5908736,"thread_start_us":178040,"threads_started":2,"wal-append.queue_time_us":84478}
I20260709 13:16:12.091259  3276 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:12.088804  4977 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:12.059162  4991 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:12.054227  5050 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:12.111701  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 1978) took 3106 ms. Trace:
I20260709 13:16:12.112206  3283 rpcz_store.cc:276] 0709 13:16:09.005136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.037125 (+ 31989us) service_pool.cc:224] Handling call
0709 13:16:09.044236 (+  7111us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:09.349420 (+305184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.349449 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:11.405276 (+2055827us) spinlock_profiling.cc:243] Waited 7.67 ms on lock 0x7b2c00138fe8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:16:11.422818 (+ 17542us) log.cc:844] Serialized 52 byte log entry
0709 13:16:11.590973 (+168155us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:11.886361 (+295388us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.908060 (+ 21699us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.908275 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.908380 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.111452 (+203072us) raft_consensus.cc:1685] finished
0709 13:16:12.111476 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.111634 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13812,"prepare.queue_time_us":98860,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":224679,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":27311,"spinlock_wait_cycles":38263552,"thread_start_us":617979,"threads_started":3,"wal-append.queue_time_us":304138}
I20260709 13:16:12.115056  3841 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:12.115401  4921 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:12.060233  4724 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:12.061053  4580 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:11.991415  4985 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:11.985713  4956 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:12.187227  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:12.188220  3841 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
W20260709 13:16:12.148682  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.984607  4949 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:12.175092  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:12.116349  4699 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:12.240466  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:12.242178  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:12.463544  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 393985us
I20260709 13:16:12.272528  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:12.274899  3805 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:12.870240  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:12.877818  3840 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
W20260709 13:16:12.613832  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.243332  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:12.883925  3281 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.008s	sys 0.004s
W20260709 13:16:12.884400  3281 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.008s	sys 0.004s
I20260709 13:16:12.887259  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:12.894345  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:12.899677  3207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 1994) took 3531 ms. Trace:
I20260709 13:16:12.901042  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:12.902004  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:12.902154  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:12.903344  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:12.832019  5003 consensus_meta.cc:287] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 1.142s	user 0.011s	sys 0.000s
I20260709 13:16:12.133054  4885 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:12.579499  4879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.005s	sys 0.007s
W20260709 13:16:12.282377  5014 consensus_meta.cc:287] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.000s
I20260709 13:16:12.908118  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:12.909873  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:12.900347  3207 rpcz_store.cc:276] 0709 13:16:09.354219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.356286 (+  2067us) service_pool.cc:224] Handling call
0709 13:16:09.369203 (+ 12917us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.144796 (+775593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.885344 (+2740548us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54003ca5d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:12.885607 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742544128}
W20260709 13:16:12.911517  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 636654us
I20260709 13:16:12.908568  3102 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:12.262380  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:12.872880  4969 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:12.454149  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:12.877899  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:12.703068  5006 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:12.302966  4949 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:12.945254  5006 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:12.222015  5009 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:12.945758  5034 consensus_meta.cc:287] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.949s	user 0.011s	sys 0.000s
I20260709 13:16:12.946322  5009 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.946575  5034 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:12.946820  5009 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:12.948675  5034 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:12.916231  5014 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:12.949292  3210 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:12.949710  5014 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:12.917348  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:12.950153  5014 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:12.950604  5014 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:12.951234  5009 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:12.951850  5009 raft_consensus.cc:2764] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:16:12.279131  4699 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:12.919320  5045 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:12.957091  5045 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:12.960702  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:12.961552  3211 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:12.917954  3805 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:12.919526  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:12.912611  4879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.007s	sys 0.019s
I20260709 13:16:12.938338  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:12.918083  4810 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.189302  4580 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:12.939263  3206 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:12.941490  5065 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:12.917997  4754 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:12.943112  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:12.918237  4825 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:12.971457  3835 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:12.980990  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:12.981292  4580 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:12.978318  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:12.982000  4885 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:12.982151  3840 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:12.982573  3211 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:12.982887  4810 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:16:12.984002  4991 consensus_meta.cc:287] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.855s	user 0.010s	sys 0.000s
I20260709 13:16:12.985539  4825 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:12.939877  4916 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:12.986611  4916 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:12.987012  4916 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.987643  4825 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:12.917475  4993 consensus_meta.cc:287] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 1.224s	user 0.013s	sys 0.000s
I20260709 13:16:12.988586  4993 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:12.988646  5014 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:12.950579  3208 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:12.829849  4985 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:12.974655  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 56794.9us
I20260709 13:16:12.981694  3835 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:12.990921  4993 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:12.991259  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2028) took 1099 ms. Trace:
I20260709 13:16:12.991784  3838 raft_consensus.cc:2368] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5.
I20260709 13:16:12.991641  3205 rpcz_store.cc:276] 0709 13:16:11.891442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.891546 (+   104us) service_pool.cc:224] Handling call
0709 13:16:11.898484 (+  6938us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.978980 (+ 80496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.979026 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:11.979626 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 13:16:12.159407 (+179781us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:12.159468 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.159725 (+   257us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.991056 (+831331us) raft_consensus.cc:1685] finished
0709 13:16:12.991078 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.991203 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9514,"raft.queue_time_us":69657,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7814,"thread_start_us":201304,"threads_started":2,"wal-append.queue_time_us":965544}
I20260709 13:16:12.976789  5065 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:12.993779  5065 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:12.993928  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:12.994623  3838 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:12.998111  3835 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:12.999797  3805 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:13.000519  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:13.000921  4810 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:13.001557  5009 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:13.001468  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:12.941524  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:12.945650  5006 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:12.979353  4754 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.006484  3837 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:13.006634  5006 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.009491  4754 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:13.004525  3841 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:13.013550  3838 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:12.906337  5003 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:13.014648  3840 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:13.015726  5009 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:16:12.982900  4977 consensus_meta.cc:287] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.866s	user 0.012s	sys 0.000s
I20260709 13:16:13.113991  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 962) took 1080 ms. Trace:
I20260709 13:16:13.154911  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2004) took 1854 ms. Trace:
I20260709 13:16:13.154112  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2001) took 1874 ms. Trace:
I20260709 13:16:13.109957  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 946) took 1787 ms. Trace:
W20260709 13:16:13.160962  3250 connection.cc:256] RPC call timeout handler was delayed by -1.2840064770000481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260709 13:16:13.099999  3806 leader_election.cc:336] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.232s (SENT)
I20260709 13:16:13.185146  4859 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.185246  4996 raft_consensus.cc:3055] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:13.184479  4961 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:16:13.158497  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 255426us
I20260709 13:16:13.077924  3838 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:13.016258  5064 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:13.183573  3840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58470 (request call id 456) took 1053 ms. Trace:
I20260709 13:16:13.015872  3203 raft_consensus.cc:2410] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:16:13.202584  3136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1053) took 3036 ms (client timeout 2066 ms). Trace:
I20260709 13:16:13.200981  4940 raft_consensus.cc:3055] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:13.186820  3133 rpcz_store.cc:276] 0709 13:16:11.320122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.322719 (+  2597us) service_pool.cc:224] Handling call
0709 13:16:11.323044 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.904719 (+581675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.106972 (+1202253us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b540032e6d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:13.107252 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313851264}
I20260709 13:16:13.217759  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:13.122061  5065 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:13.199147  3250 connection.cc:256] RPC call timeout handler was delayed by -1.1643064770000819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 13:16:13.222035  3250 connection.cc:256] RPC call timeout handler was delayed by -1.0098969279999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260709 13:16:13.147293  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:13.210469  4996 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:13.220844  4940 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:13.226845  4832 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:13.227412  4832 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.227576  4996 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.227712  4940 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.228521  4996 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.229568  4832 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:13.185952  4760 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.074863  3837 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:13.241012  3207 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:13.200450  5003 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:13.211046  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:13.212392  4859 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:13.138538  5036 log.cc:927] Time spent T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.437s	user 0.006s	sys 0.009s
I20260709 13:16:13.266052  5003 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.267491  4859 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:13.267809  4870 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.243261  4760 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.213024  3130 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:13.270983  4760 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:13.271304  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 959) took 1856 ms. Trace:
I20260709 13:16:13.017012  4916 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.271898  3130 rpcz_store.cc:276] 0709 13:16:11.415165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.458437 (+ 43272us) service_pool.cc:224] Handling call
0709 13:16:13.212733 (+1754296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:13.269496 (+ 56763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.271007 (+  1511us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54003b7ed0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:13.271149 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4012819840}
I20260709 13:16:13.273659  4916 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:13.275213  3282 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:16:13.217382  3136 rpcz_store.cc:269] 0709 13:16:10.165943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.174094 (+  8151us) service_pool.cc:224] Handling call
0709 13:16:13.202294 (+3028200us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54003b7ed4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:13.202480 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825763200}
I20260709 13:16:13.186655  3281 rpcz_store.cc:276] 0709 13:16:11.279795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.077906 (+798111us) service_pool.cc:224] Handling call
0709 13:16:12.078323 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:12.098473 (+ 20150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:12.098530 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:12.099076 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:16:12.884922 (+785846us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:13.153547 (+268625us) log.cc:844] Serialized 14 byte log entry
0709 13:16:13.153775 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.153852 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.153894 (+    42us) raft_consensus.cc:1685] finished
0709 13:16:13.153907 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.154047 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":774384,"prepare.queue_time_us":184318,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":22994,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":207,"thread_start_us":935819,"threads_started":2,"wal-append.queue_time_us":877865}
I20260709 13:16:13.186066  3132 rpcz_store.cc:276] 0709 13:16:12.028787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.028886 (+    99us) service_pool.cc:224] Handling call
0709 13:16:12.029210 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:12.176132 (+146922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:12.176181 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:12.176808 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:16:12.520432 (+343624us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:12.520487 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.520589 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.108503 (+587914us) raft_consensus.cc:1685] finished
0709 13:16:13.108533 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.109205 (+   672us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19819,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":489563,"threads_started":2,"wal-append.queue_time_us":824603}
I20260709 13:16:13.211745  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:13.277720  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 66080.8us
I20260709 13:16:13.278625  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:13.280098  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:13.283663  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:13.284281  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:13.022135  5053 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.148051  4678 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:13.212569  3840 rpcz_store.cc:276] 0709 13:16:12.130523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.977965 (+847442us) service_pool.cc:224] Handling call
0709 13:16:13.183489 (+205524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:13.199254  5070 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.226634  4864 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.200280  5066 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:13.231133  4721 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:13.106942  5014 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:13.214962  3836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 331) took 3020 ms. Trace:
I20260709 13:16:13.228866  4940 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.026302  5045 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:13.216372  5064 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.186501  3276 rpcz_store.cc:276] 0709 13:16:11.300443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.091984 (+791541us) service_pool.cc:224] Handling call
0709 13:16:12.092315 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.092501 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:12.092822 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 13:16:13.154395 (+1061573us) log.cc:844] Serialized 14 byte log entry
0709 13:16:13.154598 (+   203us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:13.154643 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:13.154690 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.154755 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.154862 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":357873,"prepare.queue_time_us":133787,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":70,"raft.queue_time_us":359346,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":168,"thread_start_us":702828,"threads_started":2,"wal-append.queue_time_us":912701}
W20260709 13:16:13.352136  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 45638us
I20260709 13:16:13.246377  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 931) took 1214 ms. Trace:
I20260709 13:16:13.246582  4810 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:13.253973  3131 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 169) took 2873 ms (client timeout 1692 ms). Trace:
I20260709 13:16:13.221397  4961 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:13.257300  5009 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:13.222749  4699 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:13.259249  4580 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:13.265573  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 165630us
I20260709 13:16:13.286115  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:13.293565  4832 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:13.294056  4766 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:13.294086  5003 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:13.294957  5067 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:13.295428  4915 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:13.268563  4870 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.351073  4741 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:16:13.378835  4870 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:13.237164  3832 raft_consensus.cc:2376] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4. Re-sending same reply.
I20260709 13:16:13.379547  3832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58470 (request call id 442) took 1354 ms. Trace:
I20260709 13:16:13.379920  3832 rpcz_store.cc:276] 0709 13:16:12.024973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.027289 (+  2316us) service_pool.cc:224] Handling call
0709 13:16:13.147078 (+1119789us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:13.379483 (+232405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4728576}
W20260709 13:16:13.297886  3841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58470 (request call id 455) took 1167 ms (client timeout 1506 ms). Trace:
W20260709 13:16:13.381769  3841 rpcz_store.cc:269] 0709 13:16:12.130236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.221197 (+ 90961us) service_pool.cc:224] Handling call
0709 13:16:13.297730 (+1076533us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54005c8854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:13.297832 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249743232}
I20260709 13:16:13.123394  5006 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.385128  5006 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:13.320415  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 928) took 1289 ms. Trace:
I20260709 13:16:13.385797  3285 rpcz_store.cc:276] 0709 13:16:12.030719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.095205 (+ 64486us) service_pool.cc:224] Handling call
0709 13:16:12.096783 (+  1578us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:12.870814 (+774031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:12.870863 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:12.890375 (+ 19512us) log.cc:844] Serialized 26 byte log entry
0709 13:16:13.222390 (+332015us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:13.319681 (+ 97291us) log.cc:844] Serialized 14 byte log entry
0709 13:16:13.319971 (+   290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.320075 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.320128 (+    53us) raft_consensus.cc:1685] finished
0709 13:16:13.320146 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.320333 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":796571,"prepare.queue_time_us":137023,"raft.queue_time_us":801770,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":11190,"thread_start_us":280044,"threads_started":1,"wal-append.queue_time_us":321569}
W20260709 13:16:13.335456  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 70431.2us
I20260709 13:16:13.371124  4901 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:13.292107  3837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 343) took 1142 ms. Trace:
I20260709 13:16:13.387830  4901 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:13.352782  3283 rpcz_store.cc:276] 0709 13:16:12.031661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.114292 (+ 82631us) service_pool.cc:224] Handling call
0709 13:16:12.114654 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:13.149045 (+1034391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:13.149102 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:13.149756 (+   654us) log.cc:844] Serialized 26 byte log entry
0709 13:16:13.237562 (+ 87806us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:13.237615 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.237715 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.246122 (+  8407us) raft_consensus.cc:1685] finished
0709 13:16:13.246151 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.246307 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":764665,"raft.queue_time_us":801672,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":21494,"thread_start_us":356647,"threads_started":2,"wal-append.queue_time_us":94665}
I20260709 13:16:13.388441  4901 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.360996  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:13.389235  3202 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:16:13.390146  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:13.390919  4859 consensus_queue.cc:1059] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:13.391189  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:13.392213  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:13.333904  4916 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:13.394004  3249 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:13.327905  5053 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.413538  5053 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:13.333770  5065 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:13.371506  5049 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:13.354730  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:13.386922  4961 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:13.324118  4956 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:13.353340  3131 rpcz_store.cc:269] 0709 13:16:10.380137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.380412 (+   275us) service_pool.cc:224] Handling call
0709 13:16:13.253703 (+2873291us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b540030aa54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:13.253879 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3495318400}
I20260709 13:16:13.392354  4758 raft_consensus.cc:3055] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:16:13.364482  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 78454us
I20260709 13:16:13.333941  5066 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:13.402571  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:13.427199  3202 raft_consensus.cc:2410] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:13.428064  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:13.428702  3202 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 3: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:13.387965  3837 rpcz_store.cc:276] 0709 13:16:12.132942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.000231 (+867289us) service_pool.cc:224] Handling call
0709 13:16:13.274958 (+274727us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:13.404039  3842 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:13.429895  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 447) took 1360 ms. Trace:
I20260709 13:16:13.429836  4758 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:13.430460  3842 rpcz_store.cc:276] 0709 13:16:12.069925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.070541 (+   616us) service_pool.cc:224] Handling call
0709 13:16:13.403560 (+1333019us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:16:13.403795 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.429511 (+ 25716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.429821 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8310528}
W20260709 13:16:13.405267  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.431201  4758 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.404260  4870 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:13.432673  4870 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:13.433110  4870 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:13.435923  4890 raft_consensus.cc:1064] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:16:13.405840  4969 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.362653  5064 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:13.370965  4918 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:16:13.328469  5070 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.343132  4721 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:13.464514  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 1983) took 4457 ms. Trace:
I20260709 13:16:13.426247  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:13.465742  4721 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:13.466332  4721 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:13.467346  3282 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 912) took 2138 ms (client timeout 1720 ms). Trace:
W20260709 13:16:13.467744  3282 rpcz_store.cc:269] 0709 13:16:11.328555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.646489 (+317934us) service_pool.cc:224] Handling call
0709 13:16:13.467153 (+1820664us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400038c54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:13.467280 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3739633920}
I20260709 13:16:13.468050  4915 consensus_queue.cc:1059] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.406828  3833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 445) took 1344 ms. Trace:
I20260709 13:16:13.468829  4744 consensus_queue.cc:1059] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:13.357594  4810 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.469238  3833 rpcz_store.cc:276] 0709 13:16:12.062941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.064016 (+  1075us) service_pool.cc:224] Handling call
0709 13:16:12.083095 (+ 19079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.278416 (+195321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:12.278462 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:12.278530 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:12.278577 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.406495 (+1127918us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54002175d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:13.406563 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.406752 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411666048}
I20260709 13:16:13.470180  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2034) took 1563 ms. Trace:
I20260709 13:16:13.470602  3210 rpcz_store.cc:276] 0709 13:16:11.906262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.955385 (+ 49123us) service_pool.cc:224] Handling call
0709 13:16:11.977260 (+ 21875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.949699 (+972439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.469960 (+520261us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b5400196254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:13.470120 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2234942336}
I20260709 13:16:13.437014  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:13.437783  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.414810  5049 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:13.451078  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:13.432884  4758 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.452601  4969 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.454981  5064 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:13.457911  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:13.485146  3204 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:13.458895  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:13.476989  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:13.375320  5003 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:13.494400  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:13.428925  5066 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:13.367151  4699 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.470221  4832 raft_consensus.cc:3055] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:13.470928  4721 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:13.438386  3203 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:13.503854  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:13.342339  3836 rpcz_store.cc:276] 0709 13:16:10.194860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.198993 (+  4133us) service_pool.cc:224] Handling call
0709 13:16:10.250526 (+ 51533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.367014 (+116488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.369738 (+  2724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.374174 (+  4436us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:10.375675 (+  1501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.214685 (+2839010us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540002b054. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:13.214737 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.214876 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240673024}
I20260709 13:16:13.510377  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:13.512741  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:13.515547  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:13.516240  3276 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:13.451610  3251 connection.cc:256] RPC call timeout handler was delayed by -1.5420691940000779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260709 13:16:13.519318  3251 connection.cc:256] RPC call timeout handler was delayed by -1.5354384370000389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 13:16:13.521363  3251 connection.cc:256] RPC call timeout handler was delayed by -1.4834928370000853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2756s for a response
I20260709 13:16:13.521646  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:13.523666  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.524122  3251 connection.cc:256] RPC call timeout handler was delayed by -1.2508917010000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
I20260709 13:16:13.529677  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:13.516172  3207 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:13.532799  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:13.535918  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.537470  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.537846  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:13.539008  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:13.539371  3284 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:13.540307  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:13.543121  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:13.535420  4766 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:13.545804  4766 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.546391  4885 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.505066  4832 raft_consensus.cc:740] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:13.547596  4832 consensus_queue.cc:260] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:13.548871  4766 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:13.550683  4969 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:13.552172  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:13.552992  3278 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:13.556118  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:13.575102  3284 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:13.572310  3276 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:13.502068  4741 consensus_queue.cc:1059] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:16:13.542078  5012 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.584621  3205 raft_consensus.cc:1240] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:13.584044  3206 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 2040) took 1344 ms (client timeout 1586 ms). Trace:
I20260709 13:16:13.508531  4721 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.603763  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:13.579375  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:13.532960  5014 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:13.607975  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:13.617278  3281 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:16:13.608374  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 52377.3us
I20260709 13:16:13.588985  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 905) took 3024 ms. Trace:
I20260709 13:16:13.617848  3277 rpcz_store.cc:276] 0709 13:16:10.564296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.575895 (+ 11599us) service_pool.cc:224] Handling call
0709 13:16:10.576245 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.645656 (+1069411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.588489 (+1942833us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002968d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:13.588898 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2407679232}
I20260709 13:16:13.575408  4918 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:13.548990  4832 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:13.612365  3101 connection.cc:256] RPC call timeout handler was delayed by -1.7255347580000944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 13:16:13.613442  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 80860.9us
I20260709 13:16:13.532701  4744 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:13.615260  3206 rpcz_store.cc:269] 0709 13:16:12.239505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.241896 (+  2391us) service_pool.cc:224] Handling call
0709 13:16:13.583836 (+1341940us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54001d7254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:13.583982 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599379200}
I20260709 13:16:13.610373  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1118) took 2192 ms. Trace:
I20260709 13:16:13.577132  5067 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:13.622395  3251 leader_election.cc:400] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5.
I20260709 13:16:13.616988  4808 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.657276  4808 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:13.659472  4808 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:13.624437  4580 raft_consensus.cc:3055] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:13.660151  4580 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:13.661041  4580 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.662295  4580 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.604207  4961 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.665493  4961 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.667088  5070 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:13.667634  4961 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:13.668447  5081 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:16:13.624944  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:13.670099  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 940) took 3103 ms. Trace:
I20260709 13:16:13.670306  3834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 341) took 1609 ms. Trace:
I20260709 13:16:13.625236  4810 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:13.670795  3834 rpcz_store.cc:276] 0709 13:16:12.060723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.064426 (+  3703us) service_pool.cc:224] Handling call
0709 13:16:13.614302 (+1549876us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:13.670242 (+ 55940us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31674624}
I20260709 13:16:13.672516  4870 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.673026  4901 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.674872  4870 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:13.675444  4885 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.652697  3251 leader_election.cc:403] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:13.652956  3209 rpcz_store.cc:276] 0709 13:16:11.417589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.417700 (+   111us) service_pool.cc:224] Handling call
0709 13:16:11.417962 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.545518 (+127556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.545547 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:11.555191 (+  9644us) log.cc:844] Serialized 26 byte log entry
0709 13:16:11.679756 (+124565us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:11.679813 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.585525 (+1905712us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400225e54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:13.585574 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.585616 (+    42us) raft_consensus.cc:1685] finished
0709 13:16:13.585628 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.610289 (+ 24661us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":15778,"spinlock_wait_cycles":292490624,"thread_start_us":117532,"threads_started":1,"wal-append.queue_time_us":147770,"wal-append.run_cpu_time_us":1891,"wal-append.run_wall_time_us":1188966}
I20260709 13:16:13.706607  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:13.707242  3209 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
W20260709 13:16:13.709848  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 87585.3us
I20260709 13:16:13.711055  3251 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:13.712494  3251 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:13.675551  4901 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:13.676434  5075 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:16:13.677366  5084 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:16:13.678272  5071 log.cc:927] Time spent T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:16:13.607767  4985 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:13.618999  5006 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:13.707577  4940 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:13.680959  3285 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:13.611531  4766 consensus_queue.cc:1059] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:16:13.779212  4766 raft_consensus.cc:3055] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:13.779580  4766 raft_consensus.cc:740] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:13.621065  4918 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:13.781365  4918 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:13.758694  4976 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:13.785462  4976 raft_consensus.cc:697] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:13.786562  4976 consensus_queue.cc:237] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:13.626183  5014 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.790833  5014 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:13.622741  5045 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:13.688638  5003 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:13.791916  5045 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:13.792387  5045 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:13.652375  3206 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:13.554672  5064 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
W20260709 13:16:13.656481  3101 connection.cc:256] RPC call timeout handler was delayed by -1.6553347579999809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
W20260709 13:16:13.793241  3101 connection.cc:256] RPC call timeout handler was delayed by -1.2071347579999383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
W20260709 13:16:13.793577  3101 connection.cc:256] RPC call timeout handler was delayed by -1.0703347579999445s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
I20260709 13:16:13.794154  3206 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:13.794659  3101 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:13.796041  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:13.716400  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:13.797464  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:13.797858  4760 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:13.798178  3833 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:13.798373  4760 raft_consensus.cc:697] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:13.670499  3129 rpcz_store.cc:276] 0709 13:16:10.566615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.577708 (+ 11093us) service_pool.cc:224] Handling call
0709 13:16:10.605097 (+ 27389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.620068 (+ 14971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.621909 (+  1841us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.637450 (+ 15541us) log.cc:844] Serialized 26 byte log entry
0709 13:16:13.295042 (+2657592us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b180044ed20. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:16:13.363200 (+ 68158us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:13.366905 (+  3705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.371881 (+  4976us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.669643 (+297762us) raft_consensus.cc:1685] finished
0709 13:16:13.669691 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.669996 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3526,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":13027,"spinlock_wait_cycles":7521536,"thread_start_us":59776,"threads_started":1,"wal-append.queue_time_us":2844710}
I20260709 13:16:13.799496  4760 consensus_queue.cc:237] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.690651  4744 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:13.800681  4952 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:13.649276  5067 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:13.720952  3251 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:13.801288  5067 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:13.801683  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 80792.9us
I20260709 13:16:13.802702  4744 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:13.803223  3251 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:13.721426  3249 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:13.724272  3210 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:13.774326  4985 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:13.620942  4969 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.807377  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 89157.9us
I20260709 13:16:13.716269  4956 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.718482  4870 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:13.723089  4864 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:13.684087  4754 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:13.465004  3280 rpcz_store.cc:276] 0709 13:16:09.006774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.203314 (+1196540us) service_pool.cc:224] Handling call
0709 13:16:10.229259 (+ 25945us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.354731 (+125472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.359202 (+  4471us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.392937 (+ 33735us) log.cc:844] Serialized 26 byte log entry
0709 13:16:10.464414 (+ 71477us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:10.534124 (+ 69710us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.547594 (+ 13470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.557807 (+ 10213us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.462069 (+2904262us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b1800410740. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:16:13.464161 (+  2092us) raft_consensus.cc:1685] finished
0709 13:16:13.464285 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.464443 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":80003,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":44322,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":182,"spinlock_wait_cycles":6568704,"thread_start_us":202500,"threads_started":3,"wal-append.queue_time_us":48314}
I20260709 13:16:13.717187  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:13.819141  3209 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:13.812292  3101 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:13.773674  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:13.819818  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:13.820045  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:13.826562  3204 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:13.837195  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:13.813041  4825 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:13.810784  4952 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:13.844424  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:13.846493  3101 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:13.780454  4766 consensus_queue.cc:260] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:13.806213  4969 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.858408  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 923) took 2427 ms. Trace:
I20260709 13:16:13.817866  4585 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:13.858822  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 239588us
I20260709 13:16:13.816921  4754 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:13.824095  4810 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:13.912782  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 56812.2us
I20260709 13:16:13.916749  3279 rpcz_store.cc:276] 0709 13:16:11.430697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.094941 (+664244us) service_pool.cc:224] Handling call
0709 13:16:12.095126 (+   185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:12.890850 (+795724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:12.890884 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:12.891327 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:16:13.334938 (+443611us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:13.335000 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.335100 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.858168 (+523068us) raft_consensus.cc:1685] finished
0709 13:16:13.858203 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.858343 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29215,"raft.queue_time_us":784541,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":21071,"thread_start_us":397976,"threads_started":1,"wal-append.queue_time_us":481534}
I20260709 13:16:13.936455  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:13.940414  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:13.811920  4940 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:13.942622  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:13.856683  5065 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:13.848373  4580 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:13.859107  4758 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.820818  5070 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 13:16:13.857127  4952 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:13.957523  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.822247  4864 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:13.962186  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.968727  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:13.974134  3841 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:13.859987  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:13.981887  3833 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:13.979028  5092 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:13.982460  5088 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:16:13.982622  5092 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:13.983212  5092 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:13.983454  5087 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:16:13.979662  5014 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:13.986199  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.935859  4754 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.952469  4585 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:13.981243  4864 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:13.978961  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:13.935436  4810 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:13.940429  4808 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:13.916265  4870 raft_consensus.cc:697] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:13.996196  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 65581.6us
I20260709 13:16:13.997179  4870 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:13.945202  4766 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:13.859280  4699 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:13.950488  4915 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.000524  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:13.998955  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 150733us
I20260709 13:16:13.967939  4758 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:14.018566  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:13.995489  4810 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.967666  4901 consensus_queue.cc:1059] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:16:13.999589  4985 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:14.017572  4758 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:14.041018  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.045331  3249 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:14.049368  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.063449  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.017023  5093 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:14.022830  4808 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:14.072981  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:14.076613  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 137675us
I20260709 13:16:14.077381  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.078681  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:14.090116  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.091360  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.092067  4996 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:14.092484  4996 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:14.093019  4996 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.094036  4976 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.094657  4976 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:14.092736  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.098368  3202 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:16:14.099682  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.100581  4976 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:14.103111  4996 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:14.104323  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:14.025228  5014 consensus_queue.cc:1059] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:16:14.038242  4890 consensus_queue.cc:237] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:14.033453  4585 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:14.396201  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.163439  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.233839  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:14.369935  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1132) took 1081 ms. Trace:
I20260709 13:16:14.368494  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1124) took 1144 ms. Trace:
I20260709 13:16:14.160256  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.132303  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:14.205876  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.136121  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.300782  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:14.090459  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 71954.6us
W20260709 13:16:14.151151  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.430109  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 297885us
I20260709 13:16:14.303150  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:14.156888  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.315078  3127 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:14.432246  3204 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:16:14.046005  4825 raft_consensus.cc:697] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:14.076399  4953 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:14.233564  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.454273  3128 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.348870  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:14.080500  5021 raft_consensus.cc:3055] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:14.084559  4808 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:14.163867  3136 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:14.111377  5093 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:14.470089  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.427361  3279 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:14.185648  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:14.431389  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.471140  3134 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.429788  3130 raft_consensus.cc:2410] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:14.427291  3202 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.433416  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:14.144773  5095 log.cc:927] Time spent T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 13:16:14.145224  5090 log.cc:927] Time spent T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:16:14.379439  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.477190  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.429206  3205 rpcz_store.cc:276] 0709 13:16:13.223779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.225001 (+  1222us) service_pool.cc:224] Handling call
0709 13:16:13.584447 (+359446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.616690 (+ 32243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.368293 (+751603us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54001d7250. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:14.368431 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777231744}
I20260709 13:16:14.477977  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1139) took 1186 ms. Trace:
I20260709 13:16:14.439234  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.478358  3210 rpcz_store.cc:276] 0709 13:16:13.291318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.546250 (+254932us) service_pool.cc:224] Handling call
0709 13:16:13.546553 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.805665 (+259112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.477767 (+672102us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400195354. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:14.477925 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408301312}
I20260709 13:16:14.427737  3208 rpcz_store.cc:276] 0709 13:16:13.289034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.291479 (+  2445us) service_pool.cc:224] Handling call
0709 13:16:13.291830 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.371185 (+ 79355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:13.371219 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:13.371270 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:13.371299 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.369645 (+998346us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b5400247554. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:14.369706 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.369866 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182033792}
I20260709 13:16:14.430713  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.442283  3805 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:14.443704  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:14.445214  3282 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:14.349761  4741 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 13:16:14.082612  4981 consensus_queue.cc:1059] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.366s
I20260709 13:16:14.498319  3209 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:14.109858  5099 consensus_queue.cc:1059] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.363s
I20260709 13:16:14.457291  5021 raft_consensus.cc:740] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:16:14.150949  4721 consensus_meta.cc:287] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 13:16:14.154126  5045 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:14.470561  4808 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.150281  4940 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:14.451639  3284 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:16:14.494364  5114 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:16:14.220142  4832 consensus_meta.cc:287] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.002s
I20260709 13:16:14.363376  4877 raft_consensus.cc:3055] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:14.162195  3133 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:14.210938  4919 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.343432  4926 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.163479  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.325732  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:14.213714  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:14.205927  4956 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5.
I20260709 13:16:14.085680  4884 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:14.211843  4969 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:14.531327  4884 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.535061  4884 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.534432  5093 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:14.518764  4877 raft_consensus.cc:740] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:14.538841  4877 consensus_queue.cc:260] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:14.540060  4877 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:14.541545  5112 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:16:14.543833  4884 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:14.498361  5101 consensus_queue.cc:1059] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:16:14.219568  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:14.516896  5070 raft_consensus.cc:3055] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:14.472855  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.547282  3135 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.547770  3134 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:14.359146  5049 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:14.474502  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.549543  3204 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:16:14.431638  3277 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:14.365840  3835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 348) took 1314 ms. Trace:
W20260709 13:16:14.474956  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 126167us
I20260709 13:16:14.551846  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.552585  3134 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:14.555092  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.475668  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:14.459285  5111 log.cc:927] Time spent T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:16:14.454073  4953 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:14.494585  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.436483  4985 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:14.499771  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.497882  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:14.328024  4758 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:14.362175  4952 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:14.600854  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 103048us
I20260709 13:16:14.602069  5014 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:14.602495  5014 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:14.216256  5092 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:14.255549  3281 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:14.373847  4810 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:14.151500  4918 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:14.508214  3202 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:14.606659  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:14.216018  5067 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:14.482935  4961 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:14.482712  4870 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.625504  4870 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:14.626864  4884 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:14.627946  4870 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:14.501986  5003 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:14.509966  4744 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:14.628644  5003 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:14.524250  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.629127  5003 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.629402  3133 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:14.630482  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.631723  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.551263  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.632269  5067 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:14.633148  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.633211  3206 raft_consensus.cc:1240] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:16:14.558002  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.634236  4961 raft_consensus.cc:697] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 2 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:14.628862  4744 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:14.635655  4744 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:14.549018  3837 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 1.
I20260709 13:16:14.545401  3129 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:14.559952  3203 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.637687  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.635260  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.561463  5045 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:14.561685  3835 rpcz_store.cc:276] 0709 13:16:13.051762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.707166 (+655404us) service_pool.cc:224] Handling call
0709 13:16:13.761625 (+ 54459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:13.818501 (+ 56876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:13.822800 (+  4299us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:13.972813 (+150013us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.365451 (+392638us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:14.365494 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.365574 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:14.365620 (+    46us) raft_consensus.cc:1685] finished
0709 13:16:14.365635 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.365775 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":341911,"threads_started":1,"wal-append.queue_time_us":146588}
I20260709 13:16:14.602931  5014 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.649401  3205 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:14.544857  4996 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:14.530704  4926 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:14.549561  5021 consensus_queue.cc:260] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:14.652241  5021 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:14.653450  4926 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:14.527010  4919 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:14.514581  4721 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:14.587882  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.550192  5070 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:14.599534  4953 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.505317  3128 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:14.603426  5101 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.605651  3127 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:14.608587  3210 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:14.635247  4961 consensus_queue.cc:237] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:14.637807  4810 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:14.521031  4825 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:14.634294  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.556224  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.642364  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.683073  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.632298  3133 raft_consensus.cc:2376] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5. Re-sending same reply.
I20260709 13:16:14.684717  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.685398  3133 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:14.602419  4832 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:16:14.648772  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:14.693575  3281 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:14.602934  4985 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:14.611130  4826 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:14.670159  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.696427  3276 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:14.697335  3204 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:14.697203  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.656301  3805 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:14.676815  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.699549  3128 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 2: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:14.700541  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.701826  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.638340  3129 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:14.679558  5092 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:14.686295  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.707911  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.708416  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.708945  3129 raft_consensus.cc:2393] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 4: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:14.709611  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.710083  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.710844  3129 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:14.563457  4766 consensus_meta.cc:287] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.001s
I20260709 13:16:14.680927  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.712294  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.713426  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.714581  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.715317  3132 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 4: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:14.716006  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.716925  3278 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:14.717062  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.718806  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.703091  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:14.691970  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 158777us
I20260709 13:16:14.688879  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:14.651224  4754 consensus_meta.cc:287] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
W20260709 13:16:14.741766  3806 leader_election.cc:336] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.692s (SENT)
I20260709 13:16:14.720032  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.711041  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.767771  3134 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:14.721143  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.725479  4919 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:14.690657  3135 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
W20260709 13:16:14.730438  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 227091us
I20260709 13:16:14.779922  3131 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:14.787683  3284 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:14.782356  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.721300  4985 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.800387  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.801501  3133 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:14.790118  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.790621  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.802546  3128 raft_consensus.cc:2376] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5. Re-sending same reply.
I20260709 13:16:14.802567  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:14.800398  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 161314us
I20260709 13:16:14.804374  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.790944  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.791421  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.817564  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:14.793650  3207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1141) took 1498 ms. Trace:
I20260709 13:16:14.818593  3207 rpcz_store.cc:276] 0709 13:16:13.294838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.792824 (+1497986us) service_pool.cc:224] Handling call
0709 13:16:14.793169 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.793348 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.793372 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:14.793412 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:14.793439 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.793489 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.793585 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:14.806284  3128 raft_consensus.cc:2393] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:14.803685  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.821023  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.823292  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.823551  3806 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:14.821543  3134 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:14.825320  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.826138  3134 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:14.677872  5101 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:14.828521  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.830566  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.721019  4826 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:14.834762  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.860100  3134 raft_consensus.cc:2410] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:16:14.836148  3133 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:14.842722  3128 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:14.844482  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:14.862063  3132 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
W20260709 13:16:14.846349  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 190113us
I20260709 13:16:14.846771  3131 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:14.845705  3136 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:14.785706  4580 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:16:14.872246  3134 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:14.873051  3128 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:14.883647  3128 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:14.875350  3132 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:14.876912  3250 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:14.888195  3131 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:14.896693  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:14.900182  3128 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:14.900005  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:14.889441  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 137180us
I20260709 13:16:14.891551  3132 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:14.911079  3132 pending_rounds.cc:85] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 1
I20260709 13:16:14.911334  3132 pending_rounds.cc:107] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:14.911554  3132 raft_consensus.cc:2889] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:14.786849  4754 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:14.908473  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.913877  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.909838  4936 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:14.904189  4981 raft_consensus.cc:2764] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:16:14.925531  5127 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:16:14.931464  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.932371  3207 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:14.787477  5070 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:14.936441  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.937455  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.941601  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:14.905143  3131 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:14.946408  3131 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:16:14.948453  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:14.948967  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:14.914299  3836 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:14.901983  4952 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:14.909305  5099 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:14.959513  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 136081us
W20260709 13:16:14.960749  3806 leader_election.cc:336] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.658s (SENT)
I20260709 13:16:14.942283  3211 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
W20260709 13:16:14.961774  3806 leader_election.cc:336] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.658s (SENT)
I20260709 13:16:14.962415  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:14.934396  3835 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:14.970350  3250 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:14.972422  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:14.974022  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:14.935086  5131 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:14.940778  4918 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:14.894235  4870 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:16:15.000321  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:14.954361  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:15.017172  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.011952  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:15.010026  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.011827  3100 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:15.011287  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.020077  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:15.021565  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.021569  4952 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:15.022281  4952 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.022641  4952 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.022921  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.026001  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.026808  3282 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:14.998049  5131 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.999904  4678 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:15.040408  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 70131us
I20260709 13:16:15.043040  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:15.044701  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:15.054600  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2061) took 1243 ms. Trace:
I20260709 13:16:15.055042  3205 rpcz_store.cc:276] 0709 13:16:13.811544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.478518 (+666974us) service_pool.cc:224] Handling call
0709 13:16:14.478765 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.649841 (+171076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.054312 (+404471us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400246b54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:15.054515 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391936768}
I20260709 13:16:15.061815  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:10.586396  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:15.018214  4870 consensus_queue.cc:1243] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer fc48eecc27554cb58b15193cd442b1d3 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:15.006866  3836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 297) took 1031 ms. Trace:
I20260709 13:16:15.031774  5099 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:15.032963  3834 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:15.030138  4721 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:15.090025  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 45428us
I20260709 13:16:15.095889  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:15.039652  5137 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.063977  4981 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.070828  5131 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.105389  3279 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:15.097999  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:15.064764  4678 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:15.117532  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:15.122992  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:15.092005  5099 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:15.093446  5045 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.110023  4940 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.114614  4678 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.082283  5135 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:15.120242  4996 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.131820  4870 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:15.142468  5123 log.cc:927] Time spent T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:16:15.129324  5134 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.081629  3836 rpcz_store.cc:276] 0709 13:16:13.974999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.785553 (+810554us) service_pool.cc:224] Handling call
0709 13:16:14.865987 (+ 80434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.958286 (+ 92299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.003128 (+ 44842us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:15.157053  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 195385us
W20260709 13:16:15.151552  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.136759  5099 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:15.156041  3250 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:15.159055  3840 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEARNER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:15.160372  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:15.151075  4981 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:15.158140  4870 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.170069  3250 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:15.172214  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:15.160624  5101 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:15.168166  4981 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.175875  3836 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:15.182185  4981 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.175865  3840 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:15.177533  3838 raft_consensus.cc:2376] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5. Re-sending same reply.
W20260709 13:16:15.179077  5125 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.224s	user 0.001s	sys 0.001s
I20260709 13:16:15.114993  5137 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:15.191450  5128 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.187s	user 0.001s	sys 0.001s
I20260709 13:16:15.170644  4826 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:15.166334  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:15.168752  3806 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:15.164402  4754 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:15.168073  5124 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
W20260709 13:16:15.186764  5003 consensus_meta.cc:287] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.557s	user 0.006s	sys 0.005s
I20260709 13:16:15.177016  4870 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.172559  4825 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.210613  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:15.196584  5101 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:15.225232  5099 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:15.168289  5141 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:15.216431  4953 consensus_meta.cc:287] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.001s
I20260709 13:16:15.210546  5049 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:15.277580  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.232621  3842 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:15.239176  5101 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.228051  5144 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.196866  4936 consensus_queue.cc:1059] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:16:15.164847  5134 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:15.230189  4826 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:15.297196  5139 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 13:16:15.299057  4808 consensus_meta.cc:287] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.783s	user 0.007s	sys 0.004s
W20260709 13:16:15.299388  3129 consensus_meta.cc:287] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.002s
W20260709 13:16:15.301741  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 133030us
I20260709 13:16:15.317538  3806 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:15.303958  5101 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.310300  4936 consensus_queue.cc:1243] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer fc48eecc27554cb58b15193cd442b1d3 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:15.234601  5003 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:15.306851  5135 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.285481  5049 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:15.325565  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:15.326916  3806 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:15.275708  4953 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:15.282228  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:15.319140  3129 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:15.332726  3841 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:15.315469  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 293) took 1552 ms. Trace:
I20260709 13:16:15.337998  3102 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:15.338308  3842 rpcz_store.cc:276] 0709 13:16:13.761158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.762614 (+  1456us) service_pool.cc:224] Handling call
0709 13:16:15.176886 (+1414272us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:16:15.202583 (+ 25697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.291824 (+ 89241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.312997 (+ 21173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53380992}
I20260709 13:16:15.340629  4961 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.341856  3136 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:15.320885  5141 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:15.347039  4926 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
W20260709 13:16:15.355345  5021 consensus_meta.cc:287] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.703s	user 0.010s	sys 0.000s
I20260709 13:16:15.319459  4808 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:15.315860  4826 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:15.357272  5143 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:16:15.355871  3203 consensus_meta.cc:287] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.001s
I20260709 13:16:15.358197  5049 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:15.464720  4981 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:15.365221  5149 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:15.454315  4870 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:14.654786  4887 consensus_queue.cc:1175] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "48080cf0460346769ab046a4f9457aa5" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: [3.6-3.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:15.467957  5149 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:15.468422  5149 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:15.461493  5145 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:16:15.462417  5134 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:15.457933  3203 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:15.466922  4940 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.454963  3842 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:15.316318  5144 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:15.481374  3128 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:15.356949  4952 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:15.487119  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 159062us
I20260709 13:16:15.457927  5003 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:15.492594  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:15.494099  5137 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:15.494104  4952 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:15.459458  5131 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:15.495756  5137 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.498070  5131 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:15.499156  3837 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
W20260709 13:16:15.499630  4877 consensus_meta.cc:287] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.959s	user 0.011s	sys 0.002s
I20260709 13:16:15.485600  5134 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:15.506451  4870 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:15.507059  4808 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:15.507303  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:15.508033  3834 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.509383  4826 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:15.523690  4985 consensus_meta.cc:287] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.000s
I20260709 13:16:15.524406  4985 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:15.526319  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.527714  4985 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:15.527969  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.530287  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1156) took 1319 ms. Trace:
I20260709 13:16:15.530710  3204 rpcz_store.cc:276] 0709 13:16:14.211105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.550665 (+339560us) service_pool.cc:224] Handling call
0709 13:16:14.551172 (+   507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.697765 (+146593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.530013 (+832248us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400225e54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:15.530218 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335693056}
I20260709 13:16:15.534587  5144 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:15.536669  4981 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:15.539209  3836 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:15.539755  3032 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38234 (request call id 258) took 8613 ms. Trace:
I20260709 13:16:15.540899  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:15.542169  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:15.542855  3207 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:15.543788  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:15.544165  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1086) took 1187 ms. Trace:
I20260709 13:16:15.544343  3207 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:15.546028  3134 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:15.546339  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:15.547060  3838 raft_consensus.cc:2393] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:15.547194  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:15.547814  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:15.548673  3205 raft_consensus.cc:2410] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:15.549144  3283 raft_consensus.cc:2410] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:15.544545  3127 rpcz_store.cc:276] 0709 13:16:14.356823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.438917 (+ 82094us) service_pool.cc:224] Handling call
0709 13:16:15.543962 (+1105045us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54000e15d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:15.544107 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290508672}
W20260709 13:16:15.549823  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.550722  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:15.551134  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 59081.2us
I20260709 13:16:15.551803  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:15.552778  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:15.553359  3204 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:15.554134  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:15.377918  5141 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:15.486164  3203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 147) took 1453 ms. Trace:
I20260709 13:16:15.555171  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:15.556042  3207 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:16:15.558213  3207 pending_rounds.cc:85] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 5
I20260709 13:16:15.558414  3205 raft_consensus.cc:1240] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:15.558557  3207 pending_rounds.cc:107] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:16:15.559015  3207 raft_consensus.cc:2889] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:15.504926  4744 consensus_meta.cc:287] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.863s	user 0.011s	sys 0.000s
I20260709 13:16:15.556849  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.560416  3205 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:15.540107  3032 rpcz_store.cc:276] 0709 13:16:06.926700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.926982 (+   282us) service_pool.cc:224] Handling call
0709 13:16:15.539662 (+8612680us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:08.530712 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:08.555061 (+ 24349us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:08.555104 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:16:08.555116 (+    12us) tablet.cc:662] Decoding operations
0709 13:16:08.556239 (+  1123us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:08.556292 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:08.556318 (+    26us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:16:08.673898 (+117580us) tablet.cc:701] Row locks acquired
0709 13:16:08.677468 (+  3570us) write_op.cc:260] PREPARE: finished
0709 13:16:08.684672 (+  7204us) write_op.cc:270] Start()
0709 13:16:08.705697 (+ 21025us) write_op.cc:276] Timestamp: P: 1783602968683025 usec, L: 0
0709 13:16:08.705738 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:16:08.706690 (+   952us) log.cc:844] Serialized 5196 byte log entry
0709 13:16:09.583603 (+876913us) op_driver.cc:464] REPLICATION: finished
0709 13:16:09.993904 (+410301us) write_op.cc:301] APPLY: starting
0709 13:16:09.994062 (+   158us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:09.994501 (+   439us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:09.994675 (+   174us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:10.230251 (+235576us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:10.230604 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:16:10.230660 (+    56us) write_op.cc:312] APPLY: finished
0709 13:16:10.231001 (+   341us) log.cc:844] Serialized 95 byte log entry
0709 13:16:10.231183 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:10.231350 (+   167us) write_op.cc:454] Released schema lock
0709 13:16:10.231405 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:10.231781 (+   376us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:10.231811 (+    30us) write_op.cc:454] Released schema lock
0709 13:16:11.244218 (+1012407us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54000a87d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ec32a 00007fb3bc171f14 00007fb3bc171ec3 00007fb3bc171e38 00007fb3bc171df3 00007fb3bc1710dc 00007fb3bc19ae16 00007fb3bc182cbb 00007fb3bc16d39d 00007fb3bc170d75
Metrics: {"mutex_wait_us":615492,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":403999,"apply.run_cpu_time_us":6045,"apply.run_wall_time_us":237875,"num_ops":13,"prepare.queue_time_us":213366,"prepare.run_cpu_time_us":46449,"prepare.run_wall_time_us":525422,"raft.queue_time_us":236172,"raft.run_cpu_time_us":44311,"raft.run_wall_time_us":1729261,"replication_time_us":839682,"spinlock_wait_cycles":24933632,"thread_start_us":878890,"threads_started":4,"wal-append.queue_time_us":403108,"wal-append.run_cpu_time_us":43550,"wal-append.run_wall_time_us":2100804}]]}
I20260709 13:16:15.531998  4678 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:15.580204  4936 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:16:15.565568  4744 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:15.627503  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 133590us
I20260709 13:16:15.632464  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:15.559717  3203 rpcz_store.cc:276] 0709 13:16:14.033094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.219193 (+186099us) service_pool.cc:224] Handling call
0709 13:16:15.485341 (+1266148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.586035  5066 consensus_queue.cc:1059] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:16:15.566448  4981 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:16:15.636672  3280 raft_consensus.cc:1240] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:15.653352  4870 raft_consensus.cc:3055] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:15.660915  4870 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:15.661934  4870 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:15.663718  4870 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:15.659159  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.653432  3034 catalog_manager.cc:5697] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 3 to 4, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 4 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.666785  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:15.666841  3034 catalog_manager.cc:5697] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.668352  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:15.650975  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:15.669575  3205 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:15.670229  5014 consensus_meta.cc:287] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.988s	user 0.007s	sys 0.006s
I20260709 13:16:15.670691  5014 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:15.669570  4744 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:15.672839  5014 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:15.678259  3034 catalog_manager.cc:5697] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:15.676827  5117 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.954s	user 0.000s	sys 0.003s
I20260709 13:16:15.679680  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.634459  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:15.681480  3806 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:15.648955  4953 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:15.682868  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.683797  3034 catalog_manager.cc:5697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:15.688375  3205 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:15.682601  4760 consensus_queue.cc:1059] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:16:15.691063  3834 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:15.683419  5152 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:15.693455  3034 catalog_manager.cc:5697] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 2 to 3, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.693459  5101 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:15.693075  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.703709  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:15.700344  3034 catalog_manager.cc:5697] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.702096  3203 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:15.697369  5012 raft_consensus.cc:3055] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:15.707058  5012 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:15.707947  5012 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:15.709844  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:15.705619  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.711011  3840 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:16:15.713059  3278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 948) took 1463 ms (client timeout 1641 ms). Trace:
W20260709 13:16:15.713475  3278 rpcz_store.cc:269] 0709 13:16:14.249854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.250031 (+   177us) service_pool.cc:224] Handling call
0709 13:16:15.712895 (+1462864us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b5400182254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:15.713003 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":658236800}
I20260709 13:16:15.714833  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:15.717793  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.719388  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 956) took 1115 ms. Trace:
I20260709 13:16:15.719748  3276 rpcz_store.cc:276] 0709 13:16:14.603961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.604090 (+   129us) service_pool.cc:224] Handling call
0709 13:16:14.604451 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.696930 (+ 92479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.719122 (+1022192us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b54002968d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:15.719328 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210608000}
I20260709 13:16:15.711020  3279 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:15.723593  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.724406  3279 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:15.699517  5141 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:15.726533  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.727641  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.728717  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.708994  5012 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:15.729809  3278 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:15.730000  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:15.730587  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.731046  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.731629  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:15.732234  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.732384  3278 raft_consensus.cc:2376] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5. Re-sending same reply.
I20260709 13:16:15.733541  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.697538  4760 raft_consensus.cc:3055] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:15.720983  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.740271  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.741487  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.742960  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:15.743613  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.712498  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:15.745793  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.746680  3278 raft_consensus.cc:2410] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:15.746510  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.747641  3276 raft_consensus.cc:2410] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:15.740553  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:15.748445  3279 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:15.701684  5101 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:15.758438  3276 raft_consensus.cc:1240] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:15.759094  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 46734us
I20260709 13:16:15.760025  3278 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:15.762260  3276 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:15.760524  3278 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:15.766467  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:15.766638  3249 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:15.766944  3276 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:15.768857  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2062) took 1957 ms. Trace:
I20260709 13:16:15.769112  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:15.769297  3210 rpcz_store.cc:276] 0709 13:16:13.811777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.480928 (+669151us) service_pool.cc:224] Handling call
0709 13:16:14.608409 (+127481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.668383 (+ 59974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.768683 (+1100300us) spinlock_profiling.cc:243] Waited 97 ms on lock 0x7b5400375fd0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:15.768800 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222996736}
I20260709 13:16:15.770313  4585 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:15.710741  3834 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:15.745537  4760 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:15.768893  3278 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:15.776510  3278 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.767771  4678 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:15.777446  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:15.778539  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:15.779422  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:15.775401  4810 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:15.786250  4760 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:15.787568  4760 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:15.787285  5149 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:15.775576  5101 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.794039  4825 consensus_queue.cc:1059] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:15.794485  5141 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:15.796875  4810 raft_consensus.cc:697] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:15.797861  4810 consensus_queue.cc:237] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:15.799297  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:15.803256  3249 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:15.815328  3249 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:15.814260  4585 raft_consensus.cc:697] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:15.824424  4585 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:15.818734  4953 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.833127  5149 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:15.834720  3838 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:15.837517  4826 raft_consensus.cc:3055] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:15.837935  4826 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:15.838629  4826 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:15.839809  4826 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.840480  4758 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:15.845417  4956 raft_consensus.cc:3055] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:15.845880  4956 raft_consensus.cc:740] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:15.846740  4956 consensus_queue.cc:260] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:15.847749  4956 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.850603  5099 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:15.867452  4864 raft_consensus.cc:3055] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:15.867990  4864 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:15.868317  5121 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 1.145s	user 0.005s	sys 0.007s
I20260709 13:16:15.868906  4864 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:15.869765  5045 raft_consensus.cc:3055] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:15.870164  4864 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:15.870215  5045 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:15.871285  5045 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:15.871765  5070 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.872258  5045 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:15.911496  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:15.939071  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.945756  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:15.953023  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 137623us
I20260709 13:16:15.955344  3249 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:15.957827  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:15.959302  3136 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:15.955571  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:15.964781  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:15.974253  4810 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:15.975755  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:15.977804  3283 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:15.979128  3281 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:15.982586  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:15.992816  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.000317  4936 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:16.001549  4936 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.003392  4936 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.003569  3279 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.992890  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 950) took 1614 ms. Trace:
I20260709 13:16:16.006464  4956 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:16.004834  3131 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:16.007179  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:16.013335  3127 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:16.008780  4956 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:16.008021  4810 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:16.025183  5135 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:16.026621  5135 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:16.027244  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:16.028203  4810 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:16.034924  4826 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:16.038751  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:16.047554  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:16.048805  3833 raft_consensus.cc:2393] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 2: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:16.050086  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:16.053579  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:16.054678  3131 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:16.055174  3832 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:16.056792  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:16.057049  3834 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:16.057849  3127 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:16.060300  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:16.062201  4810 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:16.062958  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:16.063314  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:16.063114  4810 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.067301  4810 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:16.031406  4956 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.005054  3285 rpcz_store.cc:276] 0709 13:16:14.385838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.386040 (+   202us) service_pool.cc:224] Handling call
0709 13:16:14.386511 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.386973 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.387013 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:14.426265 (+ 39252us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.662636 (+236371us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:14.662674 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.662747 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.867698 (+1204951us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:15.979688 (+111990us) raft_consensus.cc:1685] finished
0709 13:16:15.979737 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.981023 (+  1286us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3039,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":114,"spinlock_wait_cycles":6466816,"thread_start_us":181455,"threads_started":1,"wal-append.queue_time_us":264295}
I20260709 13:16:16.077852  3285 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:16.079804  3281 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:16.079337  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:16.080596  3131 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.082347  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 978) took 1516 ms. Trace:
I20260709 13:16:16.082758  3134 rpcz_store.cc:276] 0709 13:16:14.565496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.878565 (+313069us) service_pool.cc:224] Handling call
0709 13:16:15.545806 (+667241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.546546 (+   740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.081932 (+535386us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54000e15d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:16.082146 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1533602176}
I20260709 13:16:16.085047  4996 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:16.085541  3284 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:16.090324  4826 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:16.097661  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1157) took 1657 ms. Trace:
I20260709 13:16:16.061040  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:16.090819  3281 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:16.098290  3202 rpcz_store.cc:276] 0709 13:16:14.440626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.607698 (+167072us) service_pool.cc:224] Handling call
0709 13:16:14.607959 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.608157 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:14.729143 (+120986us) log.cc:844] Serialized 14 byte log entry
0709 13:16:14.730234 (+  1091us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.096213 (+1365979us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b180020d7c0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b907cc0a 00007fb3c27bc219 00007fb3b9104a40 00007fb3b90ff4e4 00007fb3b90ff455 00007fb3bc1e7060 00007fb3bc1f9716 00007fb3bc20a287 00007fb3bc20a208
0709 13:16:16.096694 (+   481us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:16.096832 (+   138us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:16.096997 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.097159 (+   162us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.097437 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10061,"prepare.queue_time_us":529959,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":83,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":47443,"spinlock_wait_cycles":93770112,"thread_start_us":85124,"threads_started":1}
I20260709 13:16:16.086112  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2050) took 2686 ms. Trace:
I20260709 13:16:16.095108  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 163) took 2203 ms. Trace:
I20260709 13:16:16.101475  3206 rpcz_store.cc:276] 0709 13:16:13.399940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.795309 (+395369us) service_pool.cc:224] Handling call
0709 13:16:13.796206 (+   897us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.633857 (+837651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.084925 (+1451068us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54001d8154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:16.085820 (+   895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1923977472}
I20260709 13:16:16.106575  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:16.107908  3835 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 2: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:16.108309  4827 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:16.108512  3835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54908 (request call id 303) took 1039 ms. Trace:
I20260709 13:16:16.109154  4827 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.111919  3841 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:16.112257  4827 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:16.111791  3020 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8e1a4d71ef0f4287999b5ee60fe02740 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 48080cf0460346769ab046a4f9457aa5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:16.089872  3806 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.122745  3281 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:16.117422  3833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54908 (request call id 301) took 1138 ms. Trace:
I20260709 13:16:16.140302  3279 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:16.108942  3835 rpcz_store.cc:276] 0709 13:16:15.069571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.072627 (+  3056us) service_pool.cc:224] Handling call
0709 13:16:16.104217 (+1031590us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caeee 0000000000375939 00007fb3c113e1e0 00007fb3c12070c4 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:16.108401 (+  4184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13373184}
W20260709 13:16:16.142411  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 52941.5us
I20260709 13:16:16.142666  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:16.143857  3806 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.145399  5149 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.145401  5137 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.154637  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:16.159662  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:16.160704  3135 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:16.162993  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.163574  3127 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
W20260709 13:16:16.164289  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.142469  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:16.166040  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.164868  3176 connection.cc:256] RPC call timeout handler was delayed by -1.1986673659998814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 13:16:16.173837  4887 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:16.174152  3102 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:16.174804  4887 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:16.177003  3277 raft_consensus.cc:2410] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:16:16.177517  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 139026us
I20260709 13:16:16.177923  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:16.179132  4890 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.180083  4890 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.180979  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:16.181703  5135 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:16.181916  3133 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:16.186201  3131 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:16.190860  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2013) took 1112 ms. Trace:
I20260709 13:16:16.191401  3277 rpcz_store.cc:276] 0709 13:16:15.078369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.742695 (+664326us) service_pool.cc:224] Handling call
0709 13:16:16.190573 (+447878us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54001b80d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:16.190787 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993427712}
I20260709 13:16:16.193414  5102 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.192781  4890 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:16.200431  4936 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.202356  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 154) took 2095 ms. Trace:
I20260709 13:16:16.203462  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:16.206952  3209 rpcz_store.cc:276] 0709 13:16:14.106832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.500799 (+393967us) service_pool.cc:224] Handling call
0709 13:16:14.501058 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.510345 (+  9287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.510388 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:14.512772 (+  2384us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.684679 (+171907us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:14.876613 (+191934us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.201687 (+1325074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.201852 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.201932 (+    80us) raft_consensus.cc:1685] finished
0709 13:16:16.201958 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.202167 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1229780,"prepare.queue_time_us":274756,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":27290,"raft.queue_time_us":1241564,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":3202,"thread_start_us":367976,"threads_started":3,"wal-append.queue_time_us":324750}
I20260709 13:16:16.210137  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 188) took 1507 ms. Trace:
I20260709 13:16:16.208832  4956 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.212795  5106 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:16:16.227543  3176 connection.cc:256] RPC call timeout handler was delayed by -1.0672673659998964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
I20260709 13:16:16.215273  3128 rpcz_store.cc:276] 0709 13:16:14.703088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.910071 (+206983us) service_pool.cc:224] Handling call
0709 13:16:14.910372 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.486914 (+576542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.209447 (+722533us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b540032e1d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:16.209967 (+   520us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312255360}
I20260709 13:16:16.102909  3280 rpcz_store.cc:276] 0709 13:16:13.841887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.014690 (+1172803us) service_pool.cc:224] Handling call
0709 13:16:15.092354 (+ 77664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.669672 (+577318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.044593 (+374921us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54001ea354. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:16.044920 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1224684800}
W20260709 13:16:16.230502  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 86850.2us
W20260709 13:16:16.228127  3176 connection.cc:256] RPC call timeout handler was delayed by -1.0618673659998876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
I20260709 13:16:16.136360  3833 rpcz_store.cc:276] 0709 13:16:14.964961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.966553 (+  1592us) service_pool.cc:224] Handling call
0709 13:16:16.047099 (+1080546us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cae9c 00007fb3b90caa5b 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:16.102912 (+ 55813us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11052416}
W20260709 13:16:16.236333  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 69375.6us
I20260709 13:16:16.171976  5021 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:16.242129  5099 consensus_queue.cc:1059] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:16:16.243444  4826 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:16.244112  4826 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.254645  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:16.255506  3127 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:16.256840  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:16.257524  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:16.257696  3249 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:16.259220  5092 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:16.260396  5106 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:16.259971  5092 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:16.261126  5106 raft_consensus.cc:697] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:16.261421  5012 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.261710  4887 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:16.262027  5012 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:16.262840  5092 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:16.262290  5106 consensus_queue.cc:237] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.264128  4936 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:16.264433  5012 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:16.265632  3130 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:16.265928  3129 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:16.266839  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:16.266924  5021 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.267894  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:16.239910  3806 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.269393  4936 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.270084  4936 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.271039  3806 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:16.271703  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:16.272186  3806 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.272461  5135 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:16.273192  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.273416  5135 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:16.262444  4887 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:16.243566  5099 raft_consensus.cc:3055] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:16.268923  3833 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 4: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:16.277611  3134 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:16.278607  5149 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:16.286347  3135 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
W20260709 13:16:16.293148  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.294370  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:16.295059  3277 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.272204  4936 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:16.243624  4956 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:16.280809  5099 raft_consensus.cc:740] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:16.306593  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:16.301146  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.263465  5092 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:16:16.303475  5021 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:16.281092  5135 raft_consensus.cc:697] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:16.305763  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:16.306578  3284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d682925c4b46799576472fe9f97a07"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:16:16.307111  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.307303  3806 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:16.279042  4887 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:16.309456  3841 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:16.310225  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:16.315927  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:16.318688  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:16.319326  3133 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.317538  3284 raft_consensus.cc:606] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:16:16.315009  4887 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.323334  3127 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:16.324286  3134 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:16.318856  3033 catalog_manager.cc:5697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 1 to 2, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 2 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:16.324400  3034 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38226 (request call id 250) took 11354 ms (client timeout 15000 ms). Trace:
I20260709 13:16:16.326578  3284 raft_consensus.cc:614] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:16.330611  4944 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:16:16.334308  3842 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:16.335354  5134 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:16.335989  5134 raft_consensus.cc:697] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:16.336025  5101 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:16.337196  5134 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:16.338888  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:16.340852  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.341917  5135 consensus_queue.cc:237] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:16.345273  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:16.350996  5092 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:16.355670  5092 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.356961  4758 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:16:16.382860  3277 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:16.370282  5102 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.370275  3033 catalog_manager.cc:5697] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 2 to 3, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 3 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:16.391141  5178 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.392131  5178 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.393505  3835 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:16.378346  5149 consensus_queue.cc:1059] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:16:16.395465  5149 raft_consensus.cc:3055] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:16.395954  5149 raft_consensus.cc:740] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:16:16.402593  3177 connection.cc:256] RPC call timeout handler was delayed by -1.1590917910000371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 13:16:16.404872  3836 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEARNER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:16.405289  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:16.405613  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:16.406255  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:16.409858  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:16.410784  3210 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:16.411742  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:16.423190  3277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:16:16.423830  3277 raft_consensus.cc:606] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:16.412755  3211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2070) took 1414 ms. Trace:
I20260709 13:16:16.413223  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2021) took 1189 ms. Trace:
W20260709 13:16:16.414096  5175 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:16:16.414364  5174 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:16:16.414752  5099 consensus_queue.cc:260] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.415467  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:16.415693  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.417059  3177 connection.cc:256] RPC call timeout handler was delayed by -1.1572917910000342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260709 13:16:16.417654  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 110898us
I20260709 13:16:16.422036  3284 raft_consensus.cc:1240] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:16.424798  3278 rpcz_store.cc:276] 0709 13:16:15.126871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.759565 (+632694us) service_pool.cc:224] Handling call
0709 13:16:15.759871 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.244105 (+484234us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:16.244512 (+   407us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.309797 (+ 65285us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:16.309848 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:16.309895 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.313656 (+  3761us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.316408 (+  2752us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4651,"prepare.queue_time_us":6957,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":2295,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":3229,"thread_start_us":64697,"threads_started":1,"wal-append.queue_time_us":125410}
I20260709 13:16:16.432219  3203 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.364090  4936 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:16:16.436995  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:16.440238  3130 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.443503  3206 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:16.436290  3102 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:16.445770  3832 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
W20260709 13:16:16.447307  5176 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.205s	user 0.000s	sys 0.002s
I20260709 13:16:16.447172  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.448460  5109 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.449025  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.449306  5109 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.450100  5109 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:16.450655  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.451504  5109 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.452173  3101 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.453058  5109 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:16.453344  5092 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:16.454077  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.453359  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:16.454532  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.468348  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:16.424505  3211 rpcz_store.cc:276] 0709 13:16:14.935904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.962093 (+ 26189us) service_pool.cc:224] Handling call
0709 13:16:14.962414 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.962614 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:15.290649 (+328035us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.241950 (+951301us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:16.287590 (+ 45640us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:16.315056 (+ 27466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.321063 (+  6007us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.350569 (+ 29506us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":776544,"prepare.queue_time_us":51057,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":51,"raft.queue_time_us":775725,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":80,"thread_start_us":448734,"threads_started":3,"wal-append.queue_time_us":166924}
I20260709 13:16:16.470100  3101 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.470651  4956 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:16.471189  5102 consensus_queue.cc:1059] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:16.472232  4862 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.472393  5109 consensus_queue.cc:1059] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:16.472981  4862 raft_consensus.cc:3055] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:16.468351  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:16.468413  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:16.472241  5102 consensus_queue.cc:1059] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:16:16.474336  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:16.474685  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:16.477820  3280 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:16:16.443526  5149 consensus_queue.cc:260] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:16.478302  5101 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:16.478505  5070 consensus_queue.cc:1059] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:16.479135  4758 raft_consensus.cc:3055] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:16.505354  4758 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:16.506356  4758 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:16.508054  4758 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.479282  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:16.509872  3840 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:16.510028  3204 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:16:16.481166  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.511221  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:16.511348  4887 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.511976  3204 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.465827  3033 catalog_manager.cc:5697] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 1 to 3, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 3 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:16.482815  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.513841  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:16.483152  5092 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:16.514925  3205 raft_consensus.cc:2376] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5. Re-sending same reply.
I20260709 13:16:16.514387  3033 catalog_manager.cc:5697] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 4 to 7, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 7 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:16.515280  5092 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.516125  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:16.517609  4864 consensus_meta.cc:287] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.647s	user 0.012s	sys 0.008s
I20260709 13:16:16.517761  3208 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:16.490873  4862 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:16.519786  4862 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:16.520596  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:16.521029  5092 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:16.525794  3206 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.526818  5178 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:16.528977  3205 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.529434  3210 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:16.530542  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:16.531080  3210 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.483492  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:16.471735  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.486564  5021 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:16.545459  4864 raft_consensus.cc:3055] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:16.545951  4864 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:16.547034  4864 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:16.547497  3203 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:16.548393  4864 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:16.454537  5173 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.192s	user 0.000s	sys 0.005s
I20260709 13:16:16.489892  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:16.504467  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.489629  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:16.541378  4969 consensus_queue.cc:1059] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:16.542848  3832 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:16.543803  5149 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.545603  5021 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:16.537493  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:16.560370  3285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:16:16.562757  3285 raft_consensus.cc:606] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:16:16.563148  3285 raft_consensus.cc:614] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:16.559240  3209 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:16.554669  5070 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.569530  3207 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 1.
I20260709 13:16:16.521070  4862 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.531924  3133 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:16.516939  3033 catalog_manager.cc:5697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 3 to 4, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 4 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:16.553025  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 69626.7us
I20260709 13:16:16.553910  3279 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
W20260709 13:16:16.326059  3034 rpcz_store.cc:269] 0709 13:16:04.970386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.987056 (+ 16670us) service_pool.cc:224] Handling call
0709 13:16:16.322393 (+11335337us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:15.774384 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:15.798455 (+ 24071us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:15.798495 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:16:15.798515 (+    20us) tablet.cc:662] Decoding operations
0709 13:16:15.830645 (+ 32130us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:15.832048 (+  1403us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:15.832079 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:16:15.833000 (+   921us) tablet.cc:701] Row locks acquired
0709 13:16:15.833022 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:16:15.833218 (+   196us) write_op.cc:270] Start()
0709 13:16:15.833334 (+   116us) write_op.cc:276] Timestamp: P: 1783602975833170 usec, L: 0
0709 13:16:15.833355 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:16:15.834143 (+   788us) log.cc:844] Serialized 2459 byte log entry
0709 13:16:15.866776 (+ 32633us) op_driver.cc:464] REPLICATION: finished
0709 13:16:15.868316 (+  1540us) write_op.cc:301] APPLY: starting
0709 13:16:15.868401 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:15.868604 (+   203us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:15.868761 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:15.870113 (+  1352us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:15.870310 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:16:15.870350 (+    40us) write_op.cc:312] APPLY: finished
0709 13:16:15.870576 (+   226us) log.cc:844] Serialized 53 byte log entry
0709 13:16:15.870756 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:15.870984 (+   228us) write_op.cc:454] Released schema lock
0709 13:16:15.871051 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:15.871441 (+   390us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:15.871478 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2262014,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":1290,"apply.run_cpu_time_us":2609,"apply.run_wall_time_us":3089,"num_ops":6,"prepare.queue_time_us":63481,"prepare.run_cpu_time_us":21927,"prepare.run_wall_time_us":79615,"raft.queue_time_us":1025,"raft.run_cpu_time_us":1372,"raft.run_wall_time_us":2162,"replication_time_us":33250,"thread_start_us":75016,"threads_started":4,"wal-append.queue_time_us":19786}]]}
I20260709 13:16:16.550424  3130 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:16.578289  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:16.579123  3249 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:16.553437  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:16.600564  3211 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.616106  3281 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:16.504878  5135 consensus_queue.cc:1059] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:16:16.636575  5178 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.646950  5178 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:16.652470  5183 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:16:16.654172  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 60348us
W20260709 13:16:16.656371  5184 log.cc:927] Time spent T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:16:16.657845  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 132778us
I20260709 13:16:16.659022  5102 raft_consensus.cc:3055] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:16.659456  5102 raft_consensus.cc:740] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:16.661156  5092 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.666556  3033 catalog_manager.cc:5697] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 1 to 4, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 4 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:16.589531  4810 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:16.669552  4810 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:16.670639  4810 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.672241  5135 raft_consensus.cc:3055] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:16.672712  5135 raft_consensus.cc:740] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:16.644145  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:16.644876  5052 raft_consensus.cc:3055] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:16.645948  4887 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:16.660403  5102 consensus_queue.cc:260] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.654268  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:16.643846  4959 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.668334  3033 catalog_manager.cc:5697] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 3 to 4, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 4 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:16.683081  3210 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:16.660753  3206 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:16.684814  3281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7ab044361f54dae84978720aac3998c"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:16:16.689100  3281 raft_consensus.cc:606] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:16.676761  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:16.686121  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.693919  5092 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:16.692632  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:16.697913  5092 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:16.699863  3204 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:16.701123  3208 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:16.700917  3249 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:16.710950  4936 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.711797  4936 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.713457  5178 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:16.714202  5099 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:16.640950  5101 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:16.718879  3204 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:16:16.699684  3207 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.721443  3205 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:16.726275  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:16.604053  5109 consensus_queue.cc:1059] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:16:16.733089  3211 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:16.677875  5052 raft_consensus.cc:740] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:16.736670  3205 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:16.717010  5070 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.735116  3033 catalog_manager.cc:5697] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 2 to 4, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 4 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:16:16.747344  3177 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:16.753505  3033 catalog_manager.cc:5697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 1 to 2, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 2 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:16.757217  3209 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.765344  3204 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:16.773855  3206 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:16.682785  5135 consensus_queue.cc:260] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:16.782361  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 84838.3us
I20260709 13:16:16.784446  3832 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:16.789618  3136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:16:16.789932  3206 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:16.790295  3136 raft_consensus.cc:606] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.790666  3136 raft_consensus.cc:614] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:16.791752  3206 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:16.792240  3206 pending_rounds.cc:85] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 2
I20260709 13:16:16.792588  3206 pending_rounds.cc:107] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:16.793864  3207 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:16.797183  5052 consensus_queue.cc:260] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:16.797791  5045 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:16.798347  5052 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.798559  5045 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:16.800355  5021 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:16.801347  4826 consensus_meta.cc:287] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.557s	user 0.005s	sys 0.009s
I20260709 13:16:16.801775  4826 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.804124  4826 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:16.813452  5101 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.814368  5101 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.816373  3210 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:16.781265  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 57474.3us
W20260709 13:16:16.817741  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.819351  3206 raft_consensus.cc:2889] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:16.775019  5178 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.827149  3204 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:16.815765  5102 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.835860  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.843149  3177 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.818413  5070 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:16:16.848220  3209 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:16.850620  4887 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:16.851441  4887 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:16.851881  4887 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:16.853408  3278 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:16:16.854005  4758 raft_consensus.cc:3055] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:16.854218  3278 raft_consensus.cc:606] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:16:16.854488  4758 raft_consensus.cc:740] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:16.850862  3177 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:16.856374  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 384726us
I20260709 13:16:16.856474  5178 raft_consensus.cc:2764] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 13:16:16.860975  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.878000  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:16.880355  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:16.881517  5178 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.882048  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:16.870932  4944 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:16:16.883368  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:16.884089  4890 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.884627  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:16.885664  5135 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:16.888538  3101 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:16:16.888728  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.882326  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:16:16.896446  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 45821us
I20260709 13:16:16.891275  4936 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:16.900220  3177 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.872025  5021 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:16.902045  5021 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:16.901933  3101 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.902580  5021 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.903570  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.904400  5109 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:16.904752  5109 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:16.904910  4959 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.905148  5109 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.905776  4959 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.909837  3278 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:16.910377  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:16.910737  5092 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.919492  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:16.923913  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.950968  4959 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:16.921048  5178 consensus_queue.cc:1059] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:16:16.953349  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 51910.9us
W20260709 13:16:16.954485  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 54372.7us
I20260709 13:16:16.956784  5178 raft_consensus.cc:3055] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:16.855674  4758 consensus_queue.cc:260] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:16.973867  4864 raft_consensus.cc:993] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:16:16.974232  5137 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:16.974756  4699 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.953585  5092 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.924777  5101 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.989775  3177 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:16.968835  5178 raft_consensus.cc:740] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:16:16.993378  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 111406us
I20260709 13:16:16.920156  5177 consensus_queue.cc:1059] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:16:17.000171  5179 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:16.996515  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.005168  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.890872  5045 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:16.983718  4810 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:17.001745  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 82345.4us
I20260709 13:16:16.991277  4936 raft_consensus.cc:1081] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:16:16.997529  4956 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:17.004108  5179 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:17.024341  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 45953.1us
I20260709 13:16:17.029757  3101 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:17.029829  4956 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.010061  5178 consensus_queue.cc:260] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.031445  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:17.033192  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.033380  4956 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:17.033941  5191 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:17.034680  5191 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:17.036376  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.040767  5101 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:17.031528  5178 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:17.032843  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:17.064481  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.046619  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 162057us
I20260709 13:16:17.048712  3177 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:17.024832  4810 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.069655  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:17.070432  3202 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:17.046700  5179 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:17.084334  5185 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:16:17.081470  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:17.089546  3204 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.084163  3208 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:17.082878  3177 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
W20260709 13:16:17.091095  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 64877.5us
I20260709 13:16:17.081683  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:17.092502  3206 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:16:17.094066  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.095206  3281 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:17.088344  4758 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.053269  4890 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:17.104285  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 71527us
I20260709 13:16:17.091761  4959 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:17.030402  5109 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:17.118264  3204 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:17.110642  3208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34342
I20260709 13:16:17.132817  3208 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:17.133339  3208 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:17.133229  3101 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:17.134591  5177 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:17.135196  5177 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.135746  5177 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:17.152009  5109 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:17.123209  4890 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:17.165688  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 67256.1us
I20260709 13:16:17.153388  5203 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:16:17.177481  5201 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:16:17.171850  4887 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:17.180177  3805 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.613s (SENT) [suppressed 37 similar messages]
I20260709 13:16:17.181289  3209 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:17.182801  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 64925.7us
I20260709 13:16:17.132141  5021 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.172564  5191 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.197613  5191 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.200294  5191 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:17.201671  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:17.201833  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:17.202382  3206 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:17.167623  4959 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.202792  3832 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
W20260709 13:16:17.206694  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.207480  3101 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:17.208580  3102 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:17.208910  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:17.209399  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.209774  5052 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.210213  4959 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:17.210732  4959 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.211181  4959 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.211143  5052 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:17.223230  5195 log.cc:927] Time spent T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.156s	user 0.001s	sys 0.001s
W20260709 13:16:17.227761  5196 log.cc:927] Time spent T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:16:17.236546  3208 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.238842  5134 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:17.172375  5204 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.239997  3211 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:17.240453  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 117039us
W20260709 13:16:17.241250  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 59808.5us
W20260709 13:16:17.241684  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 110338us
W20260709 13:16:17.242645  3020 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8e1a4d71ef0f4287999b5ee60fe02740 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 48080cf0460346769ab046a4f9457aa5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:16:17.242753  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 159934us
I20260709 13:16:17.243958  3249 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:17.248538  3208 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:17.249260  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.248804  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:17.243712  3177 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:17.253530  3205 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:17.261548  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.266881  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:17.270401  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 114400us
W20260709 13:16:17.268802  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.250708  5106 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:17.239466  5134 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.249389  5201 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:16:17.266058  4944 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:17.271176  5101 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:17.270598  4887 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:17.250850  4826 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:16:17.239689  5204 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:17.292069  3805 leader_election.cc:336] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.054s (SENT)
I20260709 13:16:17.266862  4862 consensus_queue.cc:1059] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:16:17.294274  5208 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.295015  4862 raft_consensus.cc:3055] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:17.294960  5208 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.297299  5198 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:16:17.294278  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 50629.1us
I20260709 13:16:17.268326  5209 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.295487  4862 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:17.277629  5106 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.273944  5178 consensus_queue.cc:1059] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:16:17.302747  3177 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:17.298025  5198 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:17.300179  5177 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.313692  4887 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:16:17.319815  5200 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:16:17.320241  4810 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:17.321569  5208 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:17.321666  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.326277  4864 consensus_queue.cc:1059] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:16:17.329469  5188 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.433s	user 0.004s	sys 0.000s
I20260709 13:16:17.333341  5206 raft_consensus.cc:3055] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:17.333881  5206 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:17.333586  4959 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.334868  5206 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.317570  4862 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.287736  5052 consensus_queue.cc:1059] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:16:17.303366  5106 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.316795  5177 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:17.346431  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 61672.2us
W20260709 13:16:17.350608  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 52208.7us
I20260709 13:16:17.350885  4699 raft_consensus.cc:3055] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:17.317608  5198 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:17.302794  4944 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.356076  4699 raft_consensus.cc:740] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:17.354095  5070 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:17.350337  5206 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.351255  5208 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:17.314265  5201 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
W20260709 13:16:17.379837  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 77153.1us
I20260709 13:16:17.380467  4890 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:17.382272  4953 raft_consensus.cc:993] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: : Instructing follower 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:16:17.382340  4944 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:17.382867  4959 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:17.383527  5204 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:17.384713  5021 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:17.385421  4862 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.387805  5070 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:17.388389  5070 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:17.391769  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 108252us
I20260709 13:16:17.377308  4919 raft_consensus.cc:3055] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:16:17.397123  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.405148  4953 raft_consensus.cc:1081] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Signalling peer 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:16:17.378844  5101 raft_consensus.cc:697] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:17.395237  4919 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:17.421482  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.423390  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:17.426542  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47727.5us
I20260709 13:16:17.384990  4699 consensus_queue.cc:260] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.431875  5101 consensus_queue.cc:237] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.433766  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:17.434401  3838 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.434859  3202 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:17.436625  5225 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:17.434638  5221 consensus_queue.cc:1059] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:17.437465  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:17.437875  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:17.441788  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:17.442723  3832 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 2: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:17.447772  3838 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:17.466455  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:17.471778  3102 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:17.477070  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:17.414855  4953 consensus_queue.cc:1059] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:16:17.480441  3838 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 6. Ops: []
I20260709 13:16:17.483933  3136 raft_consensus.cc:1240] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:17.479084  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 191570us
W20260709 13:16:17.485126  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 44541.5us
I20260709 13:16:17.486032  3130 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:17.486874  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:17.487461  3133 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:17.437252  5225 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.491895  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:17.502513  3177 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:17.424928  5179 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.501885  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:17.469486  4959 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:16:17.503002  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:17.440737  5191 consensus_queue.cc:1059] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:16:17.546437  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:17.493697  5208 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:17.552366  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:17.553048  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45108.6us
W20260709 13:16:17.550375  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 52577.9us
I20260709 13:16:17.491281  5220 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.558157  3203 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:17.558725  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 65110.7us
I20260709 13:16:17.560868  5226 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.130s
I20260709 13:16:17.512658  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:17.512380  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:16:17.569485  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.570112  3250 leader_election.cc:336] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.503s (SENT)
I20260709 13:16:17.510046  5231 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:17.576953  3250 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:17.573016  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 61392.8us
W20260709 13:16:17.575654  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 73221.5us
I20260709 13:16:17.494166  4810 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:16:17.552915  4890 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:17.582911  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:17.590334  5198 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:17.590837  5198 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:17.591717  5198 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.598852  3210 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:17.560354  5208 raft_consensus.cc:697] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:17.592835  5198 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:17.609813  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.610176  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.610229  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.610659  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.607815  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:17.599782  4953 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.585788  5106 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.618515  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:17.620303  5230 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.583705  5220 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:17.624061  5220 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:17.624714  5230 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:17.625460  5211 log.cc:927] Time spent T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:17.626145  3841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04"
dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:58470
I20260709 13:16:17.626708  3841 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:17.627053  3841 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.627199  5230 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:17.597415  5178 consensus_queue.cc:1059] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:16:17.627496  5070 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.628499  5178 raft_consensus.cc:3055] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:17.629005  5178 raft_consensus.cc:740] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:17.612239  5201 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.630077  5178 consensus_queue.cc:260] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.631835  5178 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.633275  4953 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.634654  3285 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:17.634511  5236 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:16:17.636264  5236 consensus_queue.cc:1059] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:17.636304  4953 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:17.637719  5224 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.638257  5237 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:17.638646  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:17.638849  5237 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:17.639365  3278 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:17.638284  5224 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.644210  5224 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:17.646983  3281 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:17.650053  3279 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:16:17.655233  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47561.1us
I20260709 13:16:17.659941  4864 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:17.662951  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:17.666627  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 75490.1us
I20260709 13:16:17.668870  5231 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:17.671109  3276 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:17.676348  5231 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.685962  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:17.687358  3279 raft_consensus.cc:2410] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:16:17.682893  5203 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:16:17.690450  5070 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:17.684576  5106 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:17.699574  5223 raft_consensus.cc:2764] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
W20260709 13:16:17.712110  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 154194us
W20260709 13:16:17.705713  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.713168  5214 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.713718  5214 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.715265  5149 consensus_queue.cc:1059] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:17.716331  5214 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:17.716794  5149 raft_consensus.cc:3055] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:17.717413  5149 raft_consensus.cc:740] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:17.718214  3210 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:16:17.706018  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45508.8us
I20260709 13:16:17.706058  5179 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:17.719779  3278 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:17.707358  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:17.710011  4864 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.721704  4864 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.722280  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:17.710927  3101 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:17.698173  5226 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:17.723420  5226 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:17.711169  5208 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.710661  3202 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:17.724463  5226 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.706804  5225 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:17.718241  5149 consensus_queue.cc:260] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.727058  5149 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.723796  4864 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:17.722316  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:17.699548  3841 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:17.732398  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 48661.3us
I20260709 13:16:17.640210  5237 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.738639  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:17.744499  5052 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:17.745137  5052 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:17.745375  5240 consensus_queue.cc:1059] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:16:17.746457  4959 raft_consensus.cc:3055] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:17.746891  5246 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:16:17.747421  4959 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:17.749554  3833 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:17.749253  4959 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.750730  4959 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:17.751328  5070 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:17.751901  5070 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.746281  5052 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.756142  5237 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:17.756664  5236 consensus_queue.cc:1175] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "43b01d5a97e149008d543a6615219928" responder_term: 5 status { last_received { term: 5 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 5 index: 3 } }
I20260709 13:16:17.759024  3278 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:16:17.760644  3841 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:17.762094  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 51318.7us
I20260709 13:16:17.762323  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:17.763063  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:17.764259  3101 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:17.765661  4758 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.768781  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:17.769883  3279 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:17.770730  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:17.773736  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:17.774451  3278 raft_consensus.cc:3055] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:17.774731  3278 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:17.786469  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:17.790072  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:17.780419  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:17.801954  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:17.802646  3276 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:17.794492  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:17.795928  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.773406  5246 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:17.795764  5191 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:16:17.798064  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:17.800119  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:17.810051  3277 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:17.777412  5109 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.800449  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:17.818501  5239 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:17.809551  3128 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:17.819157  5239 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:17.813834  5204 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:17.814347  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.820979  5204 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.823428  5215 raft_consensus.cc:3055] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:17.824047  5215 raft_consensus.cc:740] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:17.824662  5204 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:17.826491  5200 raft_consensus.cc:3055] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:17.826406  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:17.827116  5200 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:17.828274  3127 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:16:17.828588  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:17.829552  3135 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:17.830142  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:17.830123  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:17.831202  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:17.832142  3133 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:17.832695  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:17.833549  5070 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:17.834020  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:17.834262  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:17.835168  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:17.835991  3211 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:17.829516  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:17.837337  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:17.838129  3280 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:17.840173  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:17.835191  3282 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:17.833631  3134 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:17.849579  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.850311  4699 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:17.855119  3281 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:17.859230  5246 raft_consensus.cc:697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:17.862385  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:17.883929  3134 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:17.890725  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:17.893041  3210 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.893206  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:17.894253  3211 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:17.894652  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:17.895522  3202 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:17.893018  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:17.897650  3203 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:17.796835  5231 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:16:17.901973  5236 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:17.825302  5215 consensus_queue.cc:260] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.820348  5239 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.907903  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:17.891013  5109 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.860414  5246 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:17.916917  5134 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:17.920040  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.942435  5215 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:17.944450  5109 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.949890  5239 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.920639  3203 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:17.960230  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 162779us
I20260709 13:16:17.963840  5200 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:17.965256  5241 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:17.967684  3209 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:17.913612  5236 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:17.998772  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.000288  3840 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:18.002648  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:18.003512  3207 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:17.913061  3277 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:18.002863  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:18.007248  3211 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:18.010895  3205 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:18.010859  3210 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:18.013538  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:18.047472  3204 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
W20260709 13:16:18.051776  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 51680.7us
I20260709 13:16:18.002977  5045 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:18.060194  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 281725us
I20260709 13:16:18.066604  5109 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:18.067214  5225 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.067746  5225 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:18.070955  5225 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:18.073617  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:18.074741  3282 raft_consensus.cc:2410] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:18.076201  5236 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:18.076761  3134 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:18.073755  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:18.078161  3281 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:17.914525  4919 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:18.081821  3277 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:18.057179  3250 leader_election.cc:336] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.632s (SENT)
I20260709 13:16:18.083750  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:18.085624  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:18.062950  3249 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:18.087174  3249 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:18.091006  5225 consensus_queue.cc:1175] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "43b01d5a97e149008d543a6615219928" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:18.092674  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:18.093389  5099 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:18.093868  5099 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.056043  5134 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.094290  5099 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.094666  5134 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:18.093374  3277 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.098505  3249 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:18.103955  3250 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:18.106374  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:18.109668  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:18.055270  5200 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:18.127192  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.117483  3208 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:18.112406  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.110602  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:18.132256  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:18.132512  3206 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:18.104350  5208 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:18.133388  3131 raft_consensus.cc:2410] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:18.132999  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.134559  3135 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:18.128472  3203 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:18.137691  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.138296  3130 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:18.138999  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:18.139076  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:18.118371  3132 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:18.141199  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:18.143885  3277 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:18.145539  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.146464  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.146714  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:18.147212  3133 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.112535  5226 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.124862  4864 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:18.125012  4936 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:18.303169  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.124550  5149 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.110932  4887 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:18.094033  5045 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:18.121529  4919 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.122066  5134 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:18.336412  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.304947  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.342613  3134 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:18.335006  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:18.112782  5052 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.112321  4699 consensus_queue.cc:1059] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.194s
W20260709 13:16:18.365828  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 363235us
I20260709 13:16:18.352438  3135 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:18.370843  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 231888us
I20260709 13:16:18.372496  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:16:18.354728  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 218421us
W20260709 13:16:18.355355  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.146277  5179 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:18.354748  3136 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:18.378189  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.137013  5208 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.122077  5198 consensus_queue.cc:1059] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.220s
I20260709 13:16:18.149899  5244 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:18.376952  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:18.364619  3133 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:18.110687  4890 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.231s
W20260709 13:16:18.374958  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.355170  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.303340  5254 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:18.150106  5204 consensus_queue.cc:1059] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.382s
I20260709 13:16:18.337112  5241 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.342495  4864 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.137207  5101 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:18.376619  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.598067  5241 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:18.598615  3129 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:18.598826  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:18.599613  3279 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:18.596275  4890 raft_consensus.cc:2764] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:16:18.600713  5241 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:18.343609  4936 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.505756  3130 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
W20260709 13:16:18.562520  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.599577  4864 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:18.521819  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 149402us
I20260709 13:16:18.615902  3251 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:18.341436  5231 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:18.622032  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.569491  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:18.632071  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 73159.6us
I20260709 13:16:18.623337  3135 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:18.349042  5229 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:18.356920  5240 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.561609  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.628582  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:18.653026  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.606578  5177 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:18.357770  5149 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:18.595752  5198 raft_consensus.cc:3055] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:18.684355  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 55843.9us
I20260709 13:16:18.520260  5102 raft_consensus.cc:3055] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:18.671272  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:18.345182  5223 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.668771  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.690254  3131 raft_consensus.cc:2376] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5. Re-sending same reply.
I20260709 13:16:18.668725  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:18.675216  5099 consensus_meta.cc:287] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260709 13:16:18.675717  5045 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:18.676975  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:18.680086  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.695366  3132 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:18.680750  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:18.593622  5210 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.561054  5221 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.386564  4959 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.388594  5179 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:18.685232  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:18.702560  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:18.703244  3838 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:18.500109  3280 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:18.346832  4758 consensus_meta.cc:287] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.004s
W20260709 13:16:18.686782  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 310069us
I20260709 13:16:18.688630  3127 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.711078  3249 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:18.593945  5244 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:18.714659  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.635142  5241 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:18.683108  5229 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.151299  5206 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.550s
I20260709 13:16:18.711982  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.719139  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:18.689589  5239 consensus_meta.cc:287] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.692s	user 0.003s	sys 0.007s
I20260709 13:16:18.721199  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:18.722465  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:18.380349  5134 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.672932  3278 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:18.724210  3278 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.683840  5198 raft_consensus.cc:740] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:18.689616  5106 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:18.726464  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.693693  5260 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:18.666807  5177 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:18.696873  5210 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:18.689013  5102 raft_consensus.cc:740] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:18.733023  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:18.765967  3284 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:18.709868  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.687391  5208 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.727344  3135 raft_consensus.cc:2410] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:16:18.627450  4936 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.727852  4890 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.707417  5179 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.729357  3130 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:18.634073  5231 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:18.689560  5237 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.731590  5101 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:18.753897  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.622417  5254 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:18.715602  4758 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:18.692396  5240 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:18.774000  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 52924.6us
I20260709 13:16:18.498145  5052 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:18.716853  5229 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.783119  3278 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:18.813766  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52014 (request call id 197) took 1046 ms. Trace:
I20260709 13:16:18.814395  3278 rpcz_store.cc:276] 0709 13:16:17.767682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.773479 (+  5797us) service_pool.cc:224] Handling call
0709 13:16:18.672390 (+898911us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b4c003da740. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3ba4bba20 00007fb3ba4cca29 00007fb3ba492644 00007fb3ba4b9f2d 00007fb3ba4b9b93 00007fb3bc1ea18b 00007fb3bc1eacb5 00007fb3bc1e5f30 00007fb3bc1e77de 00007fb3bc1f327c 00007fb3c11b4b17
0709 13:16:18.813691 (+141301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10984832}
I20260709 13:16:18.712404  4959 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:18.731619  3129 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:18.817340  4826 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:18.817615  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.818269  3129 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:18.818853  4826 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:18.818991  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:18.819208  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.798216  4890 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:18.782533  5206 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:18.792308  5045 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.728612  5106 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.746091  3249 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:18.835031  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 89171.6us
I20260709 13:16:18.712256  5221 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:18.797327  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.725987  5226 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.801435  3132 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:18.768455  5223 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:18.768224  5214 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:18.707152  5099 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:18.807025  3136 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:18.758507  5241 raft_consensus.cc:697] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:18.769001  5260 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:18.789873  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:18.757803  5239 consensus_queue.cc:1059] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:16:18.730382  5134 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:18.839174  3131 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:18.834565  5070 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.800922  5101 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:18.845811  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:18.846606  3127 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:18.847005  3135 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:18.846490  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 967) took 1225 ms. Trace:
I20260709 13:16:18.863811  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:18.837771  5258 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:16:18.820226  4826 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:18.864034  3285 rpcz_store.cc:276] 0709 13:16:17.615841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.616115 (+   274us) service_pool.cc:224] Handling call
0709 13:16:18.840694 (+1224579us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b5400318b54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:18.840821 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35592576}
I20260709 13:16:18.841558  5223 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:18.826913  5052 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:18.827097  4890 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:18.859300  3132 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:18.820842  3250 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:18.885409  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 189739us
I20260709 13:16:18.840917  4956 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:18.803752  5237 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:18.819891  3129 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:18.838657  5106 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.849129  5226 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:18.820237  5102 consensus_queue.cc:260] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:18.843139  5206 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:18.843485  5045 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:18.889403  3135 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.909497  3128 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:18.888840  3127 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:18.924589  3134 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:18.868644  5101 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.841704  5177 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.002563  3208 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:18.834259  5198 consensus_queue.cc:260] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:18.871272  5149 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.048316  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:19.007771  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:18.933678  4919 consensus_meta.cc:287] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.003s
W20260709 13:16:18.938436  5259 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.341s	user 0.000s	sys 0.003s
I20260709 13:16:19.018800  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:19.048897  3128 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:19.049345  3841 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:19.021714  3204 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.905352  5254 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:18.903925  5221 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:19.022293  5253 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.680s	user 0.004s	sys 0.000s
I20260709 13:16:19.022696  5206 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:19.023233  5102 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.001003  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:18.955638  5268 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.869596  5070 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:18.932442  5134 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:18.865304  5229 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:18.902510  5099 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:19.005394  4699 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.048134  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:19.084051  3208 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:19.045629  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:19.024912  5215 consensus_meta.cc:287] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.021s	user 0.007s	sys 0.007s
W20260709 13:16:19.060036  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.092252  3132 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:19.007360  4944 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:16:19.070958  4919 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.042570  4890 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.027124  5204 raft_consensus.cc:3055] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:19.092650  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 359418us
W20260709 13:16:19.091814  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 256119us
I20260709 13:16:19.007488  5109 consensus_queue.cc:1059] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:16:19.051972  5052 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.042s
W20260709 13:16:19.097973  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 277201us
I20260709 13:16:19.069607  5267 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.103785  3135 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:19.101090  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:19.065410  5177 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.109174  3250 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:19.113772  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:19.116029  3806 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:19.116744  5215 raft_consensus.cc:2764] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:19.105837  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:19.104997  3249 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:19.095733  5210 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:19.116080  3250 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:19.117264  5149 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:19.139827  3132 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:19.143486  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:19.100384  5244 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:19.104570  5204 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:19.053772  5260 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.121596  4956 raft_consensus.cc:697] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:19.117723  5134 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:19.043350  5241 consensus_queue.cc:237] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.121223  5210 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:19.157848  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:19.161845  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 239608us
I20260709 13:16:19.127506  5109 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:19.092527  4699 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.074348  5223 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.124006  5203 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:19.094600  5268 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.160419  5149 raft_consensus.cc:697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:19.189193  5099 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.107553  4890 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.147970  5231 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.148995  5269 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:19.174671  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:19.156661  4826 raft_consensus.cc:697] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:19.168512  5134 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.213356  5134 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.170750  3101 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:19.206506  5204 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.173889  3285 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:19.218392  5204 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.123030  5267 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.219435  4826 consensus_queue.cc:237] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.220396  5226 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:19.205415  5275 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:19.221051  5237 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.221378  5275 raft_consensus.cc:697] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:19.222705  5237 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.222333  5275 consensus_queue.cc:237] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.207013  5269 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.224290  5269 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.224913  3832 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
W20260709 13:16:19.226330  5265 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:16:19.227982  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2094) took 1111 ms. Trace:
I20260709 13:16:19.228459  3202 rpcz_store.cc:276] 0709 13:16:18.116219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.116361 (+   142us) service_pool.cc:224] Handling call
0709 13:16:18.132256 (+ 15895us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.137489 (+  5233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.137520 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.146167 (+  8647us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.851953 (+705786us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:18.852017 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.852120 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.227670 (+375550us) raft_consensus.cc:1685] finished
0709 13:16:19.227699 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.227902 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4798,"raft.queue_time_us":5453,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":158449,"spinlock_wait_cycles":52864,"thread_start_us":330053,"threads_started":1,"wal-append.queue_time_us":659392}
I20260709 13:16:19.231737  5229 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:19.208302  5099 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.238422  5262 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:19.239108  5262 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.240929  5236 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:19.183593  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.171698  5210 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.205741  5223 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:19.201779  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.178310  5273 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:19.254065  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 164) took 1552 ms. Trace:
I20260709 13:16:19.245663  5226 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:19.255409  5226 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.257566  5226 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.259164  5267 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:19.260226  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 89561.5us
I20260709 13:16:19.260854  3177 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:19.261727  3101 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:19.254448  3209 rpcz_store.cc:276] 0709 13:16:17.702091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.702257 (+   166us) service_pool.cc:224] Handling call
0709 13:16:17.711592 (+  9335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.001455 (+289863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.253810 (+1252355us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b5400189554. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:19.254000 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588118784}
I20260709 13:16:19.264837  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:19.265524  3841 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:19.207891  3203 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 3: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:19.265947  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:19.211810  5279 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:19.176602  5274 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.241678  5236 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.271762  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:19.272565  3208 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:19.273870  5236 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.274279  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:19.274740  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:19.247555  5210 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.253042  3834 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:19.279003  5262 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.253706  5273 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.181700  5109 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:19.198776  3276 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:19.209002  4956 consensus_queue.cc:237] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.259557  5268 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:19.267252  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 61213.5us
W20260709 13:16:19.206377  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 90422.9us
I20260709 13:16:19.271216  5274 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.284075  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:19.288002  3177 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:19.292173  3210 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.291630  3251 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:19.299209  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:19.302415  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:19.303115  3205 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:19.304081  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:19.306965  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:19.300532  3284 pending_rounds.cc:85] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 6
I20260709 13:16:19.310762  3284 pending_rounds.cc:107] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:16:19.311066  3284 raft_consensus.cc:2889] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:19.312602  3278 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:16:19.315932  3210 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:19.193387  5203 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:19.326625  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 64979.3us
W20260709 13:16:19.328081  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 160651us
I20260709 13:16:19.328985  3277 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:19.333398  3101 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:19.333895  3277 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:19.333305  5285 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:19.334638  5285 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.334885  5244 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:19.336158  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:19.336809  3279 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:19.336656  3250 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:19.338013  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:19.338660  3278 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:19.338891  3250 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:19.289307  5267 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:19.285792  5254 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:19.289196  5109 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.345535  3250 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:19.335517  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:19.341049  3806 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:19.310827  5226 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:19.350487  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:19.342142  3249 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:19.268874  5179 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.335036  5285 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.363824  3133 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:19.356158  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:19.366088  5242 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:16:19.366757  3806 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:19.367841  5286 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:19.411387  5286 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.411906  5286 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.345614  5254 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:19.412567  5254 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:19.413856  3840 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:19.370040  5106 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.371122  5264 consensus_queue.cc:1059] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:16:19.344951  5244 raft_consensus.cc:697] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:19.372411  5281 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.374469  5273 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.378506  5240 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:19.392781  5210 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.378242  5134 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.379176  5283 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:19.379709  5278 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.380326  5287 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:19.380643  5200 consensus_meta.cc:287] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.250s	user 0.011s	sys 0.003s
I20260709 13:16:19.340276  5099 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:19.382380  4936 consensus_meta.cc:287] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.571s	user 0.008s	sys 0.003s
I20260709 13:16:19.343689  5267 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.343395  5229 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:19.384801  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.340011  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:19.384279  3204 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:19.384351  3805 leader_election.cc:336] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.613s (SENT)
I20260709 13:16:19.388334  5241 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:19.290491  5101 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.392267  4959 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:17.996901  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:19.395304  5208 consensus_meta.cc:287] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.584s	user 0.004s	sys 0.008s
I20260709 13:16:19.395804  5269 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.398782  5203 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.402415  5220 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:19.406351  4758 raft_consensus.cc:3055] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:19.408269  4699 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:19.410010  5272 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:19.361891  5102 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:16:19.371938  5282 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.385839  3283 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
I20260709 13:16:19.437307  3806 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:19.507416  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.363499  3280 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 1.
I20260709 13:16:19.521770  3805 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:19.532547  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:19.458590  5237 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.458307  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:19.464407  5274 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:19.355154  5226 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.331254  5149 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.469724  5244 consensus_queue.cc:237] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:19.413950  5236 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:19.531785  5267 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.452872  5179 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.508126  5283 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:19.566995  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:19.567955  3205 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.542114  5200 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.462868  5106 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:19.495352  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.570246  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 182569us
I20260709 13:16:19.663903  3806 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:19.538766  5206 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.574395  5273 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:19.659507  5214 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.011s	sys 0.016s
I20260709 13:16:19.531776  5177 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:19.535336  5281 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.456640  5109 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.544886  4758 raft_consensus.cc:740] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:19.457692  5264 raft_consensus.cc:3055] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:19.534703  4936 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.632975  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:19.562762  5272 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:19.639394  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 293040us
I20260709 13:16:19.695364  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:19.640726  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 295352us
I20260709 13:16:19.696087  3132 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
W20260709 13:16:19.582831  3276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 980) took 1750 ms (client timeout 1722 ms). Trace:
W20260709 13:16:19.696843  3276 rpcz_store.cc:269] 0709 13:16:17.832668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.839939 (+  7271us) service_pool.cc:224] Handling call
0709 13:16:19.582626 (+1742687us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002f85d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:19.582753 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2800627968}
I20260709 13:16:19.564162  5220 raft_consensus.cc:697] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:19.538403  5208 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.655807  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:19.703231  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:19.703595  3285 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:19.658128  3208 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:19.648608  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:19.582072  5203 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:16:19.664695  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 280368us
I20260709 13:16:19.592852  5226 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:19.414471  4864 consensus_meta.cc:287] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.754s	user 0.010s	sys 0.006s
I20260709 13:16:19.573648  3210 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:19.582443  5268 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:19.658138  5287 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:19.660512  5283 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.705538  3211 raft_consensus.cc:2410] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:19.705505  3100 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:19.648624  5236 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.707231  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:19.707731  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:19.703974  3130 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:19.689023  4862 raft_consensus.cc:3055] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:19.761099  4956 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:19.761577  5287 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:19.718643  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:19.699914  5214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.011s	sys 0.017s
I20260709 13:16:19.719779  3131 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:19.763367  3208 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
W20260709 13:16:19.764173  5290 log.cc:927] Time spent T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:16:19.760892  4862 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:19.692488  5262 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:19.765607  5262 raft_consensus.cc:697] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:19.765287  4862 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.766501  4862 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:19.767536  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.664399  5200 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.691090  5264 raft_consensus.cc:740] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:19.691593  5297 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:19.701391  5272 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.729710  5203 raft_consensus.cc:697] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:19.570741  5282 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.669781  5206 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:19.759953  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 52331.4us
W20260709 13:16:19.782402  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.685710  5273 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.695590  5177 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.740726  5240 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.763499  5214 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:19.805647  3210 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:19.729620  5268 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.738667  5299 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:19.789347  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 79037us
I20260709 13:16:19.775307  3100 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:19.730177  4864 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.740814  5239 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:16:19.787745  5264 consensus_queue.cc:260] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.750914  3205 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:16:19.823975  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.814967  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:19.766584  5262 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.790295  5101 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:19.800675  5134 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.813350  5299 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:19.822054  4919 consensus_meta.cc:287] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.718s	user 0.013s	sys 0.003s
W20260709 13:16:19.849370  5298 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:16:19.851529  5273 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:19.854971  5295 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:16:19.856913  5269 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.824103  4699 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.857975  4864 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:19.857863  4699 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.861552  5208 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.821656  5237 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:19.836933  3205 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:19.835652  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:19.874258  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 43585.1us
I20260709 13:16:19.813735  5240 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.778784  5297 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.855434  5286 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.896584  5286 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:19.899497  5254 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:19.849411  5203 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.901283  5294 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:19.901690  5236 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.870042  4919 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:19.872100  5237 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.875331  5275 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:19.845628  5299 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.864355  5285 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.907413  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:19.889019  5208 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.920621  3281 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:19.903679  4699 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:19.895901  5297 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:19.926442  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:19.927615  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:19.930617  5289 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.270s	user 0.000s	sys 0.002s
I20260709 13:16:19.933048  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:19.933732  3209 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.909333  5237 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.906032  5282 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.834152  5220 consensus_queue.cc:237] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:19.942725  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:19.943641  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 236480us
I20260709 13:16:19.947435  3211 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:19.922617  4936 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:19.908941  5214 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:19.957609  5304 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:16:19.913025  5286 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:16:19.929068  5204 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:19.912159  5236 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:16:19.967634  5286 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:19.984762  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:19.922129  5280 consensus_queue.cc:1059] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:16:19.969496  5177 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:19.970188  3020 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8e1a4d71ef0f4287999b5ee60fe02740 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 48080cf0460346769ab046a4f9457aa5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:19.974287  5240 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.974905  5200 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:19.929237  5208 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:19.934382  4864 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
W20260709 13:16:19.984709  3805 leader_election.cc:336] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.690s (SENT)
I20260709 13:16:19.985854  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:19.988210  3211 raft_consensus.cc:2410] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:19.972440  5283 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:19.993017  3250 connection.cc:256] RPC call timeout handler was delayed by -1.5306926839998596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 13:16:19.993541  3805 leader_election.cc:336] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.690s (SENT)
I20260709 13:16:19.982950  5275 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:19.995136  4936 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:19.999295  5198 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.001804  3203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 2102) took 1001 ms. Trace:
I20260709 13:16:19.982579  5281 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.009903  3209 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:20.008684  3203 rpcz_store.cc:276] 0709 13:16:19.000406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.000530 (+   124us) service_pool.cc:224] Handling call
0709 13:16:20.001583 (+1001053us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400225954. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:20.001720 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331162880}
I20260709 13:16:19.993423  5254 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.022855  5308 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:20.015164  5149 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:20.034397  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:20.039536  3209 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.014631  5275 raft_consensus.cc:697] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:20.043210  3211 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:20.047595  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.048283  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:20.049154  3211 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.014345  5280 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:20.028928  5045 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:20.062203  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.078848  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.078922  3206 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:20.079668  3207 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:20.081173  5275 consensus_queue.cc:237] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.085661  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:20.062999  4890 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.063220  5208 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:20.063715  5134 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.070461  5206 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:20.073390  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.077673  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.014214  4936 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.039273  5149 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.103919  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:20.076329  4758 consensus_queue.cc:260] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.105551  3207 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:16:20.108618  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.104956  3211 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:20.108453  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:20.055403  5308 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.100250  5191 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.105800  5149 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.124142  3204 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:20.125135  3136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1151) took 1596 ms (client timeout 1778 ms). Trace:
I20260709 13:16:20.089154  5280 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:20.125562  3136 rpcz_store.cc:269] 0709 13:16:18.525590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.525779 (+   189us) service_pool.cc:224] Handling call
0709 13:16:20.122036 (+1596257us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540032dcd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:20.122142 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325405056}
I20260709 13:16:20.128659  3209 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:20.100564  5134 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.129398  5206 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.133180  4887 raft_consensus.cc:3055] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:20.162077  4887 raft_consensus.cc:740] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:20.133901  5045 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.163200  5045 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.163280  4887 consensus_queue.cc:260] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.164383  5308 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.164741  4887 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.165896  5045 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:20.166628  4936 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:20.170171  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:20.170994  5313 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:20.171502  5313 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:20.172830  3283 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 983) took 2339 ms (client timeout 2071 ms). Trace:
I20260709 13:16:20.172994  5283 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:20.173307  3283 rpcz_store.cc:269] 0709 13:16:17.833627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.833739 (+   112us) service_pool.cc:224] Handling call
0709 13:16:20.172593 (+2338854us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001784d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:20.172722 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2893847680}
I20260709 13:16:20.175917  5206 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.177127  5134 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.178001  3838 raft_consensus.cc:2410] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:20.178167  5206 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:20.180907  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.136976  5268 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.138441  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:20.140798  3249 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:20.185729  3202 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:20.186053  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45336.7us
I20260709 13:16:20.187155  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:20.141520  5221 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:20.143039  5099 consensus_queue.cc:1059] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:20.144235  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1152) took 1576 ms. Trace:
I20260709 13:16:20.149501  5208 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.149632  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:20.150488  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.152725  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:20.154793  5210 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:20.156786  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:20.123493  4758 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:20.191740  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.189134  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:20.205438  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.209287  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 59749us
I20260709 13:16:20.206566  3133 rpcz_store.cc:276] 0709 13:16:18.568424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.568579 (+   155us) service_pool.cc:224] Handling call
0709 13:16:18.568967 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.364258 (+795291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.143949 (+779691us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b54003dca54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:20.144144 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1791718272}
W20260709 13:16:20.245047  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 56024.5us
I20260709 13:16:20.246023  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:20.172478  5313 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.242854  3205 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.244263  5244 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.205992  4936 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:20.251641  3204 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:20.205840  4956 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:20.256325  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 105858us
I20260709 13:16:20.242621  5268 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:20.242836  5134 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:20.128669  5191 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.258312  3204 pending_rounds.cc:85] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 1
I20260709 13:16:20.274288  3204 pending_rounds.cc:107] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:20.274663  3204 raft_consensus.cc:2889] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:20.264098  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:20.266297  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:20.276803  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:20.206344  5045 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:16:20.250007  5099 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:20.256807  5220 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:20.205914  4959 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:16:20.278271  3209 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:20.259629  4956 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.279390  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:20.259917  4936 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.241559  5299 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:20.275332  5226 consensus_meta.cc:287] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.001s
I20260709 13:16:20.256050  5308 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:20.242555  5208 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.277812  4890 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:20.259526  5244 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.288131  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:20.287904  3207 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:20.267829  5268 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:20.289024  5281 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:20.258456  5206 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:16:20.308633  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:20.289430  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.289299  4936 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.277983  5134 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.289255  5099 raft_consensus.cc:697] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:20.316761  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:20.317147  4890 raft_consensus.cc:2764] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:20.333091  5271 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:20.326663  5267 consensus_meta.cc:287] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.666s	user 0.006s	sys 0.006s
I20260709 13:16:20.331095  5299 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.288458  4956 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.317217  5281 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:20.341243  5070 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:20.342598  5191 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:20.384788  5206 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:20.345679  5316 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:16:20.348258  3282 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:20.309540  5308 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.286865  5294 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:16:20.351644  5236 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.354132  5231 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.311321  5200 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:20.285033  5178 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:20.319409  3205 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:20.305570  5226 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.360255  5102 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.285032  5204 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:20.306697  5220 raft_consensus.cc:697] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:20.371502  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 54913.3us
I20260709 13:16:20.372692  3202 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:20.309845  5268 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.349702  5242 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:16:20.349647  5237 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.397032  4959 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.406742  5215 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.436786  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:20.399290  5281 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.430538  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.444500  3205 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:20.430753  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:20.421731  5313 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.446406  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:20.418957  5299 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.399960  5267 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.483104  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:20.434458  3176 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:20.456934  5313 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.459725  4956 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:20.445210  5272 consensus_meta.cc:287] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.657s	user 0.014s	sys 0.001s
I20260709 13:16:20.418655  5178 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:20.420030  5280 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:20.462999  4959 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.419528  5231 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.511138  3203 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:20.433231  5204 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.414917  5236 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.473057  5244 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:20.449712  5215 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.467152  5237 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.468997  5308 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.470450  5220 consensus_queue.cc:237] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.445595  5052 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.429979  5206 raft_consensus.cc:697] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:20.448603  5149 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.442483  5273 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 13:16:20.484253  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 49871.9us
W20260709 13:16:20.539381  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 93057.3us
I20260709 13:16:20.489907  5299 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.395730  5271 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.436326  5102 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.482604  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:20.493515  5239 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:20.494270  4956 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:20.495536  5242 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:20.501040  5313 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:20.501675  5326 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:16:20.477375  5099 consensus_queue.cc:237] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.502919  5134 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.566140  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:20.566807  3128 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.569813  5206 consensus_queue.cc:237] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.503070  5178 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.506740  5268 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.507665  5203 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:20.512452  3249 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:20.465811  5329 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.475858  5109 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:20.518260  5208 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:20.519793  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:20.646510  3838 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:20.539593  5052 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.527086  5236 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.496079  5177 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:20.670292  5177 raft_consensus.cc:697] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:20.671294  5177 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.529064  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 984) took 1389 ms. Trace:
I20260709 13:16:20.542824  5286 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:20.542843  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.677769  3210 raft_consensus.cc:2368] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6.
I20260709 13:16:20.544638  3205 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:20.544797  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:20.536341  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:20.509790  5272 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.545987  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.685395  3211 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:20.686231  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.686450  5272 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:20.547137  5328 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:16:20.552690  3131 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:20.688932  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:20.689761  3131 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.689970  4956 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:20.690830  4956 raft_consensus.cc:697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:20.553377  3806 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:20.693471  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 140171us
I20260709 13:16:20.694873  5134 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:20.691963  4956 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.695281  5134 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.695717  5134 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.555979  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:20.697687  3136 raft_consensus.cc:2376] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5. Re-sending same reply.
I20260709 13:16:20.699024  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:20.556632  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:20.557389  5294 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:20.554055  5242 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:20.551061  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:20.559072  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:20.559242  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:20.727349  3281 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:20.728221  3131 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:20.560897  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:20.561956  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:20.562126  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:20.562230  3277 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:20.561977  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:20.562770  5327 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:16:20.562147  4959 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:20.563480  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:20.564263  5299 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:20.565272  5267 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:20.574898  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.576045  3832 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:20.576508  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:20.749863  3208 raft_consensus.cc:2376] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2. Re-sending same reply.
I20260709 13:16:20.751142  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:20.523818  5264 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.647886  3177 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:20.549641  5239 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:20.665040  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:20.665663  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:20.679399  3207 raft_consensus.cc:2376] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4. Re-sending same reply.
I20260709 13:16:20.673424  3282 rpcz_store.cc:276] 0709 13:16:19.139781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.140547 (+   766us) service_pool.cc:224] Handling call
0709 13:16:20.528811 (+1388264us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400039154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:20.528974 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2688119552}
W20260709 13:16:20.754105  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 106292us
I20260709 13:16:20.761931  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:20.682678  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 170295us
I20260709 13:16:20.762795  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:20.763832  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.734618  5045 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.647364  5203 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.700519  3211 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 2.
I20260709 13:16:20.799182  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:20.700690  3130 raft_consensus.cc:2393] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 2: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:20.799885  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.621641  5246 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.711194  5294 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.711789  5052 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.712117  5285 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:20.646234  5329 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:20.716377  5215 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:20.717195  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.843562  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.844437  3206 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:20.718334  5242 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.731132  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:20.661195  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:20.740726  3284 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 3: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:20.746459  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:20.846539  3136 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.751471  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.799182  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:20.663143  5311 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:16:20.766043  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.765810  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:20.766381  3280 raft_consensus.cc:2393] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 3: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:20.760800  3127 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.769680  3207 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:20.723765  5281 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.766407  5267 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.765846  5286 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:20.799968  3131 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:20.553388  3134 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:20.835528  5204 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.739897  5226 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:20.804329  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:20.806701  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:20.935766  3204 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.753744  5214 raft_consensus.cc:3055] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:20.930599  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:20.942656  3207 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.833606  5246 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.836561  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:20.948527  3130 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.763955  5239 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:20.768072  5273 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:20.841830  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:20.921854  5206 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.587378  3128 raft_consensus.cc:2410] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:16:20.850833  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:20.852527  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.959116  3210 raft_consensus.cc:2368] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6.
W20260709 13:16:20.914757  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.870479  3136 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:20.924440  3101 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:20.860536  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.863130  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.959908  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.928459  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:20.801678  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.961589  3210 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
W20260709 13:16:20.931954  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.963804  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:20.964370  3210 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:20.932665  3250 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:20.829452  5045 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.940025  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:20.841835  5231 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.973203  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:20.903534  4887 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.855074  5272 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:16:20.959960  3838 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 3: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:20.860090  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:20.941396  5214 raft_consensus.cc:740] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:20.979176  3127 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:20.923406  5102 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.937467  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:20.961584  3211 raft_consensus.cc:2393] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:20.962615  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:20.968623  3285 raft_consensus.cc:2393] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:20.968806  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:20.969134  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:20.845953  4758 consensus_meta.cc:287] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.004s
I20260709 13:16:20.981470  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:20.982280  3203 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:20.969359  3130 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:20.847579  3208 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:20.974187  3131 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.955272  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:20.977648  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:20.970789  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:20.981803  4887 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:20.961131  3204 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:20.951442  5286 raft_consensus.cc:697] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:20.940629  5262 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:16:20.950590  4956 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:16:20.942081  5267 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:21.131914  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:20.983036  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:21.134614  3203 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:21.104290  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:21.139740  3206 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:20.983707  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.113966  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:21.144977  3204 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:16:21.144891  3211 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:21.155707  3210 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:20.959327  5271 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:21.111500  3207 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:20.976575  3842 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 5: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:21.073588  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:21.162412  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:20.967984  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:21.163033  3285 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:20.981470  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:21.167804  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:21.171743  3136 raft_consensus.cc:2376] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5. Re-sending same reply.
I20260709 13:16:21.163161  3128 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:21.162659  3134 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
W20260709 13:16:21.163934  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 193231us
I20260709 13:16:21.186404  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:21.193548  3127 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:20.982949  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:21.195039  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.198271  3209 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:16:21.095028  5215 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:21.201123  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:21.202214  3134 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:21.195686  3285 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:21.205368  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.129868  5246 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:21.091190  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.180677  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:21.218506  3210 raft_consensus.cc:2393] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 2: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:21.165479  5285 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:21.190277  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:21.190197  5214 consensus_queue.cc:260] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:21.191401  5286 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:21.219349  3130 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.978785  5149 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:20.969229  5206 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:21.091169  5329 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:20.990747  5268 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:21.192705  3832 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:21.214627  3211 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:21.214913  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:21.255721  3128 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:21.215051  3131 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:21.145887  5045 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:21.198953  3209 pending_rounds.cc:85] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 2
I20260709 13:16:21.261719  3209 pending_rounds.cc:107] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:21.262013  3209 raft_consensus.cc:2889] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:21.262385  3209 pending_rounds.cc:107] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:21.262595  3209 raft_consensus.cc:2889] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:21.263652  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:21.192055  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:21.165480  5226 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.185571  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.230798  3127 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:21.233174  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:21.234815  3206 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:21.248530  3205 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.289642  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:21.292589  3210 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:21.247995  3130 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:21.216656  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:21.270278  3134 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:21.297283  3131 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:21.300370  3209 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:21.310712  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:21.320838  3128 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.311465  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:21.313747  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.322439  3278 raft_consensus.cc:2393] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 2: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:21.340402  3205 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:21.341876  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.343407  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.232163  5285 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:21.290561  3833 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:21.271085  5214 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.367506  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.361217  3206 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:21.364862  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 338020us
I20260709 13:16:21.241606  5275 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:16:21.378630  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 446025us
W20260709 13:16:21.447657  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.540175  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:21.541615  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:21.540756  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 680980us
I20260709 13:16:21.549695  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:21.451339  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:21.348105  5285 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.378044  5226 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:21.558452  5226 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:21.559484  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.560751  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.446552  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.562007  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.562873  3277 raft_consensus.cc:2410] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:21.563864  4887 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:21.564033  3277 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:21.448454  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:21.450770  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.565702  3210 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:16:21.565796  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2062) took 1001 ms. Trace:
I20260709 13:16:21.566259  3210 pending_rounds.cc:85] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 1
I20260709 13:16:21.566654  3210 pending_rounds.cc:107] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:21.566339  3277 rpcz_store.cc:276] 0709 13:16:20.564763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.563502 (+998739us) service_pool.cc:224] Handling call
0709 13:16:21.563855 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.565536 (+  1681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.565708 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.569026  3277 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:21.569676  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2064) took 1004 ms. Trace:
I20260709 13:16:21.570187  5226 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:21.575300  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.567068  3210 raft_consensus.cc:2889] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:21.578022  3210 pending_rounds.cc:107] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:21.576292  5275 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:21.578938  3210 raft_consensus.cc:2889] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:21.579586  3281 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:21.572057  3277 rpcz_store.cc:276] 0709 13:16:20.565283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.568319 (+1003036us) service_pool.cc:224] Handling call
0709 13:16:21.568852 (+   533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.569474 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.569627 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.387804  3128 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:21.592934  5149 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:21.584651  5271 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.597615  5271 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:21.599901  5271 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:21.575024  5277 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.574947  5070 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.575287  5215 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:21.583060  4758 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.619114  4758 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:21.622526  4758 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:21.415760  5281 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:21.617488  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 693081us
I20260709 13:16:21.628173  3128 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:16:21.629506  3805 leader_election.cc:400] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6.
I20260709 13:16:21.630136  3805 leader_election.cc:403] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:21.631912  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:21.634296  5272 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.641356  5149 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:21.616616  5070 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:21.660097  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 84238.5us
I20260709 13:16:21.659009  3031 catalog_manager.cc:5697] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 1 to 3, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.667155  5070 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:21.668459  3204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.039s	sys 0.094s
W20260709 13:16:21.668815  3204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.039s	sys 0.094s
I20260709 13:16:21.669246  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1180) took 1117 ms. Trace:
I20260709 13:16:21.644735  5052 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:21.669728  3132 rpcz_store.cc:276] 0709 13:16:20.551719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.551917 (+   198us) service_pool.cc:224] Handling call
0709 13:16:20.575421 (+ 23504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.645570 (+ 70149us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:20.710721 (+ 65151us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.442828 (+732107us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b18003ef020. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b907cc0a 00007fb3c27bc219 00007fb3c00c358f 00007fb3b9102571 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd
0709 13:16:21.539801 (+ 96973us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.576837 (+ 37036us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.576995 (+   158us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:21.586009 (+  9014us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.668868 (+ 82859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.668942 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.669042 (+   100us) raft_consensus.cc:1685] finished
0709 13:16:21.669056 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.669184 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":794279,"prepare.queue_time_us":66559,"raft.queue_time_us":731052,"raft.run_cpu_time_us":394,"raft.run_wall_time_us":33323,"spinlock_wait_cycles":70025216,"thread_start_us":244409,"threads_started":2,"wal-append.queue_time_us":380534}
I20260709 13:16:21.677888  3128 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:21.667748  3174 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.045s	sys 0.078s
I20260709 13:16:21.677237  3031 catalog_manager.cc:5697] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:21.683357  3174 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.046s	sys 0.078s
W20260709 13:16:21.684849  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 60647.4us
I20260709 13:16:21.686069  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:21.645772  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:21.690989  3033 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55102 (request call id 134) took 7884 ms. Trace:
W20260709 13:16:21.692832  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 144281us
I20260709 13:16:21.656296  4959 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.687500  3031 catalog_manager.cc:5697] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:21.705348  3132 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:21.706972  3132 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:21.715533  3132 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:21.675722  5267 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:21.717163  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:21.674189  5070 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.681205  5052 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:21.697880  5134 consensus_meta.cc:287] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 1.002s	user 0.009s	sys 0.004s
W20260709 13:16:21.710070  5177 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.021s	sys 0.009s
I20260709 13:16:21.738551  3128 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:21.721974  5344 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:21.743748  5349 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.718575  4959 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:21.685742  5275 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:21.751308  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 90089.8us
I20260709 13:16:21.696501  5281 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:21.754751  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1207) took 1006 ms. Trace:
I20260709 13:16:21.770900  3128 rpcz_store.cc:276] 0709 13:16:20.748734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.657518 (+908784us) service_pool.cc:224] Handling call
0709 13:16:21.677734 (+ 20216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.754381 (+ 76647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.754671 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.704072  5206 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:21.758152  3249 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:21.722013  5198 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.750027  5052 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.772768  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:21.777650  3031 catalog_manager.cc:5697] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:16:21.785341  3128 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:16:21.758728  5177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.021s	sys 0.009s
I20260709 13:16:21.748545  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:21.691551  3033 rpcz_store.cc:276] 0709 13:16:13.789804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.790083 (+   279us) service_pool.cc:224] Handling call
0709 13:16:13.921873 (+131790us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b54000a87d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc159090 00007fb3bc1f7f3a 00007fb3c1fae1cc 00007fb3c20ac37e 00007fb3c056d2a4 00007fb3c056d232 00007fb3c056d161 00007fb3c056d0dc 00007fb3c056c392 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:21.674283 (+7752410us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:17.033675 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:17.034410 (+   735us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:17.034460 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:16:17.034477 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:17.035588 (+  1111us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:17.035693 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:17.035726 (+    33us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:16:17.036666 (+   940us) tablet.cc:701] Row locks acquired
0709 13:16:17.036725 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:16:17.036907 (+   182us) write_op.cc:270] Start()
0709 13:16:17.037064 (+   157us) write_op.cc:276] Timestamp: P: 1783602977036846 usec, L: 0
0709 13:16:17.068690 (+ 31626us) op_driver.cc:348] REPLICATION: starting
0709 13:16:17.076501 (+  7811us) log.cc:844] Serialized 3636 byte log entry
0709 13:16:17.232336 (+155835us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3b90e50ac 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b
0709 13:16:17.296409 (+ 64073us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b18002f4160. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:16:17.645769 (+349360us) op_driver.cc:464] REPLICATION: finished
0709 13:16:17.799149 (+153380us) write_op.cc:301] APPLY: starting
0709 13:16:17.799282 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:17.799536 (+   254us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:17.799572 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:17.855320 (+ 55748us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:17.855659 (+   339us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:16:17.855729 (+    70us) write_op.cc:312] APPLY: finished
0709 13:16:17.856166 (+   437us) log.cc:844] Serialized 71 byte log entry
0709 13:16:17.857190 (+  1024us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:17.857337 (+   147us) write_op.cc:454] Released schema lock
0709 13:16:17.857422 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:17.857905 (+   483us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:17.857948 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1207005,"reported_tablets":17,"spinlock_wait_cycles":43531008,"child_traces":[["op",{"apply.queue_time_us":114825,"apply.run_cpu_time_us":3868,"apply.run_wall_time_us":77046,"num_ops":9,"prepare.queue_time_us":119788,"prepare.run_cpu_time_us":13551,"prepare.run_wall_time_us":248756,"raft.queue_time_us":249580,"raft.run_cpu_time_us":19279,"raft.run_wall_time_us":125035,"replication_time_us":544651,"spinlock_wait_cycles":33558784,"thread_start_us":450595,"threads_started":4,"wal-append.queue_time_us":214438,"wal-append.run_cpu_time_us":34343,"wal-append.run_wall_time_us":1561788}]]}
I20260709 13:16:21.783001  3210 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:21.783082  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 97088.5us
I20260709 13:16:21.786481  3100 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:21.799000  3806 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:21.800407  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:21.805315  3210 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:21.809711  3031 catalog_manager.cc:5697] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 2 to 3, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.747310  5070 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:21.813062  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:21.814245  3128 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:21.774581  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:21.828491  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:21.828712  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:21.814919  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:21.829530  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:21.830451  3283 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:21.830775  3210 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:21.785518  5271 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:21.789649  5275 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:21.786243  5215 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.757174  5134 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:21.834959  3031 catalog_manager.cc:5697] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.805876  5149 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:21.827960  5102 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:21.839447  5239 consensus_meta.cc:287] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.877s	user 0.008s	sys 0.003s
I20260709 13:16:21.837019  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:21.839982  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2067) took 1273 ms. Trace:
W20260709 13:16:21.840210  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 108039us
I20260709 13:16:21.844208  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.847538  3128 raft_consensus.cc:2410] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:21.847218  3277 rpcz_store.cc:276] 0709 13:16:20.566062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.580252 (+1014190us) service_pool.cc:224] Handling call
0709 13:16:21.580566 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.580778 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:21.766211 (+185433us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.839633 (+ 73422us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:21.839688 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:21.839749 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.839818 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.839924 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5202,"raft.queue_time_us":5305,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":252682,"threads_started":2}
I20260709 13:16:21.848686  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:21.849861  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:21.850821  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:21.851735  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:21.852262  3128 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:21.853246  3250 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:21.854696  5357 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:21.855195  5178 consensus_meta.cc:287] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.191s	user 0.012s	sys 0.000s
I20260709 13:16:21.855845  5337 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.855798  5178 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:21.856096  5345 consensus_queue.cc:1059] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:21.783209  5281 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:21.857882  3202 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:21.789779  5198 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:21.860833  3805 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:21.872313  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.837826  5275 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.865834  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:21.865787  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.859104  3031 catalog_manager.cc:5697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 3 to 4, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 4 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:21.874912  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 74618.1us
W20260709 13:16:21.877491  3176 connection.cc:256] RPC call timeout handler was delayed by -2.2386029309998321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
I20260709 13:16:21.839900  5280 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.888296  3806 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:21.881901  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.764616  5344 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:21.858242  3832 raft_consensus.cc:3055] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:21.882690  3841 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:21.834733  3833 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:21.855252  5357 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:21.887670  3176 connection.cc:256] RPC call timeout handler was delayed by -1.9320184610000979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
I20260709 13:16:21.893870  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:21.895296  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:21.898420  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.899048  3283 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:21.896368  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:21.765825  5349 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:21.880065  5149 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:21.856485  5337 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:21.904769  5244 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.884974  5275 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:21.892172  4936 consensus_meta.cc:287] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.522s	user 0.015s	sys 0.001s
I20260709 13:16:21.912680  3031 catalog_manager.cc:5697] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.909235  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:21.914517  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:21.914590  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.910331  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.915194  3210 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:21.911971  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.912947  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1259) took 1054 ms. Trace:
I20260709 13:16:21.894495  5345 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:21.854182  5215 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:21.915447  3279 raft_consensus.cc:2393] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:21.916826  3277 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:21.912854  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:21.861146  5239 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:21.916111  3205 rpcz_store.cc:276] 0709 13:16:20.858176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.952244 (+ 94068us) service_pool.cc:224] Handling call
0709 13:16:21.912730 (+960486us) spinlock_profiling.cc:243] Waited 84 ms on lock 0x7b5400248454. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:21.912871 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193304960}
W20260709 13:16:21.924803  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 71627.4us
I20260709 13:16:21.988305  3250 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:21.990145  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:21.993491  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.994889  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:21.995862  3128 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:21.977517  3031 catalog_manager.cc:5697] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 2 to 3, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.905748  5177 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:21.905061  5280 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:22.000203  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.897531  3832 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:22.001771  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:21.902385  5351 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.002434  3283 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:22.004647  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:21.999588  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:22.005509  3031 catalog_manager.cc:5697] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 2 to 3, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:22.007360  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:22.007892  3279 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:21.921497  5345 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.036711  5345 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:22.037348  5339 log.cc:927] Time spent T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.202s	user 0.000s	sys 0.006s
I20260709 13:16:22.029637  3210 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:22.041003  3100 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:22.043038  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:22.044732  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1198) took 1365 ms. Trace:
I20260709 13:16:22.046000  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:22.009891  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:22.012249  5215 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:22.013237  3129 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:22.015118  3203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1268) took 1099 ms. Trace:
I20260709 13:16:22.059679  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:22.060485  3205 raft_consensus.cc:2393] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 3: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:22.059908  3203 rpcz_store.cc:276] 0709 13:16:20.916124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.192326 (+276202us) service_pool.cc:224] Handling call
0709 13:16:21.192602 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.533931 (+341329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.533977 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.572545 (+ 38568us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.760095 (+187550us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:21.760130 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.760193 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.014897 (+254704us) raft_consensus.cc:1685] finished
0709 13:16:22.014918 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.015055 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62198,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":27351,"thread_start_us":510977,"threads_started":2,"wal-append.queue_time_us":296393}
I20260709 13:16:22.061363  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:22.015180  5349 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:22.017449  4959 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:22.018643  5264 consensus_meta.cc:287] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 1.254s	user 0.008s	sys 0.003s
W20260709 13:16:22.022473  5242 consensus_meta.cc:287] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 1.100s	user 0.005s	sys 0.006s
I20260709 13:16:22.023335  3031 catalog_manager.cc:5697] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 2 to 4, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 4 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:22.025111  5365 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:22.026887  5357 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:22.027320  5347 log.cc:927] Time spent T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:16:22.028214  5178 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:22.029533  5281 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:22.029837  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:22.030388  3211 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:22.025180  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.030530  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:22.031370  5362 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:16:22.033001  5344 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:22.033963  3832 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:22.036621  5134 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:22.049803  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 59730.6us
I20260709 13:16:22.005316  3128 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:22.100574  3031 catalog_manager.cc:5697] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:22.045308  3130 rpcz_store.cc:276] 0709 13:16:20.679412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.293837 (+614425us) service_pool.cc:224] Handling call
0709 13:16:21.294091 (+   254us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:21.608108 (+314017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.608136 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:21.608609 (+   473us) log.cc:844] Serialized 52 byte log entry
0709 13:16:21.804825 (+196216us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:21.981425 (+176600us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.982375 (+   950us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.984710 (+  2335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.984817 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.044440 (+ 59623us) raft_consensus.cc:1685] finished
0709 13:16:22.044464 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.044643 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":411450,"prepare.queue_time_us":259050,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":330403,"raft.run_cpu_time_us":498,"raft.run_wall_time_us":52254,"thread_start_us":273216,"threads_started":2,"wal-append.queue_time_us":240447}
I20260709 13:16:22.061955  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1208) took 1304 ms. Trace:
I20260709 13:16:22.092685  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:22.062081  3210 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:22.104697  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:22.105033  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:22.067142  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 195465us
I20260709 13:16:22.079893  5242 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:22.105633  3210 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:22.102728  3136 rpcz_store.cc:276] 0709 13:16:20.757830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.656433 (+898603us) service_pool.cc:224] Handling call
0709 13:16:21.667745 (+ 11312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.756113 (+ 88368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.756166 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.756659 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.841172 (+ 84513us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:22.003563 (+162391us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.006630 (+  3067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.006706 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.061741 (+ 55035us) raft_consensus.cc:1685] finished
0709 13:16:22.061763 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.061898 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137539,"prepare.queue_time_us":174895,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":103156,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":70263,"thread_start_us":150395,"threads_started":2,"wal-append.queue_time_us":223996}
I20260709 13:16:22.109530  3031 catalog_manager.cc:5697] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 2 to 3, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:22.111086  3133 raft_consensus.cc:2393] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:22.111753  3031 catalog_manager.cc:5697] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 3 to 4, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 4 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:22.075673  5365 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.113304  5365 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.117448  5134 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:22.118057  5134 raft_consensus.cc:697] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:22.118377  5070 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:22.068254  4862 consensus_queue.cc:1059] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:16:22.009610  5285 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:22.067353  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1197) took 1391 ms. Trace:
I20260709 13:16:21.923213  4936 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:21.919315  5244 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:22.071699  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:22.072679  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:22.039151  5272 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6.
I20260709 13:16:22.006826  5177 raft_consensus.cc:697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 5 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:22.076625  3132 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:22.087550  3207 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:22.061255  5299 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:22.069715  5215 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:22.098765  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.053723  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2082) took 1103 ms. Trace:
I20260709 13:16:22.109566  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:22.109634  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:22.501693  3128 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 2.
W20260709 13:16:22.187294  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 85916.2us
W20260709 13:16:22.184538  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 296336us
W20260709 13:16:22.210093  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.193480  3203 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:16:22.504982  3282 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:22.130039  3031 catalog_manager.cc:5697] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:22.444242  5052 consensus_meta.cc:287] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.003s
I20260709 13:16:22.505479  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:22.506098  5052 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:22.226300  5203 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:22.121016  5294 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:22.192421  5275 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:22.136399  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:22.102223  5368 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:22.202999  3101 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 2.437s (SENT) [suppressed 34 similar messages]
I20260709 13:16:22.509908  5240 raft_consensus.cc:3055] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:22.124532  5264 consensus_queue.cc:1059] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.386s
W20260709 13:16:22.274477  5214 consensus_meta.cc:287] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.815s	user 0.010s	sys 0.002s
I20260709 13:16:22.510761  5272 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:22.534439  3285 raft_consensus.cc:2410] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:22.278038  5273 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.511407  3277 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:22.509923  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 403697us
I20260709 13:16:22.186684  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:22.537848  3249 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:22.538278  3283 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:22.500939  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1264) took 1596 ms. Trace:
W20260709 13:16:22.518165  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 315172us
I20260709 13:16:22.519059  5070 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:22.503484  3281 rpcz_store.cc:276] 0709 13:16:20.950389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.448120 (+497731us) service_pool.cc:224] Handling call
0709 13:16:22.053529 (+605409us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b54004362d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:22.053654 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34195328}
I20260709 13:16:22.508612  5203 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:22.543548  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:22.528578  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:22.512048  5149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.011s	sys 0.007s
W20260709 13:16:22.119377  5360 log.cc:927] Time spent T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:16:22.520437  5178 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.541255  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:22.520468  5240 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:22.520026  5215 raft_consensus.cc:697] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:22.544205  3205 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:22.544726  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:22.563582  3207 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:22.505520  3127 rpcz_store.cc:276] 0709 13:16:20.676358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.316985 (+640627us) service_pool.cc:224] Handling call
0709 13:16:21.564913 (+247928us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.712058 (+147145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.712105 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.727302 (+ 15197us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.882067 (+154765us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:22.066469 (+184402us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.066937 (+   468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.067102 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.067159 (+    57us) raft_consensus.cc:1685] finished
0709 13:16:22.067173 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.067298 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":192542,"prepare.queue_time_us":133985,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":195152,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":10815,"thread_start_us":262758,"threads_started":2,"wal-append.queue_time_us":156272}
I20260709 13:16:22.538976  3208 rpcz_store.cc:276] 0709 13:16:20.904072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.165100 (+261028us) service_pool.cc:224] Handling call
0709 13:16:21.175001 (+  9901us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:21.190868 (+ 15867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.190897 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:21.191415 (+   518us) log.cc:844] Serialized 52 byte log entry
0709 13:16:21.365697 (+174282us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:21.365752 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.365846 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.500652 (+1134806us) raft_consensus.cc:1685] finished
0709 13:16:22.500676 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.500864 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39366,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":15445,"thread_start_us":173861,"threads_started":1,"wal-append.queue_time_us":498473}
I20260709 13:16:22.548770  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:22.520808  5198 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:22.225960  5375 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:22.551923  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:22.520299  5231 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.572329  5281 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:22.572851  5281 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:22.572901  5240 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:22.553194  5376 consensus_queue.cc:1059] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:16:22.531483  3834 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:22.574555  5365 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:22.509995  5177 consensus_queue.cc:237] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:22.556643  5214 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
W20260709 13:16:22.580046  5277 consensus_meta.cc:287] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.968s	user 0.009s	sys 0.002s
I20260709 13:16:22.580456  5277 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:22.560158  5226 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:22.581290  3276 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:22.561965  5206 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.582159  5206 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:22.582412  5134 consensus_queue.cc:237] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:22.584662  5206 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:22.552184  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:22.557934  5242 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:22.586091  5285 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:22.586450  3283 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:22.540769  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:22.587368  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:22.530923  3832 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.566583  5178 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:22.588472  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:22.551468  5149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.011s	sys 0.007s
I20260709 13:16:22.533955  5299 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:22.543181  5273 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.569568  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:22.550645  5294 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:22.573362  5281 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:22.123425  5352 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 13:16:22.572420  5231 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:22.545202  5351 raft_consensus.cc:697] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:22.600797  3277 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:22.604673  3176 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:22.550827  5368 raft_consensus.cc:697] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:22.534199  5344 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:16:22.607127  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:22.611282  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:22.619141  3101 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:22.565485  5378 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:22.615509  3283 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:22.612185  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1199) took 1930 ms. Trace:
I20260709 13:16:22.623670  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:22.617251  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 76551.3us
I20260709 13:16:22.621440  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:22.614063  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:22.623749  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:22.627235  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:22.628906  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.623262  3134 rpcz_store.cc:276] 0709 13:16:20.681541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.294950 (+613409us) service_pool.cc:224] Handling call
0709 13:16:21.540976 (+246026us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.628429 (+ 87453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.628480 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.644915 (+ 16435us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.836715 (+191800us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:22.286519 (+449804us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.326011 (+ 39492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.326165 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.611914 (+285749us) raft_consensus.cc:1685] finished
0709 13:16:22.611940 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.612105 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":250050,"prepare.queue_time_us":179116,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":142678,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":117770,"thread_start_us":553590,"threads_started":2,"wal-append.queue_time_us":227309}
W20260709 13:16:22.632696  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 90612.5us
I20260709 13:16:22.601327  4936 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:22.633198  3284 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:22.637308  3277 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:22.600700  5149 raft_consensus.cc:697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:22.633423  3101 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:22.633412  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:22.643255  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:22.631431  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:22.609867  5206 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:22.640661  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:22.645398  3101 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:22.712430  3838 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:22.613608  5226 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:22.725736  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 79947.4us
I20260709 13:16:22.726780  3249 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:22.710368  5254 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.639689  5294 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:22.632426  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:22.601156  5375 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:22.640249  5264 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.617148  5365 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:22.632536  5242 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:22.733896  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:22.738369  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.636492  5271 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:22.644470  5277 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:22.740847  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:22.644912  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:22.709100  5191 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.610831  5374 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
W20260709 13:16:22.807062  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 77956.2us
I20260709 13:16:22.809010  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1021) took 1077 ms. Trace:
I20260709 13:16:22.809484  3134 rpcz_store.cc:276] 0709 13:16:21.731808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.733519 (+1001711us) service_pool.cc:224] Handling call
0709 13:16:22.808948 (+ 75429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.810619  3838 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 1.
I20260709 13:16:22.614988  5368 consensus_queue.cc:237] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:22.639732  5378 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:22.750741  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 117386us
I20260709 13:16:22.741492  5206 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:22.817391  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:22.738476  5380 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:22.813745  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1025) took 1081 ms. Trace:
I20260709 13:16:22.824590  3250 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:22.828336  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:22.781713  5242 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.833711  3127 rpcz_store.cc:276] 0709 13:16:21.732844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.626059 (+893215us) service_pool.cc:224] Handling call
0709 13:16:22.813669 (+187610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.807282  5271 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:16:22.934717  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 289384us
I20260709 13:16:22.953994  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:22.824712  5099 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.003s	sys 0.008s
I20260709 13:16:22.815989  5333 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:22.816160  5379 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.984360  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:22.808401  5344 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 13:16:22.999744  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 160409us
I20260709 13:16:22.830451  5206 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.739507  5299 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:22.709894  5351 consensus_queue.cc:237] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:22.832796  5286 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:22.826318  5371 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:22.835786  5380 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:23.002131  3020 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8e1a4d71ef0f4287999b5ee60fe02740 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 48080cf0460346769ab046a4f9457aa5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:22.745048  5215 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:22.832986  5277 raft_consensus.cc:697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:23.005524  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.840121  5275 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:22.832604  5385 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.183s
I20260709 13:16:23.001318  5264 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:22.988919  5099 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.003s	sys 0.008s
W20260709 13:16:23.007719  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 380530us
I20260709 13:16:23.098093  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:23.098753  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:23.100036  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:22.937670  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:22.980906  5198 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:22.983122  5271 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:23.012853  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:22.838124  5242 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.987833  5070 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:22.826452  5386 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.197s
I20260709 13:16:22.832881  5349 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.173s
I20260709 13:16:22.995898  5191 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:22.834167  4936 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.172s
W20260709 13:16:23.023854  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 204445us
I20260709 13:16:23.157778  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1017) took 1444 ms. Trace:
W20260709 13:16:23.006192  5377 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:16:23.038717  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:23.160806  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 122202us
I20260709 13:16:22.988337  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:23.058648  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 230409us
I20260709 13:16:23.008659  5206 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:23.009657  5178 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:22.830206  5149 consensus_queue.cc:237] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:23.021358  5371 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.023603  5380 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:23.002580  5379 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:23.158227  3127 rpcz_store.cc:276] 0709 13:16:21.713421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.996972 (+1283551us) service_pool.cc:224] Handling call
0709 13:16:23.157704 (+160732us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:23.162983  3134 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:23.128335  5226 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:23.122603  5198 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.129158  4887 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:23.005803  5294 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.126573  5254 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:23.189435  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1036) took 1442 ms. Trace:
I20260709 13:16:23.059948  5398 consensus_queue.cc:1059] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.142s
I20260709 13:16:23.208771  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:23.210403  3127 raft_consensus.cc:2376] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5. Re-sending same reply.
W20260709 13:16:23.185649  5384 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 13:16:23.166882  5264 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:23.210031  3134 rpcz_store.cc:276] 0709 13:16:21.746983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.835583 (+1088600us) service_pool.cc:224] Handling call
0709 13:16:23.189363 (+353780us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:23.169974  5371 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:23.213145  5396 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.217187  5254 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.217947  5396 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.219957  5254 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:23.220155  5396 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:23.222060  5277 consensus_queue.cc:237] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:23.225330  5375 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:23.225730  5388 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:16:23.227123  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2071) took 2660 ms. Trace:
I20260709 13:16:23.227510  3279 rpcz_store.cc:276] 0709 13:16:20.567129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.063357 (+1496228us) service_pool.cc:224] Handling call
0709 13:16:22.075594 (+ 12237us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:22.100821 (+ 25227us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:22.100868 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:22.521501 (+420633us) log.cc:844] Serialized 52 byte log entry
0709 13:16:22.831155 (+309654us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:22.831213 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.831316 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.226829 (+395513us) raft_consensus.cc:1685] finished
0709 13:16:23.226848 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.227035 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":342260,"raft.queue_time_us":22115,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":81165,"thread_start_us":273325,"threads_started":1,"wal-append.queue_time_us":514576}
I20260709 13:16:23.229616  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:23.231045  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:23.232092  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:23.233260  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:23.234388  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:23.235467  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:23.236045  3279 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
W20260709 13:16:23.236915  5345 consensus_meta.cc:287] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.199s	user 0.005s	sys 0.004s
I20260709 13:16:23.237481  5254 raft_consensus.cc:3055] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:23.237425  5345 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.237982  5254 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:23.243395  3277 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:23.236914  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:23.206815  5198 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:23.247123  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.247911  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.264472  3127 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:23.265287  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1043) took 1255 ms. Trace:
I20260709 13:16:23.265681  3127 rpcz_store.cc:276] 0709 13:16:22.009927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.211256 (+1201329us) service_pool.cc:224] Handling call
0709 13:16:23.265214 (+ 53958us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:23.251493  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 93165.8us
I20260709 13:16:23.254992  5396 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.256675  4887 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:23.227506  5391 log.cc:927] Time spent T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:16:23.260633  5345 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:23.272150  5396 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:23.272884  5359 log.cc:927] Time spent T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:16:23.245874  5385 raft_consensus.cc:3055] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:23.268575  4936 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.159691  5070 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:16:23.288054  3806 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.006s	sys 0.010s
I20260709 13:16:23.215711  5264 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:23.294795  3806 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.008s	sys 0.011s
W20260709 13:16:23.296104  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 734911us
I20260709 13:16:23.260193  5254 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:23.316710  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 153827us
I20260709 13:16:23.295637  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.365198  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2129) took 3011 ms. Trace:
I20260709 13:16:23.371574  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.372957  3202 rpcz_store.cc:276] 0709 13:16:20.353723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.429336 (+ 75613us) service_pool.cc:224] Handling call
0709 13:16:20.429855 (+   519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.860777 (+1430922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.364673 (+1503896us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54003741d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:23.364969 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3283680384}
I20260709 13:16:23.373765  3127 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:23.374434  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1026) took 1641 ms. Trace:
I20260709 13:16:23.374830  3127 rpcz_store.cc:276] 0709 13:16:21.733075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.294313 (+1561238us) service_pool.cc:224] Handling call
0709 13:16:23.374367 (+ 80054us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:23.281980  5399 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:16:23.369395  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 61401.2us
I20260709 13:16:23.378003  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.378877  3130 raft_consensus.cc:2393] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:23.379585  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.380363  3128 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
W20260709 13:16:23.380944  3128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1031) took 1635 ms (client timeout 2027 ms). Trace:
W20260709 13:16:23.381392  3128 rpcz_store.cc:269] 0709 13:16:21.745609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.379287 (+1633678us) service_pool.cc:224] Handling call
0709 13:16:23.380877 (+  1590us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:23.382553  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:23.386719  3130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1041) took 1480 ms (client timeout 1810 ms). Trace:
W20260709 13:16:23.387308  3130 rpcz_store.cc:269] 0709 13:16:21.906705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.365870 (+1459165us) service_pool.cc:224] Handling call
0709 13:16:23.386632 (+ 20762us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:23.277058  3832 consensus_meta.cc:287] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.689s	user 0.009s	sys 0.000s
W20260709 13:16:23.395047  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.277652  5178 raft_consensus.cc:476] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Not starting pre-election -- already a leader
W20260709 13:16:23.395840  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.291708  5385 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:23.397854  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:23.282657  5226 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:23.356367  5281 consensus_meta.cc:287] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.001s
I20260709 13:16:23.399122  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.400261  3127 raft_consensus.cc:2410] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:16:23.402874  3130 raft_consensus.cc:1240] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:16:23.403803  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1018) took 1690 ms. Trace:
I20260709 13:16:23.404193  3130 rpcz_store.cc:276] 0709 13:16:21.713759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.388122 (+1674363us) service_pool.cc:224] Handling call
0709 13:16:23.402196 (+ 14074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.403396 (+  1200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.403726 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:23.355154  5070 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:23.405532  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1040) took 1520 ms. Trace:
I20260709 13:16:23.295727  5264 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:23.406454  3127 rpcz_store.cc:276] 0709 13:16:21.885540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.375584 (+1490044us) service_pool.cc:224] Handling call
0709 13:16:23.405472 (+ 29888us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:23.371146  5378 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:23.410521  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 143050us
I20260709 13:16:23.410976  3130 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:23.416103  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1022) took 1684 ms. Trace:
I20260709 13:16:23.416622  3130 rpcz_store.cc:276] 0709 13:16:21.732067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.405359 (+1673292us) service_pool.cc:224] Handling call
0709 13:16:23.410467 (+  5108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.415753 (+  5286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.416027 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:23.282513  5206 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.414964  3251 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:23.316028  4936 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:23.447043  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 69851.5us
I20260709 13:16:23.285897  5380 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.448596  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:23.296315  4887 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.424031  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:23.449546  5254 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:23.469812  3130 raft_consensus.cc:1240] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:23.470538  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1005) took 1467 ms. Trace:
I20260709 13:16:23.471904  5415 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:23.471151  3283 rpcz_store.cc:276] 0709 13:16:22.003568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.634621 (+631053us) service_pool.cc:224] Handling call
0709 13:16:22.635124 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.713979 (+ 78855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.714023 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.717849 (+  3826us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.994313 (+276464us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:22.994358 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.994429 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.470312 (+475883us) raft_consensus.cc:1685] finished
0709 13:16:23.470335 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.470473 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":158390,"raft.queue_time_us":79133,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":15033,"thread_start_us":188080,"threads_started":1,"wal-append.queue_time_us":388912}
I20260709 13:16:23.473470  5396 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:23.474730  5379 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:23.475708  4887 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:23.452076  5405 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:23.477432  5405 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:23.477923  5405 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:23.413482  4758 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.452078  5398 consensus_queue.cc:1059] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:16:23.478652  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1211) took 1628 ms. Trace:
I20260709 13:16:23.490851  3130 rpcz_store.cc:276] 0709 13:16:21.850046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.417848 (+1567802us) service_pool.cc:224] Handling call
0709 13:16:23.469612 (+ 51764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.478379 (+  8767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.478590 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:23.449404  3832 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:16:23.492020  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.492332  3832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 396) took 1725 ms. Trace:
W20260709 13:16:23.492525  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 44024.8us
I20260709 13:16:23.492624  3130 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:23.492833  3832 rpcz_store.cc:276] 0709 13:16:21.767266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.769883 (+  2617us) service_pool.cc:224] Handling call
0709 13:16:21.838174 (+ 68291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.491875 (+1653701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.492244 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:23.478397  5385 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:23.493690  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.480636  3251 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:23.445127  5178 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.421412  5275 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.419881  5333 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.524318  5333 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:23.527292  5271 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.527837  5333 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:23.530342  5405 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:23.532544  5405 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:23.493913  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:23.467981  5378 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:23.564333  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 70491.8us
W20260709 13:16:23.502207  5204 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:16:23.408048  5226 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.500401  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1200) took 2798 ms. Trace:
I20260709 13:16:23.418208  5386 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:23.469985  5351 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.582219  3131 rpcz_store.cc:276] 0709 13:16:20.701518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.327310 (+625792us) service_pool.cc:224] Handling call
0709 13:16:21.327698 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.608172 (+280474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.608214 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.608609 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.789518 (+180909us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:21.976436 (+186918us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.978189 (+  1753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.978301 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.279907 (+301606us) spinlock_profiling.cc:243] Waited 7.9 ms on lock 0x7b18000f65e0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90d02a6 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1118aa1 00007fb3c110fb37 00007fb3c110f9ca 00007fb3c120726f
0709 13:16:22.739269 (+459362us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b4800080058. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1118aa1 00007fb3c110fb37 00007fb3c110f9ca 00007fb3c120726f 00007fb3c1206f37 00007fb3c121b55c 00007fb3c121b508 00007fb3c121b488 00007fb3c121b443 00007fb3c121a6ec 00007fb3c0144a96
0709 13:16:23.167156 (+427887us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b18000f65e0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:16:23.500155 (+332999us) raft_consensus.cc:1685] finished
0709 13:16:23.500180 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.500317 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":308762,"prepare.queue_time_us":129594,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":5382,"raft.queue_time_us":288779,"raft.run_cpu_time_us":5376,"raft.run_wall_time_us":774849,"spinlock_wait_cycles":49826304,"thread_start_us":218987,"threads_started":2,"wal-append.queue_time_us":332233}
I20260709 13:16:23.497535  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.519434  5198 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.523574  5380 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:23.533759  5206 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:23.496546  4758 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:23.535531  5273 consensus_meta.cc:287] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.926s	user 0.011s	sys 0.000s
I20260709 13:16:23.407863  5281 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:23.565670  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 141685us
W20260709 13:16:23.565980  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:23.567392  3282 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2063) took 3002 ms (client timeout 1838 ms). Trace:
I20260709 13:16:23.567272  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:23.583827  5398 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.588961  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:23.494745  5385 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:23.636500  3278 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:23.496734  5406 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.563052  5407 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:23.565606  5404 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.603065  3100 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:23.587970  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.557727  5356 raft_consensus.cc:3055] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:23.603135  3282 rpcz_store.cc:269] 0709 13:16:20.565016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.834693 (+269677us) service_pool.cc:224] Handling call
0709 13:16:23.567177 (+2732484us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400002154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:23.567317 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3509958400}
I20260709 13:16:23.538703  5410 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:23.583595  5333 raft_consensus.cc:3055] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:16:23.637647  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 70441.4us
W20260709 13:16:23.642071  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.563750  5275 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.517226  5178 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:23.654412  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:23.655757  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:23.598222  5417 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:23.584894  5378 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:23.660724  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.736719  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:23.637638  5271 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:23.734059  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 78384us
W20260709 13:16:23.740089  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 137111us
I20260709 13:16:23.598472  5351 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.642134  5380 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:23.641134  5398 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.750156  5198 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:23.750414  5395 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.589s	user 0.003s	sys 0.000s
I20260709 13:16:23.606760  5273 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:23.736402  4887 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:23.751876  5398 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:23.752125  4758 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:23.752377  5273 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:23.753620  5351 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:23.754349  5178 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:23.755913  5418 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:23.740917  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.741362  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:23.758153  3282 raft_consensus.cc:2368] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6.
I20260709 13:16:23.653297  5356 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:23.651832  5410 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:23.745853  5413 log.cc:927] Time spent T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:16:23.747371  5412 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:16:23.748270  5420 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:16:23.734287  5375 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.758008  3131 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:23.772048  5375 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:23.772810  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.773123  5070 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.774412  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.775102  3131 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:23.776036  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.776039  5375 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:23.777374  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.732191  5206 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:23.765116  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:23.778976  3840 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:23.779332  3282 raft_consensus.cc:2410] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:23.779738  3840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 529) took 1154 ms. Trace:
I20260709 13:16:23.780216  3840 rpcz_store.cc:276] 0709 13:16:22.625009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.625225 (+   216us) service_pool.cc:224] Handling call
0709 13:16:23.778548 (+1153323us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:16:23.778766 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.779460 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.779679 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14831488}
I20260709 13:16:23.780910  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:23.782523  3282 raft_consensus.cc:2393] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 3: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:23.783398  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:23.784003  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:23.784751  3842 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 2.
I20260709 13:16:23.785310  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58470 (request call id 530) took 1159 ms. Trace:
I20260709 13:16:23.785481  3131 raft_consensus.cc:2393] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 4: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:23.785815  3842 rpcz_store.cc:276] 0709 13:16:22.626040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.632642 (+  6602us) service_pool.cc:224] Handling call
0709 13:16:23.783839 (+1151197us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:23.785246 (+  1407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11655040}
I20260709 13:16:23.786448  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:23.786986  3131 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:23.791541  5203 raft_consensus.cc:3055] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:23.653165  5333 raft_consensus.cc:740] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:23.793254  5333 consensus_queue.cc:260] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.794225  5281 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:23.794685  5333 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:23.650455  5407 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.603504  5386 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.756419  5418 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.762046  5378 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:23.777560  5341 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 2.488s	user 0.002s	sys 0.002s
I20260709 13:16:23.792229  5203 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:23.800331  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 216) took 3233 ms. Trace:
I20260709 13:16:23.760756  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:23.802753  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:23.734591  5371 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.804266  5264 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.762182  5149 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:23.805748  3128 raft_consensus.cc:2368] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6.
I20260709 13:16:23.805948  5149 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:23.806921  5264 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:23.801461  5242 consensus_meta.cc:287] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.642s	user 0.006s	sys 0.005s
I20260709 13:16:23.808202  5149 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:23.807667  5203 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:23.808378  5242 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.810053  3130 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:23.811529  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:23.812438  5242 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:23.800755  3284 rpcz_store.cc:276] 0709 13:16:20.564011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.561843 (+997832us) service_pool.cc:224] Handling call
0709 13:16:21.562105 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.637662 (+1075557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.776926 (+1139264us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400038254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:23.797577 (+ 20651us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2462648064}
I20260709 13:16:23.815492  3279 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:23.734004  5404 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:23.815683  5281 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:23.816114  5281 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.763404  5410 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:23.818156  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:23.816466  5281 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:23.820544  5404 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:23.821235  5206 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:23.821581  5226 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:23.822324  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:23.822847  5275 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:23.823485  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:23.795838  5337 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:23.826323  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1210) took 1976 ms. Trace:
I20260709 13:16:23.800758  5418 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:23.826778  3127 rpcz_store.cc:276] 0709 13:16:21.849711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.407294 (+1557583us) service_pool.cc:224] Handling call
0709 13:16:23.445692 (+ 38398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:23.446083 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.446115 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:23.451764 (+  5649us) log.cc:844] Serialized 52 byte log entry
0709 13:16:23.586372 (+134608us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:23.739656 (+153284us) log.cc:844] Serialized 14 byte log entry
0709 13:16:23.741420 (+  1764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.741491 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.826081 (+ 84590us) raft_consensus.cc:1685] finished
0709 13:16:23.826101 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.826248 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36468,"raft.queue_time_us":48301,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":4944,"thread_start_us":218562,"threads_started":2,"wal-append.queue_time_us":272074}
I20260709 13:16:23.829355  3176 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:23.821360  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1181) took 3269 ms. Trace:
I20260709 13:16:23.823587  5240 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:23.830451  3135 rpcz_store.cc:276] 0709 13:16:20.552024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.552764 (+   740us) service_pool.cc:224] Handling call
0709 13:16:20.553044 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.625270 (+ 72226us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:20.674413 (+ 49143us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.540327 (+865914us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.572630 (+ 32303us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.572891 (+   261us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:21.840321 (+267430us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.840590 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.840693 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.595851 (+1755158us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:23.821134 (+225283us) raft_consensus.cc:1685] finished
0709 13:16:23.821159 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.821299 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":701148,"prepare.queue_time_us":369042,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":5040,"raft.queue_time_us":737648,"raft.run_cpu_time_us":440,"raft.run_wall_time_us":47741,"spinlock_wait_cycles":30972160,"thread_start_us":518053,"threads_started":3,"wal-append.queue_time_us":431957}
I20260709 13:16:23.795802  5407 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:23.830672  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:23.650698  5406 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.836148  5351 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:23.833725  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 92998.7us
I20260709 13:16:23.836859  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:23.835321  3134 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:23.838498  3131 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:23.838884  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.841289  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:23.813011  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:23.843730  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:23.843923  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 987) took 2059 ms. Trace:
I20260709 13:16:23.844216  3276 rpcz_store.cc:276] 0709 13:16:21.784304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.067807 (+283503us) service_pool.cc:224] Handling call
0709 13:16:22.068198 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.581659 (+513461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.843591 (+1261932us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b5400435dd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:23.843857 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179146624}
I20260709 13:16:23.795284  5356 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:23.842234  3127 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:23.856938  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:23.860545  3276 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:23.834872  5226 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:23.842623  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:23.930353  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:23.931831  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.856793  5280 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:23.841274  5273 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:23.988441  5273 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.988926  5273 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.000216  3282 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:24.001958  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:23.856927  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:23.831727  5178 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:23.840487  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:24.044785  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:23.904217  3101 leader_election.cc:336] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.838s (SENT)
W20260709 13:16:24.046607  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 142462us
I20260709 13:16:23.842286  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:24.005946  3135 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
W20260709 13:16:24.045693  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 205269us
I20260709 13:16:23.855898  5242 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:16:24.055022  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:24.090217  3101 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:24.092095  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:24.093101  3251 connection.cc:256] RPC call timeout handler was delayed by -1.1903058899997632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2561s for a response
W20260709 13:16:24.105163  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 262946us
I20260709 13:16:24.105470  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:24.109912  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:24.110520  3208 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.110579  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:24.111289  3202 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:24.113833  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:24.108700  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:24.114687  3210 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:24.114964  3840 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.115774  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:24.116685  3207 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:24.119035  3207 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:24.129988  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:24.132745  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1215) took 2281 ms. Trace:
I20260709 13:16:24.108386  4959 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.138015  3805 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:24.139360  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:24.140069  3202 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:24.056893  5356 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.086974  5280 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:24.147862  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:24.149737  3127 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:16:24.149899  3805 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:24.105187  5254 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.114355  5178 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.169878  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1008) took 2116 ms. Trace:
I20260709 13:16:24.211470  3282 rpcz_store.cc:276] 0709 13:16:22.053911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.152437 (+2098526us) service_pool.cc:224] Handling call
0709 13:16:24.169024 (+ 16587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.169325 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.169362 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.169418 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:24.169468 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.169538 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.169681 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:24.109207  5264 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.191298  3127 pending_rounds.cc:85] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 4
I20260709 13:16:24.218514  5375 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.218946  5375 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.219295  5375 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.226819  3840 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:24.202461  3806 leader_election.cc:400] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6.
I20260709 13:16:24.147382  3833 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:16:24.229729  3806 leader_election.cc:403] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:24.217881  3127 pending_rounds.cc:107] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:16:24.218181  3206 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 3: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:24.220420  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 182) took 3246 ms. Trace:
I20260709 13:16:24.234747  3208 raft_consensus.cc:2410] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:24.234915  3209 rpcz_store.cc:276] 0709 13:16:20.974047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.293771 (+319724us) service_pool.cc:224] Handling call
0709 13:16:21.294043 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.320423 (+ 26380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.220139 (+2899716us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b5400247f54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:24.220356 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13854976}
W20260709 13:16:24.238925  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.231164  3276 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
W20260709 13:16:24.241456  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.139451  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:24.243227  3127 raft_consensus.cc:2917] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:16:24.184454  5272 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.153331  5149 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:24.255982  5149 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:24.257251  3836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 527) took 1642 ms. Trace:
I20260709 13:16:24.257804  3836 rpcz_store.cc:276] 0709 13:16:22.614926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.615118 (+   192us) service_pool.cc:224] Handling call
0709 13:16:24.151482 (+1536364us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:16:24.227382 (+ 75900us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.248280 (+ 20898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.256822 (+  8542us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.256888 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:24.256932 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.257012 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.257178 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11180288}
I20260709 13:16:24.259052  5149 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:24.129427  5226 consensus_queue.cc:1059] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 13:16:24.260138  5226 raft_consensus.cc:3055] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:24.260547  5226 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:24.231805  3833 pending_rounds.cc:85] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 4
I20260709 13:16:24.221597  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:24.262465  3832 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:24.252478  5272 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:24.210542  5378 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:24.272523  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.220112  5178 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:24.273299  4956 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:24.338647  5406 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:24.340994  5375 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:24.321713  5149 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6.
I20260709 13:16:24.317091  5429 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:16:24.261528  5226 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:24.142102  3834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 386) took 3648 ms (client timeout 1839 ms). Trace:
W20260709 13:16:24.371405  5412 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.041s	sys 0.077s
I20260709 13:16:24.276268  3833 pending_rounds.cc:107] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:16:24.413861  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1014) took 2087 ms. Trace:
I20260709 13:16:24.416947  3251 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:24.419924  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 274926us
W20260709 13:16:24.397621  5281 consensus_meta.cc:287] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.003s
I20260709 13:16:24.421131  3282 rpcz_store.cc:276] 0709 13:16:22.326104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.233991 (+1907887us) service_pool.cc:224] Handling call
0709 13:16:24.412824 (+178833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.413312 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.413359 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.413427 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:24.413482 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.413574 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.413771 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2375}
I20260709 13:16:24.392795  4959 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:24.424328  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 265206us
I20260709 13:16:24.424939  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:24.425694  3251 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:24.425765  3806 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:24.400857  5178 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.450491  5281 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:24.452535  5281 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:24.373258  5206 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:24.427361  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:24.453410  5206 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:24.454578  3806 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:24.455515  5070 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:24.455767  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:24.415432  3280 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:24.456478  3832 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:24.457670  3280 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:24.458202  3282 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:24.458379  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2087) took 1641 ms. Trace:
I20260709 13:16:24.458810  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2085) took 1642 ms. Trace:
I20260709 13:16:24.459280  3282 rpcz_store.cc:276] 0709 13:16:22.816701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.457615 (+1640914us) service_pool.cc:224] Handling call
0709 13:16:24.457902 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.458590 (+   688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.458758 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:24.460495  3282 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:24.373709  5378 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:24.428762  5204 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.461303  5378 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.428912  5273 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:24.429028  5294 consensus_queue.cc:1059] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:24.429771  5275 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:24.430894  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.418370  5412 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.041s	sys 0.078s
I20260709 13:16:24.423938  5402 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:24.434048  5406 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.436709  5272 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:24.416189  4956 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:24.437318  5410 consensus_meta.cc:287] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.597s	user 0.004s	sys 0.007s
W20260709 13:16:24.444212  5407 consensus_meta.cc:287] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.000s
I20260709 13:16:24.444694  5226 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:24.445627  5418 consensus_meta.cc:287] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.000s
I20260709 13:16:24.447683  5375 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:24.424600  3833 raft_consensus.cc:2917] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:16:24.488770  3833 raft_consensus.cc:2889] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:24.468223  5429 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.466553  5402 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:16:24.466856  3841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58470 (request call id 519) took 3909 ms (client timeout 2561 ms). Trace:
W20260709 13:16:24.467641  3806 leader_election.cc:336] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.543s (SENT)
I20260709 13:16:24.455802  5206 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:24.467367  5433 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.492165  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:24.491989  3841 rpcz_store.cc:269] 0709 13:16:20.557668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.560648 (+  2980us) service_pool.cc:224] Handling call
0709 13:16:24.466700 (+3906052us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400609354. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:24.466804 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2633097472}
I20260709 13:16:24.469930  5149 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:24.495409  3806 leader_election.cc:336] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.747s (SENT)
I20260709 13:16:24.458897  3280 rpcz_store.cc:276] 0709 13:16:22.817242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.457092 (+1639850us) service_pool.cc:224] Handling call
0709 13:16:24.457459 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.458094 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.458316 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:24.472729  5275 raft_consensus.cc:697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:24.460974  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2090) took 1643 ms. Trace:
I20260709 13:16:24.500999  3282 rpcz_store.cc:276] 0709 13:16:22.817882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.460061 (+1642179us) service_pool.cc:224] Handling call
0709 13:16:24.460340 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.460778 (+   438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.460930 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:24.492985  5402 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:24.498883  3806 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:24.509107  3136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1023) took 2776 ms (client timeout 1962 ms). Trace:
I20260709 13:16:24.509604  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1007) took 2469 ms. Trace:
I20260709 13:16:24.477454  5418 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:24.419106  3834 rpcz_store.cc:269] 0709 13:16:20.480783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.497430 (+ 16647us) service_pool.cc:224] Handling call
0709 13:16:21.617339 (+1119909us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:24.105242 (+2487903us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54007945d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:24.114210 (+  8968us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1896078464}
I20260709 13:16:24.510004  3277 rpcz_store.cc:276] 0709 13:16:22.039907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.638278 (+598371us) service_pool.cc:224] Handling call
0709 13:16:22.638670 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.243793 (+605123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.509375 (+1265582us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b540022e554. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:24.509552 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390172928}
W20260709 13:16:24.509626  3136 rpcz_store.cc:269] 0709 13:16:21.732316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.508880 (+2776564us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:24.509016 (+   136us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:16:24.512048  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.498061  5375 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.485657  5410 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:24.477566  5407 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:24.518817  5272 raft_consensus.cc:476] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:16:24.503224  5149 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:24.523092  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:24.524677  3131 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:16:24.524775  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 97003us
I20260709 13:16:24.525031  3136 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:24.525830  3251 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:24.526993  3251 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:24.518082  5429 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.528584  3284 raft_consensus.cc:2368] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3.
I20260709 13:16:24.529732  5149 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:24.530898  5418 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:24.532380  5434 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:24.533068  5434 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:24.534510  5434 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:24.537560  5294 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.538944  4956 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:24.539485  5378 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:24.540843  3841 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:24.541931  3806 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:24.543228  5418 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:24.524430  5273 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:24.547338  5433 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:24.550141  3806 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:24.550674  5275 consensus_queue.cc:237] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:24.551887  5204 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:24.551605  5418 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:24.560987  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:24.561604  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:24.561970  3136 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:16:24.564632  3277 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:24.567128  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:24.560063  5433 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.570670  5429 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.568563  5418 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:24.571972  5418 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:24.572500  5410 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:24.573050  5418 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:24.574868  5397 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 1.260s	user 0.002s	sys 0.018s
I20260709 13:16:24.576869  5378 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:24.579663  5240 consensus_meta.cc:287] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.000s
I20260709 13:16:24.580140  5239 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:24.581920  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:24.582661  3835 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:24.583799  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:24.574894  5418 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:24.586992  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:24.580171  5102 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.589505  5102 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:24.593130  5407 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:24.596335  5231 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:24.603494  3133 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1177) took 4052 ms (client timeout 1801 ms). Trace:
W20260709 13:16:24.604039  3133 rpcz_store.cc:269] 0709 13:16:20.550671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.550824 (+   153us) service_pool.cc:224] Handling call
0709 13:16:24.603143 (+4052319us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54003f8254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:24.603343 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3225557376}
W20260709 13:16:24.607532  3281 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1012) took 2517 ms (client timeout 1810 ms). Trace:
W20260709 13:16:24.608078  3281 rpcz_store.cc:269] 0709 13:16:22.090569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.540981 (+450412us) service_pool.cc:224] Handling call
0709 13:16:24.607260 (+2066279us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540022ef54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:24.607435 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2405332736}
W20260709 13:16:24.611769  3177 connection.cc:256] RPC call timeout handler was delayed by -1.1187926989998687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
I20260709 13:16:24.615546  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:24.617373  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:24.618192  3134 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1047) took 2025 ms (client timeout 2239 ms). Trace:
I20260709 13:16:24.618599  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:24.618723  3134 rpcz_store.cc:269] 0709 13:16:22.592600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.376055 (+783455us) service_pool.cc:224] Handling call
0709 13:16:24.617990 (+1241935us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b540039e254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:24.618118 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":952955136}
I20260709 13:16:24.619374  3136 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:16:24.620543  3134 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:24.621728  3203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1282) took 2082 ms (client timeout 1753 ms). Trace:
W20260709 13:16:24.622221  3203 rpcz_store.cc:269] 0709 13:16:22.539592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.540136 (+   544us) service_pool.cc:224] Handling call
0709 13:16:24.621456 (+2081320us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54001d7c54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:24.621606 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2032179072}
W20260709 13:16:24.624078  3128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1213) took 2773 ms (client timeout 3001 ms). Trace:
W20260709 13:16:24.624583  3128 rpcz_store.cc:269] 0709 13:16:21.850689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.382226 (+1531537us) service_pool.cc:224] Handling call
0709 13:16:24.623833 (+1241607us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54000e15d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:24.624004 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":971353472}
I20260709 13:16:24.626362  3128 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:24.627034  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1038) took 2757 ms. Trace:
I20260709 13:16:24.627393  3128 rpcz_store.cc:276] 0709 13:16:21.869815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.625596 (+2755781us) service_pool.cc:224] Handling call
0709 13:16:24.625980 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.626775 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.626975 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:24.633919  5052 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:24.640064  5402 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:24.641618  4936 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:24.645622  5178 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:24.646188  5244 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:24.647951  5178 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:24.648633  5178 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.649253  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:24.649461  5226 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.649907  5226 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:24.650987  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1230) took 1229 ms. Trace:
I20260709 13:16:24.652007  5226 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:24.652920  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 228048us
I20260709 13:16:24.654299  3176 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:24.655473  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:24.656019  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:24.656802  3209 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:24.658443  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:24.592625  4862 raft_consensus.cc:3055] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:24.651540  3130 rpcz_store.cc:276] 0709 13:16:23.421918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.588709 (+166791us) service_pool.cc:224] Handling call
0709 13:16:24.650693 (+1061984us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54003dc554. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:24.650896 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401165568}
I20260709 13:16:24.670416  3208 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:24.669975  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:24.680146  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:24.680371  3208 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:24.676306  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:24.680759  3203 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.669596  5406 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:24.683892  3130 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:24.689482  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1046) took 2138 ms. Trace:
I20260709 13:16:24.689833  3130 rpcz_store.cc:276] 0709 13:16:22.551078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.683360 (+2132282us) service_pool.cc:224] Handling call
0709 13:16:24.683682 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.689228 (+  5546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.689428 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:24.688338  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.687889  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1216) took 2836 ms. Trace:
I20260709 13:16:24.689347  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:24.693758  3134 rpcz_store.cc:276] 0709 13:16:21.851532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.619845 (+2768313us) service_pool.cc:224] Handling call
0709 13:16:24.620169 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.621045 (+   876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.687829 (+ 66784us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:24.694316  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:24.694353  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1217) took 2842 ms. Trace:
I20260709 13:16:24.696311  3277 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:24.695400  3208 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:24.697319  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:24.657972  5281 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:16:24.698391  5406 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:24.698709  3211 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:16:24.699250  3211 pending_rounds.cc:85] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 4
I20260709 13:16:24.699501  3211 pending_rounds.cc:107] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:16:24.697410  3128 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:24.700254  3208 raft_consensus.cc:2410] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:24.669740  5206 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:24.701521  3133 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:24.694115  3209 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:24.704250  3130 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:24.704708  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1045) took 2602 ms. Trace:
I20260709 13:16:24.704843  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1049) took 1974 ms. Trace:
I20260709 13:16:24.705039  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:24.705767  3209 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:24.705196  3130 rpcz_store.cc:276] 0709 13:16:22.730347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.703789 (+1973442us) service_pool.cc:224] Handling call
0709 13:16:24.704084 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.704629 (+   545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.704796 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:24.706753  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:24.706715  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:24.708199  3209 raft_consensus.cc:2368] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4.
I20260709 13:16:24.671280  4862 raft_consensus.cc:740] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:24.712898  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:24.616730  5371 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:24.700052  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 67275us
I20260709 13:16:24.705047  3133 rpcz_store.cc:276] 0709 13:16:22.102681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.700938 (+2598257us) service_pool.cc:224] Handling call
0709 13:16:24.701306 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.704483 (+  3177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.704655 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:24.696199  3136 rpcz_store.cc:276] 0709 13:16:21.851765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.620040 (+2768275us) service_pool.cc:224] Handling call
0709 13:16:24.620402 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.694019 (+ 73617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.694051 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.694095 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:24.694131 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.694192 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.694300 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72982,"raft.queue_time_us":73118}
I20260709 13:16:24.711913  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:24.712237  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:24.712616  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:24.706763  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:24.719033  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:24.709066  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:24.703444  3211 raft_consensus.cc:2917] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:16:24.721184  3211 raft_consensus.cc:2889] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:24.716862  3209 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:24.710894  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:24.726112  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:24.727123  3204 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:24.732299  3209 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:24.734038  3209 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:24.733894  3806 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:24.736734  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:24.737054  3208 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:24.738168  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:24.738405  3134 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:24.739084  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1226) took 1318 ms. Trace:
I20260709 13:16:24.736893  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:24.739491  3134 rpcz_store.cc:276] 0709 13:16:23.420751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.711829 (+1291078us) service_pool.cc:224] Handling call
0709 13:16:24.738220 (+ 26391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.738822 (+   602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.739015 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:24.740093  3281 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:24.740967  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:24.741972  5204 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:24.743633  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:24.664669  5178 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:24.747534  3209 raft_consensus.cc:1275] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:24.742060  5254 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:24.740164  5365 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.752556  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:24.753446  3277 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.756172  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:24.756425  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:24.756991  3281 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:24.707468  5244 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:16:24.758682  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:24.762282  3134 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:24.741400  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:24.739179  5177 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.709826  5406 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:24.766325  3208 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:24.766836  3206 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:24.742573  5204 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:24.749055  3129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1183) took 4194 ms (client timeout 1579 ms). Trace:
I20260709 13:16:24.769797  3203 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:24.770886  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:24.749430  5254 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.758250  3835 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:24.757665  5365 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:24.783619  3285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2080) took 3847 ms (client timeout 1904 ms). Trace:
W20260709 13:16:24.803162  3285 rpcz_store.cc:269] 0709 13:16:20.935855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.343120 (+407265us) service_pool.cc:224] Handling call
0709 13:16:24.771871 (+3428751us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001ea854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:24.783523 (+ 11652us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2736965504}
W20260709 13:16:24.806373  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.765178  5281 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.801724  3203 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:24.771977  5204 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:24.823206  3279 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2083) took 2007 ms (client timeout 2155 ms). Trace:
W20260709 13:16:24.828601  3279 rpcz_store.cc:269] 0709 13:16:22.816077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.236673 (+420596us) service_pool.cc:224] Handling call
0709 13:16:24.822955 (+1586282us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54001e9954. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:24.823137 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307819904}
I20260709 13:16:24.823873  3276 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:24.826220  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:24.831146  3130 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:24.832335  3250 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:24.834167  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:24.834810  3134 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.835055  3250 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:24.767908  5272 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:16:24.817690  5254 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:24.847144  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:24.839433  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:24.843739  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:24.837421  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:24.849872  3205 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.850018  3206 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:24.769610  5429 consensus_queue.cc:1059] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:16:24.819087  5281 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.850466  3250 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:24.815532  5365 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.851907  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:24.854138  3282 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.849884  3130 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:24.862324  3277 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:24.866889  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:24.869665  3277 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.872339  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:24.873028  3283 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:24.873026  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:24.769845  5177 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:24.876950  3101 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:24.888265  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:24.841537  5299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.683s	user 0.019s	sys 0.018s
I20260709 13:16:24.869551  3250 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:24.839432  5220 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:24.909165  3101 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:24.913677  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:24.889328  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 303144us
I20260709 13:16:24.859304  5281 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.934712  3282 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:24.938100  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:24.931682  3101 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:24.893951  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 157185us
I20260709 13:16:24.892112  3205 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:24.894944  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:24.895596  3277 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:24.839118  5371 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:24.896777  5299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.740s	user 0.020s	sys 0.018s
I20260709 13:16:24.849416  5402 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:24.772120  3129 rpcz_store.cc:269] 0709 13:16:20.552591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.553894 (+  1303us) service_pool.cc:224] Handling call
0709 13:16:24.738993 (+4185099us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400183154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:24.745137 (+  6144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2670257536}
I20260709 13:16:24.881752  3134 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:24.771447  4862 consensus_queue.cc:260] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:24.927871  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:24.941576  3211 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:24.838253  5434 consensus_queue.cc:1059] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:16:24.885586  5294 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.859263  5426 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.901006  5280 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:24.971943  3805 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:24.970160  3205 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:24.970450  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:24.978808  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:24.979460  3206 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:24.978896  3134 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.981112  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:24.982156  3132 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1019) took 3268 ms (client timeout 2038 ms). Trace:
W20260709 13:16:24.983419  3132 rpcz_store.cc:269] 0709 13:16:21.714048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.716817 (+  2769us) service_pool.cc:224] Handling call
0709 13:16:24.981931 (+3265114us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54003f7d54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:24.982070 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":805287680}
I20260709 13:16:24.984776  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:24.985742  3132 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:24.911535  5206 raft_consensus.cc:697] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 5 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:24.987797  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:24.992012  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 78969us
I20260709 13:16:24.992765  3205 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:24.993141  3250 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:24.990579  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:24.942134  5237 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:24.940246  5198 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:24.911056  5220 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:24.994547  3132 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:24.939539  5231 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.910163  5419 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:24.942917  5418 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:24.943462  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:24.997067  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:24.998668  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:25.001660  3250 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:25.002643  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:25.002671  5237 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:24.999765  4936 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:25.030442  5206 consensus_queue.cc:237] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:25.057654  5440 log.cc:927] Time spent T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:16:24.974746  5052 consensus_queue.cc:1175] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "48080cf0460346769ab046a4f9457aa5" responder_term: 5 status { last_received { term: 5 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 5 index: 3 } }
I20260709 13:16:24.943269  5226 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 13:16:25.041671  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.989187  5386 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:25.048995  3205 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:25.049357  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 47812.8us
I20260709 13:16:25.049935  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:24.999643  5220 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.997756  5198 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.046628  3134 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:24.978951  5426 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:24.981184  5429 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:25.064126  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:25.059450  3835 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.070292  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1016) took 2543 ms. Trace:
W20260709 13:16:25.074043  3278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2084) took 2257 ms (client timeout 1708 ms). Trace:
I20260709 13:16:25.169762  3276 rpcz_store.cc:276] 0709 13:16:22.527350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.250785 (+1723435us) service_pool.cc:224] Handling call
0709 13:16:24.823646 (+572861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.830178 (+  6532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.070087 (+239909us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54001e9950. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:25.070227 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316443520}
W20260709 13:16:25.170104  3278 rpcz_store.cc:269] 0709 13:16:22.816391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.097819 (+281428us) service_pool.cc:224] Handling call
0709 13:16:25.073786 (+1975967us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b5400037d54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:25.073942 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235784576}
I20260709 13:16:25.075131  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52014 (request call id 230) took 1239 ms. Trace:
I20260709 13:16:25.167488  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:25.171120  3284 rpcz_store.cc:276] 0709 13:16:23.835449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.929722 (+ 94273us) service_pool.cc:224] Handling call
0709 13:16:25.074915 (+1145193us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54001784d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:25.075064 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110576896}
I20260709 13:16:25.079025  3285 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
W20260709 13:16:25.079351  5441 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:16:25.085453  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1042) took 3108 ms. Trace:
I20260709 13:16:25.174965  3134 raft_consensus.cc:2410] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:25.089241  5070 raft_consensus.cc:3055] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:25.092043  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:25.177101  3136 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.097780  3834 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:16:25.046571  5273 consensus_queue.cc:1059] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.124s
I20260709 13:16:25.100173  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:24.991998  5272 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 13:16:25.124991  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.186195  3205 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
W20260709 13:16:25.186733  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.043394  5434 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:25.052935  5418 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.166513  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:25.167464  3250 leader_election.cc:400] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6.
W20260709 13:16:25.191052  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 61952.1us
W20260709 13:16:25.168684  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.998319  5450 consensus_queue.cc:1059] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.138s
I20260709 13:16:25.057984  4956 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:25.086649  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:25.174868  3128 rpcz_store.cc:276] 0709 13:16:21.984429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.628382 (+2643953us) service_pool.cc:224] Handling call
0709 13:16:24.697179 (+ 68797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.705520 (+  8341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.085173 (+379653us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b54003dc550. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:25.085369 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157385600}
I20260709 13:16:25.048029  5419 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.058318  4936 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:16:25.098352  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.034871  5448 consensus_queue.cc:1059] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.171s
I20260709 13:16:25.185662  3100 leader_election.cc:400] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4.
I20260709 13:16:25.125322  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:25.223016  3204 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:25.187290  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:25.169466  3837 raft_consensus.cc:1240] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:25.230895  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:25.167076  5198 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.167737  5429 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:25.205209  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:25.195897  5418 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.209404  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:25.179494  3834 pending_rounds.cc:85] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 4
I20260709 13:16:25.210846  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:25.212240  5419 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.176699  5070 raft_consensus.cc:740] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:25.223521  3205 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:25.222604  3100 leader_election.cc:403] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:16:25.215401  4936 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.231633  3204 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:25.238423  3128 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:25.122736  5406 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:25.232722  5439 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 13:16:25.245363  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:25.316076  3208 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:16:25.317010  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:25.201867  5386 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.319427  5386 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:25.321502  4862 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.322088  5386 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:25.323388  5438 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.352s	user 0.001s	sys 0.001s
I20260709 13:16:25.324170  3206 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:16:25.325321  5426 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:25.243181  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:16:25.326501  5445 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.327s	user 0.000s	sys 0.001s
I20260709 13:16:25.326704  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:25.327903  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:25.213323  5177 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:25.328933  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:25.329532  3841 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:25.330122  3202 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:25.330313  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:25.332592  3209 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:25.222586  5178 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:25.338179  3209 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:25.231921  4956 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:25.261226  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58470 (request call id 537) took 1207 ms. Trace:
I20260709 13:16:25.341797  4956 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:25.342531  5378 raft_consensus.cc:3055] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:25.342945  5378 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:25.343783  5378 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:25.344744  5378 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.341542  3842 rpcz_store.cc:276] 0709 13:16:24.049944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.105060 (+ 55116us) service_pool.cc:224] Handling call
0709 13:16:24.648677 (+543617us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:25.099987 (+451310us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cae9c 00007fb3b90caa5b 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:25.257181 (+157194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61083264}
I20260709 13:16:25.345522  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:25.346104  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:25.347044  3841 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:25.238490  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:25.347332  5070 consensus_queue.cc:260] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:25.348587  5070 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.315758  5273 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:25.349684  5273 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:25.350450  5273 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:25.354799  3206 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:25.348839  3841 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:25.310164  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:25.245946  5444 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
W20260709 13:16:25.357718  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 175882us
I20260709 13:16:25.359083  3100 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:25.308573  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:25.360149  3840 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.315291  5456 raft_consensus.cc:3055] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:25.321408  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:25.361343  3204 raft_consensus.cc:2368] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6.
I20260709 13:16:25.260213  3132 raft_consensus.cc:2376] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4. Re-sending same reply.
W20260709 13:16:25.248097  5451 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:16:25.259903  3834 pending_rounds.cc:107] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:16:25.247509  3127 raft_consensus.cc:2889] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:25.240984  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 221) took 1725 ms. Trace:
I20260709 13:16:25.356504  3208 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:25.251814  5102 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:25.363024  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:25.247633  5442 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 13:16:25.247128  5446 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:16:25.245124  5429 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.248221  3833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 534) took 2508 ms. Trace:
W20260709 13:16:25.310849  5412 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:16:25.316721  5457 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 13:16:25.368573  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:25.357481  5273 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.369364  5280 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:16:25.370468  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.370397  5244 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:25.246919  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:25.356940  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:25.348526  5275 raft_consensus.cc:3055] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:25.402799  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:25.380271  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:25.405110  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:25.373816  3834 raft_consensus.cc:2917] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:16:25.385717  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:25.354722  5299 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:25.414050  3836 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:25.414263  5299 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:25.388461  3136 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
W20260709 13:16:25.420496  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.260643  5434 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 13:16:25.367322  5426 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.390287  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1212) took 3540 ms. Trace:
W20260709 13:16:25.405531  5204 consensus_meta.cc:287] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.562s	user 0.003s	sys 0.007s
I20260709 13:16:25.390250  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:25.393151  5454 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:25.408008  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 215634us
W20260709 13:16:25.383927  3249 connection.cc:256] RPC call timeout handler was delayed by -1.2928470199999538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 13:16:25.449049  3249 connection.cc:256] RPC call timeout handler was delayed by -1.1524470199999541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
I20260709 13:16:25.409628  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:25.450990  3128 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.408059  5275 raft_consensus.cc:740] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:25.471341  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.471712  5275 consensus_queue.cc:260] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:25.425345  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1218) took 2006 ms. Trace:
I20260709 13:16:25.472986  5275 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.473245  3131 rpcz_store.cc:276] 0709 13:16:23.418547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.931558 (+513011us) service_pool.cc:224] Handling call
0709 13:16:25.425157 (+1493599us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b5400075154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:25.425286 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1361314176}
I20260709 13:16:25.474525  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:25.474572  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:25.475235  3131 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:25.475893  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:25.430425  3127 rpcz_store.cc:276] 0709 13:16:21.850379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.055952 (+2205573us) service_pool.cc:224] Handling call
0709 13:16:24.115544 (+ 59592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.247436 (+1131892us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b4c00038e00. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3ba4bba20 00007fb3ba4cca29 00007fb3ba492644 00007fb3ba4b9f2d 00007fb3ba4b9b93 00007fb3bc1ea18b 00007fb3bc1eacb5 00007fb3bc1f9fde 00007fb3bc1f97bf 00007fb3bc20b81f 00007fb3bc20b7b8
0709 13:16:25.390041 (+142605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.390215 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18838784}
W20260709 13:16:25.478873  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.464536  5281 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:25.365051  5456 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:25.481335  5281 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:25.481215  5456 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:25.482470  5456 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.484166  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:25.416908  5299 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:25.386966  3833 rpcz_store.cc:276] 0709 13:16:22.740147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.004707 (+264560us) service_pool.cc:224] Handling call
0709 13:16:24.114148 (+1109441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.489719 (+375571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.247978 (+758259us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54007945d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:25.248138 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2446585088}
I20260709 13:16:25.486418  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:25.487762  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:25.488345  3833 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
W20260709 13:16:25.489920  3249 connection.cc:256] RPC call timeout handler was delayed by -1.0039470199999414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 13:16:25.491048  5203 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.491506  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:25.492515  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:25.493310  3836 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:25.493413  5402 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:25.494216  5402 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.494834  5402 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.372216  5271 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:16:25.372715  5198 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:25.496876  5356 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:25.497125  3250 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:25.497416  5356 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.497869  5356 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.498687  5198 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:25.499320  5198 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:25.499734  5198 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.499568  5462 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:25.500203  5198 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.500771  3130 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:25.272063  5237 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:25.502828  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:25.503630  3130 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:25.504284  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1232) took 2081 ms. Trace:
I20260709 13:16:25.504462  3202 raft_consensus.cc:1240] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:25.447713  5204 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:25.438531  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.406965  5450 consensus_queue.cc:1059] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:16:25.508531  5450 raft_consensus.cc:3055] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:25.508718  5204 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:25.509043  5450 raft_consensus.cc:740] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:25.509781  3842 raft_consensus.cc:2410] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:25.500765  5177 raft_consensus.cc:3055] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:25.510087  5450 consensus_queue.cc:260] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:25.511425  5450 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:25.444875  5254 consensus_meta.cc:287] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.002s
W20260709 13:16:25.513648  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.513469  5254 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:25.514819  3134 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:25.515842  5254 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:25.516227  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:24.133586  3135 rpcz_store.cc:276] 0709 13:16:21.851272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.074720 (+2223448us) service_pool.cc:224] Handling call
0709 13:16:24.131720 (+ 57000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.132260 (+   540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.132307 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.132369 (+    62us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:24.132422 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.132506 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.132669 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":145,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":10862}
I20260709 13:16:25.461519  5280 raft_consensus.cc:3055] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:25.517238  5280 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:25.517920  3135 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:25.518626  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 235) took 2095 ms. Trace:
I20260709 13:16:25.518239  5280 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:25.518998  3135 rpcz_store.cc:276] 0709 13:16:23.423468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.517309 (+2093841us) service_pool.cc:224] Handling call
0709 13:16:25.517682 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.518368 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.518571 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.519577  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:25.519874  3134 raft_consensus.cc:2368] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 3. Current term is 4.
I20260709 13:16:25.520797  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 238) took 2005 ms. Trace:
I20260709 13:16:25.469280  5454 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:25.470445  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1227) took 2049 ms. Trace:
I20260709 13:16:25.407879  5244 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:25.495601  3102 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:25.510648  5177 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:25.463389  5220 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:25.521119  3249 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:25.462492  5365 consensus_meta.cc:287] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.001s
I20260709 13:16:25.460081  3837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 526) took 2851 ms. Trace:
I20260709 13:16:25.373435  3280 rpcz_store.cc:276] 0709 13:16:23.515972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.510700 (+994728us) service_pool.cc:224] Handling call
0709 13:16:24.526768 (+ 16068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.549682 (+ 22914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.549713 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.550232 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.831830 (+281598us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:24.838461 (+  6631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.841659 (+  3198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.237775 (+396116us) raft_consensus.cc:1685] finished
0709 13:16:25.237811 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.240914 (+  3103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":249875,"threads_started":1,"wal-append.queue_time_us":390884}
I20260709 13:16:25.523950  3806 leader_election.cc:400] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 3. Current term is 4.
I20260709 13:16:25.547683  3806 leader_election.cc:403] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:16:25.464169  3128 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:25.494392  5418 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:25.488535  5429 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:25.406617  3840 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:25.525527  3177 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:25.524740  3135 rpcz_store.cc:276] 0709 13:16:23.515305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.519801 (+2004496us) service_pool.cc:224] Handling call
0709 13:16:25.520134 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.520466 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.520491 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:25.520534 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:25.520562 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.520620 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.520722 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.520821  3805 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:25.531597  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:25.532294  3250 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:25.539317  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 43830us
I20260709 13:16:25.539024  3133 rpcz_store.cc:276] 0709 13:16:23.421051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.715089 (+1294038us) service_pool.cc:224] Handling call
0709 13:16:24.715502 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.744575 (+ 29073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.744617 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.765057 (+ 20440us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.894465 (+129408us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:24.894510 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.894598 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.470198 (+575600us) raft_consensus.cc:1685] finished
0709 13:16:25.470221 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.470381 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28584,"raft.queue_time_us":31088,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":122083,"threads_started":1,"wal-append.queue_time_us":206655}
W20260709 13:16:25.527565  3020 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8e1a4d71ef0f4287999b5ee60fe02740 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:25.439400  3834 raft_consensus.cc:2889] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:25.549947  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:25.544013  5254 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:25.542066  5244 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.504294  3841 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:16:25.558944  3806 leader_election.cc:400] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3.
I20260709 13:16:25.616372  3806 leader_election.cc:403] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:25.560063  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.563759  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:25.565773  3101 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:25.617578  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 51887.4us
W20260709 13:16:25.610948  3020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 83406.6us
I20260709 13:16:25.618378  3101 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:25.535223  5281 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.504629  3130 rpcz_store.cc:276] 0709 13:16:23.422548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.503107 (+2080559us) service_pool.cc:224] Handling call
0709 13:16:25.503425 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.504009 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.504228 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:25.611992  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 79808.2us
W20260709 13:16:25.604331  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 245287us
I20260709 13:16:25.570221  3283 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:25.468839  4936 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:25.524384  5272 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:25.611435  3128 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.622788  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:25.623158  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:25.624495  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:25.624851  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:25.626511  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:25.546761  3835 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:25.543462  5204 consensus_queue.cc:1059] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:16:25.560351  5375 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:25.621670  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 58028.7us
I20260709 13:16:25.553517  5365 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:25.618824  5070 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:25.634298  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 113568us
W20260709 13:16:25.630308  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 98791us
W20260709 13:16:25.703215  3031 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38218 (request call id 241) took 11557 ms (client timeout 15000 ms). Trace:
I20260709 13:16:25.716114  3805 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:25.692305  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:25.637030  3277 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:25.640156  3279 raft_consensus.cc:2368] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4.
I20260709 13:16:25.697399  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:25.633603  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 108131us
I20260709 13:16:25.619040  5254 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.718464  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:25.644513  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:25.722901  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 102139us
I20260709 13:16:25.725391  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:25.725769  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 87994us
I20260709 13:16:25.700827  3129 raft_consensus.cc:2368] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5.
I20260709 13:16:25.746466  3283 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:25.638540  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:16:25.748339  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 189530us
I20260709 13:16:25.643278  3100 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:25.750524  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 239) took 2185 ms. Trace:
I20260709 13:16:25.751333  3134 rpcz_store.cc:276] 0709 13:16:23.564950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.520632 (+1955682us) service_pool.cc:224] Handling call
0709 13:16:25.521005 (+   373us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:25.521645 (+   640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.521671 (+    26us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:25.522334 (+   663us) log.cc:844] Serialized 78 byte log entry
0709 13:16:25.613844 (+ 91510us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:25.613905 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.613999 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.749883 (+135884us) raft_consensus.cc:1685] finished
0709 13:16:25.749918 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.750310 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1209,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":218,"thread_start_us":87688,"threads_started":1,"wal-append.queue_time_us":165031}
I20260709 13:16:25.691069  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:25.753720  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 110550us
I20260709 13:16:25.754491  3100 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:25.610644  5465 raft_consensus.cc:2764] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:25.634723  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:25.728305  5045 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:25.735150  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1229) took 2313 ms. Trace:
I20260709 13:16:25.759812  3131 rpcz_store.cc:276] 0709 13:16:23.421652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.475925 (+2054273us) service_pool.cc:224] Handling call
0709 13:16:25.476425 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.476645 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.476676 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.521691 (+ 45015us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.614734 (+ 93043us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:25.614772 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.614841 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.734858 (+120017us) raft_consensus.cc:1685] finished
0709 13:16:25.734883 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.735060 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":92663,"threads_started":1,"wal-append.queue_time_us":116440}
I20260709 13:16:25.760643  5436 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:25.761250  5436 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:25.639853  5149 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:25.761718  5436 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.762821  5244 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:25.764432  3279 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:25.637167  5206 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:25.739900  5375 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 3. Current term is 4.
I20260709 13:16:25.719834  5070 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:25.790618  3134 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:25.741065  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:25.791328  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 240) took 2135 ms. Trace:
I20260709 13:16:25.791724  3134 rpcz_store.cc:276] 0709 13:16:23.656124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.753874 (+2097750us) service_pool.cc:224] Handling call
0709 13:16:25.790201 (+ 36327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.791085 (+   884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.791274 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.742025  5418 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:25.644516  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:25.639462  3282 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:25.694741  3832 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:25.638700  3836 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:25.628145  5463 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.634588  4862 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:25.755380  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:25.640017  5406 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:25.830523  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:25.791316  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.686936  5231 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:16:25.759166  5461 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:25.766654  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 48145.3us
I20260709 13:16:25.853181  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:25.739042  5419 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:25.627530  5272 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:25.861428  3134 raft_consensus.cc:1275] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:25.862330  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1242) took 1050 ms. Trace:
I20260709 13:16:25.862727  3134 rpcz_store.cc:276] 0709 13:16:24.812352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.805282 (+992930us) service_pool.cc:224] Handling call
0709 13:16:25.860984 (+ 55702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.861976 (+   992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.862223 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:25.865193  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.772542  3128 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:25.779850  3100 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:25.785719  3249 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:25.785977  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 69968.8us
I20260709 13:16:25.791774  3135 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:25.739921  5365 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:25.716595  3031 rpcz_store.cc:269] 0709 13:16:14.145519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.145780 (+   261us) service_pool.cc:224] Handling call
0709 13:16:25.703115 (+11557335us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:23.056378 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:23.156194 (+ 99816us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:23.156235 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:16:23.156258 (+    23us) tablet.cc:662] Decoding operations
0709 13:16:23.261194 (+104936us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:23.267940 (+  6746us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:23.273242 (+  5302us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:16:23.274601 (+  1359us) tablet.cc:701] Row locks acquired
0709 13:16:23.274623 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:16:23.274791 (+   168us) write_op.cc:270] Start()
0709 13:16:23.274922 (+   131us) write_op.cc:276] Timestamp: P: 1783602983274734 usec, L: 0
0709 13:16:23.274945 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:16:23.275795 (+   850us) log.cc:844] Serialized 5963 byte log entry
0709 13:16:24.497186 (+1221391us) op_driver.cc:464] REPLICATION: finished
0709 13:16:24.688849 (+191663us) write_op.cc:301] APPLY: starting
0709 13:16:24.698399 (+  9550us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:24.698679 (+   280us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:24.735663 (+ 36984us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:24.937105 (+201442us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:25.003130 (+ 66025us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:16:25.043907 (+ 40777us) write_op.cc:312] APPLY: finished
0709 13:16:25.189936 (+146029us) log.cc:844] Serialized 107 byte log entry
0709 13:16:25.213912 (+ 23976us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:25.257273 (+ 43361us) write_op.cc:454] Released schema lock
0709 13:16:25.270332 (+ 13059us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:25.325551 (+ 55219us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:25.325586 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1641645,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":174586,"apply.run_cpu_time_us":7296,"apply.run_wall_time_us":645532,"num_ops":15,"prepare.queue_time_us":422193,"prepare.run_cpu_time_us":67052,"prepare.run_wall_time_us":458585,"raft.queue_time_us":651244,"raft.run_cpu_time_us":3727,"raft.run_wall_time_us":29097,"replication_time_us":1222072,"thread_start_us":996070,"threads_started":4,"wal-append.queue_time_us":308277}]]}
W20260709 13:16:25.802567  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 158135us
I20260709 13:16:25.727533  5254 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.807423  3177 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:25.674181  5052 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:25.808156  3127 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:25.755769  5299 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:25.640030  5281 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:25.778209  5045 raft_consensus.cc:697] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:25.702621  3834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 400) took 1177 ms. Trace:
I20260709 13:16:25.841596  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1244) took 1028 ms. Trace:
I20260709 13:16:25.673414  5271 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 13:16:25.673602  5462 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 13:16:25.858775  3133 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:25.866586  3128 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:25.808583  5237 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:25.802031  5070 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.873988  5418 raft_consensus.cc:3055] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:25.869644  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:25.672885  5177 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:25.878229  5231 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:25.875806  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 90165us
I20260709 13:16:25.906279  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1231) took 2484 ms. Trace:
I20260709 13:16:25.785106  5434 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:16:25.547240  3837 rpcz_store.cc:276] 0709 13:16:22.608592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.609199 (+   607us) service_pool.cc:224] Handling call
0709 13:16:24.871713 (+2262514us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:16:24.910355 (+ 38642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.230627 (+320272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.459799 (+229172us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540064ebd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:25.460007 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484353024}
I20260709 13:16:25.877578  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:25.906811  3127 rpcz_store.cc:276] 0709 13:16:23.422232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.478335 (+2056103us) service_pool.cc:224] Handling call
0709 13:16:25.478620 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.876958 (+398338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.905929 (+ 28971us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b540032ebd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:25.906187 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757431552}
W20260709 13:16:25.879011  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 129005us
I20260709 13:16:25.879755  5400 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:25.803892  5437 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:25.880820  3840 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:25.880218  3130 rpcz_store.cc:276] 0709 13:16:24.813473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.840720 (+1027247us) service_pool.cc:224] Handling call
0709 13:16:25.841119 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.841305 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.841329 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:25.841365 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:25.841396 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.841447 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.841545 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.839244  5468 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:25.882988  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1246) took 1068 ms. Trace:
I20260709 13:16:25.882382  5454 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:25.890622  5273 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:25.884565  3131 raft_consensus.cc:1240] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:25.851809  5149 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3.
I20260709 13:16:25.864560  5461 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.890067  3128 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:25.890798  3135 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:25.891837  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1245) took 1078 ms. Trace:
I20260709 13:16:25.921952  3133 rpcz_store.cc:276] 0709 13:16:24.813831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.846829 (+1032998us) service_pool.cc:224] Handling call
0709 13:16:25.847102 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.888255 (+ 41153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.891789 (+  3534us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.891084  5220 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:25.870574  5272 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:25.927402  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 147633us
I20260709 13:16:25.927942  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 243) took 1665 ms. Trace:
W20260709 13:16:25.928085  5469 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:25.928478  3131 rpcz_store.cc:276] 0709 13:16:24.262692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.761067 (+1498375us) service_pool.cc:224] Handling call
0709 13:16:25.767394 (+  6327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.917535 (+150141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.927612 (+ 10077us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540036a1d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:25.927871 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268927360}
I20260709 13:16:25.929052  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:25.930284  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1228) took 2509 ms. Trace:
I20260709 13:16:25.930559  3100 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:25.851994  5478 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:25.930998  3136 rpcz_store.cc:276] 0709 13:16:23.421368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.432403 (+2011035us) service_pool.cc:224] Handling call
0709 13:16:25.432763 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.433122 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.433153 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.433601 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.695612 (+262011us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:25.695676 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.695788 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.930071 (+234283us) raft_consensus.cc:1685] finished
0709 13:16:25.930092 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.930223 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27816,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":261264,"threads_started":1,"wal-append.queue_time_us":332603}
I20260709 13:16:25.869426  3805 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:25.932569  3100 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:25.870783  5280 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.873658  5406 raft_consensus.cc:697] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:25.868988  4862 raft_consensus.cc:697] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:25.878295  5206 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:25.845510  5102 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.920683  5429 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:25.912431  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:25.910740  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:25.982360  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 71726.4us
I20260709 13:16:25.983626  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:25.914198  3134 rpcz_store.cc:276] 0709 13:16:24.814220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.863673 (+1049453us) service_pool.cc:224] Handling call
0709 13:16:25.882495 (+ 18822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.882673 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.882698 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:25.882737 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:25.882781 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.882841 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.882936 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:25.883167  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 75835.7us
I20260709 13:16:25.854907  5463 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:25.924055  5461 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.917371  3130 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:25.877944  5447 consensus_queue.cc:1059] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:16:25.923429  3133 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:25.930224  3131 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:26.001271  3133 pending_rounds.cc:85] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 2
I20260709 13:16:26.001572  3133 pending_rounds.cc:107] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:26.001830  3133 raft_consensus.cc:2889] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:26.002246  3283 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:25.900384  5418 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:25.900935  5237 raft_consensus.cc:697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:25.915004  5271 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:25.917987  5177 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.914141  5226 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:25.805650  5465 consensus_queue.cc:1059] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:16:26.030580  5463 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:25.924191  5470 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:16:25.956138  5206 raft_consensus.cc:697] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:25.957613  4862 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:25.958478  5102 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:25.940250  4936 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:25.961555  5471 log.cc:927] Time spent T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:16:25.963308  5481 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:25.963403  5244 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:25.963965  5475 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:25.964570  5204 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.884192  3834 rpcz_store.cc:276] 0709 13:16:24.523783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.524254 (+   471us) service_pool.cc:224] Handling call
0709 13:16:25.096939 (+572685us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:16:25.097248 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.645586 (+548338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.700898 (+ 55312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54136192}
I20260709 13:16:26.053982  5481 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.964885  5272 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.056080  5481 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.056247  5204 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.058060  5272 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:25.967450  3838 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:25.973803  5406 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.060798  5461 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.056092  5465 raft_consensus.cc:3055] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:26.061764  5465 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:26.062059  3127 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:25.975441  5070 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:25.936281  5479 consensus_queue.cc:1059] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 13:16:25.979135  5477 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:16:25.986339  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.064327  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:26.036003  5226 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.989706  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:25.913930  5468 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:25.997629  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 65140.1us
I20260709 13:16:26.003819  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:25.942895  5299 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:25.938783  5273 raft_consensus.cc:697] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 5 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:16:25.996404  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 88505.2us
I20260709 13:16:26.075984  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:25.917353  5464 consensus_queue.cc:1059] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.080s
W20260709 13:16:25.981972  5426 consensus_meta.cc:287] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.001s
W20260709 13:16:26.014420  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 102033us
I20260709 13:16:26.077826  3101 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:26.019310  5483 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:26.019907  5338 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:25.953236  5478 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:16:26.023669  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 154323us
I20260709 13:16:26.026103  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1068) took 1062 ms. Trace:
I20260709 13:16:26.026242  5237 consensus_queue.cc:237] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.096223  5231 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.097234  5280 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.098577  3211 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:26.002461  5454 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:25.953841  5480 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:16:26.015431  5437 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.042586  3832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 398) took 1524 ms. Trace:
I20260709 13:16:26.062652  5465 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.000905  5045 consensus_queue.cc:237] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.037497  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:26.058795  5204 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.063472  3136 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:26.017820  5429 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:16:26.053685  5402 consensus_meta.cc:287] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.510s	user 0.004s	sys 0.007s
I20260709 13:16:26.013177  5456 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:26.081845  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:26.086088  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:26.087061  4936 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:16:26.103185  5454 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.164722  3210 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:26.090104  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 200) took 1128 ms. Trace:
I20260709 13:16:26.068698  3842 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:26.063555  5474 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.095082  3251 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:26.167141  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 72152.9us
I20260709 13:16:26.063386  5475 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.100718  3203 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:26.101264  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:26.169571  3207 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.101806  3249 leader_election.cc:400] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6.
I20260709 13:16:26.170948  3249 leader_election.cc:403] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:16:26.102085  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:26.097823  5280 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.112061  3836 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:26.112824  3840 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:26.145792  5490 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:26.091413  5483 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.113421  5434 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:26.113961  5294 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:26.108624  5214 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
W20260709 13:16:26.045936  5450 consensus_meta.cc:287] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.534s	user 0.004s	sys 0.007s
I20260709 13:16:26.090996  4956 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:26.090687  5426 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4.
I20260709 13:16:26.155700  3837 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:26.150709  3841 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:26.167472  5454 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.063776  5418 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.078754  5226 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.151286  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:26.159133  3206 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.082381  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:26.179368  5070 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:26.094225  5486 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:26.076956  5488 consensus_queue.cc:1059] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:16:26.123643  5281 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.109175  5464 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:16:26.112556  5273 consensus_queue.cc:237] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.155293  5461 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.147730  5299 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:16:26.166908  5204 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:26.166759  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:26.171484  5475 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:26.177737  5356 consensus_meta.cc:287] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.679s	user 0.013s	sys 0.000s
W20260709 13:16:26.115824  5198 consensus_meta.cc:287] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.615s	user 0.005s	sys 0.005s
I20260709 13:16:26.175114  5462 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:26.163309  5402 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.122011  5437 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.202754  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:26.186600  5483 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.117236  5206 consensus_queue.cc:237] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.116284  3832 rpcz_store.cc:276] 0709 13:16:24.517745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.519258 (+  1513us) service_pool.cc:224] Handling call
0709 13:16:25.434496 (+915238us) spinlock_profiling.cc:243] Waited 8.97 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:16:25.434700 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.810944 (+376244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.042299 (+231355us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54003abbd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:26.042502 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503785600}
I20260709 13:16:26.252318  4956 raft_consensus.cc:697] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:26.089821  3101 leader_election.cc:400] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4.
I20260709 13:16:26.231930  5198 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.366483  3101 leader_election.cc:403] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:26.079711  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 75956.7us
I20260709 13:16:26.367419  4956 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.369874  3280 raft_consensus.cc:2368] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6.
I20260709 13:16:26.099758  3129 rpcz_store.cc:276] 0709 13:16:24.963973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.189796 (+225823us) service_pool.cc:224] Handling call
0709 13:16:26.025890 (+836094us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54003f7d54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:26.026037 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642356992}
I20260709 13:16:26.343981  3202 raft_consensus.cc:2410] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:26.165150  3205 rpcz_store.cc:276] 0709 13:16:24.961445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.312754 (+351309us) service_pool.cc:224] Handling call
0709 13:16:25.316097 (+  3343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.316463 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.316491 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.363720 (+ 47229us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.456150 (+ 92430us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b18002e7b60. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:16:25.817589 (+361439us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:25.817642 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.817718 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:26.075759 (+258041us) raft_consensus.cc:1685] finished
0709 13:16:26.075788 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.089966 (+ 14178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16961,"raft.queue_time_us":37840,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":10291,"spinlock_wait_cycles":3046144,"thread_start_us":361209,"threads_started":1,"wal-append.queue_time_us":352497}
I20260709 13:16:26.112308  3135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
W20260709 13:16:26.207216  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 105576us
I20260709 13:16:26.373965  3135 raft_consensus.cc:606] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:26.374763  3135 raft_consensus.cc:614] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:26.375630  5198 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:26.207170  4936 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6.
W20260709 13:16:26.220767  5275 consensus_meta.cc:287] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.747s	user 0.011s	sys 0.000s
I20260709 13:16:26.220932  5102 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.248183  5254 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.185567  3207 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:26.380218  5102 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4.
I20260709 13:16:26.380692  5254 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:26.382073  5226 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.382911  5226 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:26.383242  5254 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.383664  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:26.219893  5356 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.258515  5280 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:26.385766  3278 raft_consensus.cc:2410] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:26.218972  5204 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.387526  5356 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:26.387995  3832 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:26.389250  5406 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:26.420452  5406 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.421766  3102 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:26.423295  5426 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:26.423487  5406 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.390244  5204 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.423909  5426 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.424425  5426 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:26.390707  5402 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:26.235544  5450 raft_consensus.cc:3055] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:26.426568  5450 raft_consensus.cc:740] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:26.428227  5450 consensus_queue.cc:260] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.264858  5456 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:26.431191  5456 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.238101  5462 raft_consensus.cc:697] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:26.387526  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 297924us
I20260709 13:16:26.436439  3101 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:26.404589  5461 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:26.436769  5462 consensus_queue.cc:237] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:26.405674  5436 consensus_meta.cc:287] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.643s	user 0.007s	sys 0.006s
I20260709 13:16:26.439292  5436 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.442109  5436 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.405583  5102 consensus_queue.cc:1059] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:26.444437  5102 raft_consensus.cc:3055] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:26.383759  5226 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:26.417375  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:26.445801  3842 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.194672  5478 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.448743  5481 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.177309  5474 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.213346  5488 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:26.455181  5503 log.cc:927] Time spent T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.140s	user 0.000s	sys 0.002s
I20260709 13:16:26.454836  5488 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.309315  5490 raft_consensus.cc:697] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:26.384027  5254 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.404856  3840 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:16:26.220846  5468 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.216491  5486 raft_consensus.cc:697] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:26.467406  5488 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:26.412659  5378 consensus_meta.cc:287] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 1.055s	user 0.016s	sys 0.002s
I20260709 13:16:26.467860  5226 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.467643  5486 consensus_queue.cc:237] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.469446  5468 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:26.444941  5102 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:26.471364  5102 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.472142  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:26.414219  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.474716  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.475574  5492 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.476567  5492 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:26.479072  5468 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:26.436681  5450 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.485769  3132 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
W20260709 13:16:26.487465  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.459151  5490 consensus_queue.cc:237] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:26.495414  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 322339us
I20260709 13:16:26.430723  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:26.420380  5437 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:26.505160  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.506036  5102 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.512998  3842 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
W20260709 13:16:26.522116  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.520823  3102 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:26.511225  5484 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:16:26.528421  5468 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:26.528995  5468 raft_consensus.cc:697] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:26.534125  5468 consensus_queue.cc:237] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.537057  5437 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:26.542531  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 552711us
I20260709 13:16:26.544188  3206 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:26.551445  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:26.555366  5426 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.560508  3841 raft_consensus.cc:3055] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:26.568750  3841 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:26.572314  3841 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.575013  3841 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.532666  5454 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.586231  3209 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:26.589463  5481 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:26.595494  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:26.597033  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:26.598076  3283 raft_consensus.cc:2393] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:16:26.599255  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.603042  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:26.603909  3210 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:26.606981  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:26.607834  3206 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:26.607882  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:26.530392  5475 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.610582  3211 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:26.611234  3282 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:26.612118  5475 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.613921  3276 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:26.616530  5437 consensus_queue.cc:1059] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:26.617372  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:26.618793  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 188679us
I20260709 13:16:26.607179  5474 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.621097  5450 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:26.621492  5509 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:26.623520  5450 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.623462  5437 raft_consensus.cc:3055] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:26.624233  5437 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:26.624274  3834 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:26.625052  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 73867.2us
I20260709 13:16:26.619674  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:26.549270  5483 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.632146  3841 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:16:26.604954  3177 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:26.635167  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:26.625360  5484 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:16:26.639986  3176 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:26.632982  3841 pending_rounds.cc:85] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 4
I20260709 13:16:26.640934  3841 pending_rounds.cc:107] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:16:26.641925  3841 raft_consensus.cc:2889] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:26.643343  5375 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:16:26.646416  5426 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:26.647063  5426 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.647536  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:26.647704  5426 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:26.648186  3835 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:26.650559  5483 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.651870  5506 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:26.631036  5454 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.652477  5506 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:26.656003  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 51324.2us
I20260709 13:16:26.661516  5484 consensus_queue.cc:1059] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:26.662761  5484 raft_consensus.cc:3055] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:26.663195  5484 raft_consensus.cc:740] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:26.663347  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1055) took 1924 ms. Trace:
I20260709 13:16:26.663856  3132 rpcz_store.cc:276] 0709 13:16:24.738552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.362710 (+624158us) service_pool.cc:224] Handling call
0709 13:16:26.663063 (+1300353us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b5400183154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:26.663245 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2221851904}
I20260709 13:16:26.661587  5450 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:26.665927  5450 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.666497  5450 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:26.666849  5497 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.351s	user 0.004s	sys 0.000s
W20260709 13:16:26.665661  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 46151.7us
I20260709 13:16:26.667477  5506 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.676381  5426 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.655742  4956 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.677452  5463 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:26.680282  3176 leader_election.cc:400] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5.
I20260709 13:16:26.680619  3176 leader_election.cc:403] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:26.681579  5273 consensus_queue.cc:1059] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:26.682565  3249 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:26.684732  5356 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:26.685321  5356 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:26.685838  5356 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.685536  5437 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.687170  5437 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.688459  5499 consensus_queue.cc:1059] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:26.683576  5226 raft_consensus.cc:3055] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:26.682690  5273 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5.
I20260709 13:16:26.722327  3835 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:16:26.664541  5484 consensus_queue.cc:260] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.726040  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:26.744278  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2113) took 1123 ms. Trace:
I20260709 13:16:26.747179  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:26.748697  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:26.716722  5226 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:16:26.809422  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.749622  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:26.812271  3282 raft_consensus.cc:2368] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 5. Current term is 6.
I20260709 13:16:26.744772  3280 rpcz_store.cc:276] 0709 13:16:25.620673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.627234 (+  6561us) service_pool.cc:224] Handling call
0709 13:16:26.743964 (+1116730us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b5400319054. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:26.744179 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1407448320}
I20260709 13:16:26.813946  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:26.817263  5272 raft_consensus.cc:3055] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:26.817754  5272 raft_consensus.cc:740] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:26.818897  5272 consensus_queue.cc:260] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.797675  3283 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:26.823223  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:26.823848  3840 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:26.825183  5484 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.777335  5426 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.826870  5426 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.827512  5474 consensus_queue.cc:1059] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:26.820405  5450 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.827214  5356 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:26.831103  5356 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:26.810444  4956 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:26.837292  5479 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.754581  5365 raft_consensus.cc:3055] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:26.831259  5426 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:26.846199  5052 raft_consensus.cc:3055] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:26.846750  5052 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:26.847419  3838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 538) took 2797 ms. Trace:
I20260709 13:16:26.840070  5479 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.847819  5052 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.849644  5052 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.850591  5479 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.850507  5506 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.847810  3838 rpcz_store.cc:276] 0709 13:16:24.050300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.050876 (+   576us) service_pool.cc:224] Handling call
0709 13:16:24.051266 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.059221 (+2007955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.846871 (+787650us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b54005226d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:26.847235 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4405778816}
I20260709 13:16:26.834405  5475 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:16:26.862305  5450 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:27.007969  5490 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:27.033067  5275 raft_consensus.cc:1064] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:16:27.035598  5275 consensus_queue.cc:237] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:27.037606  5272 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.038862  4956 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.044952  4956 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:27.047200  4956 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:27.051524  4956 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:27.052275  4956 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.052701  3250 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:27.054600  4956 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:27.057384  4956 consensus_queue.cc:1059] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:26.762437  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:27.064355  3279 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.067946  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:27.068847  4956 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:27.070650  4956 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:27.071225  4956 raft_consensus.cc:697] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:27.072046  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1254) took 1541 ms. Trace:
I20260709 13:16:27.072463  4956 consensus_queue.cc:237] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.072659  3128 rpcz_store.cc:276] 0709 13:16:25.530411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.923327 (+392916us) service_pool.cc:224] Handling call
0709 13:16:25.926692 (+  3365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.102215 (+175523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.102246 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:26.102308 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:26.102343 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.071589 (+969246us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54000695d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:27.071656 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.071836 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403185920}
I20260709 13:16:27.073980  5526 consensus_queue.cc:1059] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:27.076225  5526 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:27.078352  5526 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:27.085325  5526 consensus_queue.cc:1243] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer fc48eecc27554cb58b15193cd442b1d3 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:16:27.088086  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.088963  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:27.090077  4956 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:27.090337  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:27.093734  3285 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:27.095113  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:27.096488  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:27.097594  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:27.098824  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:27.099975  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:27.101768  3285 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:27.103279  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:27.107137  5526 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:27.104951  3276 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:27.106264  5275 consensus_queue.cc:1059] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:27.110934  5272 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.111841  5272 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:27.114178  5272 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:27.112136  3279 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:27.092976  4956 raft_consensus.cc:3055] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:27.117308  4956 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:27.118346  4956 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.119942  4956 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:27.125201  5254 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:26.728386  3102 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:27.185700  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 456722us
I20260709 13:16:27.188102  5254 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:27.188637  5254 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:27.189839  5254 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:27.191164  3100 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:27.193920  5338 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:27.194787  5338 raft_consensus.cc:697] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:27.196007  4862 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.196208  5338 consensus_queue.cc:237] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.197496  5231 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.198364  5231 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:27.201387  5487 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.202316  5487 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:27.204645  5487 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:27.217067  5299 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.217393  5487 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:27.200882  5231 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:27.217690  5299 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.219187  5231 raft_consensus.cc:1064] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:16:27.219987  5299 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:27.221540  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:27.223299  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:27.224436  5418 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.192301  3100 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:27.225945  3100 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:27.226958  5426 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:27.227363  5426 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.227741  5426 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:27.227924  5299 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:27.228363  5299 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:27.228718  5299 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:27.229900  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:27.230664  3131 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 4: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:27.230499  5487 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.211409  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:27.235664  5463 raft_consensus.cc:3055] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:27.236174  5463 raft_consensus.cc:740] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:27.213609  5492 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.196724  4862 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.215471  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:27.216166  5102 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:27.244237  5102 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.242367  3134 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:27.249042  5052 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:27.251106  5052 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.253196  5052 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:27.243314  5492 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.265436  4862 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:27.281958  5492 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:27.282361  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:27.284189  5052 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:27.268189  5102 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:27.242151  5463 consensus_queue.cc:260] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.272606  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2119) took 1646 ms. Trace:
I20260709 13:16:27.285418  3278 rpcz_store.cc:276] 0709 13:16:25.626098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.626233 (+   135us) service_pool.cc:224] Handling call
0709 13:16:27.272382 (+1646149us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54001ea354. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:27.272547 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1720575872}
I20260709 13:16:27.289582  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:27.292012  3131 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:27.293071  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:27.293735  3134 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:27.294613  3135 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:16:27.295527  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 68100.6us
I20260709 13:16:27.299773  5463 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.762118  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:27.301028  5231 consensus_queue.cc:237] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:27.302325  3284 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:27.304911  5299 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.307111  5299 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:27.307559  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:27.308385  3134 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.224790  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:27.305225  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:27.277000  5487 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:27.309594  3135 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:27.315786  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 244) took 1141 ms. Trace:
I20260709 13:16:27.316378  3277 rpcz_store.cc:276] 0709 13:16:26.171382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.172027 (+   645us) service_pool.cc:224] Handling call
0709 13:16:26.172357 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.362072 (+189715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.362144 (+    72us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.363157 (+  1013us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.495880 (+132723us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:26.495921 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.312333 (+816412us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54002701d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:27.312387 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.312440 (+    53us) raft_consensus.cc:1685] finished
0709 13:16:27.312459 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.312875 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4014,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":388,"spinlock_wait_cycles":433162624,"thread_start_us":132198,"threads_started":1,"wal-append.queue_time_us":133377}
I20260709 13:16:27.318531  3206 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:27.322450  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:27.323326  3206 raft_consensus.cc:2410] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:16:27.322381  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:27.308432  3132 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:27.326035  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:27.352015  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.327184  3129 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.356410  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:27.357259  3205 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:27.358042  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:27.359213  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:27.359745  3205 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:27.361541  3135 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:27.362252  5482 raft_consensus.cc:3055] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:27.363286  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:27.365365  5052 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:27.379055  3134 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:27.394942  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:27.396082  3132 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:27.409436  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:27.410753  3207 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:27.415648  3129 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:27.393323  5482 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:27.427251  5482 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.429773  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:27.440611  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:27.441900  3202 raft_consensus.cc:2410] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:27.449379  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:27.450300  3208 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:27.410334  5052 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:27.456233  5052 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:27.461510  3250 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.526s (SENT) [suppressed 25 similar messages]
W20260709 13:16:27.462580  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.463410  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.463316  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:27.464277  5506 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:27.465353  3836 raft_consensus.cc:1240] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:27.466251  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.467401  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:26.837484  5226 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.464303  3211 raft_consensus.cc:2410] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:27.469480  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:27.471776  5482 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.842180  5365 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:27.474890  5365 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:27.476027  5365 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.463377  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:27.476888  5426 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.492722  3838 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:27.495142  3132 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:16:27.498011  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:27.500204  3100 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:27.501838  3100 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:27.504181  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:27.504845  3211 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:27.505336  3100 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:27.509955  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:27.527745  3836 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.512307  5486 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:16:27.536300  3132 pending_rounds.cc:85] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 1
I20260709 13:16:27.536654  3132 pending_rounds.cc:107] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:27.536903  3132 raft_consensus.cc:2889] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:27.537210  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 75730.3us
I20260709 13:16:27.537431  5254 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:27.537897  5254 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.538219  5254 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.538793  5418 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.539336  5418 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.552963  3208 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:27.523398  5102 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:27.556756  3100 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:27.559899  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.527020  5299 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:27.562248  3838 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEARNER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:27.566681  5299 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:27.568795  5299 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.571231  3211 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:27.581940  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1250) took 2083 ms. Trace:
I20260709 13:16:27.582616  3100 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:27.582808  5338 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:27.564651  5487 consensus_queue.cc:1059] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:16:27.583480  5468 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:27.583364  5338 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.584018  5468 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:27.583514  5231 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:27.585543  5231 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:27.585140  5468 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.586463  5231 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.588788  5437 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.589479  5437 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.589792  5483 raft_consensus.cc:3055] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:27.590912  5483 raft_consensus.cc:740] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:27.591941  5483 consensus_queue.cc:260] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:27.582366  3127 rpcz_store.cc:276] 0709 13:16:25.498870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.907878 (+409008us) service_pool.cc:224] Handling call
0709 13:16:25.908189 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.062451 (+154262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.525034 (+1462583us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400182c54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:27.581736 (+ 56702us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353351936}
I20260709 13:16:27.579387  5052 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:27.599913  5052 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.565258  5461 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:16:27.565385  5102 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.605598  5102 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.608386  3836 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:27.609634  3207 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:27.657495  3177 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:27.609702  5483 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.664521  3135 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:27.722963  5365 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:27.723834  5365 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:27.732273  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.749126  5365 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:27.790134  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.803170  5534 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.804031  5534 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.807075  5534 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:27.858255  3211 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:27.858207  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:27.859387  3208 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 8: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:27.859645  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:27.858381  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:27.861028  3205 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:27.869460  5177 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:27.870229  5177 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:16:27.871960  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.648955  5254 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:27.881384  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.884792  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.885267  5272 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.885452  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.885847  5272 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:26.749715  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:27.886888  3281 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.888254  5272 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:27.890163  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:27.891495  5177 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:27.895442  3205 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:27.897351  3283 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:27.901296  5533 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:27.904235  3100 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:27.904795  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:27.906131  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:27.909016  3205 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:27.920945  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.921855  3210 raft_consensus.cc:2410] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:16:27.923236  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.885848  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.905318  5543 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.273s	user 0.001s	sys 0.003s
I20260709 13:16:27.628152  5418 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:27.625273  5426 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:27.614645  5437 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:27.935252  5462 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.936882  3281 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:27.953828  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1026) took 1207 ms. Trace:
I20260709 13:16:27.937999  3836 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:27.938421  5492 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.939265  4862 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:27.941210  5206 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:27.925287  5533 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:27.942945  3835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 354) took 1218 ms. Trace:
I20260709 13:16:27.954438  3205 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:27.954200  3281 rpcz_store.cc:276] 0709 13:16:26.746820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.749227 (+  2407us) service_pool.cc:224] Handling call
0709 13:16:27.953750 (+1204523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.967202  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:27.968173  3835 rpcz_store.cc:276] 0709 13:16:26.724805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.724939 (+   134us) service_pool.cc:224] Handling call
0709 13:16:26.841367 (+116428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.232145 (+390778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.232190 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:27.233050 (+   860us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.482220 (+249170us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:27.482296 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.482381 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.942693 (+460312us) raft_consensus.cc:1685] finished
0709 13:16:27.942722 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.942854 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1393,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":242440,"threads_started":1,"wal-append.queue_time_us":340527}
I20260709 13:16:27.962642  5198 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.974114  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.944839  5299 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.973827  5052 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:27.964831  5553 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:27.997710  5481 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.004268  5553 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.006650  5553 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:28.008340  5482 consensus_meta.cc:287] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.002s
I20260709 13:16:27.970016  5418 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:16:28.002005  5338 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:28.004333  5481 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:27.998008  5492 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:28.045737  3101 leader_election.cc:336] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.840s (SENT)
I20260709 13:16:28.046416  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:28.008929  5482 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:28.068400  3065 debug-util.cc:398] Leaking SignalData structure 0x7b08002a3920 after lost signal to thread 2028
I20260709 13:16:28.068333  5482 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.071178  5482 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:27.996155  5198 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.049839  5481 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:28.063210  5299 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:27.987524  5462 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.065510  5492 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:28.067759  5484 consensus_meta.cc:287] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 1.242s	user 0.012s	sys 0.012s
W20260709 13:16:28.072924  3065 debug-util.cc:398] Leaking SignalData structure 0x7b080008a5c0 after lost signal to thread 3068
I20260709 13:16:28.083416  5206 raft_consensus.cc:697] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:16:28.106539  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 1.42641e+06us
I20260709 13:16:28.072999  5483 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
W20260709 13:16:28.120059  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 82452.1us
W20260709 13:16:28.120221  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 126347us
W20260709 13:16:28.115056  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 145039us
I20260709 13:16:28.115260  5338 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.127521  3842 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:16:28.128274  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 86896.8us
I20260709 13:16:28.131626  3250 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:28.125196  5338 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.131424  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:28.133579  3832 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:28.133926  5419 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:28.124272  5533 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:28.135105  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:28.136216  5338 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:28.137179  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.121857  5206 consensus_queue.cc:237] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.140014  5461 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:28.140580  5461 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.142920  5461 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:28.154254  3805 leader_election.cc:336] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.005s (SENT)
I20260709 13:16:28.154379  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:28.154824  3805 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:28.155395  3832 raft_consensus.cc:2410] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:28.143445  5461 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:28.156420  5461 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.157236  3135 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:28.158293  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:28.159402  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:28.159934  3135 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:28.158533  5461 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:28.131357  5280 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:28.154594  3834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 547) took 2059 ms. Trace:
W20260709 13:16:28.173589  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 51023.9us
I20260709 13:16:28.175539  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:28.176700  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:28.160728  3135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:16:28.181946  3135 raft_consensus.cc:606] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:16:28.182799  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.183543  3203 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:28.188737  5552 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.189517  5198 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:28.190403  3842 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
W20260709 13:16:28.191124  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 220581us
I20260709 13:16:28.203336  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1073) took 2588 ms. Trace:
I20260709 13:16:28.203783  3136 rpcz_store.cc:276] 0709 13:16:25.614427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.932520 (+318093us) service_pool.cc:224] Handling call
0709 13:16:25.936249 (+  3729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.149853 (+213604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.202883 (+2053030us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54003f8254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:28.203145 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292115840}
I20260709 13:16:28.205317  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:28.205866  3202 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:28.206290  5102 consensus_meta.cc:287] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.600s	user 0.003s	sys 0.009s
I20260709 13:16:28.206696  5102 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:28.207854  5546 log.cc:927] Time spent T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.674s	user 0.000s	sys 0.008s
I20260709 13:16:28.209220  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.209415  5102 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:28.209487  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.209885  3205 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:28.210362  5462 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:28.210887  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.211964  5533 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.212591  3207 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:28.192808  3134 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:28.214444  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.210803  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.172401  5484 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:28.195362  5553 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.195804  5566 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:28.196161  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 69546.5us
I20260709 13:16:28.196412  5177 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:28.196818  5499 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:28.197068  5559 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.161888  3834 rpcz_store.cc:276] 0709 13:16:26.095669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.111024 (+ 15355us) service_pool.cc:224] Handling call
0709 13:16:26.111355 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.629653 (+518298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.154305 (+1524652us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54005785d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:28.154537 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178673408}
I20260709 13:16:28.197872  5563 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.194561  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:28.215049  3205 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
W20260709 13:16:28.195030  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.243028  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.215372  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:28.226567  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.200242  3033 catalog_manager.cc:5697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.236366  3203 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:16:28.236153  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 76499.9us
I20260709 13:16:28.243990  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:28.244617  3207 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.244001  3203 pending_rounds.cc:85] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 1
I20260709 13:16:28.245399  3203 pending_rounds.cc:107] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:28.245633  3203 raft_consensus.cc:2889] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:28.230450  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:28.240199  3134 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:28.233269  5499 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.246806  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:28.201399  5552 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:28.248445  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.228335  5102 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.250648  3136 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:28.251744  3211 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:28.240483  5566 raft_consensus.cc:697] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:28.237123  5177 raft_consensus.cc:697] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:28.259713  3250 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:28.262084  3202 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:28.262472  5198 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:28.264493  5198 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:28.264438  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.264312  3033 catalog_manager.cc:5697] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 3 to 4, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 4 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.265734  3211 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:28.265800  5198 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.266265  3033 catalog_manager.cc:5697] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 4 to 5, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 5 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.252630  5499 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.250211  5462 raft_consensus.cc:2764] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:28.268604  3033 catalog_manager.cc:5697] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.249665  5559 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.241923  5563 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.279316  5563 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:28.280859  5356 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:28.281657  5356 raft_consensus.cc:697] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:28.282809  5356 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.285995  5456 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:28.289609  5566 consensus_queue.cc:237] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.290807  3211 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:28.292445  5552 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:28.260600  5102 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.251888  5553 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.293434  5254 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:28.293774  5177 consensus_queue.cc:237] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.284889  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:28.286530  3127 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:28.314116  3841 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:28.308431  3250 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:28.311443  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:28.325225  3033 catalog_manager.cc:5697] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 2 to 4, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 4 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.311151  5426 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.329010  3211 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.331267  3203 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:16:28.331646  3203 pending_rounds.cc:85] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 6
I20260709 13:16:28.332654  3203 pending_rounds.cc:107] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:16:28.334079  3133 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:16:28.330821  3033 catalog_manager.cc:5697] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 2 to 6, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 6 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.336261  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:28.337054  3033 catalog_manager.cc:5697] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 4 to 5, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 5 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.338047  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:28.338352  5575 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:16:28.338892  5462 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:28.340373  5463 consensus_queue.cc:1059] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:28.340848  3033 catalog_manager.cc:5697] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.342662  5463 raft_consensus.cc:3055] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:28.332934  3203 raft_consensus.cc:2889] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:28.342794  3033 catalog_manager.cc:5697] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:28.351866  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 121571us
I20260709 13:16:28.352608  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:28.353331  3205 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:16:28.379932  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:28.380530  5482 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:28.381289  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.375701  5553 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:28.375849  5102 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:28.382766  3840 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:28.381383  5482 consensus_queue.cc:1243] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer fc48eecc27554cb58b15193cd442b1d3 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:28.379542  3205 pending_rounds.cc:85] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 2
I20260709 13:16:28.383678  3205 pending_rounds.cc:107] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:28.383806  3285 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:28.382596  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:28.383926  3205 raft_consensus.cc:2889] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:28.424324  3207 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
W20260709 13:16:28.438820  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 64722.1us
W20260709 13:16:28.398138  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.389948  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:28.459884  3211 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:28.510281  3203 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:16:28.500204  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.515254  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.385169  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:28.517719  3285 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.385589  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:28.518992  3277 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.349938  5463 raft_consensus.cc:740] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:28.520328  3133 raft_consensus.cc:606] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:16:28.372705  5533 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.525293  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.527184  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:28.392905  3283 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1039) took 1577 ms (client timeout 1710 ms). Trace:
W20260709 13:16:28.405310  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.400105  5437 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.397881  5275 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.352679  5426 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.393193  5484 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.384384  5559 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:28.438310  5448 raft_consensus.cc:3055] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:28.398988  5272 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.385542  5198 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:28.536609  3281 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:28.380003  5460 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:28.538635  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 92005.9us
I20260709 13:16:28.543701  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:28.544431  3211 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:28.545224  5437 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.544703  5275 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.546000  5226 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.550032  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:28.531803  3283 rpcz_store.cc:269] 0709 13:16:26.815364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.822895 (+  7531us) service_pool.cc:224] Handling call
0709 13:16:28.392681 (+1569786us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003ba6d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:28.392847 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2468089600}
I20260709 13:16:28.562244  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:28.566962  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:28.570847  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.385174  5462 consensus_queue.cc:1059] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.185s
W20260709 13:16:28.595381  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.571471  3033 catalog_manager.cc:5697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:28.602260  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.596999  3204 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:28.605536  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 2188) took 1601 ms. Trace:
I20260709 13:16:28.565049  5448 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:28.605640  3277 raft_consensus.cc:2410] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:28.570235  5198 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:28.537250  5533 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.606190  3204 rpcz_store.cc:276] 0709 13:16:27.004330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.561805 (+1557475us) service_pool.cc:224] Handling call
0709 13:16:28.605468 (+ 43663us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:28.609157  3279 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:28.570168  5482 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:16:28.569727  5484 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.595868  5460 raft_consensus.cc:697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:28.572494  5272 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.617522  5429 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:28.617820  5583 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.628770  5429 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.629504  5214 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:28.631238  5429 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:28.631800  5429 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.632301  5429 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.620247  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:28.619078  5582 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:16:28.627522  5460 consensus_queue.cc:237] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.635345  5429 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:28.628193  5272 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:28.628860  5583 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.617955  5465 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:28.653941  5275 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:28.655360  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:28.656054  3204 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.639199  5463 consensus_queue.cc:260] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.665297  5448 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.666560  5448 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.667590  5484 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:28.668889  3033 catalog_manager.cc:5697] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 2, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 2 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:28.671134  3033 catalog_manager.cc:5697] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:16:28.673991  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:28.674800  5491 log.cc:927] Time spent T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 2.432s	user 0.014s	sys 0.004s
I20260709 13:16:28.675176  3277 raft_consensus.cc:2410] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:16:28.676173  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.677455  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.677533  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.677891  3284 raft_consensus.cc:1240] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:28.678917  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.679121  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.679500  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:28.680145  3277 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:16:28.680521  5578 consensus_queue.cc:1175] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "48080cf0460346769ab046a4f9457aa5" responder_term: 5 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: [4.3-4.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:28.679144  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:28.682334  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:28.682607  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.683204  3278 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:28.683166  5198 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.684340  5198 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:28.684556  3278 raft_consensus.cc:1240] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:28.690234  5463 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.699777  5499 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.691391  5533 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:28.701640  3134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:16:28.701812  5426 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:28.702239  3134 raft_consensus.cc:606] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:16:28.703110  5583 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:28.704308  5437 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:28.705747  5542 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 1.178s	user 0.010s	sys 0.000s
I20260709 13:16:28.701577  3283 raft_consensus.cc:2393] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:28.708427  3285 raft_consensus.cc:2410] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:28.709295  3279 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:16:28.709637  3279 pending_rounds.cc:85] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 5
I20260709 13:16:28.710032  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:28.710043  3279 pending_rounds.cc:107] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:16:28.710683  3279 raft_consensus.cc:2889] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:28.710847  3282 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1030) took 1962 ms (client timeout 1653 ms). Trace:
W20260709 13:16:28.711261  3282 rpcz_store.cc:269] 0709 13:16:26.748431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.821986 (+ 73555us) service_pool.cc:224] Handling call
0709 13:16:28.710779 (+1888793us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:28.712189  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:28.712877  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.672571  3033 catalog_manager.cc:5697] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 3 to 4, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 4 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:16:28.714269  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:28.715354  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.715546  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.716320  3278 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:28.695101  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:28.695717  5177 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:28.716403  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:28.649700  3806 connection.cc:256] RPC call timeout handler was delayed by -1.37805256799993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260709 13:16:28.717162  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.691896  3277 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
W20260709 13:16:28.715651  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.721171  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:28.723863  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.680337  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.722426  3279 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:28.724983  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.725829  3204 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:28.727394  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:28.728104  3176 leader_election.cc:400] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 5. Current term is 6.
I20260709 13:16:28.728463  3176 leader_election.cc:403] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:28.728572  5506 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:28.729367  5506 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 5. Current term is 6.
W20260709 13:16:28.729697  3065 debug-util.cc:398] Leaking SignalData structure 0x7b0800331d40 after lost signal to thread 3160
I20260709 13:16:28.729897  3130 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:28.729982  3176 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:28.730474  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 257) took 1520 ms. Trace:
I20260709 13:16:28.730854  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.730823  3130 rpcz_store.cc:276] 0709 13:16:27.210614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.729342 (+1518728us) service_pool.cc:224] Handling call
0709 13:16:28.729597 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:28.730269 (+   672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.730428 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:28.731346  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:28.732218  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.732649  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:28.732820  3208 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 3.
I20260709 13:16:28.733366  5177 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:28.733834  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.734051  5177 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:28.734448  3208 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:28.725652  3278 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
W20260709 13:16:28.735175  3065 debug-util.cc:398] Leaking SignalData structure 0x7b08003eac20 after lost signal to thread 3235
W20260709 13:16:28.735491  3065 debug-util.cc:398] Leaking SignalData structure 0x7b0800037600 after lost signal to thread 3236
I20260709 13:16:28.723078  3033 catalog_manager.cc:5697] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 4 to 5, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 5 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:28.736646  3065 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6ea0 after lost signal to thread 3309
W20260709 13:16:28.736832  3065 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0fc0 after lost signal to thread 3310
W20260709 13:16:28.738252  3065 debug-util.cc:398] Leaking SignalData structure 0x7b08000c32e0 after lost signal to thread 3867
I20260709 13:16:28.728114  3284 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:16:28.739679  3065 debug-util.cc:398] Leaking SignalData structure 0x7b0800258960 after lost signal to thread 5271
I20260709 13:16:28.744225  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:28.728240  3277 raft_consensus.cc:2410] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:28.745986  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:28.746776  3134 raft_consensus.cc:2410] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:28.728578  3133 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:28.740798  3033 catalog_manager.cc:5697] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 2 to 4, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 4 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.737785  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:28.760886  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:28.762692  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.763021  3285 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:28.764756  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.765609  3277 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:28.762497  3100 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:28.722401  5426 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:28.771301  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:28.772130  3835 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
W20260709 13:16:28.771306  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 204444us
I20260709 13:16:28.775103  3250 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:28.778926  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:28.780313  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:28.781049  3838 raft_consensus.cc:2393] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:28.744925  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:28.789987  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:28.797281  3131 raft_consensus.cc:2410] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:16:28.778303  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:28.779699  3127 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:16:28.793174  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:28.793815  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.800563  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.801011  3208 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:28.802641  3100 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:28.748497  3033 catalog_manager.cc:5697] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.803488  3100 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:28.804515  3100 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:28.805730  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.806370  3207 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:28.810526  3177 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:28.813356  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.770855  5506 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:28.815176  3136 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:28.744942  3832 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:28.814093  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.796427  5482 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:28.811965  5254 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:28.822813  3203 raft_consensus.cc:2393] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:16:28.823199  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.847252  3177 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:28.823419  3100 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:28.824683  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:28.864014  3207 raft_consensus.cc:2393] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:28.829113  5226 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:28.829407  5465 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:28.829706  5559 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:28.872014  5559 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.872427  5559 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.867726  5102 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.873394  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.873528  5102 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.874327  3283 raft_consensus.cc:2393] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 4: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:28.875208  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.875676  5102 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:28.867947  5487 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.830034  5437 consensus_queue.cc:1059] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:28.877463  5437 consensus_queue.cc:1243] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer fc48eecc27554cb58b15193cd442b1d3 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:28.877895  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.879113  4936 raft_consensus.cc:3055] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:28.879294  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.879555  4936 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:28.876986  5487 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.831607  3202 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:16:28.832239  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.881451  5465 raft_consensus.cc:3055] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:28.881855  5465 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:28.882038  5487 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:28.833961  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 101402us
I20260709 13:16:28.882910  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:28.882707  5465 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.883311  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.834705  5231 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:28.885279  5231 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.885637  5231 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.887362  3836 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:28.888711  3207 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:28.836467  5499 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:28.888898  3842 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:28.813532  5462 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:16:28.890048  5564 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:28.837396  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.890463  5564 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:28.890843  5564 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:28.892210  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:28.892374  3101 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:28.892649  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:28.892954  3842 raft_consensus.cc:2393] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 8: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:28.821130  5486 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:28.893421  5486 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:28.884693  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:28.840713  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.857678  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.888887  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:28.858544  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:28.894650  3835 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:28.895017  3282 raft_consensus.cc:2410] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:28.857811  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:28.864593  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:28.895491  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:28.841714  5482 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.880497  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:28.898303  3279 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:28.821489  5534 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:28.897433  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:28.838132  5509 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.900678  5509 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.901225  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:28.901943  3280 raft_consensus.cc:2410] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:28.868947  5226 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:28.867830  5552 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:28.878201  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.830971  3209 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 2183) took 2680 ms (client timeout 2116 ms). Trace:
I20260709 13:16:28.835242  5533 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:28.915508  3209 rpcz_store.cc:269] 0709 13:16:26.150906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.151055 (+   149us) service_pool.cc:224] Handling call
0709 13:16:28.823634 (+2672579us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5400189a54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:28.830872 (+  7238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885234560}
I20260709 13:16:28.838517  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:28.811403  3834 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:28.811790  5214 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:16:28.896459  3206 raft_consensus.cc:2410] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:28.875797  3283 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:28.895720  3276 raft_consensus.cc:2376] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6. Re-sending same reply.
I20260709 13:16:28.867158  5177 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:28.904229  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:28.895754  5254 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:28.921301  5553 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:28.902205  5487 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:16:28.896237  5486 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.926980  5552 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:28.796049  5426 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:28.940768  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.897430  5482 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.944665  3208 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:28.993506  3202 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:16:28.946969  3840 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:28.897653  5102 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:28.983529  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:28.996393  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.985437  3278 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
W20260709 13:16:28.989172  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.996999  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.997597  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.987990  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:28.880576  4936 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:29.000164  3209 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:16:28.994863  3280 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1031) took 2238 ms (client timeout 1897 ms). Trace:
I20260709 13:16:28.997017  3278 pending_rounds.cc:85] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 7
I20260709 13:16:29.001158  3278 pending_rounds.cc:107] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 8.8
W20260709 13:16:29.001005  3280 rpcz_store.cc:269] 0709 13:16:26.748762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.813441 (+ 64679us) service_pool.cc:224] Handling call
0709 13:16:28.949179 (+2135738us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b54001b80d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:28.986836 (+ 37657us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4795744512}
I20260709 13:16:29.001693  3278 raft_consensus.cc:2889] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:28.991681  5487 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.003289  3842 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:29.003870  3204 raft_consensus.cc:2410] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:28.945186  5177 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:29.007295  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 62050.1us
I20260709 13:16:28.946439  5254 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:29.013379  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:29.018733  3177 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:28.987972  5506 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.005172  5587 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.008430  5177 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.012099  5254 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:29.051453  5566 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:16:29.066038  3206 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:29.006862  5487 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:29.071188  5487 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:29.072352  5552 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:29.035121  5490 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:29.073249  5490 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.073612  5490 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.075676  3208 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:29.078408  5426 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:29.079444  5509 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:29.057734  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 44473.5us
I20260709 13:16:29.062604  3251 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:29.086615  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.093830  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:29.101054  3209 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:29.102311  3209 pending_rounds.cc:85] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 2
I20260709 13:16:29.102545  3209 pending_rounds.cc:107] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:29.102782  3209 raft_consensus.cc:2889] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:29.104553  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.033789  5462 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
W20260709 13:16:29.106161  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 288598us
I20260709 13:16:29.089869  5499 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.048612  5463 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:16:29.101321  5566 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:29.121351  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:29.123181  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:29.123719  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:29.114287  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 290927us
W20260709 13:16:29.108294  5478 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.531s	user 0.025s	sys 0.027s
I20260709 13:16:29.083587  5587 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:29.122005  3278 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
W20260709 13:16:29.117902  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 321935us
W20260709 13:16:29.112713  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 302178us
I20260709 13:16:29.111439  4936 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:29.107558  5462 consensus_queue.cc:1243] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer 0930e3e7657c43bcaaa5b0778f3e08cf log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:29.128719  3100 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:29.115295  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.142676  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:29.137926  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 245625us
W20260709 13:16:29.130326  5478 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.677s	user 0.026s	sys 0.027s
I20260709 13:16:29.108145  5198 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:16:29.145606  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:29.150883  3101 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:29.130091  5566 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:29.174420  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.147957  3100 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:29.139425  5534 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:29.182834  3842 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:29.155602  5533 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:29.146157  5226 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:29.188753  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 64295.2us
W20260709 13:16:29.189983  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 70537.5us
I20260709 13:16:29.190912  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:29.192150  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:29.196991  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.179224  5566 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.186023  5506 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:29.137926  5559 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:29.198421  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47658.1us
I20260709 13:16:29.203783  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:29.205049  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.206548  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:29.193675  5533 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:29.194304  5460 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.196424  5578 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.211164  5102 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.196094  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:29.196269  5553 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.213966  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.196341  5448 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:29.238507  3834 raft_consensus.cc:2393] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
W20260709 13:16:29.240181  5590 log.cc:927] Time spent T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:16:29.206552  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 58689.4us
I20260709 13:16:29.188441  5552 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:16:29.210788  5418 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:29.207489  5426 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:16:29.244585  5587 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:29.240051  5604 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:29.208966  3101 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:29.246518  5603 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:29.247558  5604 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:29.248190  5604 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:29.250131  5418 raft_consensus.cc:697] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:29.248423  3100 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:29.252120  5426 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:29.251722  5418 consensus_queue.cc:237] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:29.252640  5482 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:29.254603  5465 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.254757  5482 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:29.247563  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:29.257894  3204 raft_consensus.cc:1217] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Deduplicated request from leader. Original: 1.4->[2.5-2.5]   Dedup: 2.5->[]
I20260709 13:16:29.263025  3204 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:29.263835  3203 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:29.209760  5506 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:29.202919  5509 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:16:29.221596  5533 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:29.254348  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:29.268301  3102 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:29.209131  5275 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:16:29.270766  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.211254  5356 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:16:29.272006  3100 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:29.270622  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.275120  3204 raft_consensus.cc:2368] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 3. Current term is 4.
I20260709 13:16:29.252662  5426 raft_consensus.cc:697] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:29.291325  3206 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:29.270455  3101 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:29.234402  5198 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:16:29.329048  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.329946  3204 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.273988  5487 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:29.236352  5231 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:29.263365  5460 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:29.315275  5102 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:29.275132  5606 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:29.277489  5564 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:29.354005  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.355962  3205 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.272524  5490 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:29.354918  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.357147  3204 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:29.272392  5534 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:29.319571  5177 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:29.339756  5102 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.343055  5606 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:29.361691  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 155255us
I20260709 13:16:29.369626  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.300833  3102 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:29.383520  3205 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
W20260709 13:16:29.384419  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 114066us
I20260709 13:16:29.386106  3210 raft_consensus.cc:2393] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:29.368551  5102 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:29.400409  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.368775  5606 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.403242  3101 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:29.403347  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.404884  3249 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:29.406122  3249 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:29.384900  5608 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.408456  5615 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.388278  5604 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:29.386869  5559 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:29.417395  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:16:29.422483  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 237372us
I20260709 13:16:29.425868  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:29.426468  3835 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.412807  5509 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:29.361773  5506 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:29.403241  5607 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:29.432355  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.417814  5356 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.436086  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.439108  3204 raft_consensus.cc:2393] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:29.439702  3205 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:29.423040  5604 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.376091  5426 consensus_queue.cc:237] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:29.458038  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:29.451037  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:29.432248  5509 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.468428  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:29.485215  3284 raft_consensus.cc:2410] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:16:29.505888  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 54910.2us
W20260709 13:16:29.476490  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.494274  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.508581  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:29.487182  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.510363  3211 raft_consensus.cc:2376] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7. Re-sending same reply.
I20260709 13:16:29.488441  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.512799  3208 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:29.498800  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.487958  3202 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:29.485531  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.486537  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.495532  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:29.437853  5418 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:29.435334  5487 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:29.559607  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 45920.3us
I20260709 13:16:29.448099  5462 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.523687  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.425324  5254 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:29.569830  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.570619  3205 raft_consensus.cc:2410] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:16:29.517827  3209 raft_consensus.cc:2376] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6. Re-sending same reply.
I20260709 13:16:29.486018  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.571478  3207 raft_consensus.cc:2368] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 3. Current term is 4.
I20260709 13:16:29.522008  3206 raft_consensus.cc:2393] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 4: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:16:29.523908  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 55569.2us
I20260709 13:16:29.561203  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:29.494093  5602 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.254s	user 0.001s	sys 0.002s
W20260709 13:16:29.473577  5591 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.286s	user 0.004s	sys 0.000s
I20260709 13:16:29.421517  5608 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:29.479336  5592 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
W20260709 13:16:29.464726  5601 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:16:29.469833  5611 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:16:29.472455  5612 log.cc:927] Time spent T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:29.423815  5615 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:29.482368  5603 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.463624  5604 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:29.609871  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 309186us
I20260709 13:16:29.519359  5509 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.468680  5214 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:29.477869  5177 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:29.474697  5460 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:29.464254  5231 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:29.464672  5482 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:29.560602  5487 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:29.565615  5499 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:29.604672  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 201483us
I20260709 13:16:29.568504  5418 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:29.589274  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:29.567553  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 59053.1us
I20260709 13:16:29.611464  3102 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:29.558956  5600 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:29.615226  3835 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
W20260709 13:16:29.625764  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.585736  5578 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:29.634649  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 334097us
I20260709 13:16:29.481317  5607 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.139s
I20260709 13:16:29.649272  3838 pending_rounds.cc:85] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 5
I20260709 13:16:29.649607  3838 pending_rounds.cc:107] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:16:29.635002  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:29.649866  3838 raft_consensus.cc:2889] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:29.605456  5564 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:29.630170  5486 consensus_meta.cc:287] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.003s
I20260709 13:16:29.635386  5583 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:29.606545  5625 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:29.646327  3842 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:29.646842  3177 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:29.654318  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:29.657805  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.663959  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:29.664108  5629 consensus_queue.cc:1059] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:16:29.664660  3134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:16:29.665138  5633 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:29.665748  5177 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:29.666195  5626 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:29.666296  5177 raft_consensus.cc:697] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:29.666754  5626 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.666566  5356 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:29.667143  5626 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.586689  5624 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:16:29.667342  5177 consensus_queue.cc:237] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:29.668141  3205 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:29.669976  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.670519  3205 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:29.671868  5102 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:29.641575  5490 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:29.673794  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.674127  5254 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:29.676218  5254 raft_consensus.cc:993] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:16:29.676759  5254 raft_consensus.cc:1081] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:16:29.660287  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2137) took 1064 ms. Trace:
I20260709 13:16:29.644192  5487 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.661784  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:29.689931  3835 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:29.665278  3134 raft_consensus.cc:606] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:29.691046  3134 raft_consensus.cc:614] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:29.588214  5465 consensus_queue.cc:1059] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
W20260709 13:16:29.677793  5598 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.439s	user 0.001s	sys 0.002s
I20260709 13:16:29.679315  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.700666  3209 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.680025  5606 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:29.642992  5418 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:29.681025  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.682133  5625 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:29.710000  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 55756.1us
I20260709 13:16:29.667150  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.682399  3204 raft_consensus.cc:1240] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:29.713421  3210 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:29.686195  3281 rpcz_store.cc:276] 0709 13:16:28.595890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.597620 (+  1730us) service_pool.cc:224] Handling call
0709 13:16:28.610081 (+ 12461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.648628 (+ 38547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:28.648657 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:28.704819 (+ 56162us) log.cc:844] Serialized 26 byte log entry
0709 13:16:28.946471 (+241652us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:28.946530 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.946633 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.478603 (+531970us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:29.651673 (+173070us) raft_consensus.cc:1685] finished
0709 13:16:29.651701 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.660181 (+  8480us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3373,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9387,"spinlock_wait_cycles":5917440,"thread_start_us":241203,"threads_started":1,"wal-append.queue_time_us":402539}
I20260709 13:16:29.702770  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.712641  3101 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:29.639019  5482 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:29.665215  5275 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:29.630508  5603 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:29.715286  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:29.744465  3127 raft_consensus.cc:2410] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:29.661697  5483 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:16:29.662228  5486 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:29.753070  3176 connection.cc:256] RPC call timeout handler was delayed by -3.1199341559999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
I20260709 13:16:29.761634  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:29.686889  5583 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:29.768052  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 50841.3us
I20260709 13:16:29.719982  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:29.775432  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:29.771636  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.716046  5625 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.772558  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.775601  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:29.776597  3203 raft_consensus.cc:2393] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:29.747928  3806 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:29.778066  3210 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:29.743062  5628 raft_consensus.cc:3055] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:29.783380  5275 consensus_queue.cc:1059] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:16:29.783984  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:29.787096  5437 raft_consensus.cc:3055] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:29.787591  5437 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:29.788646  5533 consensus_meta.cc:287] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.000s
I20260709 13:16:29.752367  5465 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:16:29.789709  5599 log.cc:927] Time spent T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.554s	user 0.000s	sys 0.002s
I20260709 13:16:29.765576  5226 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:29.791205  5226 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:29.792951  5630 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.714100  5214 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:16:29.784246  5275 consensus_queue.cc:1243] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:16:29.784909  5621 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.067s	user 0.005s	sys 0.000s
W20260709 13:16:29.797158  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.797525  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.768301  5607 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:29.799652  3204 raft_consensus.cc:2376] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4. Re-sending same reply.
I20260709 13:16:29.798286  3136 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:29.800943  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.801877  4936 raft_consensus.cc:2955] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:29.805786  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:29.806825  3130 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:29.817828  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.819175  3134 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:29.807029  3128 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:29.807612  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:29.807657  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:29.797485  5628 raft_consensus.cc:740] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:29.750020  5629 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:16:29.809823  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:29.810179  5632 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:16:29.824838  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.825749  3204 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.810844  3129 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:29.811909  5486 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:29.814059  5603 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:29.815208  5615 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:29.819795  3203 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:29.831295  3135 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:29.821439  3131 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:29.796496  3833 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:29.830428  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:29.837289  3210 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:29.832172  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:29.838840  3134 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:29.841462  3203 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:29.841550  3133 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:29.842260  3130 raft_consensus.cc:2393] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:29.841472  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:29.817168  5607 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.865715  3203 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:16:29.877985  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 175607us
I20260709 13:16:29.878937  3100 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:29.880672  3100 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:29.892922  3135 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:29.895339  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:29.897294  3131 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:29.896106  3130 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:29.900106  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1274) took 2518 ms. Trace:
I20260709 13:16:29.900506  3132 rpcz_store.cc:276] 0709 13:16:27.382062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.512562 (+130500us) service_pool.cc:224] Handling call
0709 13:16:27.536087 (+ 23525us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:28.714962 (+1178875us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b24001485c8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b8f889c4 00007fb3b8f86acb 00007fb3b9141dc9 00007fb3b9141a55 00007fb3b9140db5 00007fb3bbdb72a5 00007fb3bbdb7f12 00007fb3bbdbf4c4 00007fb3bc1aba86 00007fb3bc166a75
0709 13:16:28.715474 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:28.715503 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:28.716164 (+   661us) log.cc:844] Serialized 78 byte log entry
0709 13:16:29.158309 (+442145us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:29.368476 (+210167us) log.cc:844] Serialized 14 byte log entry
0709 13:16:29.407405 (+ 38929us) log.cc:844] Serialized 14 byte log entry
0709 13:16:29.552924 (+145519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.553062 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.577601 (+ 24539us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:29.792544 (+214943us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b180041e300. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:16:29.899892 (+107348us) raft_consensus.cc:1685] finished
0709 13:16:29.899914 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.900046 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40776,"prepare.queue_time_us":655822,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":58693,"raft.run_cpu_time_us":485,"raft.run_wall_time_us":26816,"spinlock_wait_cycles":84732416,"thread_start_us":776619,"threads_started":3,"wal-append.queue_time_us":521817}
I20260709 13:16:29.837530  5637 raft_consensus.cc:3055] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:29.798906  5533 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:29.900830  5566 consensus_meta.cc:287] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.693s	user 0.012s	sys 0.000s
W20260709 13:16:29.908353  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 116081us
I20260709 13:16:29.920886  3204 raft_consensus.cc:2410] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:29.892685  5607 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.865530  5226 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:29.898149  5486 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:29.788671  5437 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:29.906039  5102 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:29.928225  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:29.919018  5608 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:29.907605  5483 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:29.933677  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:29.937644  3204 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:29.907308  5637 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:29.938884  3100 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:29.939405  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.923569  5490 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.925918  5635 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:29.926656  5486 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.859105  5482 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:29.946064  5627 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:29.937314  5483 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.941742  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:29.999816  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 287243us
I20260709 13:16:30.002835  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:30.004492  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:29.938098  5639 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:29.985025  5598 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:16:29.927902  5566 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:29.994400  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.965526  5486 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.962563  5627 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.986073  5437 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.992923  5483 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:30.028674  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.941561  5626 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.052811  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:30.066799  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:29.954032  5490 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:30.027559  5482 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:30.043501  5636 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:16:30.089448  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:30.051117  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.982553  5487 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.039390  5102 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:30.086841  3207 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.926087  5628 consensus_queue.cc:260] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.042830  5615 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:30.119074  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:30.110845  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:16:30.127161  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.042585  5627 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.163980  3840 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.162421  3209 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:30.082381  5619 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.166545  3209 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:30.079417  5583 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:30.112497  5598 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:16:30.181052  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 433322us
W20260709 13:16:30.169441  5610 log.cc:927] Time spent T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:16:30.174373  5634 log.cc:927] Time spent T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:30.126449  5631 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:30.159602  5102 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:30.183998  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 131328us
I20260709 13:16:30.198189  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:30.198873  3278 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:30.199880  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:30.192072  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.171437  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:30.185366  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:30.203322  3208 raft_consensus.cc:3055] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:30.207015  3208 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:30.210415  3207 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:30.168008  5603 consensus_queue.cc:1059] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:16:30.214623  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:30.111470  5640 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 13:16:30.040815  5639 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.189332  5608 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:30.232443  5608 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:30.233757  5626 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:30.234455  5608 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:30.235648  5460 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.236173  5460 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:30.237910  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:30.219092  3020 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8e1a4d71ef0f4287999b5ee60fe02740 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 48080cf0460346769ab046a4f9457aa5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:30.226930  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:16:30.228456  5604 consensus_meta.cc:287] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.591s	user 0.006s	sys 0.001s
I20260709 13:16:30.229622  5198 raft_consensus.cc:3055] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:30.043804  5637 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.242841  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:30.250501  3281 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:30.244252  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 58993.9us
I20260709 13:16:30.242944  3840 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:30.201351  5102 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:30.187434  5559 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.254945  5487 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:30.176232  5619 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.244716  3210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:16:30.255230  5460 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:30.247079  3284 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:30.209563  5583 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:30.213598  3833 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:30.248281  3208 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:30.213379  5533 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:30.250629  5651 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.286679  3208 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:30.250502  5198 raft_consensus.cc:740] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:30.261066  5214 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:30.284372  3210 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:30.252403  5506 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:30.285924  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:30.293798  3281 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:30.280727  5426 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:30.287777  5583 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:30.298554  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 102534us
W20260709 13:16:30.283605  5462 consensus_meta.cc:287] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.004s
I20260709 13:16:30.302412  3176 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:30.300410  3210 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.296003  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:30.296792  5487 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.258260  5604 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:30.286906  5637 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:30.308894  3136 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:30.304970  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:30.322763  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:30.306246  5487 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.296375  5499 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.283161  5559 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:30.215863  5631 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.334012  3281 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:30.303529  5583 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.286499  5608 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:16:30.333380  5226 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:30.303862  5506 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.329011  5462 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.326805  5626 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:30.340760  5630 consensus_meta.cc:287] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.001s
I20260709 13:16:30.310948  5604 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:30.305877  5619 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:30.355867  5487 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:30.393146  5660 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:16:30.358042  5198 consensus_queue.cc:260] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.339918  5177 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:16:30.397663  3207 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:30.306425  5655 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:30.427067  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 82120.6us
I20260709 13:16:30.303753  5639 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:30.343230  5533 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.440755  3208 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:30.440557  5533 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.441440  5198 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:30.303592  5214 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:30.401986  5418 consensus_meta.cc:287] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.632s	user 0.005s	sys 0.006s
W20260709 13:16:30.432055  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 120150us
I20260709 13:16:30.299422  5651 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:30.447418  5418 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.448609  3101 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:30.449703  5418 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:30.449815  3101 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:30.450435  5418 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:30.450765  5604 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:30.450906  5651 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:30.451507  5604 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:30.453039  5604 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:30.455727  5656 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:16:30.441123  3208 pending_rounds.cc:85] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 2
I20260709 13:16:30.339746  5640 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:16:30.405383  5626 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.415839  5506 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.348230  5659 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:30.425571  5566 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:30.445856  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:30.469063  5659 raft_consensus.cc:697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:30.428987  5630 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.464160  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:30.467851  5214 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:30.347944  5627 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:30.470813  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:30.477314  3102 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:30.459183  3208 pending_rounds.cc:107] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260709 13:16:30.450428  5509 consensus_meta.cc:287] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.817s	user 0.008s	sys 0.004s
I20260709 13:16:30.348363  5499 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.473773  5177 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:30.484884  3102 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:30.479000  5426 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:30.489640  5426 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.490012  5426 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:30.483265  5608 consensus_queue.cc:1059] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 13:16:30.491735  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.484117  5509 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:30.497244  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:30.479650  3208 raft_consensus.cc:2889] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:30.482741  3101 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:30.497884  5559 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:30.498281  5509 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:30.481909  5226 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:30.472611  5626 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:30.484978  5671 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:16:30.502389  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:30.502565  5627 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:30.504962  5615 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:30.506954  5607 consensus_meta.cc:287] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.564s	user 0.000s	sys 0.011s
I20260709 13:16:30.506651  5486 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.470067  5659 consensus_queue.cc:237] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.474225  5418 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:16:30.510403  5608 consensus_queue.cc:1243] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer fc48eecc27554cb58b15193cd442b1d3 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:30.511759  5533 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:30.439832  5655 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:30.523519  3202 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:30.518162  3210 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:30.529068  5665 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:30.529235  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:30.556429  3132 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:30.520656  5226 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.529834  5465 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.530929  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:30.531602  5490 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:30.532150  5617 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:30.532095  5483 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:30.536518  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:30.536861  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:30.560289  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:30.560887  3281 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:30.537492  3129 raft_consensus.cc:2368] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8.
I20260709 13:16:30.537354  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:30.536880  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:30.571084  3285 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:30.536518  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:30.539462  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:30.542109  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:30.543543  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:30.544414  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:30.571967  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.572384  3835 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:30.545145  3127 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
W20260709 13:16:30.547139  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 64464.5us
I20260709 13:16:30.554608  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:30.559253  3833 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:30.565138  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:30.568857  3278 raft_consensus.cc:2393] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 4: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:30.580703  3102 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:30.546072  5509 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.582553  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:30.582646  3210 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:30.584574  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:30.583112  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:30.587987  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:30.568349  5617 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:30.592921  3278 raft_consensus.cc:2410] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:30.592512  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:30.595013  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:30.555795  5661 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:30.556228  5655 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.589802  5647 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:30.598498  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:30.599586  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:30.600057  5627 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:30.614362  3284 raft_consensus.cc:2410] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:30.601367  5603 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:30.601536  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:30.615396  3285 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:30.615456  3283 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:30.561059  5226 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:30.602530  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:30.616983  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.605516  3277 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:30.617313  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:30.618311  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:30.618994  3277 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:30.623602  3276 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:30.539911  5607 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:30.590139  5665 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:30.626219  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:30.600721  5606 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:30.577893  5465 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:30.627997  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:30.583973  5583 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.589721  5509 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:30.629011  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:31.112984  5628 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:30.815759  4936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:33888 (request call id 77) took 15225 ms. Trace:
I20260709 13:16:31.115201  4936 rpcz_store.cc:276] 0709 13:16:15.550527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.072817 (+522290us) service_pool.cc:224] Handling call
0709 13:16:16.095648 (+ 22831us) log.cc:844] Serialized 494 byte log entry
0709 13:16:16.175826 (+ 80178us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b18002ad420. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b907cc0a 00007fb3c27bc219 00007fb3b9104a40 00007fb3b90ff4e4 00007fb3b90ff455 00007fb3bc148b0b 00007fb3bc1cdb63 00007fb3bc1f5752 00007fb3bc1ed9fa
0709 13:16:16.416128 (+240302us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:30.738984 (+14322856us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15638,"raft.queue_time_us":44727,"raft.run_cpu_time_us":1721,"raft.run_wall_time_us":28165,"spinlock_wait_cycles":66449536,"thread_start_us":37425,"threads_started":1,"wal-append.queue_time_us":93422,"wal-append.run_cpu_time_us":5065,"wal-append.run_wall_time_us":1234458}
W20260709 13:16:30.819259  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.754902  5644 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:30.629199  3834 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:31.124984  5644 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.119374  3840 raft_consensus.cc:1240] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:30.626832  5603 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.617690  5426 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:30.659837  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:31.140848  3838 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.141306  3131 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:16:31.008450  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.730049  5671 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.121433  5583 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:30.622437  5533 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:31.147933  3102 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:30.760601  5617 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.199298  5617 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.201694  5631 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:31.203842  5671 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:30.658504  5486 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:30.608258  5647 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:31.205600  5647 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.206245  5671 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:30.625470  5629 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.122764  3282 raft_consensus.cc:2410] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:30.656663  5102 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:30.620934  5627 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.217020  5627 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.722636  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:31.219319  3133 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:16:31.057127  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.122749  5604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.012s	sys 0.022s
I20260709 13:16:30.663262  3128 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:31.118430  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.221223  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.631026  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:30.650780  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:30.881928  3277 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:31.222165  3285 raft_consensus.cc:2368] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7.
I20260709 13:16:30.664557  5607 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:30.870062  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.131507  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 451765us
W20260709 13:16:31.131973  3176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.004s	sys 0.024s
I20260709 13:16:31.148473  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 575) took 1640 ms. Trace:
W20260709 13:16:31.228152  3176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.005s	sys 0.025s
W20260709 13:16:31.144896  5655 consensus_meta.cc:287] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.000s
I20260709 13:16:31.228260  3842 rpcz_store.cc:276] 0709 13:16:29.508523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.509178 (+   655us) service_pool.cc:224] Handling call
0709 13:16:29.646067 (+136889us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.662680 (+ 16613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.148203 (+1485523us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b54002175d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:31.148389 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183570176}
W20260709 13:16:30.934623  5625 consensus_meta.cc:287] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 1.118s	user 0.014s	sys 0.000s
W20260709 13:16:30.997480  5643 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.805s	user 0.002s	sys 0.000s
W20260709 13:16:30.998108  5637 consensus_meta.cc:287] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.001s
I20260709 13:16:31.197702  5426 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:31.198428  5603 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:30.983112  5177 raft_consensus.cc:3055] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:31.215503  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:31.229327  5662 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:31.219699  3806 leader_election.cc:336] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.516s (SENT)
I20260709 13:16:30.652174  5478 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:31.230296  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:31.253885  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:31.254544  3277 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:31.231644  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.222944  5604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.012s	sys 0.023s
I20260709 13:16:31.232893  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 772d700b048349bf9547efac6befb60d with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:16:31.224121  5226 consensus_meta.cc:287] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.595s	user 0.011s	sys 0.000s
W20260709 13:16:31.224752  5506 consensus_meta.cc:287] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.740s	user 0.010s	sys 0.001s
I20260709 13:16:31.241139  5655 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:16:31.286581  3136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1090) took 1478 ms (client timeout 1814 ms). Trace:
I20260709 13:16:31.221913  5534 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.219054  5629 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:31.244330  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 1.48092e+06us
W20260709 13:16:31.299782  3805 connection.cc:256] RPC call timeout handler was delayed by -1.5416056169999592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 13:16:31.300175  3805 leader_election.cc:336] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.561s (SENT)
I20260709 13:16:31.248018  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:31.300489  3805 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:31.248832  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:31.301353  3285 raft_consensus.cc:2376] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6. Re-sending same reply.
W20260709 13:16:31.301657  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.243083  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:31.249986  3284 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.218456  5102 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:31.257302  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.257967  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:31.249564  5564 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.249486  5177 raft_consensus.cc:740] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:31.262106  5478 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.263147  5617 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.263399  5644 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:31.251000  5625 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.264097  5578 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.264633  5662 raft_consensus.cc:697] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:31.229710  5533 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.233644  4936 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.247613  5687 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:16:31.266393  5626 consensus_meta.cc:287] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.741s	user 0.010s	sys 0.000s
I20260709 13:16:31.247592  5483 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:31.267858  5509 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:31.270642  3277 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:31.252537  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:31.282739  3101 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:31.283586  5426 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:31.283668  3020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 50813.5us
I20260709 13:16:31.284356  3209 raft_consensus.cc:2955] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:31.237015  5499 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:31.286123  3206 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:31.236858  5671 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:31.287025  3136 rpcz_store.cc:269] 0709 13:16:29.808644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.821736 (+ 13092us) service_pool.cc:224] Handling call
0709 13:16:31.286395 (+1464659us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54003b79d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:31.286526 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070756608}
I20260709 13:16:31.286785  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:31.283512  3838 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:31.291649  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:31.304862  3805 connection.cc:256] RPC call timeout handler was delayed by -1.5286736759999258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 13:16:31.305817  3210 raft_consensus.cc:1240] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:16:31.330498  3102 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:31.305876  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:31.331115  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 48480us
I20260709 13:16:31.332098  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:31.332939  3208 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
W20260709 13:16:31.330869  3805 connection.cc:256] RPC call timeout handler was delayed by -1.5218056169999272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
I20260709 13:16:31.333187  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2236) took 1646 ms. Trace:
I20260709 13:16:31.333809  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:31.333220  3101 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:31.292789  5666 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:31.336828  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:31.337387  5666 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.338567  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:31.339687  3282 raft_consensus.cc:2410] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:31.339941  5666 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:31.340490  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:31.303555  5534 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.313755  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:31.301517  5620 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.314625  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:31.304394  5583 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:31.353801  3133 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:31.318269  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:31.356072  3285 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.289408  5226 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.320662  3836 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:31.353134  3100 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:31.320595  5102 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.327418  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:31.368641  3277 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.341305  3282 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:31.342243  3283 raft_consensus.cc:2393] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:31.342269  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:31.333806  3205 rpcz_store.cc:276] 0709 13:16:29.678572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.679764 (+  1192us) service_pool.cc:224] Handling call
0709 13:16:29.680075 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.680460 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.680489 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.680940 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.898231 (+217291us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:29.898273 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.898347 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:30.980148 (+1081801us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:31.316968 (+336820us) raft_consensus.cc:1685] finished
0709 13:16:31.316990 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.324481 (+  7491us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4939,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":7476,"spinlock_wait_cycles":7677824,"thread_start_us":216864,"threads_started":1,"wal-append.queue_time_us":325119}
I20260709 13:16:31.313210  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:31.352034  3101 leader_election.cc:400] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7.
I20260709 13:16:31.374642  3211 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:31.374712  3101 leader_election.cc:403] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:16:31.357939  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:31.294446  5506 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.378516  3836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 578) took 1765 ms. Trace:
W20260709 13:16:31.378961  3127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1078) took 1611 ms (client timeout 1517 ms). Trace:
W20260709 13:16:31.379458  3127 rpcz_store.cc:269] 0709 13:16:29.767796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.768007 (+   211us) service_pool.cc:224] Handling call
0709 13:16:31.378599 (+1610592us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b54003a9dd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:31.378697 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1689770240}
I20260709 13:16:31.380561  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:31.381695  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:31.311365  5564 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.317425  5578 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.313323  5617 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:31.394344  3202 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:31.353597  5630 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:31.387704  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:31.388527  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:31.379106  3836 rpcz_store.cc:276] 0709 13:16:29.612887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.613039 (+   152us) service_pool.cc:224] Handling call
0709 13:16:29.634207 (+ 21168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.357881 (+1723674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.378232 (+ 20351us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b540066d5d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:31.378443 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3877881600}
I20260709 13:16:31.282167  5665 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.391414  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:31.392103  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:31.392508  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:31.387086  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:31.353250  5483 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:31.350519  5637 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:31.420583  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:31.357928  5628 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:31.392549  3277 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:31.376997  5606 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:31.424714  3203 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:31.392158  5486 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.397745  5699 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.399188  3833 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:31.428314  5699 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:31.399333  5680 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:16:31.323987  4936 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.405299  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:31.440984  3127 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:31.407820  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 98063.2us
I20260709 13:16:31.401926  3282 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
W20260709 13:16:31.410115  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 245330us
I20260709 13:16:31.411847  3281 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:31.403895  3278 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:31.418393  3285 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:31.325917  5626 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.436836  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:31.410526  5682 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.119s	user 0.001s	sys 0.001s
I20260709 13:16:31.389919  5693 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.456030  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:31.448621  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:31.458662  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:31.463186  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:31.463387  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 129675us
I20260709 13:16:31.463886  3281 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:31.323766  5687 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.342021  5426 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.460940  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 259) took 1263 ms. Trace:
I20260709 13:16:31.461939  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:31.479470  3282 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:31.457707  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 69872.1us
W20260709 13:16:31.464123  3805 connection.cc:256] RPC call timeout handler was delayed by -1.4219056169999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
I20260709 13:16:31.344413  5671 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:31.480975  3805 connection.cc:256] RPC call timeout handler was delayed by -1.1884736760000578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24670000000000003s for a response
W20260709 13:16:31.481926  3805 connection.cc:256] RPC call timeout handler was delayed by -1.0579736760000742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26120000000000004s for a response
I20260709 13:16:31.483719  3278 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:31.486287  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:31.487341  3285 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:16:31.489584  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:31.490895  3841 raft_consensus.cc:2410] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:31.468138  3101 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:31.449306  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:31.470314  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:31.399801  5226 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:31.382342  5102 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.503947  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:31.455680  5699 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:31.478932  3280 rpcz_store.cc:276] 0709 13:16:30.197518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.197653 (+   135us) service_pool.cc:224] Handling call
0709 13:16:30.994442 (+796789us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b5800160e98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caeee 0000000000375939 00007fb3c113e1e0 00007fb3c12070c4 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:16:30.994671 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.994981 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:31.302558 (+307577us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.460585 (+158027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.460640 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:31.460698 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.460766 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.460878 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24438,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":1516,"raft.queue_time_us":113,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":12714,"spinlock_wait_cycles":2511872,"thread_start_us":460420,"threads_started":2}
I20260709 13:16:31.507995  3130 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:31.498610  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:16:31.500816  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 102050us
I20260709 13:16:31.455546  5644 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:31.512998  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45065.8us
I20260709 13:16:31.503149  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:31.504895  3133 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:31.425541  5630 raft_consensus.cc:697] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:31.482824  5356 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.482606  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:31.517051  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1087) took 1709 ms. Trace:
I20260709 13:16:31.518496  3128 rpcz_store.cc:276] 0709 13:16:29.807857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.840194 (+ 32337us) service_pool.cc:224] Handling call
0709 13:16:29.840590 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.220975 (+1380385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.516804 (+295829us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54000e1ad4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:31.516993 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891495808}
I20260709 13:16:31.519438  3101 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:31.508109  3278 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:31.464560  5628 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:31.528995  5626 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:31.528824  5628 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.510946  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:31.530351  3835 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:31.533214  5687 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:31.533723  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:31.534309  5625 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:31.535059  5687 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.535501  3279 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:31.535547  5687 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.517856  5607 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:31.537386  5607 raft_consensus.cc:697] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:31.538336  5607 consensus_queue.cc:237] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.539176  5478 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:31.539987  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:31.540313  5506 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:31.511582  3281 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:31.542028  3281 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:31.542209  5578 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:31.485061  5499 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.543087  5499 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.543681  3281 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:31.544036  5689 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:16:31.545203  5356 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.544911  3281 raft_consensus.cc:1240] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:16:31.546522  5486 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7.
I20260709 13:16:31.547247  5356 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:31.548983  5617 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:31.390640  5177 consensus_queue.cc:260] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.439553  5662 consensus_queue.cc:237] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.494980  5637 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:31.480769  5693 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.367646  5620 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.555346  5693 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:31.556258  5620 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:31.506271  5583 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:31.558954  5671 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:31.560350  4936 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:31.520311  5606 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:31.521183  5690 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:16:31.558799  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:31.499694  5698 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:31.527037  5655 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:31.527318  3129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1094) took 1608 ms (client timeout 1628 ms). Trace:
W20260709 13:16:31.542303  5691 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:16:31.556995  5583 raft_consensus.cc:697] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:31.552614  5637 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.608405  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:31.610267  3133 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:31.577821  5625 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:31.509262  3841 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.563587  3281 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:16:31.651866  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.578118  5499 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:31.653735  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.577607  5698 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.655441  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:31.655232  5630 consensus_queue.cc:237] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.656000  3133 raft_consensus.cc:3055] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:31.518119  5644 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:31.565680  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 51991.2us
I20260709 13:16:31.566123  3282 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:31.566318  3276 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:31.694654  3276 pending_rounds.cc:85] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 2
I20260709 13:16:31.695068  3276 pending_rounds.cc:107] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:31.695336  3276 raft_consensus.cc:2889] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:31.680505  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.665884  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2191) took 1049 ms. Trace:
I20260709 13:16:31.566653  3284 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
W20260709 13:16:31.496484  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47198.4us
I20260709 13:16:31.656376  3133 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:31.568827  3127 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:31.569922  3805 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:31.571938  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:31.523082  5564 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:31.742862  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 43612.5us
I20260709 13:16:31.658648  5687 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:31.746598  3282 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:16:31.680938  5691 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:16:31.746742  3285 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:31.699872  3281 rpcz_store.cc:276] 0709 13:16:30.616213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.547355 (+931142us) service_pool.cc:224] Handling call
0709 13:16:31.563341 (+ 15986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.656597 (+ 93256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.665800 (+  9203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.747215  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 273) took 1109 ms. Trace:
I20260709 13:16:31.764155  3127 rpcz_store.cc:276] 0709 13:16:30.627378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.404969 (+777591us) service_pool.cc:224] Handling call
0709 13:16:31.736772 (+331803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.765475  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:31.766882  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:31.750867  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 253348us
I20260709 13:16:31.756060  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:31.742250  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1067) took 1091 ms. Trace:
I20260709 13:16:31.665011  5698 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:31.769687  3284 rpcz_store.cc:276] 0709 13:16:30.657397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.138871 (+481474us) service_pool.cc:224] Handling call
0709 13:16:31.700876 (+562005us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.757725  3841 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
W20260709 13:16:31.571527  3129 rpcz_store.cc:269] 0709 13:16:29.918920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.922972 (+  4052us) service_pool.cc:224] Handling call
0709 13:16:31.527094 (+1604122us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b5400075b54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:31.527247 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216903424}
I20260709 13:16:31.759578  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2192) took 1143 ms. Trace:
I20260709 13:16:31.748771  5625 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:31.683786  5647 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.791990  3282 rpcz_store.cc:276] 0709 13:16:30.618324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.722793 (+1104469us) service_pool.cc:224] Handling call
0709 13:16:31.743087 (+ 20294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.759277 (+ 16190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.759493 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.773229  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:31.753677  3133 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:31.798197  3133 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.684908  5627 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.786284  3834 raft_consensus.cc:2410] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:16:31.787101  5701 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:16:31.786422  5705 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:31.755492  5583 consensus_queue.cc:237] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.835525  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:31.763250  5622 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:31.790400  5644 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:31.756839  5499 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:16:32.208181  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1063) took 1640 ms. Trace:
I20260709 13:16:31.993625  3840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 446) took 1442 ms. Trace:
I20260709 13:16:31.947079  3133 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
W20260709 13:16:32.220719  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 588351us
I20260709 13:16:31.917831  3280 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:16:32.224126  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 656777us
I20260709 13:16:32.234623  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:31.928299  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1100) took 1400 ms. Trace:
W20260709 13:16:32.182328  3130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 272) took 1555 ms (client timeout 1748 ms). Trace:
I20260709 13:16:32.247526  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:32.247920  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1104) took 1017 ms. Trace:
I20260709 13:16:32.181560  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2173) took 1577 ms. Trace:
I20260709 13:16:32.248423  3127 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:32.212568  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:31.841450  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:32.249532  3135 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:32.249956  3281 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.250274  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 270) took 1623 ms. Trace:
I20260709 13:16:32.250694  3135 rpcz_store.cc:276] 0709 13:16:30.626631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.212171 (+1585540us) service_pool.cc:224] Handling call
0709 13:16:32.250192 (+ 38021us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:32.247984  3130 rpcz_store.cc:269] 0709 13:16:30.627142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.357676 (+730534us) service_pool.cc:224] Handling call
0709 13:16:32.182109 (+824433us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54000e33d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:32.182233 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304234368}
W20260709 13:16:32.222896  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.916108  3283 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:16:32.209357  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:32.254628  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 684743us
I20260709 13:16:32.254652  3283 pending_rounds.cc:85] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 3
I20260709 13:16:32.245743  3285 rpcz_store.cc:276] 0709 13:16:30.567540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.511771 (+944231us) service_pool.cc:224] Handling call
0709 13:16:31.695792 (+184021us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.764028 (+ 68236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.207720 (+443692us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400177fd0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:32.208074 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345778048}
I20260709 13:16:32.256493  3283 pending_rounds.cc:107] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 6.4
W20260709 13:16:31.865886  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.248311  3133 rpcz_store.cc:276] 0709 13:16:31.230266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.618181 (+387915us) service_pool.cc:224] Handling call
0709 13:16:32.247857 (+629676us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.257004  3283 raft_consensus.cc:2889] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:32.257431  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.913226  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 269) took 1288 ms. Trace:
W20260709 13:16:32.258199  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.259006  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.964802  3132 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:32.248903  3276 rpcz_store.cc:276] 0709 13:16:30.603674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.526264 (+922590us) service_pool.cc:224] Handling call
0709 13:16:31.526648 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.746297 (+219649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.181205 (+434908us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b54002f8ad4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:32.181449 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90191104}
I20260709 13:16:32.256191  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:32.245952  3840 rpcz_store.cc:276] 0709 13:16:30.551096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.551222 (+   126us) service_pool.cc:224] Handling call
0709 13:16:30.564377 (+ 13155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.134272 (+569895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.993330 (+859058us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b540064ebd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:31.993551 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275810688}
I20260709 13:16:31.897581  3136 raft_consensus.cc:2368] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7.
I20260709 13:16:32.255075  3128 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:32.258061  3134 rpcz_store.cc:276] 0709 13:16:30.624648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.630701 (+  6053us) service_pool.cc:224] Handling call
0709 13:16:31.112313 (+481612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.150434 (+ 38121us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:31.205532 (+ 55098us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.300985 (+ 95453us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.302463 (+  1478us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.302530 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:31.302588 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.530880 (+228292us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b1800204d60. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:16:31.912907 (+382027us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b5400068bd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:31.912974 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.913156 (+   182us) inbound_call.cc:177] Queueing success response
0709 13:16:31.935980 (+ 22824us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b1800204d60. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b9102522 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
Metrics: {"mutex_wait_us":55946,"prepare.queue_time_us":56014,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":1823,"raft.queue_time_us":3890,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":4137,"spinlock_wait_cycles":98543488,"thread_start_us":94464,"threads_started":1,"wal-append.queue_time_us":113614}
W20260709 13:16:32.243366  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.247571  3131 rpcz_store.cc:276] 0709 13:16:30.527505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.527633 (+   128us) service_pool.cc:224] Handling call
0709 13:16:30.530519 (+  2886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.141706 (+611187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.927942 (+786236us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b5400183154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:31.928205 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404160896}
I20260709 13:16:32.264895  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1103) took 1035 ms. Trace:
I20260709 13:16:32.270007  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:32.118791  4936 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:32.272877  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 504106us
I20260709 13:16:32.251739  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:32.287108  3249 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:32.276283  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1315) took 1015 ms. Trace:
I20260709 13:16:32.290115  3127 rpcz_store.cc:276] 0709 13:16:31.260558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.793543 (+532985us) service_pool.cc:224] Handling call
0709 13:16:32.276186 (+482643us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.277472  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1310) took 1018 ms. Trace:
I20260709 13:16:32.292620  3130 rpcz_store.cc:276] 0709 13:16:31.259303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.269705 (+1010402us) service_pool.cc:224] Handling call
0709 13:16:32.277411 (+  7706us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.294180  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:31.812346  5231 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:32.225651  5698 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:32.280049  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:32.297817  3207 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:32.297880  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:32.299129  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:32.183843  5629 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:32.282013  3204 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:32.271163  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1070) took 1001 ms. Trace:
I20260709 13:16:32.309054  3283 rpcz_store.cc:276] 0709 13:16:31.269433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.915363 (+645930us) service_pool.cc:224] Handling call
0709 13:16:31.915704 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.270871 (+355167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.271087 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.275195  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:32.271976  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:31.989166  5713 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:16:32.277801  3128 rpcz_store.cc:276] 0709 13:16:31.229357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.208953 (+979596us) service_pool.cc:224] Handling call
0709 13:16:32.264831 (+ 55878us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.312135  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:32.312762  3207 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.934954  5465 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:32.313846  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:32.303344  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:32.314822  3131 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:32.315336  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1307) took 1090 ms. Trace:
I20260709 13:16:32.315645  3131 rpcz_store.cc:276] 0709 13:16:31.224536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.274612 (+1050076us) service_pool.cc:224] Handling call
0709 13:16:32.315278 (+ 40666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.316051  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1308) took 1053 ms. Trace:
I20260709 13:16:32.316668  3130 rpcz_store.cc:276] 0709 13:16:31.248000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.293801 (+1045801us) service_pool.cc:224] Handling call
0709 13:16:32.301164 (+  7363us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.281162  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:32.318454  3205 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:31.989194  5533 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:32.263408  5663 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:16:32.319674  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:32.320334  3277 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:32.299059  3276 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:32.301761  3135 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:32.321000  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:32.321820  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1306) took 1183 ms. Trace:
I20260709 13:16:32.322247  3135 rpcz_store.cc:276] 0709 13:16:31.138638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.251472 (+1112834us) service_pool.cc:224] Handling call
0709 13:16:32.321756 (+ 70284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.301472  4936 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:31.842226  5622 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:32.321425  5633 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:32.323350  5622 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.321691  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:32.302460  5699 consensus_queue.cc:1059] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:16:32.297281  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:32.325343  4936 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:32.302704  5231 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:32.326114  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:32.326728  3204 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.327451  5198 consensus_queue.cc:1059] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:32.328262  5198 raft_consensus.cc:3055] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:32.328421  3285 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:32.328617  5198 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:32.329424  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:32.329566  5198 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:32.330008  5629 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:32.300634  5617 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:32.263243  5606 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:16:32.331224  5418 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:32.331458  5620 consensus_queue.cc:1059] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:32.332219  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2187) took 1720 ms. Trace:
I20260709 13:16:32.297508  5604 consensus_queue.cc:1059] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:16:32.263069  5478 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:32.253610  5626 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.346999  3280 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:32.305368  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:32.306669  3210 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:32.354491  3204 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:32.355158  3210 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:32.307377  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:31.858570  5637 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:32.310899  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1309) took 1052 ms. Trace:
I20260709 13:16:32.356426  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:32.273447  5534 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:32.321362  5486 consensus_queue.cc:1059] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:32.360566  5198 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.360970  3210 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:32.315819  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:32.361472  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:32.361912  3283 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:32.303256  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:32.363036  3203 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.333891  5707 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.329630  4936 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:16:32.346088  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:32.225208  5564 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:32.350154  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:32.352435  5465 raft_consensus.cc:3055] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:31.812628  5625 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:32.335723  3128 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:32.335848  5478 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:32.353389  5633 raft_consensus.cc:697] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:32.356779  3134 rpcz_store.cc:276] 0709 13:16:31.258767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.271656 (+1012889us) service_pool.cc:224] Handling call
0709 13:16:32.310817 (+ 39161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.358515  3281 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:32.360471  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1313) took 1100 ms. Trace:
I20260709 13:16:32.362622  3204 raft_consensus.cc:2410] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:32.253474  5706 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.363947  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:32.378723  3205 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:32.331255  5617 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:32.364705  3207 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:32.366394  3202 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:32.368566  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:32.332659  3278 rpcz_store.cc:276] 0709 13:16:30.611367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.545914 (+934547us) service_pool.cc:224] Handling call
0709 13:16:31.546185 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.752284 (+206099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.752320 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.757622 (+  5302us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.025181 (+267559us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:32.025243 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.025348 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.332000 (+306652us) raft_consensus.cc:1685] finished
0709 13:16:32.332021 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.332159 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":201982,"raft.queue_time_us":203413,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6249,"thread_start_us":231826,"threads_started":1,"wal-append.queue_time_us":508171}
I20260709 13:16:32.361927  5637 raft_consensus.cc:2764] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:16:32.373397  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:32.375438  3131 rpcz_store.cc:276] 0709 13:16:31.260078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.353965 (+1093887us) service_pool.cc:224] Handling call
0709 13:16:32.360399 (+  6434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.375828  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:32.386498  3134 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:32.387001  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1312) took 1127 ms. Trace:
I20260709 13:16:32.356530  5603 raft_consensus.cc:3055] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:32.383664  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:32.388084  3206 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:32.392390  3210 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:32.395541  3204 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:32.357008  5626 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:32.387444  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:32.387337  3134 rpcz_store.cc:276] 0709 13:16:31.259820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.375582 (+1115762us) service_pool.cc:224] Handling call
0709 13:16:32.386941 (+ 11359us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.377558  5478 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:32.370468  5465 raft_consensus.cc:740] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:32.399258  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:32.399292  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 143173us
I20260709 13:16:32.400612  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:32.402012  3204 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:32.384649  5617 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.395730  5603 raft_consensus.cc:740] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:32.402724  5617 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:32.402770  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1106) took 1171 ms. Trace:
I20260709 13:16:32.403261  3131 rpcz_store.cc:276] 0709 13:16:31.231870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.386141 (+1154271us) service_pool.cc:224] Handling call
0709 13:16:32.402700 (+ 16559us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.409590  3805 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:32.410219  3131 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:32.410825  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1286) took 1656 ms. Trace:
I20260709 13:16:32.410938  3805 leader_election.cc:400] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 3 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 3. Current term is 4.
I20260709 13:16:32.411150  3131 rpcz_store.cc:276] 0709 13:16:30.754696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.409798 (+1655102us) service_pool.cc:224] Handling call
0709 13:16:32.410066 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.410596 (+   530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.410773 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.412171  3131 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:32.412624  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1293) took 1655 ms. Trace:
I20260709 13:16:32.412912  3128 rpcz_store.cc:276] 0709 13:16:30.757358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.373617 (+1616259us) service_pool.cc:224] Handling call
0709 13:16:32.412576 (+ 38959us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.387391  5706 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:32.414031  3128 raft_consensus.cc:1217] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Deduplicated request from leader. Original: 7.7->[8.8-8.8]   Dedup: 8.8->[]
I20260709 13:16:32.414623  3128 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:32.415198  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1289) took 1659 ms. Trace:
I20260709 13:16:32.415759  5706 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:32.415800  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1288) took 1660 ms. Trace:
I20260709 13:16:32.416628  3131 rpcz_store.cc:276] 0709 13:16:30.755356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.411799 (+1656443us) service_pool.cc:224] Handling call
0709 13:16:32.412060 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.415547 (+  3487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.415716 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.415889  3128 rpcz_store.cc:276] 0709 13:16:30.755704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.413625 (+1657921us) service_pool.cc:224] Handling call
0709 13:16:32.413940 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.414992 (+  1052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.415149 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.420243  3128 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:32.420925  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1292) took 1663 ms. Trace:
I20260709 13:16:32.421339  3128 rpcz_store.cc:276] 0709 13:16:30.757058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.419746 (+1662688us) service_pool.cc:224] Handling call
0709 13:16:32.420065 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.420682 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.420871 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.425894  3204 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:32.449388  3128 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:32.370643  5707 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:32.464275  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2175) took 1859 ms. Trace:
I20260709 13:16:32.465478  5617 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:32.423576  5637 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:32.466703  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 55894.7us
I20260709 13:16:32.428839  3134 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:32.372433  5564 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:32.503640  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:32.504357  3206 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:32.479856  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1294) took 1722 ms. Trace:
I20260709 13:16:32.480202  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:32.511214  3204 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.478504  3279 rpcz_store.cc:276] 0709 13:16:30.604896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.536471 (+931575us) service_pool.cc:224] Handling call
0709 13:16:31.536785 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.569820 (+ 33035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.569869 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.609552 (+ 39683us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.893071 (+283519us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:32.263584 (+370513us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.263976 (+   392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.264058 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.464044 (+199986us) raft_consensus.cc:1685] finished
0709 13:16:32.464069 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.464205 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7181,"prepare.queue_time_us":357885,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":40015,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":16290,"thread_start_us":480509,"threads_started":2,"wal-append.queue_time_us":719219}
I20260709 13:16:32.466495  5465 consensus_queue.cc:260] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:32.497934  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1285) took 1743 ms. Trace:
I20260709 13:16:32.517949  3134 rpcz_store.cc:276] 0709 13:16:30.754419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.400324 (+1645905us) service_pool.cc:224] Handling call
0709 13:16:32.427713 (+ 27389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.497577 (+ 69864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.497857 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.481804  3805 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:32.513154  3128 rpcz_store.cc:276] 0709 13:16:30.757620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.422174 (+1664554us) service_pool.cc:224] Handling call
0709 13:16:32.449205 (+ 27031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.478072 (+ 28867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.478345 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:32.640534  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.587570  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:32.401332  5633 consensus_queue.cc:237] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:32.559538  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:32.403481  5603 consensus_queue.cc:260] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:32.685458  3838 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:32.686272  3128 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:32.686926  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1297) took 1928 ms. Trace:
I20260709 13:16:32.687237  3128 rpcz_store.cc:276] 0709 13:16:30.758587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.679883 (+1921296us) service_pool.cc:224] Handling call
0709 13:16:32.686049 (+  6166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.686694 (+   645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.686874 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:32.523396  3806 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.748s (SENT) [suppressed 28 similar messages]
W20260709 13:16:32.688014  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 206172us
I20260709 13:16:32.658187  3133 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:32.586367  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:32.657848  5465 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:32.629370  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 299329us
W20260709 13:16:32.630674  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 316901us
I20260709 13:16:32.605607  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:32.671221  3204 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:32.579494  5698 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:16:32.633939  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 344808us
I20260709 13:16:32.658406  5177 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:32.689714  3805 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:32.689983  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1296) took 1931 ms. Trace:
I20260709 13:16:32.696640  5707 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:32.702648  5622 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:32.705163  5583 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:32.706207  5626 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:32.706615  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2194) took 1432 ms. Trace:
I20260709 13:16:32.719525  3282 rpcz_store.cc:276] 0709 13:16:31.274081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.919642 (+645561us) service_pool.cc:224] Handling call
0709 13:16:32.238205 (+318563us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.238792 (+   587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.238833 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.239594 (+   761us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.662020 (+422426us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:32.682236 (+ 20216us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.683031 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.683152 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.706366 (+ 23214us) raft_consensus.cc:1685] finished
0709 13:16:32.706397 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.706553 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20509,"raft.queue_time_us":211,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":18671,"spinlock_wait_cycles":4390144,"thread_start_us":261071,"threads_started":1,"wal-append.queue_time_us":438454}
I20260709 13:16:32.712724  3133 rpcz_store.cc:276] 0709 13:16:30.758319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.657648 (+1899329us) service_pool.cc:224] Handling call
0709 13:16:32.658016 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.689749 (+ 31733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.689927 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.714244  3805 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:32.683044  5617 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:32.728018  5705 raft_consensus.cc:3055] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:32.729837  5705 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:32.730576  5564 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:32.730687  3132 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1317) took 1469 ms (client timeout 1545 ms). Trace:
W20260709 13:16:32.731307  3132 rpcz_store.cc:269] 0709 13:16:31.261119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.392544 (+131425us) service_pool.cc:224] Handling call
0709 13:16:32.730490 (+1337946us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54002da854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:32.730622 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249335680}
I20260709 13:16:32.732187  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:32.733351  5583 raft_consensus.cc:697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:32.707517  5625 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:32.735121  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:32.735683  3132 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:32.736758  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1301) took 1977 ms. Trace:
I20260709 13:16:32.737322  3132 rpcz_store.cc:276] 0709 13:16:30.759682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.732172 (+1972490us) service_pool.cc:224] Handling call
0709 13:16:32.732553 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.736398 (+  3845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.736674 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.738020  3203 raft_consensus.cc:2410] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:32.740561  3132 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:32.744802  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 201498us
I20260709 13:16:32.749863  3133 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:32.750711  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1300) took 1991 ms. Trace:
I20260709 13:16:32.751207  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1302) took 1991 ms. Trace:
I20260709 13:16:32.751104  3133 rpcz_store.cc:276] 0709 13:16:30.759410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.722857 (+1963447us) service_pool.cc:224] Handling call
0709 13:16:32.748959 (+ 26102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.750399 (+  1440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.750649 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.751771  3132 rpcz_store.cc:276] 0709 13:16:30.759956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.738507 (+1978551us) service_pool.cc:224] Handling call
0709 13:16:32.740371 (+  1864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.748747 (+  8376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.751151 (+  2404us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.753358  3132 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:32.753868  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1304) took 1623 ms. Trace:
I20260709 13:16:32.754137  3132 rpcz_store.cc:276] 0709 13:16:31.130170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.752760 (+1622590us) service_pool.cc:224] Handling call
0709 13:16:32.753031 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.753666 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.753818 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:32.759146  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.774080  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1290) took 2018 ms. Trace:
W20260709 13:16:32.776758  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 58495.3us
I20260709 13:16:32.774773  3131 rpcz_store.cc:276] 0709 13:16:30.755955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.417834 (+1661879us) service_pool.cc:224] Handling call
0709 13:16:32.418360 (+   526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.418768 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:32.419064 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.471306 (+ 52242us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.505461 (+ 34155us) log.cc:844] Serialized 556 byte log entry
0709 13:16:32.505683 (+   222us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:32.505733 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.505840 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.773814 (+267974us) raft_consensus.cc:1685] finished
0709 13:16:32.773834 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.774015 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2294,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":677,"raft.queue_time_us":966,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":3781,"thread_start_us":51780,"threads_started":1,"wal-append.queue_time_us":158589}
I20260709 13:16:32.734418  5603 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.781788  3131 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:32.782305  3133 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:32.718182  5723 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.782548  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1314) took 1522 ms. Trace:
I20260709 13:16:32.782922  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1303) took 1880 ms. Trace:
I20260709 13:16:32.789351  3133 rpcz_store.cc:276] 0709 13:16:30.902408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.752023 (+1849615us) service_pool.cc:224] Handling call
0709 13:16:32.781976 (+ 29953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.782684 (+   708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.782861 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.712436  5706 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:16:32.748436  5625 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:32.790915  3131 rpcz_store.cc:276] 0709 13:16:31.260326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.779428 (+1519102us) service_pool.cc:224] Handling call
0709 13:16:32.779809 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.782271 (+  2462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.782494 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.788730  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:32.752249  5617 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:32.797766  3835 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:32.774005  5637 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.719877  5478 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:32.800328  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 106209us
W20260709 13:16:32.799791  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 65246.8us
I20260709 13:16:32.815429  3131 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:16:32.818806  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.800772  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 277416us
W20260709 13:16:32.811511  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.821045  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.821699  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.823562  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:32.824405  3204 raft_consensus.cc:2410] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:32.824518  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:32.824981  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:32.821096  3806 leader_election.cc:336] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.796s (SENT)
I20260709 13:16:32.825274  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 278) took 1374 ms. Trace:
I20260709 13:16:32.825680  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:32.825752  3131 rpcz_store.cc:276] 0709 13:16:31.450598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.802724 (+1352126us) service_pool.cc:224] Handling call
0709 13:16:32.803000 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.815919 (+ 12919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.825212 (+  9293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.826514  3100 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:32.826989  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:32.825598  3211 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:32.828145  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:32.828737  3204 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:32.829016  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:32.814535  3834 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:32.800815  5617 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.831045  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:32.775791  5728 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
W20260709 13:16:32.838594  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.832605  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:32.862119  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:32.864568  3250 leader_election.cc:336] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.545s (SENT)
I20260709 13:16:32.840734  3211 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:32.730782  5705 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:32.869946  3100 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:32.870929  3206 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:32.870748  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:32.874287  3100 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:32.836313  3806 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:32.828094  5707 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.820109  5730 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:32.887900  5478 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:32.816465  5698 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:32.883705  5486 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:32.787211  5583 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:32.862349  5709 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:32.840358  5617 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.886402  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1316) took 1625 ms. Trace:
W20260709 13:16:32.882741  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 46527.4us
I20260709 13:16:32.869777  5673 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:32.892488  5198 consensus_meta.cc:287] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.005s
I20260709 13:16:32.823464  5534 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:16:32.895582  3133 rpcz_store.cc:276] 0709 13:16:31.260840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.790546 (+1529706us) service_pool.cc:224] Handling call
0709 13:16:32.801374 (+ 10828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.801573 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:32.801814 (+   241us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.885685 (+ 83871us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.885808 (+   123us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:32.885923 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.886053 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.886277 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12487,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"thread_start_us":83383,"threads_started":1}
I20260709 13:16:32.918578  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:32.974557  3838 raft_consensus.cc:2368] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8.
W20260709 13:16:32.921635  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.975888  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.832931  5662 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:16:32.990895  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:32.891017  5637 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:32.878333  5726 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:32.934592  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 54401.9us
W20260709 13:16:32.956524  5732 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:16:32.995003  5254 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:32.960990  5622 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:33.005223  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.005913  3133 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:33.007043  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:33.008054  3838 raft_consensus.cc:2393] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 4: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:32.883977  3832 raft_consensus.cc:2955] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:32.891848  5604 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:16:32.895315  5707 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:32.909178  5705 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.870229  5600 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:16:32.890298  5607 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:32.981768  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:32.995239  5637 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:33.021736  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:32.992303  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:32.903983  5730 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:32.923847  5673 raft_consensus.cc:697] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:33.029836  5673 consensus_queue.cc:237] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:32.996152  3100 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:32.923301  5733 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.022745  3841 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:33.023794  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.038225  3841 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:33.025640  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.026677  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.028159  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:33.040998  5752 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.041808  5752 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:33.046381  5647 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:33.048486  5426 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:33.059003  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.065938  3136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 274) took 2438 ms (client timeout 1796 ms). Trace:
W20260709 13:16:33.066385  3136 rpcz_store.cc:269] 0709 13:16:30.630426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.361357 (+730931us) service_pool.cc:224] Handling call
0709 13:16:33.065719 (+1704362us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b540032e1d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:33.065861 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121922944}
I20260709 13:16:33.004443  5254 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:33.066731  5707 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:33.154273  3102 leader_election.cc:400] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8.
I20260709 13:16:33.162568  3102 leader_election.cc:403] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:16:33.067581  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.151742  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:33.149358  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 153328us
I20260709 13:16:33.088940  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1298) took 2330 ms. Trace:
W20260709 13:16:33.165872  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 350662us
I20260709 13:16:33.169232  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:33.169891  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.087759  3210 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:16:33.171680  3833 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:33.176656  3210 pending_rounds.cc:85] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 4
I20260709 13:16:33.176999  3210 pending_rounds.cc:107] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:16:33.177652  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:33.177850  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:33.148293  5752 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:33.068495  5231 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:33.073616  5687 raft_consensus.cc:3055] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:33.167708  5735 log.cc:927] Time spent T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.198s	user 0.003s	sys 0.002s
I20260709 13:16:33.167495  5633 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:33.174144  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:33.234848  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 60801us
I20260709 13:16:33.174856  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:33.079674  5748 log.cc:927] Time spent T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:33.178109  3210 raft_consensus.cc:2889] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:33.168762  3100 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:33.167411  3128 rpcz_store.cc:276] 0709 13:16:30.758881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.687964 (+1929083us) service_pool.cc:224] Handling call
0709 13:16:32.688252 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.708977 (+ 20725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.709024 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.709612 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.821642 (+112030us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:32.821681 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.821761 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:33.088552 (+266791us) raft_consensus.cc:1685] finished
0709 13:16:33.088582 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.088869 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":20264,"thread_start_us":47375,"threads_started":1,"wal-append.queue_time_us":366125}
I20260709 13:16:33.261970  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:33.262730  3128 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:33.197365  3101 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:16:33.198262  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.264048  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.264312  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 67076.9us
I20260709 13:16:33.199298  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:33.265980  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 66761us
W20260709 13:16:33.202796  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 49246.3us
I20260709 13:16:33.176383  3842 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:33.033335  5637 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.223938  5644 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:16:33.229723  5737 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.340s	user 0.003s	sys 0.000s
I20260709 13:16:33.237326  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:33.269572  3278 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:33.238394  3279 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:33.210399  5687 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:33.195889  5626 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:33.259902  4936 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:33.251366  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.167898  5662 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.082698  5730 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:33.174926  5102 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:33.210876  5620 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:33.195914  5622 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:33.205476  5478 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:33.196309  5600 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:33.174944  5418 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:16:33.032656  5607 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:33.268230  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.268556  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:33.301879  5620 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:33.281620  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 112935us
W20260709 13:16:33.264652  5465 consensus_meta.cc:287] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.567s	user 0.006s	sys 0.005s
I20260709 13:16:33.299451  3249 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:33.268838  5750 consensus_queue.cc:1059] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:16:33.269605  5746 consensus_queue.cc:1059] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:16:33.268800  5663 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:33.300367  5630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.005s	sys 0.011s
W20260709 13:16:33.315376  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 444742us
I20260709 13:16:33.269441  5499 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.260377  5604 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:16:33.316782  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1295) took 2558 ms. Trace:
I20260709 13:16:33.278296  4936 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:33.315567  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.318495  5478 raft_consensus.cc:697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:33.301829  5629 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:33.248422  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:33.331032  3100 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:33.299937  3177 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:33.322516  5600 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:33.317366  5647 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:33.326941  5607 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:33.302394  5662 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:33.343843  3136 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:33.262655  5231 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:16:33.343370  3134 rpcz_store.cc:276] 0709 13:16:30.758056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.539688 (+1781632us) service_pool.cc:224] Handling call
0709 13:16:32.658593 (+118905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.658868 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:32.659315 (+   447us) log.cc:844] Serialized 14 byte log entry
0709 13:16:33.074818 (+415503us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b180018dc00. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f23a 00007fb3bc1f9a2a
0709 13:16:33.316281 (+241463us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.316355 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:33.316437 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.316529 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.316700 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":150,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":2760,"raft.queue_time_us":96,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":9282,"spinlock_wait_cycles":23945088,"thread_start_us":241187,"threads_started":1}
I20260709 13:16:33.303603  5652 consensus_queue.cc:1059] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:16:33.334990  5620 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:33.338406  5630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.006s	sys 0.011s
W20260709 13:16:33.349892  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 50056us
I20260709 13:16:33.340418  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:33.352262  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 165185us
I20260709 13:16:33.329972  5254 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:33.308319  5622 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:33.355000  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.430330  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:33.315742  5744 consensus_queue.cc:1059] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 13:16:33.390820  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 121636us
W20260709 13:16:33.410454  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 75090.8us
W20260709 13:16:33.410805  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 113503us
I20260709 13:16:33.345614  4936 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:33.347954  5629 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.356401  5564 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:33.356725  5499 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:33.433200  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.433851  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.457880  3134 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:33.336120  5663 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:33.382880  5198 consensus_queue.cc:1059] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
W20260709 13:16:33.450407  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 110053us
I20260709 13:16:33.334707  5687 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:33.452566  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:33.436642  3133 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:33.462292  3806 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:33.476691  3842 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:33.466861  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:33.422185  5534 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:33.468007  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.470070  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:33.479028  3208 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:33.479023  3136 raft_consensus.cc:2410] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:16:33.471333  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:33.472250  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:33.481541  3204 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:33.479280  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:33.437222  3129 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:33.500232  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:33.499733  3206 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:33.500854  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:33.501071  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:33.501842  3209 raft_consensus.cc:2410] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:16:33.459271  5629 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:33.506263  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.496022  3204 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
W20260709 13:16:33.496977  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 66860.5us
I20260709 13:16:33.497346  5604 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:33.498436  5418 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:33.499416  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.499528  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:33.499725  3211 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:33.457057  5564 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.460996  5730 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.460878  5499 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.463008  5663 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:33.462529  5733 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:33.512488  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:33.514664  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:33.487942  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:33.501520  3202 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:33.515902  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:33.504235  5723 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:33.507867  5687 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:33.534252  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:33.540061  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.547272  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:33.550755  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 93857.6us
W20260709 13:16:33.529136  5751 log.cc:927] Time spent T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.272s	user 0.002s	sys 0.000s
I20260709 13:16:33.489353  5707 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:16:33.583544  3840 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:33.503055  5757 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:33.553918  3805 leader_election.cc:336] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.139s (SENT)
I20260709 13:16:33.584213  3840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 383) took 1023 ms. Trace:
I20260709 13:16:33.588056  3840 rpcz_store.cc:276] 0709 13:16:32.560915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.561064 (+   149us) service_pool.cc:224] Handling call
0709 13:16:33.581180 (+1020116us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:16:33.583204 (+  2024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.583967 (+   763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.584159 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2643328}
I20260709 13:16:33.589684  3805 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:33.514588  5744 raft_consensus.cc:3055] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:33.511921  5604 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:33.599107  5604 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:33.600528  5534 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.601019  5534 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:33.590533  3128 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:33.516227  5564 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:33.514813  5418 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:33.517024  5699 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:33.594641  5744 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:33.594677  5768 consensus_queue.cc:1059] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:33.597898  5622 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:33.466528  5478 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:33.598567  5750 raft_consensus.cc:3055] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:33.643076  5750 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:33.546288  5254 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:33.540982  5706 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:33.507206  5177 consensus_queue.cc:1175] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "48080cf0460346769ab046a4f9457aa5" responder_term: 6 status { last_received { term: 5 index: 3 } last_committed_idx: 3 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:33.608011  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:33.654086  3128 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:33.527351  5499 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:33.610914  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:33.654711  3134 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.553148  5698 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:33.590013  5760 log.cc:927] Time spent T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.086s	user 0.001s	sys 0.001s
W20260709 13:16:33.621726  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 159544us
I20260709 13:16:33.628515  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:33.628939  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 78530.4us
I20260709 13:16:33.548540  3833 raft_consensus.cc:2376] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7. Re-sending same reply.
I20260709 13:16:33.582186  5775 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.662364  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:33.605777  5770 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:33.617926  5583 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:33.626995  5756 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:16:33.624895  5767 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.656852  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.641947  5757 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:33.660866  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:33.636787  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 83222.3us
I20260709 13:16:33.631450  5730 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 13:16:33.666333  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.675745  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:33.690095  3277 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:33.664528  5779 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.564762  5723 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:33.682176  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:33.647756  5746 consensus_queue.cc:1059] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:16:33.686439  3276 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:33.686287  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.658664  5254 raft_consensus.cc:697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:33.658893  5600 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:33.687567  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:33.682406  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1105) took 2451 ms. Trace:
I20260709 13:16:33.672982  5622 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:16:33.672012  5583 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.699796  5781 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:33.693786  5758 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:16:33.655668  5706 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:33.723431  3132 rpcz_store.cc:276] 0709 13:16:31.231100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.754787 (+1523687us) service_pool.cc:224] Handling call
0709 13:16:32.780541 (+ 25754us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.798712 (+ 18171us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:32.798747 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.815882 (+ 17135us) log.cc:844] Serialized 26 byte log entry
0709 13:16:33.010483 (+194601us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:33.010535 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.010623 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:33.682170 (+671547us) raft_consensus.cc:1685] finished
0709 13:16:33.682191 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.682345 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6721,"raft.queue_time_us":1160,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":21070,"thread_start_us":130442,"threads_started":1,"wal-append.queue_time_us":391780}
I20260709 13:16:33.742669  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:33.700145  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:33.700227  5662 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:33.722258  5772 consensus_queue.cc:1059] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:16:33.671352  5750 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:33.724275  5633 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8.
I20260709 13:16:33.699901  5773 consensus_queue.cc:1059] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:16:33.708637  5726 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:33.676260  5775 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:33.737151  3134 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:33.756590  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:33.748522  5663 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:33.749856  5765 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:16:33.672760  5744 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:33.755685  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 68199.6us
I20260709 13:16:33.760797  3136 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:33.761148  3806 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:33.744084  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 48018.5us
I20260709 13:16:33.735781  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:33.757603  3134 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:33.665239  5418 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:33.758114  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 70340us
I20260709 13:16:33.754118  5750 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:33.734515  5759 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.250s	user 0.001s	sys 0.001s
I20260709 13:16:33.762641  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:33.734416  5583 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.762944  3206 raft_consensus.cc:1813] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Handling vote request from an unknown peer fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:33.777943  3206 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:33.765713  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:33.778785  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:33.779266  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.735044  5781 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.779853  3135 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:33.746037  5771 raft_consensus.cc:3055] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:33.758471  5707 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:33.694149  5757 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:33.759294  5726 raft_consensus.cc:697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:33.697243  5767 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:33.830839  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.845692  5768 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:33.846309  5768 raft_consensus.cc:697] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:33.847288  5768 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:33.851507  5757 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:33.852380  5757 consensus_queue.cc:1059] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:33.853456  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:33.854115  3206 raft_consensus.cc:2376] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7. Re-sending same reply.
I20260709 13:16:33.855137  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:33.855808  3206 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:33.858845  5628 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:33.859302  5628 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:33.765239  5622 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:33.794206  3132 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:33.790519  5781 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:33.796149  5663 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:33.799746  5775 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:33.800915  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:33.724082  5777 consensus_queue.cc:1059] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:16:33.841238  5744 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:33.903519  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:33.803776  5418 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:33.857007  5761 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:16:33.782610  5699 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:33.791961  5707 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:33.773167  5779 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:16:33.889983  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:33.781946  5771 raft_consensus.cc:740] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:33.915895  5626 consensus_meta.cc:287] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.005s
W20260709 13:16:33.918205  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 150516us
I20260709 13:16:33.845705  5723 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:33.792933  5730 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:33.924048  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:33.954679  3208 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.841701  5754 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:16:33.902638  5622 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:33.925611  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:33.922555  5707 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:33.921769  5699 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.768225  5604 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:33.936848  5775 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.953210  5626 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:33.977298  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.791328  5254 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:33.981591  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:33.957751  5730 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:33.967499  5622 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:33.979667  5617 consensus_meta.cc:287] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.060s	user 0.017s	sys 0.000s
I20260709 13:16:33.988118  3206 raft_consensus.cc:2410] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:33.970996  5699 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.003847  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:34.006569  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 222919us
I20260709 13:16:34.007718  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:33.987948  5730 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:34.010922  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:34.021631  3834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54908 (request call id 384) took 1458 ms. Trace:
I20260709 13:16:34.021737  5793 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:16:34.022269  3834 rpcz_store.cc:276] 0709 13:16:32.563430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.569986 (+  6556us) service_pool.cc:224] Handling call
0709 13:16:34.021348 (+1451362us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b54006086d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:34.021527 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98367360}
I20260709 13:16:34.023402  5793 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:34.026283  3835 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:34.027411  5772 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.028100  5772 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:33.980672  5775 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.030133  5177 raft_consensus.cc:3055] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:34.030551  5177 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:34.031312  5775 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:34.000233  5706 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:33.985754  5771 consensus_queue.cc:260] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.038347  3206 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:34.038807  5771 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.031343  5177 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:33.998461  5617 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.045883  5617 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:34.047112  5177 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.955703  5628 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:34.005386  4936 consensus_meta.cc:287] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.001s
I20260709 13:16:33.935555  5726 consensus_queue.cc:237] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.085592  3208 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:34.087335  5604 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:34.091966  5788 log.cc:927] Time spent T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:16:34.092002  5629 consensus_meta.cc:287] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.008s
I20260709 13:16:34.093626  5629 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.069293  5754 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:34.110076  5534 consensus_meta.cc:287] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.002s
I20260709 13:16:34.110756  5534 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.138644  5769 raft_consensus.cc:3055] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:34.139470  5769 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:34.141876  5767 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:34.148017  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1329) took 1091 ms. Trace:
I20260709 13:16:34.068962  4936 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.140643  5769 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.053526  5583 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.154573  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 281) took 1121 ms. Trace:
W20260709 13:16:34.574410  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 566714us
I20260709 13:16:34.576870  3132 rpcz_store.cc:276] 0709 13:16:33.033545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.742435 (+708890us) service_pool.cc:224] Handling call
0709 13:16:34.154297 (+411862us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b540036abd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:34.154481 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28153728}
I20260709 13:16:34.148638  3135 rpcz_store.cc:276] 0709 13:16:33.056308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.665706 (+609398us) service_pool.cc:224] Handling call
0709 13:16:34.147770 (+482064us) spinlock_profiling.cc:243] Waited 67.5 ms on lock 0x7b54003566d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:34.147928 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155257600}
W20260709 13:16:34.392853  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 443359us
W20260709 13:16:34.570791  3278 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.001s	sys 0.019s
W20260709 13:16:34.580724  3278 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.001s	sys 0.019s
W20260709 13:16:34.573973  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 1.30876e+06us
W20260709 13:16:34.388728  3280 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.003s	sys 0.011s
I20260709 13:16:34.582160  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:34.516875  5699 consensus_meta.cc:287] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.003s
W20260709 13:16:34.584069  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.096076  5628 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:34.208148  5620 consensus_meta.cc:287] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.759s	user 0.008s	sys 0.003s
W20260709 13:16:34.582988  3280 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.003s	sys 0.012s
I20260709 13:16:34.181567  5627 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:34.247838  5607 consensus_meta.cc:287] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.823s	user 0.012s	sys 0.000s
I20260709 13:16:34.601763  5708 consensus_queue.cc:1059] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:34.598268  5795 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:16:34.602259  5607 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.604233  5795 raft_consensus.cc:3055] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:34.600620  5699 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.606580  3206 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:16:34.606606  5620 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.604751  5795 raft_consensus.cc:740] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:34.609882  5795 consensus_queue.cc:260] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.610862  5620 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:34.612659  3276 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:16:34.613339  5177 consensus_meta.cc:287] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.004s
I20260709 13:16:34.598459  5254 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:34.588057  5730 consensus_meta.cc:287] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.000s
W20260709 13:16:34.259960  5499 consensus_meta.cc:287] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.595s	user 0.011s	sys 0.000s
W20260709 13:16:34.246996  5637 consensus_meta.cc:287] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.947s	user 0.014s	sys 0.000s
W20260709 13:16:34.246275  5564 consensus_meta.cc:287] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.001s
W20260709 13:16:34.168988  5687 consensus_meta.cc:287] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.001s
W20260709 13:16:34.388728  3833 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.003s	sys 0.015s
W20260709 13:16:34.588003  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.155762  5652 raft_consensus.cc:3055] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:34.157689  5746 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:34.589679  3279 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:34.280483  5629 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:34.164448  5729 raft_consensus.cc:3055] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:34.120955  5698 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:34.381012  5622 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.176003  5772 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:34.371495  5478 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.008s	sys 0.007s
I20260709 13:16:34.583774  5754 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:34.291669  5781 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.575663  5534 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:34.631235  3250 connection.cc:256] RPC call timeout handler was delayed by -1.3322955220000949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
W20260709 13:16:34.633659  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.600184  5769 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:34.681514  5803 log.cc:927] Time spent T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:16:34.631462  3833 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.005s	sys 0.020s
I20260709 13:16:34.630465  5499 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.666304  3211 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:34.671989  5622 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:34.629877  5607 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:34.283299  5707 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.586813  5801 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
W20260709 13:16:34.685012  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 100543us
I20260709 13:16:34.624472  5418 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 13:16:34.674240  5478 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.008s	sys 0.008s
I20260709 13:16:34.655359  5729 raft_consensus.cc:740] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:34.647274  5652 raft_consensus.cc:740] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:34.629194  5730 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.646898  5746 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:34.699146  3282 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:34.689822  5534 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.690099  5802 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:34.700928  5754 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.702927  5707 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:34.703663  5799 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:34.704164  3176 connection.cc:256] RPC call timeout handler was delayed by -1.8183219150000696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
I20260709 13:16:34.703824  5729 consensus_queue.cc:260] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.706780  5499 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:34.696738  5698 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:16:34.709609  5652 consensus_queue.cc:260] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.652645  5564 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.711872  4936 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:34.654795  5637 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.731725  3207 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:34.700142  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:34.719779  5534 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:34.725437  3176 connection.cc:256] RPC call timeout handler was delayed by -1.6644219150000481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
I20260709 13:16:34.696534  5607 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:34.736824  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 51680.9us
I20260709 13:16:34.729919  3805 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:34.725890  5687 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:34.698192  5768 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.013s	sys 0.058s
I20260709 13:16:34.738756  3838 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:34.738745  3805 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:34.745391  3250 connection.cc:256] RPC call timeout handler was delayed by -1.14492119800002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260709 13:16:34.745896  3250 connection.cc:256] RPC call timeout handler was delayed by -1.0855866850001803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260709 13:16:34.746376  3250 connection.cc:256] RPC call timeout handler was delayed by -1.0811955220001437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
W20260709 13:16:34.748595  3250 leader_election.cc:336] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.633s (SENT)
I20260709 13:16:34.748960  5637 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:34.749032  3250 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:34.749681  5637 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:34.749852  4936 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:34.750137  5637 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:34.750550  5637 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.752846  3250 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:34.753752  4936 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:34.754129  4936 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:34.754501  4936 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.755336  5687 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.757372  5687 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:34.745523  5607 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.759747  5607 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:34.762179  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:34.733498  5478 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:34.765008  5478 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.764612  5746 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.766673  5564 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:34.767371  5478 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:34.767585  5812 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:34.768301  5812 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.769869  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:34.770762  5769 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:34.771010  5812 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:34.771236  5769 raft_consensus.cc:697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:34.771941  3176 connection.cc:256] RPC call timeout handler was delayed by -1.0372238069999185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260709 13:16:34.772866  5707 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:34.745829  5768 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.013s	sys 0.058s
I20260709 13:16:34.734256  5729 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:34.737715  5804 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:34.773458  5707 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.722777  5802 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.772248  5769 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.775830  5707 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:34.772435  3176 connection.cc:256] RPC call timeout handler was delayed by -1.0372238069999185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260709 13:16:34.764012  4936 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.768857  5499 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:34.778751  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:34.779867  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:34.780756  5726 consensus_queue.cc:1059] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:34.733356  5622 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:34.782181  5687 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.782059  5622 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.782760  5177 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:34.782677  5687 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.783218  5177 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.783641  5177 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:34.783934  5764 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 1.052s	user 0.002s	sys 0.000s
I20260709 13:16:34.784399  5622 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:34.745909  5652 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.784898  5687 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:34.785488  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:34.781424  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:34.732376  5625 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.786218  3840 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:34.781585  5726 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:34.787495  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:34.776721  5802 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:34.732944  5583 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:34.796185  3840 pending_rounds.cc:85] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 6
I20260709 13:16:34.794664  3250 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:34.797127  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:34.805994  3840 pending_rounds.cc:107] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:16:34.806509  3840 raft_consensus.cc:2889] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:34.806490  3832 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:34.745391  5762 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:34.808851  3132 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:34.810364  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:34.811249  3128 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:34.812417  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:34.813580  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:34.813643  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:34.812191  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:34.813779  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:34.815737  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:34.793959  5746 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.793174  5811 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.818014  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:34.827728  3132 raft_consensus.cc:2393] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 3: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:34.827112  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:34.819373  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:34.819888  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:34.828745  3841 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.796626  3834 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.726305  5799 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.822168  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:34.823141  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:34.842854  3127 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:34.805965  5564 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.808965  5534 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:34.843426  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:34.851470  3841 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:34.814273  5802 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:34.817181  5768 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:34.816965  5728 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:34.853029  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:34.822088  5418 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:34.814338  5699 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:34.837911  5811 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.856822  4936 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:34.861385  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:34.881935  3135 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.862066  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 277) took 1098 ms. Trace:
W20260709 13:16:34.866456  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 127774us
I20260709 13:16:34.873685  3127 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.882881  3280 rpcz_store.cc:276] 0709 13:16:33.764033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.764172 (+   139us) service_pool.cc:224] Handling call
0709 13:16:33.764469 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.598633 (+834164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.598681 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.599294 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.733991 (+134697us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:34.734025 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.734096 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.861843 (+127747us) raft_consensus.cc:1685] finished
0709 13:16:34.861862 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.862003 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":221209,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":7323,"thread_start_us":958940,"threads_started":2,"wal-append.queue_time_us":210734}
I20260709 13:16:34.884282  3805 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:34.851563  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:34.796473  5625 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.888255  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:34.854588  5817 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:34.890086  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:34.899868  3135 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:34.902249  3250 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:34.903798  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:34.904639  3135 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.916493  5811 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:34.917014  4936 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:34.917755  4936 raft_consensus.cc:697] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:34.918795  4936 consensus_queue.cc:237] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:34.922632  5637 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.925653  5730 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:34.881827  5418 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:34.953272  3128 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:34.955080  5625 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:34.957811  3133 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1332) took 1893 ms (client timeout 1522 ms). Trace:
W20260709 13:16:34.959064  3133 rpcz_store.cc:269] 0709 13:16:33.064945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.140614 (+ 75669us) service_pool.cc:224] Handling call
0709 13:16:34.954011 (+1813397us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54003a9dd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:34.957735 (+  3724us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598453632}
I20260709 13:16:34.959841  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:34.889629  5583 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.966001  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:34.967204  3132 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:34.969956  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:34.972628  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:34.975770  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:34.977165  3127 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:34.970885  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:34.984390  3135 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
W20260709 13:16:34.987668  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.989671  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:34.996188  3806 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:35.003026  5815 log.cc:927] Time spent T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:16:34.991870  5802 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:35.012703  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:35.003443  5755 raft_consensus.cc:3055] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:35.009115  3250 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:35.010545  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:34.993393  5821 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:16:34.962145  5817 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:35.017730  3133 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:16:35.035879  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.037581  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:35.013295  5802 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.042480  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:35.015030  5622 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:35.015748  5755 raft_consensus.cc:740] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:35.017014  5772 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:35.044117  3135 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.046175  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:35.047314  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:35.062990  3132 raft_consensus.cc:2376] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4. Re-sending same reply.
I20260709 13:16:35.063808  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:35.049050  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 274) took 1382 ms. Trace:
I20260709 13:16:35.050352  5418 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:35.070284  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:35.026574  5637 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:35.052198  5499 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:35.052928  5564 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.054587  5817 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:35.057876  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2291) took 1418 ms. Trace:
I20260709 13:16:35.085669  3135 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:35.084517  3209 rpcz_store.cc:276] 0709 13:16:33.639035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.150129 (+511094us) service_pool.cc:224] Handling call
0709 13:16:34.575968 (+425839us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.727880 (+151912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.727913 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.733362 (+  5449us) log.cc:844] Serialized 26 byte log entry
0709 13:16:35.017391 (+284029us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:35.017556 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.017663 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.057649 (+ 39986us) raft_consensus.cc:1685] finished
0709 13:16:35.057670 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.057814 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15374,"raft.queue_time_us":20418,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3303,"thread_start_us":338542,"threads_started":2,"wal-append.queue_time_us":308302}
I20260709 13:16:35.066154  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:35.068104  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:35.051340  3131 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:35.073581  5772 raft_consensus.cc:697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:35.073836  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:35.077047  5811 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:35.081272  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2285) took 1447 ms. Trace:
I20260709 13:16:35.057794  5802 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:35.065260  3279 rpcz_store.cc:276] 0709 13:16:33.666472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.666759 (+   287us) service_pool.cc:224] Handling call
0709 13:16:33.667035 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.656951 (+989916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.048835 (+391884us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54002701d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:35.048993 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2120569600}
I20260709 13:16:35.077296  5812 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:35.088862  3805 leader_election.cc:336] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.748s (SENT)
I20260709 13:16:35.089121  3208 rpcz_store.cc:276] 0709 13:16:33.634137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.086557 (+452420us) service_pool.cc:224] Handling call
0709 13:16:34.087149 (+   592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.095799 (+  8650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.095847 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.952484 (+856637us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b2c00136548. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:16:34.952935 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:16:35.012118 (+ 59183us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:35.012159 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.012235 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.061951 (+ 49716us) raft_consensus.cc:1685] finished
0709 13:16:35.061974 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.081172 (+ 19198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":402429,"raft.queue_time_us":9002,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":86018,"spinlock_wait_cycles":7938816,"thread_start_us":58747,"threads_started":1,"wal-append.queue_time_us":96525}
I20260709 13:16:35.094453  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:35.096442  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:35.081634  3833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 392) took 1348 ms. Trace:
I20260709 13:16:35.092681  3805 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:35.105507  5772 consensus_queue.cc:237] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:35.086570  5755 consensus_queue.cc:260] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:35.108466  5755 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:35.091739  5812 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:35.110436  5812 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:35.113795  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:35.115155  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:35.116603  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:35.120093  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:35.120924  3209 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:35.121842  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:35.122786  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:35.123229  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.127530  3132 raft_consensus.cc:2368] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7.
I20260709 13:16:35.127708  3209 raft_consensus.cc:2393] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:35.129716  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:35.130725  3209 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.132032  3806 leader_election.cc:400] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7.
I20260709 13:16:35.092617  5637 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:35.134524  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:35.138922  3205 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:35.140714  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:35.124372  5762 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.144155  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:35.146142  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:35.128585  5622 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:35.152549  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:35.154524  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:35.098069  5177 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:35.167224  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:35.142544  5637 raft_consensus.cc:697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:35.167999  3132 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:35.152511  5699 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:35.182860  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:35.190236  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:35.192140  3202 raft_consensus.cc:2368] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7.
I20260709 13:16:35.192401  3209 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:35.194008  3208 raft_consensus.cc:2393] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:35.193306  5778 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:35.196297  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:35.197799  3132 raft_consensus.cc:2376] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8. Re-sending same reply.
I20260709 13:16:35.198666  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:35.194650  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:35.199699  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:35.200315  3208 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
I20260709 13:16:35.200253  3209 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.201016  3132 raft_consensus.cc:2410] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:35.192219  5583 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:35.193431  5699 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:35.203084  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:35.202459  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:35.205278  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:35.206256  3132 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:35.207089  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:35.208102  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:35.197511  5778 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.209923  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:35.211777  3208 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:35.203807  5637 consensus_queue.cc:237] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:35.210623  5746 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:35.212955  5746 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.213327  5746 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:35.214818  3806 leader_election.cc:336] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.548s (SENT)
I20260709 13:16:35.212057  3836 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:35.215907  3209 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:35.098914  3833 rpcz_store.cc:276] 0709 13:16:33.733610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.741185 (+  7575us) service_pool.cc:224] Handling call
0709 13:16:33.780030 (+ 38845us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:34.683088 (+903058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.683145 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:34.683878 (+   733us) log.cc:844] Serialized 52 byte log entry
0709 13:16:34.880448 (+196570us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:34.882321 (+  1873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.891763 (+  9442us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.057659 (+165896us) raft_consensus.cc:1685] finished
0709 13:16:35.062238 (+  4579us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.077927 (+ 15689us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113585,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":2739,"thread_start_us":1048560,"threads_started":2,"wal-append.queue_time_us":205160}
W20260709 13:16:35.220037  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.216382  5778 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.222342  5699 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:35.223656  5830 log.cc:927] Time spent T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:16:35.225929  5177 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:35.211194  5652 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.234632  3132 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:16:35.247602  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.248315  3208 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:35.250006  3834 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:35.257495  3837 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:35.263728  5778 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:35.249859  5177 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:16:35.279951  5603 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.283087  5418 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.283082  5603 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:35.283691  5418 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:35.285022  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:35.288834  3133 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.291061  3100 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:35.294361  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:35.285789  5418 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:35.290714  5607 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.297946  5607 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:35.300025  5607 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:35.285614  5603 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:35.303274  5789 raft_consensus.cc:3055] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:35.303857  5789 raft_consensus.cc:740] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:35.300894  3211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1398) took 1826 ms. Trace:
I20260709 13:16:35.309789  5789 consensus_queue.cc:260] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:35.296295  3840 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:35.297186  5817 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:35.310839  3177 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:35.311161  5789 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.311818  3177 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:35.281870  5812 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:35.316543  5699 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:35.316618  5793 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.317047  5699 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:35.317500  5699 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.317204  5793 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:35.317927  5726 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:35.318332  5726 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.318662  5726 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.319304  5793 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:35.323357  3207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2286) took 1688 ms. Trace:
I20260709 13:16:35.323926  3207 rpcz_store.cc:276] 0709 13:16:33.634504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.088079 (+453575us) service_pool.cc:224] Handling call
0709 13:16:34.088403 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.732270 (+643867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.323112 (+590842us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b5400225454. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:35.323294 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1478973312}
I20260709 13:16:35.323640  5817 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.326236  5817 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:35.328336  5817 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:35.331718  3102 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:35.333122  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:35.336728  3100 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:35.339124  5726 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:35.336408  5817 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.341001  5817 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:35.343941  5817 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:35.345407  5802 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:35.400764  3133 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:35.402149  5812 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:35.403970  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:35.406354  3133 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:35.335727  5607 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.433619  3838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 388) took 2280 ms. Trace:
I20260709 13:16:35.436859  3838 rpcz_store.cc:276] 0709 13:16:33.158968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.159123 (+   155us) service_pool.cc:224] Handling call
0709 13:16:33.159454 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.739636 (+1580182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.433315 (+693679us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b5400659ad4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:35.433545 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3631588096}
I20260709 13:16:35.437273  5802 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:35.459543  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:35.460258  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:35.460603  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.466325  5768 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.466854  5768 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:35.468853  5768 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:35.469301  5768 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.469712  5768 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:35.472553  5768 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:35.476071  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:35.477757  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:35.478325  3279 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.486696  3279 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
W20260709 13:16:35.487628  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.487888  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:35.488533  5768 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.489048  5768 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:35.491304  5768 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:35.488122  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.495591  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:35.498927  3283 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:35.500169  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:35.500784  3283 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:35.501974  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:35.502720  3283 raft_consensus.cc:2393] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:35.500945  3279 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:35.496897  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:35.504993  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:35.506132  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:35.506214  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:35.506649  3283 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:35.506737  3284 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:35.509112  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:35.510532  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:35.511907  3284 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:16:35.512981  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:35.506743  3279 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:35.517856  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:35.518652  3279 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:35.520598  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:35.521272  3279 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.522859  3283 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:16:35.524312  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:35.525884  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:35.526543  3283 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:35.527765  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:35.528100  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.529428  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:35.530001  3283 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:35.534557  3284 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:35.535837  3279 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:35.565891  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2275) took 3075 ms. Trace:
I20260709 13:16:35.566393  3210 rpcz_store.cc:276] 0709 13:16:32.491010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.491297 (+   287us) service_pool.cc:224] Handling call
0709 13:16:32.491727 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.263194 (+771467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.565565 (+2302371us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b5400375ad4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:35.565789 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1369212288}
I20260709 13:16:35.568634  3835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 454) took 2664 ms. Trace:
I20260709 13:16:35.569025  3835 rpcz_store.cc:276] 0709 13:16:32.904713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.905059 (+   346us) service_pool.cc:224] Handling call
0709 13:16:34.026099 (+1121040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.026696 (+   597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.568435 (+1541739us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54006086d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:35.568565 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2577387264}
I20260709 13:16:35.575700  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:35.585543  3130 raft_consensus.cc:1240] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:16:35.587512  3130 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:35.290277  5665 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.610100  5665 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:35.613894  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:35.613894  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:35.616089  3281 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:35.618063  3130 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:35.619791  3130 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:35.614699  3280 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:35.626237  3130 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:35.643595  3281 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:35.645216  3281 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:35.645578  3281 pending_rounds.cc:85] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 2
I20260709 13:16:35.645792  3281 pending_rounds.cc:107] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:35.646009  3281 raft_consensus.cc:2889] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:35.647257  3276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52014 (request call id 278) took 1846 ms (client timeout 1759 ms). Trace:
I20260709 13:16:35.647389  3281 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:16:35.647712  3276 rpcz_store.cc:269] 0709 13:16:33.800420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.800550 (+   130us) service_pool.cc:224] Handling call
0709 13:16:35.647038 (+1846488us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b5400182254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:35.647172 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630607104}
I20260709 13:16:35.636359  3130 raft_consensus.cc:2955] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:16:35.698153  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.718217  5665 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:35.741369  3136 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:16:35.813689  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.851145  5781 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:35.853827  5776 raft_consensus.cc:3055] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:35.854290  5776 raft_consensus.cc:740] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:35.855165  5776 consensus_queue.cc:260] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:35.856218  5776 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:35.860247  5231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.011s	sys 0.034s
W20260709 13:16:35.864440  5231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.013s	sys 0.035s
I20260709 13:16:35.309286  3211 rpcz_store.cc:276] 0709 13:16:33.474896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.024425 (+549529us) service_pool.cc:224] Handling call
0709 13:16:34.024773 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.684661 (+659888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.300562 (+615901us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b540027c254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:35.300814 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1474709760}
I20260709 13:16:35.876356  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:35.877159  3278 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:35.878767  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:35.896194  3177 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:35.899411  5781 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:35.899981  5781 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:35.900840  5781 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:35.908258  5726 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:35.911602  5726 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.912222  5726 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:35.912580  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:35.913762  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.914486  3202 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:35.916304  5726 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:35.917049  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:35.921528  5726 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.922394  5726 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:35.923583  5799 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:35.926474  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:35.927350  3211 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:35.927606  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:35.928303  3208 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:35.928392  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:35.928988  3207 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.929437  3208 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:16:35.929780  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:35.930079  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:35.930538  3205 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.931130  3209 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:35.932655  3209 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:35.933475  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:35.939714  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1351) took 1103 ms. Trace:
I20260709 13:16:35.940131  3135 rpcz_store.cc:276] 0709 13:16:34.843284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.010126 (+166842us) service_pool.cc:224] Handling call
0709 13:16:35.939468 (+929342us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b54003dbb54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:35.939637 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68019456}
I20260709 13:16:35.942276  5726 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:35.944461  3132 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:35.929780  3208 pending_rounds.cc:85] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 3
I20260709 13:16:35.945572  3208 pending_rounds.cc:107] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:35.945827  3208 raft_consensus.cc:2889] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.945897  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:35.946620  3211 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:35.947361  3208 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:35.947655  3211 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:35.948710  3208 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:35.951181  3836 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:16:35.959656  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.960814  3127 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:35.961320  3207 raft_consensus.cc:2410] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:35.963459  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1349) took 1128 ms. Trace:
I20260709 13:16:35.951900  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:35.951021  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:35.965240  3835 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.952479  3833 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:35.954546  3205 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:35.955705  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:35.969153  3841 raft_consensus.cc:2393] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
W20260709 13:16:35.956552  3136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1115) took 2976 ms (client timeout 3374 ms). Trace:
I20260709 13:16:35.970635  5778 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:35.970713  3136 rpcz_store.cc:269] 0709 13:16:32.980486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.779018 (+798532us) service_pool.cc:224] Handling call
0709 13:16:35.956271 (+2177253us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54000dd754. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:35.956449 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4510302592}
I20260709 13:16:35.956617  3135 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:35.973276  5776 consensus_queue.cc:1059] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:35.963567  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 280) took 1904 ms. Trace:
I20260709 13:16:35.974378  5776 raft_consensus.cc:3055] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:35.953498  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:35.966087  3127 rpcz_store.cc:276] 0709 13:16:34.835378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.652657 (+817279us) service_pool.cc:224] Handling call
0709 13:16:35.960558 (+307901us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:35.961241 (+   683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.963163 (+  1922us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54000dd750. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:35.963366 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707343744}
W20260709 13:16:35.969153  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:35.975198  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 75665.2us
I20260709 13:16:35.976787  3806 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:35.977927  3806 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:35.974812  5776 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:35.974951  3277 rpcz_store.cc:276] 0709 13:16:34.059447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.059888 (+   441us) service_pool.cc:224] Handling call
0709 13:16:34.060326 (+   438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:34.061324 (+   998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.061353 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:34.061920 (+   567us) log.cc:844] Serialized 52 byte log entry
0709 13:16:35.926608 (+1864688us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b180030db40. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:16:35.958566 (+ 31958us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:35.959259 (+   693us) log.cc:844] Serialized 14 byte log entry
0709 13:16:35.959702 (+   443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.959833 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.963233 (+  3400us) raft_consensus.cc:1685] finished
0709 13:16:35.963359 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.963504 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5318,"prepare.queue_time_us":218,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":5788,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":3419,"spinlock_wait_cycles":8444288,"thread_start_us":31735,"threads_started":1,"wal-append.queue_time_us":1885215}
I20260709 13:16:35.979178  5776 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:35.980540  5776 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.978919  3832 raft_consensus.cc:2393] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:35.977928  3835 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:35.984547  3251 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:35.987442  3250 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:35.990872  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.989588  5465 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.992300  5465 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:35.994617  5795 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.995193  5465 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:35.996017  5465 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:35.982952  5768 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.990089  5778 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:16:35.997459  5768 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:35.999809  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2279) took 2368 ms. Trace:
I20260709 13:16:35.990383  5728 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:36.005856  5728 raft_consensus.cc:697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:36.007313  5728 consensus_queue.cc:237] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.009100  5564 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:35.999859  5768 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:36.009716  5564 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:36.012084  5564 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:36.017112  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:36.016716  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:36.017828  3836 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:16:36.018693  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:36.019418  3841 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:36.019572  5781 consensus_queue.cc:1059] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:36.019826  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:36.020360  5763 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:36.020648  3833 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:36.000367  3206 rpcz_store.cc:276] 0709 13:16:33.631693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.039422 (+407729us) service_pool.cc:224] Handling call
0709 13:16:34.039826 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.607075 (+567249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.999405 (+1392330us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b5400195854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:35.999721 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1302855552}
I20260709 13:16:36.021159  5726 raft_consensus.cc:3055] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:36.021752  5726 raft_consensus.cc:740] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:36.022089  5628 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:36.022541  5628 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.022893  5628 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.023792  3177 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:35.996474  5465 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:36.026268  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.028438  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 691728us
I20260709 13:16:36.030201  3100 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:36.020888  5763 raft_consensus.cc:697] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:36.037232  5763 consensus_queue.cc:237] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.038648  5465 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.041476  5607 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:36.043316  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 579573us
I20260709 13:16:36.047549  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.048290  3280 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:36.031002  5799 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:36.067764  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:36.070595  3102 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:36.061362  5846 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:36.077448  5418 consensus_queue.cc:1059] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:16:36.097497  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 119628us
W20260709 13:16:36.098062  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 67936.8us
I20260709 13:16:36.098367  3806 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:36.079911  5799 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.102952  5763 raft_consensus.cc:3055] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:36.103428  5763 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:36.104276  5763 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.105285  5607 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.105527  5763 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.105988  5607 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:36.107690  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.109582  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:36.110214  3127 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:36.113795  3135 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:36.115191  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:36.116618  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:36.117837  3136 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:36.118247  5763 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:36.118981  5763 raft_consensus.cc:697] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:16:36.119864  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.120333  5763 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.084530  5534 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:36.083613  5198 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:36.122803  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1345) took 1289 ms. Trace:
I20260709 13:16:36.022905  5726 consensus_queue.cc:260] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.124173  3130 rpcz_store.cc:276] 0709 13:16:34.833618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.629598 (+795980us) service_pool.cc:224] Handling call
0709 13:16:35.635783 (+  6185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.636186 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:35.807123 (+170937us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.120721 (+313598us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:36.120788 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:36.120853 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.120930 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.121064 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":297129,"raft.queue_time_us":297901,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":101,"thread_start_us":15968,"threads_started":1,"wal-append.queue_time_us":44644}
I20260709 13:16:36.118997  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:36.128330  3136 raft_consensus.cc:2410] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:16:36.101433  5426 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:36.104643  3101 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:36.131193  3136 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:36.132181  3832 raft_consensus.cc:3055] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:36.133762  3832 raft_consensus.cc:740] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:36.134979  3130 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:36.134645  3832 consensus_queue.cc:260] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.135603  3832 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.100203  5728 consensus_queue.cc:1059] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:16:36.108793  5607 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:36.126091  5534 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.122838  5799 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.141911  3127 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:16:36.126798  3833 raft_consensus.cc:3055] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:36.129750  5198 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:36.188843  3832 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:16:36.183310  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 57911.8us
W20260709 13:16:36.160262  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 61966us
I20260709 13:16:36.140288  5627 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:16:36.154361  5726 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:36.205416  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 100900us
W20260709 13:16:36.208189  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.208797  3101 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:36.158355  5534 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:36.194880  5607 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:36.215991  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1340) took 1384 ms. Trace:
I20260709 13:16:36.216384  3128 rpcz_store.cc:276] 0709 13:16:34.832075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.602782 (+770707us) service_pool.cc:224] Handling call
0709 13:16:35.603185 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.062373 (+459188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.062422 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.063072 (+   650us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.194062 (+130990us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:36.194112 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.194191 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.215752 (+ 21561us) raft_consensus.cc:1685] finished
0709 13:16:36.215788 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.215930 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":509780,"raft.queue_time_us":461935,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":1038,"thread_start_us":91296,"threads_started":1,"wal-append.queue_time_us":151118}
I20260709 13:16:36.216794  5607 consensus_queue.cc:1059] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:16:36.140535  5647 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:16:36.160691  5665 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:16:36.220556  5647 raft_consensus.cc:3055] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:36.220949  5647 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:36.221246  5418 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:36.221776  5418 raft_consensus.cc:697] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:36.221940  5647 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.222501  5534 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.223207  5647 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:36.202795  3806 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:36.228533  5534 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:36.228240  5465 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.231078  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:36.160763  3833 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:36.231688  3841 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:36.233844  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 94069us
I20260709 13:16:36.222674  5418 consensus_queue.cc:237] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:36.254750  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 52047us
I20260709 13:16:36.258781  3841 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:16:36.229205  5534 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:36.255945  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:36.262636  3833 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.263753  3833 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.277159  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:36.277412  3285 raft_consensus.cc:1240] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:36.278149  3280 raft_consensus.cc:2410] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:36.279091  3277 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:16:36.261912  5778 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:36.253144  5665 raft_consensus.cc:3055] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:36.281700  3277 pending_rounds.cc:85] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 5
I20260709 13:16:36.282951  3277 pending_rounds.cc:107] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:16:36.284539  3277 raft_consensus.cc:2889] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:36.229964  5628 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.278441  5853 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:36.316442  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.292088  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.319830  3129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1327) took 3264 ms (client timeout 1728 ms). Trace:
W20260709 13:16:36.335983  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 82875.6us
I20260709 13:16:36.321156  5628 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:36.322829  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:36.340162  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:36.340663  3835 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.285773  5665 raft_consensus.cc:740] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:36.345719  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:36.346565  3279 raft_consensus.cc:2410] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:36.346637  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:36.347463  3277 raft_consensus.cc:2410] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:36.347965  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.348714  3280 raft_consensus.cc:2410] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:36.349751  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.353111  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.354490  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.355618  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:36.356277  3279 raft_consensus.cc:2368] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9.
I20260709 13:16:36.357724  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:36.358458  3128 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:36.349236  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.361044  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:36.340583  5699 consensus_meta.cc:287] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.023s	user 0.014s	sys 0.001s
I20260709 13:16:36.367837  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.379650  3284 raft_consensus.cc:2393] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:36.282531  5817 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:16:36.374199  3277 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 3.
I20260709 13:16:36.286837  5254 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:16:36.342012  5426 raft_consensus.cc:697] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:36.286319  5865 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:16:36.375696  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:36.389120  3278 raft_consensus.cc:2410] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:36.376101  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.376288  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.391331  3835 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:36.392134  3281 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:36.392437  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:36.366165  5728 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.338680  5778 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:16:36.371349  3285 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:36.383328  3277 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:36.385777  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.419713  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.420614  3277 raft_consensus.cc:2410] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:16:36.385871  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 172218us
I20260709 13:16:36.340914  5853 raft_consensus.cc:697] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:36.341462  5564 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:36.357893  5708 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.376677  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.427373  3283 raft_consensus.cc:2410] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:36.395323  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:36.395751  3157 debug-util.cc:398] Leaking SignalData structure 0x7b08003335e0 after lost signal to thread 2028
I20260709 13:16:36.380481  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.428809  3284 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:36.429847  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:36.431051  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.432410  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.390391  3280 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:36.398674  3128 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:36.402199  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:36.402865  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.404776  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:36.414258  5728 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:36.414918  5465 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:36.433831  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.414535  5665 consensus_queue.cc:260] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:36.384833  5699 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.421429  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:36.423110  5776 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.422662  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.454315  3279 raft_consensus.cc:2368] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 6. Current term is 7.
I20260709 13:16:36.395210  5846 raft_consensus.cc:697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:36.426036  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:36.443660  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 48440.5us
I20260709 13:16:36.459064  3277 raft_consensus.cc:2368] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9.
I20260709 13:16:36.459769  3805 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:36.459861  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.460047  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:36.460943  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.461163  3836 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:16:36.336001  3129 rpcz_store.cc:269] 0709 13:16:33.055572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.262220 (+206648us) service_pool.cc:224] Handling call
0709 13:16:36.311210 (+3048990us) spinlock_profiling.cc:243] Waited 99.7 ms on lock 0x7b54000e2ed4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:36.317410 (+  6200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229415680}
I20260709 13:16:36.434886  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:36.446313  3280 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:36.437160  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:36.462373  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:36.462903  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:36.315052  5198 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.455348  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.447721  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.463480  3136 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.464088  3279 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:36.423717  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:36.464535  3285 raft_consensus.cc:2410] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:36.426698  5733 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.439152  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:36.435457  3130 raft_consensus.cc:2393] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:36.456837  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:36.467648  5795 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.467820  5254 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:36.467922  5812 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.468186  5795 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:36.414535  5426 consensus_queue.cc:237] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:36.443046  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.462736  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:36.395848  5647 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:36.458249  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.442922  5708 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:36.442611  5868 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:16:36.439775  5564 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:36.433068  3284 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:36.463371  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:36.477656  3278 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:16:36.620795  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.534245  3157 debug-util.cc:398] Leaking SignalData structure 0x7b08003582e0 after lost signal to thread 3068
W20260709 13:16:36.662484  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.489153  3136 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:36.531226  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:36.465715  5603 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:36.574681  3133 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:36.521008  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1112) took 3541 ms. Trace:
I20260709 13:16:36.466161  5665 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:36.538596  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 81905.2us
I20260709 13:16:36.677790  3101 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:36.578315  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2207) took 2958 ms. Trace:
I20260709 13:16:36.678850  3282 rpcz_store.cc:276] 0709 13:16:33.619639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.619899 (+   260us) service_pool.cc:224] Handling call
0709 13:16:33.620250 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.719319 (+1099069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.577806 (+1858487us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001e00d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:36.578182 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2480685312}
W20260709 13:16:36.655650  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 394921us
W20260709 13:16:36.573577  3131 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1111) took 3594 ms (client timeout 2007 ms). Trace:
I20260709 13:16:36.642939  3841 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:36.580272  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:16:36.476485  5867 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:16:36.669589  3128 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:16:36.668815  3134 rpcz_store.cc:276] 0709 13:16:32.979609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.914465 (+934856us) service_pool.cc:224] Handling call
0709 13:16:36.314914 (+2400449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.315152 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.315178 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.330357 (+ 15179us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.434072 (+103715us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:36.434109 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.434593 (+   484us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.519331 (+ 84738us) raft_consensus.cc:1685] finished
0709 13:16:36.519360 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.520741 (+  1381us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b54000e2ed0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:36.520941 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5498389760,"thread_start_us":67364,"threads_started":1,"wal-append.queue_time_us":114601}
I20260709 13:16:36.664822  3136 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:36.530169  5778 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:36.666914  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.528499  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:36.692577  3834 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:36.688959  5254 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:16:36.528147  5861 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:36.681859  3131 rpcz_store.cc:269] 0709 13:16:32.979319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.025338 (+ 46019us) service_pool.cc:224] Handling call
0709 13:16:36.573302 (+3547964us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b5400068bd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:36.573480 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4626898688}
W20260709 13:16:36.574266  5746 consensus_meta.cc:287] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.361s	user 0.012s	sys 0.005s
I20260709 13:16:36.521032  5728 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:36.689208  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.664912  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 133766us
I20260709 13:16:36.579636  5231 raft_consensus.cc:3055] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:36.517906  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:36.566944  3833 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:16:36.685210  5865 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:36.459055  5776 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:36.680217  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.693400  5795 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:36.679977  3101 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:36.668119  5603 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.591504  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:36.670508  5781 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:36.567790  5583 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.702131  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:36.712239  3833 pending_rounds.cc:85] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 7
I20260709 13:16:36.738319  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:36.696445  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:36.474282  5812 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:36.707480  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 169287us
I20260709 13:16:36.749224  5627 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:36.749900  5627 raft_consensus.cc:697] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:36.750870  5627 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:36.710114  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:36.472532  5733 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.714015  3102 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:36.754923  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 44930.6us
W20260709 13:16:36.682348  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.709156  5231 raft_consensus.cc:740] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:36.718030  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 258320us
I20260709 13:16:36.668139  5647 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:36.722399  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:36.742112  3204 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:36.758265  3805 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:36.759857  3842 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:36.714795  5865 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:36.755272  3102 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:36.711675  5726 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 13:16:36.729905  5799 consensus_meta.cc:287] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.563s	user 0.012s	sys 0.001s
I20260709 13:16:36.525399  5846 consensus_queue.cc:237] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.636000  5853 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.721540  5603 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:36.716243  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.760689  3805 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:36.766995  3204 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:36.732568  3833 pending_rounds.cc:107] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:16:36.711127  5746 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.773029  3176 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:36.731736  5881 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:36.770534  5887 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:36.771028  5870 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:36.771369  5865 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.733429  5583 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.770680  5781 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:36.782215  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:36.779973  5881 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:36.784428  5861 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:36.785204  5564 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:36.778024  3833 raft_consensus.cc:2889] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:36.801257  3276 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:36.773851  5795 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:16:36.795413  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:36.796231  3279 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:36.795056  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:36.775651  5799 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.815104  3842 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:36.798555  5699 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:36.801028  5868 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:36.799752  5881 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:36.806253  5781 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:36.803969  5887 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:36.788308  5231 consensus_queue.cc:260] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.825590  5733 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:36.815088  5763 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:36.814559  5883 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:36.823738  5868 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:36.800678  5647 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:36.835173  5647 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.830782  5763 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:36.833892  5883 raft_consensus.cc:697] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:36.835773  5868 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:36.881558  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 108375us
W20260709 13:16:36.883922  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 161465us
I20260709 13:16:36.885690  3101 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:36.887820  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 132487us
W20260709 13:16:36.890949  3176 leader_election.cc:336] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.517s (SENT)
W20260709 13:16:36.742532  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 46231.6us
I20260709 13:16:36.911255  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:36.916049  5254 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:36.829907  5887 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.921766  5628 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:36.842396  5883 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.923082  5870 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:36.924661  5795 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.926440  5746 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:36.929104  5583 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:36.929983  5418 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:36.939888  5418 raft_consensus.cc:697] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:36.929440  5868 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.832718  5231 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.840564  5763 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.937444  5628 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:36.942530  3176 leader_election.cc:336] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.525s (SENT)
I20260709 13:16:36.937731  5254 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.948506  5254 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.946573  5628 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:36.951620  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.953446  5795 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:36.956233  5868 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:36.957943  5870 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.962829  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 290) took 2139 ms. Trace:
I20260709 13:16:36.963348  3133 rpcz_store.cc:276] 0709 13:16:34.823095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.407362 (+584267us) service_pool.cc:224] Handling call
0709 13:16:36.574465 (+1167103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.668439 (+ 93974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.962331 (+293892us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400068bd0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:36.962573 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2682596096}
I20260709 13:16:36.964643  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:36.966297  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47914.1us
I20260709 13:16:36.967391  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:36.953449  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.975549  5781 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:36.976675  5781 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.804244  5861 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.849687  5865 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:36.968825  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:36.981006  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 289) took 2158 ms. Trace:
I20260709 13:16:36.996281  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 281) took 1513 ms. Trace:
I20260709 13:16:36.987475  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 2301) took 1059 ms. Trace:
I20260709 13:16:37.005560  5871 raft_consensus.cc:2764] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:37.029299  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:37.030156  3202 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:37.030483  3205 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 2.
I20260709 13:16:37.032153  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:37.033226  3206 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:37.033592  5640 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:37.033747  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:37.034471  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:37.035375  3210 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:37.036371  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:16:37.036526  3157 debug-util.cc:398] Leaking SignalData structure 0x7b080021fb20 after lost signal to thread 3160
I20260709 13:16:37.038173  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:37.038892  3203 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:37.040000  3842 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.041339  5871 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:37.043928  5861 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:37.006357  3837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 467) took 2187 ms. Trace:
W20260709 13:16:37.038910  3157 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2ee0 after lost signal to thread 3235
I20260709 13:16:37.016584  3276 rpcz_store.cc:276] 0709 13:16:35.482705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.648625 (+165920us) service_pool.cc:224] Handling call
0709 13:16:35.648909 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.801816 (+1152907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.995694 (+193878us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400319554. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:36.996033 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2646044544}
I20260709 13:16:37.022485  3281 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:37.018050  3204 rpcz_store.cc:276] 0709 13:16:35.927521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.701790 (+774269us) service_pool.cc:224] Handling call
0709 13:16:36.986971 (+285181us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54002a71d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:36.987203 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45795712}
I20260709 13:16:37.014063  3132 rpcz_store.cc:276] 0709 13:16:34.822855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.240438 (+417583us) service_pool.cc:224] Handling call
0709 13:16:35.944247 (+703809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.944893 (+   646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.980494 (+1035601us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b54003dbb50. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:36.980779 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1617372032}
W20260709 13:16:37.054545  3157 debug-util.cc:398] Leaking SignalData structure 0x7b0800037b60 after lost signal to thread 3236
I20260709 13:16:37.009495  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:36.993546  5799 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:37.061305  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.048130  5746 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
W20260709 13:16:37.066066  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.066449  3157 debug-util.cc:398] Leaking SignalData structure 0x7b08000ed760 after lost signal to thread 3309
W20260709 13:16:37.066867  3157 debug-util.cc:398] Leaking SignalData structure 0x7b08003db420 after lost signal to thread 3310
W20260709 13:16:37.068673  3157 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1700 after lost signal to thread 3867
W20260709 13:16:37.069053  3157 debug-util.cc:398] Leaking SignalData structure 0x7b08003d18a0 after lost signal to thread 3868
I20260709 13:16:37.073899  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:37.074570  3157 debug-util.cc:398] Leaking SignalData structure 0x7b0800378ca0 after lost signal to thread 5754
I20260709 13:16:37.074798  5708 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:37.075139  3277 raft_consensus.cc:2410] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:36.989529  5627 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:37.080667  3203 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:37.081158  3203 pending_rounds.cc:85] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 2
I20260709 13:16:37.081445  3203 pending_rounds.cc:107] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:37.081616  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:37.083953  3206 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: [3.5-6.6]
I20260709 13:16:37.081836  3203 raft_consensus.cc:2889] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:37.069219  5865 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:37.084839  5768 raft_consensus.cc:3055] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:37.040024  5887 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:37.100083  3842 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:37.048623  3837 rpcz_store.cc:276] 0709 13:16:34.819061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.839345 (+ 20284us) service_pool.cc:224] Handling call
0709 13:16:35.257187 (+417842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.258044 (+   857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.005819 (+1747775us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b5400475250. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:37.006115 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":869721472}
I20260709 13:16:37.123925  3132 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:16:37.124410  3132 pending_rounds.cc:85] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 8
I20260709 13:16:37.124733  3132 pending_rounds.cc:107] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:16:36.989995  5418 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:37.124857  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:37.125051  3132 raft_consensus.cc:2889] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:37.124411  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:37.124922  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:37.126552  3127 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:37.127059  3133 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:37.131635  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:37.088086  5795 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:37.087900  5768 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:37.144928  3281 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:16:37.145915  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 212527us
I20260709 13:16:37.148802  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:37.153584  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:37.156291  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:37.157601  3280 raft_consensus.cc:2410] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:37.158053  5881 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:37.162660  5881 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:37.169739  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 201114us
I20260709 13:16:37.177997  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:37.179631  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:37.147390  5781 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:37.180629  3176 leader_election.cc:336] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.534s (SENT)
I20260709 13:16:37.183275  3277 raft_consensus.cc:2410] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:37.156540  3276 raft_consensus.cc:2410] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:37.186290  5871 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:37.186750  5871 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:37.180670  3129 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:37.192770  5768 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:37.194571  5768 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:37.197402  5776 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:37.199208  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:37.205461  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.207055  3281 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 4.
I20260709 13:16:37.212314  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:37.215519  5881 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:37.215834  3832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 604) took 1206 ms. Trace:
I20260709 13:16:37.216126  5881 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:37.216343  3832 rpcz_store.cc:276] 0709 13:16:36.009462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.009661 (+   199us) service_pool.cc:224] Handling call
0709 13:16:36.009979 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.193800 (+183821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.215216 (+1021416us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400639cd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:37.215592 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280673152}
I20260709 13:16:37.223570  5647 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:37.224272  5607 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:37.225548  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1367) took 1121 ms. Trace:
I20260709 13:16:37.225854  5647 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:37.225972  3135 rpcz_store.cc:276] 0709 13:16:36.103796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.116345 (+ 12549us) service_pool.cc:224] Handling call
0709 13:16:37.225143 (+1108798us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000686d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:37.225340 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2434241792}
I20260709 13:16:37.227322  5887 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:37.229614  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:37.216626  5881 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:37.233443  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:37.238538  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:37.179777  5603 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:37.203898  5865 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.267129  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.267441  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:37.271504  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:37.247625  5776 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.276937  3842 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
W20260709 13:16:37.278056  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.278647  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 95348.6us
I20260709 13:16:37.279556  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:37.270418  3033 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38234 (request call id 259) took 12979 ms (client timeout 15000 ms). Trace:
I20260709 13:16:37.268416  5640 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 13:16:37.289237  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.290130  3279 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:37.299945  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:37.302351  5644 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:37.303395  5861 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:37.304523  5861 raft_consensus.cc:3055] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:37.305971  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:37.308686  3280 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:37.311841  3134 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:37.312083  5871 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:37.313488  5887 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.313858  5871 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:37.314245  5887 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:37.304868  5861 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:37.310047  3285 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:37.322129  3207 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:37.323438  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:37.329362  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.329448  3211 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:16:37.329993  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.330493  5426 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.331144  5426 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:37.331794  3207 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:16:37.332665  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.333669  5665 consensus_meta.cc:287] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.655s	user 0.012s	sys 0.007s
I20260709 13:16:37.333545  5746 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.334355  5746 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:37.337591  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:37.316301  5776 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:37.338944  3282 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:37.337543  5812 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:37.329782  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:37.340580  5776 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:37.340344  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 67589.5us
I20260709 13:16:37.341058  3209 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:37.343951  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:37.285851  3033 rpcz_store.cc:269] 0709 13:16:24.219103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.220277 (+  1174us) service_pool.cc:224] Handling call
0709 13:16:37.198632 (+12978355us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:29.423859 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:29.470019 (+ 46160us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:29.470085 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:16:29.470128 (+    43us) tablet.cc:662] Decoding operations
0709 13:16:29.472128 (+  2000us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:29.472263 (+   135us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:29.472303 (+    40us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:16:29.749213 (+276910us) tablet.cc:701] Row locks acquired
0709 13:16:29.778912 (+ 29699us) write_op.cc:260] PREPARE: finished
0709 13:16:29.813509 (+ 34597us) write_op.cc:270] Start()
0709 13:16:29.813720 (+   211us) write_op.cc:276] Timestamp: P: 1783602989813427 usec, L: 0
0709 13:16:29.813768 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:16:29.814634 (+   866us) log.cc:844] Serialized 6341 byte log entry
0709 13:16:30.661629 (+846995us) op_driver.cc:464] REPLICATION: finished
0709 13:16:31.291849 (+630220us) write_op.cc:301] APPLY: starting
0709 13:16:31.291959 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:31.316929 (+ 24970us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:31.340739 (+ 23810us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:31.524786 (+184047us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:31.525200 (+   414us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:16:31.525274 (+    74us) write_op.cc:312] APPLY: finished
0709 13:16:31.525702 (+   428us) log.cc:844] Serialized 113 byte log entry
0709 13:16:31.526796 (+  1094us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:31.526958 (+   162us) write_op.cc:454] Released schema lock
0709 13:16:31.527027 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:31.527499 (+   472us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:31.527525 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3122,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":592853,"apply.run_cpu_time_us":6046,"apply.run_wall_time_us":235661,"num_ops":16,"prepare.queue_time_us":198072,"prepare.run_cpu_time_us":30246,"prepare.run_wall_time_us":728455,"raft.queue_time_us":232248,"raft.run_cpu_time_us":21707,"raft.run_wall_time_us":294820,"replication_time_us":847641,"thread_start_us":853781,"threads_started":4,"wal-append.queue_time_us":501142,"wal-append.run_cpu_time_us":18605,"wal-append.run_wall_time_us":2193813}]]}
I20260709 13:16:37.350010  5465 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.350662  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:37.380383  5254 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:37.381029  5905 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.069s	user 0.004s	sys 0.000s
I20260709 13:16:37.352073  5865 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:37.383041  5254 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:37.383863  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:37.384632  5812 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.385566  5865 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:37.385327  5812 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:37.386439  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:37.387682  5812 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:37.355654  5763 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:37.359155  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.388460  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.389662  3177 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:37.390161  5746 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:37.390812  3207 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:37.391459  5812 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:37.391763  3281 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:37.354812  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:37.380159  5776 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.390060  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:37.395478  3282 raft_consensus.cc:2410] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:37.397055  3210 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:37.392346  5812 raft_consensus.cc:697] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 5 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:37.400554  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:37.405876  3837 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:37.406952  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:37.407754  3211 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.390825  5746 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:16:37.415269  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:37.416872  3209 raft_consensus.cc:2393] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:37.417802  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:37.418517  3209 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:37.419466  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:37.419696  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:37.432155  3277 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:37.440063  3211 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:37.439916  3280 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:37.434864  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:37.452273  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 46962.8us
I20260709 13:16:37.458761  3207 raft_consensus.cc:2410] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:16:37.460053  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.403579  5603 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:37.472198  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:37.400295  5465 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:37.479038  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:37.483338  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.466703  5426 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:37.488379  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.459903  5776 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:37.494691  5231 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:37.498039  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:37.495797  5628 consensus_meta.cc:287] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.027s
I20260709 13:16:37.519045  5628 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:37.505807  5644 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:37.506328  5901 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.281s	user 0.000s	sys 0.002s
I20260709 13:16:37.510088  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:37.509902  5231 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:37.513190  5776 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:37.517357  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:37.517928  5881 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:37.521214  3206 raft_consensus.cc:2393] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:16:37.530953  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.534626  3204 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:37.538019  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:37.532927  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:37.550734  5776 consensus_queue.cc:1059] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:37.551740  5465 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:37.552098  5776 raft_consensus.cc:3055] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:37.552549  5776 raft_consensus.cc:740] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:37.552919  5628 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:37.553416  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:37.553557  5776 consensus_queue.cc:260] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:37.554143  3835 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:37.554896  5881 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:37.555032  3841 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:16:37.556181  5846 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.555009  5776 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.557022  5846 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:37.559576  5846 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:37.555173  3202 raft_consensus.cc:2393] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:37.493558  5861 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:37.566095  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:37.579643  3210 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:37.560408  5426 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:37.584434  5746 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:16:37.598069  5861 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:37.601485  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 96173.8us
I20260709 13:16:37.602525  3101 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:37.604215  3101 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:37.605368  5603 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:37.605834  5603 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.606244  5603 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.607569  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:37.608321  3205 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
W20260709 13:16:37.610780  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 318757us
W20260709 13:16:37.615181  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 124704us
I20260709 13:16:37.617974  5426 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:37.618544  5426 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:37.634704  3207 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:37.635239  5776 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.635381  5881 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:37.636586  3207 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:37.636081  5776 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:37.637384  5628 consensus_queue.cc:1059] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:37.638963  5817 raft_consensus.cc:3055] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:37.639357  5817 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:37.585745  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:37.624506  3211 raft_consensus.cc:1240] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:16:37.643361  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:37.648438  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.616990  3203 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:37.523697  5812 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:37.654701  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:37.658835  3841 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:37.665271  5781 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.666554  5916 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:16:37.666177  5781 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:37.670491  5781 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:37.670976  3134 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:37.672260  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:37.665328  3206 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:37.679638  3209 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:37.697746  3135 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:37.673383  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:37.655471  3204 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:37.673153  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:37.701041  3211 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:37.655993  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:37.711021  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 61741.7us
I20260709 13:16:37.703502  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:37.672554  3176 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.753s (SENT) [suppressed 45 similar messages]
W20260709 13:16:37.709004  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.679421  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:37.707986  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:37.722579  3203 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:37.673682  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:37.724948  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 52437.1us
I20260709 13:16:37.729528  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:37.731798  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:37.732059  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 58853.4us
I20260709 13:16:37.733417  3805 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:37.734903  5926 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.735539  3209 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:37.735924  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:37.738677  5768 consensus_meta.cc:287] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.544s	user 0.015s	sys 0.000s
I20260709 13:16:37.739329  3207 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:37.678597  5817 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:37.740590  3284 raft_consensus.cc:2410] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:37.683081  5763 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:37.749356  3203 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:37.754144  3206 raft_consensus.cc:2393] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:37.755525  3282 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:16:37.746040  5846 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:37.768973  3202 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:37.755921  3282 pending_rounds.cc:85] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 6
I20260709 13:16:37.770046  3282 pending_rounds.cc:107] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:16:37.770393  3282 raft_consensus.cc:2889] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:37.723871  5887 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:37.778420  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:37.779162  3281 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
W20260709 13:16:37.789258  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.799916  5817 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:37.804126  5231 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:37.740993  5628 consensus_queue.cc:1059] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 13:16:37.829401  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.753480  5881 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:16:37.735561  5926 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:37.849514  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 75213us
I20260709 13:16:37.866215  3278 raft_consensus.cc:3055] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:37.866720  3278 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:37.867689  3278 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:37.869625  3278 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:37.897138  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.900830  3279 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:37.909927  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:37.925869  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.928885  5861 consensus_queue.cc:1059] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:37.930162  5861 raft_consensus.cc:3055] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:37.930605  5861 raft_consensus.cc:740] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:37.935196  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:37.938513  5926 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:37.942442  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.951767  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 51153.2us
I20260709 13:16:37.872700  5231 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:16:37.956542  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.946980  3806 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:37.915962  5426 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:37.963718  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 103579us
I20260709 13:16:37.964043  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:37.965261  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:37.965394  3281 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:37.966127  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:37.971235  3282 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
W20260709 13:16:37.972982  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.012356  3278 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:37.974102  5846 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:38.029387  3210 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:38.035419  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:38.027124  5871 consensus_meta.cc:287] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.713s	user 0.017s	sys 0.004s
W20260709 13:16:38.029356  5931 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 13:16:38.045683  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 137271us
W20260709 13:16:38.047036  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.062331  3282 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:38.063795  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:38.064541  3282 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:38.073451  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.073793  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:37.982676  5795 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:16:38.040882  5846 raft_consensus.cc:697] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:38.031256  5853 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:16:37.981411  5861 consensus_queue.cc:260] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:38.060222  5231 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:38.091529  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.060722  5871 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:38.076646  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.050318  5887 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:38.100096  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.100672  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 88869us
W20260709 13:16:38.101188  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 102192us
W20260709 13:16:38.104389  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 119035us
I20260709 13:16:38.109236  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:38.109684  5846 consensus_queue.cc:237] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:38.110229  3283 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:38.110144  3130 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:38.111482  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:38.125823  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:38.127553  3283 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:38.090867  5603 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:38.138356  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:38.144066  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:38.113003  5887 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:38.117944  5231 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:38.119701  5885 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.160s
I20260709 13:16:38.134883  5426 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:38.117481  5768 consensus_queue.cc:1059] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:16:38.155583  5932 log.cc:927] Time spent T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.092s	user 0.001s	sys 0.001s
I20260709 13:16:38.158903  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:38.121182  5871 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:38.156081  5940 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.166419  5899 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:16:38.167562  5885 consensus_queue.cc:1243] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer 48080cf0460346769ab046a4f9457aa5 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:38.159173  5795 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:38.181648  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:38.184661  3278 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
W20260709 13:16:38.198110  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 74556.5us
W20260709 13:16:38.199288  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.201934  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:38.202095  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:38.205627  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:38.220196  3278 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.226621  3133 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:38.236289  3283 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:38.234020  3134 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:38.248413  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:38.234694  5940 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:38.253765  5746 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:38.254845  5746 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:38.261001  5231 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:38.263350  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:38.265337  3176 leader_election.cc:400] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 6. Current term is 7.
I20260709 13:16:38.265671  3176 leader_election.cc:403] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:38.266953  3176 leader_election.cc:400] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9.
I20260709 13:16:38.267967  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:38.269006  5776 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:38.269841  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:38.270591  3135 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:38.271203  5733 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:38.271600  5733 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:38.271776  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:38.273839  3134 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:16:38.274699  5925 log.cc:927] Time spent T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.647s	user 0.006s	sys 0.000s
I20260709 13:16:38.274824  3131 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:16:38.275066  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:38.275974  3134 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:38.276026  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:38.273682  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:38.277199  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:38.272959  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:38.277886  3128 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:38.278172  3132 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:38.277316  3136 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:38.279269  3127 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:38.279577  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:38.280179  3135 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:38.280251  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:38.287077  3278 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:38.290793  3284 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:38.273633  5795 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:38.237630  5952 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:38.273561  5885 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 6. Current term is 7.
W20260709 13:16:38.305934  5932 log.cc:927] Time spent T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:16:38.309587  3806 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:38.272600  5733 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:38.329545  5733 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:38.330044  5939 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:16:38.314365  5899 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:16:38.334619  5883 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:38.335217  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:38.336901  5853 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:38.337322  5853 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:38.329540  5936 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:16:38.337862  5853 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:38.341351  5603 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:38.337314  5950 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:16:38.348623  5883 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:38.354626  5943 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:38.355346  5943 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:38.357267  5746 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:38.357123  5887 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:38.358129  5746 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:38.349503  5254 raft_consensus.cc:3055] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:38.350135  5768 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:38.363839  3282 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:38.367045  5940 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:38.375326  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:38.364313  5254 raft_consensus.cc:740] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:38.386417  5254 consensus_queue.cc:260] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:38.388010  5254 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:38.391580  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 80375.4us
I20260709 13:16:38.392509  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:38.393343  5795 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:38.397673  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.398187  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.402793  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.405686  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.417496  3282 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:16:38.419914  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 218058us
W20260709 13:16:38.428546  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 288499us
I20260709 13:16:38.432053  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:38.432790  3840 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:38.434669  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:38.418524  5817 consensus_meta.cc:287] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.005s
I20260709 13:16:38.413898  5861 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:38.422679  3249 connection.cc:256] RPC call timeout handler was delayed by -2.510401752000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 13:16:38.445184  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:38.447575  3249 connection.cc:256] RPC call timeout handler was delayed by -2.357401751999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 13:16:38.449319  3249 connection.cc:256] RPC call timeout handler was delayed by -2.3250017519999346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
W20260709 13:16:38.449631  3249 connection.cc:256] RPC call timeout handler was delayed by -2.25570175200005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
W20260709 13:16:38.449918  3249 connection.cc:256] RPC call timeout handler was delayed by -2.2107017519999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
W20260709 13:16:38.450215  3249 connection.cc:256] RPC call timeout handler was delayed by -2.1864017519999379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
W20260709 13:16:38.450519  3249 connection.cc:256] RPC call timeout handler was delayed by -1.9533017520000158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
I20260709 13:16:38.419111  5943 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:38.377604  5768 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:38.459529  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:38.422616  5887 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.471007  3034 catalog_manager.cc:5697] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 3 to 4, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 4 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:38.471982  5887 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:38.474296  5887 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:38.475930  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:38.479866  5960 consensus_queue.cc:1059] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:38.480973  5776 raft_consensus.cc:3055] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:38.481309  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:38.481429  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:38.471314  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:38.469388  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:38.473503  3034 catalog_manager.cc:5697] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 4 to 6, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 6 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:16:38.485826  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:38.487336  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:38.488106  3205 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:38.376678  5952 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:38.489405  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 95519.7us
I20260709 13:16:38.491807  3842 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:16:38.493637  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 61708.3us
I20260709 13:16:38.492990  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:38.478400  5926 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:38.497723  3203 raft_consensus.cc:2376] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6. Re-sending same reply.
I20260709 13:16:38.524622  3840 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:38.519862  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:38.522327  3202 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:38.520323  3282 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:38.470230  5871 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:38.438896  5853 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:38.481429  5776 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:38.531654  3034 catalog_manager.cc:5697] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 4 to 7, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 7 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
W20260709 13:16:38.538688  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 110307us
W20260709 13:16:38.541391  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.562201  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:38.562665  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 79999.2us
W20260709 13:16:38.564458  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.521342  5943 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:38.592730  3034 catalog_manager.cc:5697] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 2 to 5, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 5 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:16:38.596688  5943 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.598106  5943 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:38.603371  3034 catalog_manager.cc:5697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 4 to 5, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 5 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:16:38.605772  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.607215  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:38.604905  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:38.613200  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.609943  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 173797us
I20260709 13:16:38.622717  3840 raft_consensus.cc:1240] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:38.611166  3202 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:38.626730  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.627434  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.630290  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:38.631806  3203 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: [3.5-6.6]
I20260709 13:16:38.626824  3034 catalog_manager.cc:5697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 4 to 5, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 5 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:38.635936  3281 consensus_meta.cc:287] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.663s	user 0.017s	sys 0.002s
I20260709 13:16:38.641230  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:38.642112  3208 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.642869  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:38.646124  5956 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:16:38.646345  5961 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:38.647823  5953 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:16:38.647326  5961 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:38.649960  5951 log.cc:927] Time spent T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:38.662590  3202 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:38.565606  5871 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:16:38.666379  5768 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:38.605882  5959 raft_consensus.cc:3055] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:38.664474  5952 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:38.667218  5959 raft_consensus.cc:740] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:38.649988  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 96369.2us
I20260709 13:16:38.674571  3101 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:38.675978  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:38.681195  3205 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:38.688582  3101 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:38.672585  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 111059us
I20260709 13:16:38.636348  3281 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
W20260709 13:16:38.721930  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.727421  3282 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
W20260709 13:16:38.646184  5954 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:16:38.757827  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:38.670194  5733 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.772756  5768 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:38.772539  5733 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:38.775339  5733 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:38.757833  5955 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:38.753188  5628 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:38.777366  5776 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:38.778846  5776 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:38.782478  5853 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:38.786351  5961 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:38.627872  5963 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:38.769089  3277 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:38.800132  3840 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:16:38.815675  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 127167us
I20260709 13:16:38.809547  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:38.816473  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:38.828708  3276 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:38.668507  5959 consensus_queue.cc:260] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:38.824931  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:38.831701  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:38.824396  5846 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:38.835543  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 281772us
I20260709 13:16:38.838557  5846 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:38.839965  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:38.837554  3209 raft_consensus.cc:2410] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:38.825759  3034 catalog_manager.cc:5697] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 2 to 3, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.842159  5846 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:38.848433  5846 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:38.849069  5846 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:38.846648  3834 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:38.843714  3034 catalog_manager.cc:5697] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 4 to 6, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 6 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:38.796868  5963 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:38.859763  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 87637.2us
I20260709 13:16:38.863750  3034 catalog_manager.cc:5697] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:38.858566  5954 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:16:38.791749  5952 consensus_queue.cc:1059] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:16:38.831359  5628 raft_consensus.cc:697] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:38.884379  3250 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:38.884603  5966 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:38.886588  5940 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:38.886986  5733 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:38.887437  5949 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:38.887625  5733 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:38.888130  5940 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:38.889909  5733 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:38.884444  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 44656us
I20260709 13:16:38.891902  3250 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:38.892450  5465 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:38.893256  5942 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:38.892885  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 119785us
W20260709 13:16:38.910933  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.913920  5887 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:16:38.915256  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.897307  3842 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:16:38.920485  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.892602  3100 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:38.929111  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:38.862033  5963 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:38.934177  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.945397  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:38.947911  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.950623  3100 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:16:38.931290  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 114859us
I20260709 13:16:38.951967  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:38.955317  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:38.874388  5768 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:38.958528  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:38.959733  5965 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:38.960230  5965 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.960583  5965 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:38.963044  3203 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:16:38.964469  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.966024  3101 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:38.969583  5942 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:38.970528  3034 catalog_manager.cc:5697] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 3 to 6, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 6 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:38.973701  5943 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:38.975978  3205 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:38.894325  5969 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.978440  3208 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:38.982034  3101 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:38.972693  3034 catalog_manager.cc:5697] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 3 to 4, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 4 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.894976  5881 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.894709  5964 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.910488  5959 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:38.984992  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 56027.2us
W20260709 13:16:38.986075  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.947299  5961 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:38.947599  5846 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:38.944180  5871 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:38.994490  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.980273  5733 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:39.003367  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 212022us
I20260709 13:16:39.002010  5973 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:38.956601  5768 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:39.000528  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:39.009900  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 79438.5us
I20260709 13:16:39.010380  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:39.002046  5949 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:38.961501  5795 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:16:38.990104  5942 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:39.006273  3034 catalog_manager.cc:5697] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 4, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 4 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:16:39.007406  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:39.026093  3100 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:39.051821  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 60207.1us
I20260709 13:16:39.005271  5961 raft_consensus.cc:697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:39.013414  5817 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:39.005343  5943 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:38.992427  5881 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:39.059434  3177 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
W20260709 13:16:39.069901  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.002796  5969 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:39.090787  3034 catalog_manager.cc:5697] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 2 to 3, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.099483  3034 catalog_manager.cc:5697] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.058458  5871 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:39.052501  5949 raft_consensus.cc:697] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:39.104121  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45971.2us
W20260709 13:16:39.104979  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.105317  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 104871us
I20260709 13:16:39.057534  5942 raft_consensus.cc:697] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:39.114408  5985 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:16:39.112891  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:39.003178  5964 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:39.066505  5817 raft_consensus.cc:697] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:39.111177  5997 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.117578  5870 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:39.164594  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 55993.1us
W20260709 13:16:39.165051  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 52254us
W20260709 13:16:39.166905  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 149380us
I20260709 13:16:39.042336  5628 consensus_queue.cc:237] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:39.168278  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 166060us
I20260709 13:16:39.170046  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:39.129587  5799 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:39.120787  5871 raft_consensus.cc:697] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:39.171548  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:39.185339  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 187137us
W20260709 13:16:39.195379  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.180387  5426 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:39.203805  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:39.204697  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 145334us
W20260709 13:16:39.205153  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 51495.8us
I20260709 13:16:39.182711  5870 raft_consensus.cc:697] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:39.187247  5733 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:39.185299  5940 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:39.175690  5865 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:16:39.242951  3249 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:39.244089  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.220197  3279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:16:39.245004  3279 raft_consensus.cc:606] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:16:39.245489  3279 raft_consensus.cc:614] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:39.202538  5254 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:39.230633  3204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.016s	sys 0.029s
W20260709 13:16:39.249820  3204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.017s	sys 0.030s
I20260709 13:16:39.179039  5961 consensus_queue.cc:237] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:39.258294  5980 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:16:39.175295  5817 consensus_queue.cc:237] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:39.260270  5998 log.cc:927] Time spent T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:16:39.221792  5733 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.278205  5733 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:39.263895  6003 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:39.264408  5966 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:16:39.264621  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 60967.6us
I20260709 13:16:39.209671  5949 consensus_queue.cc:237] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:39.265309  5982 log.cc:927] Time spent T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
W20260709 13:16:39.265980  5979 log.cc:927] Time spent T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 13:16:39.266784  5993 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:16:39.268857  5960 raft_consensus.cc:3055] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:39.167533  5997 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:39.283541  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 95639.4us
W20260709 13:16:39.296849  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 125510us
I20260709 13:16:39.312080  3101 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:39.282496  5926 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:39.333491  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:39.337878  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:39.317811  3020 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8e1a4d71ef0f4287999b5ee60fe02740 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:16:39.339505  3020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 97551.6us
I20260709 13:16:39.345784  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:39.349011  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 136021us
I20260709 13:16:39.310406  5960 raft_consensus.cc:740] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:39.200693  5942 consensus_queue.cc:237] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:39.328282  5644 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.351284  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 311) took 1162 ms. Trace:
I20260709 13:16:39.353500  3207 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:39.355810  3283 rpcz_store.cc:276] 0709 13:16:38.189100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.413633 (+224533us) service_pool.cc:224] Handling call
0709 13:16:38.429829 (+ 16196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.597418 (+167589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.597610 (+   192us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.599326 (+  1716us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.761958 (+162632us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:38.762007 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.762069 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.351049 (+588980us) raft_consensus.cc:1685] finished
0709 13:16:39.351071 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.351213 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12736,"raft.queue_time_us":49390,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":315643,"threads_started":2,"wal-append.queue_time_us":422494}
I20260709 13:16:39.318122  5254 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:16:39.366771  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:39.367369  3205 raft_consensus.cc:1813] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Handling vote request from an unknown peer fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:39.367885  3205 raft_consensus.cc:2368] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7.
W20260709 13:16:39.367277  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 60581.8us
W20260709 13:16:39.369192  5986 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
W20260709 13:16:39.369907  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.370010  3279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
W20260709 13:16:39.371236  5994 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:16:39.371559  5974 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.370659  3249 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:39.372792  6002 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:39.330087  5871 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:39.376320  3279 raft_consensus.cc:606] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:16:39.380741  3279 raft_consensus.cc:614] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:39.377271  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2250) took 1315 ms. Trace:
I20260709 13:16:39.381410  3278 rpcz_store.cc:276] 0709 13:16:38.062066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.287970 (+225904us) service_pool.cc:224] Handling call
0709 13:16:38.288279 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.327445 (+ 39166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.327493 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.394705 (+ 67212us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.614656 (+219951us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:38.614708 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.614772 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.377032 (+762260us) raft_consensus.cc:1685] finished
0709 13:16:39.377052 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.377202 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4,"raft.queue_time_us":170352,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":5504,"thread_start_us":165215,"threads_started":1,"wal-append.queue_time_us":576075}
W20260709 13:16:39.371932  5984 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:16:39.378367  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:39.383985  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2251) took 1321 ms. Trace:
I20260709 13:16:39.383795  5965 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:39.384374  3284 rpcz_store.cc:276] 0709 13:16:38.062411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.303785 (+241374us) service_pool.cc:224] Handling call
0709 13:16:38.304432 (+   647us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.326684 (+ 22252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.326731 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.372467 (+ 45736us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.791673 (+419206us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:38.791719 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.791802 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.383752 (+591950us) raft_consensus.cc:1685] finished
0709 13:16:39.383773 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.383917 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":165643,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":397513,"threads_started":1,"wal-append.queue_time_us":598452}
I20260709 13:16:39.379462  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:39.352701  5881 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:39.362112  6005 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:39.385830  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:39.387406  5940 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:39.390491  5995 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:16:39.364243  6008 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:39.370553  5964 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:39.393795  5940 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:39.417971  5965 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:39.395784  6003 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:39.396226  5997 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:39.394397  5959 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:39.366226  5644 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:39.381460  5974 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:39.404469  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:39.407869  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45330.7us
I20260709 13:16:39.341949  5870 consensus_queue.cc:237] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:39.409403  5969 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:39.411664  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2253) took 1348 ms. Trace:
I20260709 13:16:39.432119  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:39.428011  3841 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:39.417243  5960 consensus_queue.cc:260] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:39.399113  5996 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:16:39.412833  5983 log.cc:927] Time spent T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.458s	user 0.001s	sys 0.002s
I20260709 13:16:39.418977  6010 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:39.437810  5644 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:39.445288  5865 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.450577  5988 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.234s	user 0.002s	sys 0.000s
W20260709 13:16:39.451911  5989 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.338s	user 0.003s	sys 0.000s
I20260709 13:16:39.432726  5943 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.457314  5940 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:39.468533  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 71521.4us
I20260709 13:16:39.469339  5960 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:39.469146  6005 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:39.468523  3129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:16:39.484336  3129 raft_consensus.cc:606] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:16:39.469872  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.485241  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.432734  3285 rpcz_store.cc:276] 0709 13:16:38.063042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.332896 (+269854us) service_pool.cc:224] Handling call
0709 13:16:38.333322 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.554800 (+221478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.554848 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.619921 (+ 65073us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.799173 (+179252us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:38.799211 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.799275 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.411343 (+612068us) raft_consensus.cc:1685] finished
0709 13:16:39.411372 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.411558 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26,"raft.queue_time_us":144460,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":59,"thread_start_us":369375,"threads_started":2,"wal-append.queue_time_us":278174}
W20260709 13:16:39.475404  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 88604.5us
W20260709 13:16:39.434645  5861 consensus_meta.cc:287] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.974s	user 0.007s	sys 0.007s
I20260709 13:16:39.481694  3176 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:39.422638  5881 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:16:39.508100  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:39.513149  3249 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:39.531836  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.535234  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.536571  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:39.541193  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 59575.4us
I20260709 13:16:39.545984  5254 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.546665  5254 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:39.548225  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:39.548444  5962 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:39.549427  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:39.549705  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:39.549885  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:39.550331  3134 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:39.551039  5959 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:39.551290  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:39.552119  5952 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:16:39.553361  5991 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.441s	user 0.003s	sys 0.000s
I20260709 13:16:39.553462  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:39.554482  5776 consensus_meta.cc:287] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.775s	user 0.013s	sys 0.000s
I20260709 13:16:39.549043  3128 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:39.552683  3135 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 8: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:39.554535  3136 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:39.558409  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:39.559068  3208 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:39.515444  5795 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:39.562188  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:39.483014  5943 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:39.484961  5865 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:39.585071  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:39.572041  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.571856  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:39.538067  5861 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.566164  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:39.586385  3130 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:39.572844  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:39.565518  5949 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.588451  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:39.597246  3250 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:16:39.598759  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.601210  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:39.601994  3136 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
W20260709 13:16:39.603221  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.603719  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.548991  5254 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:39.600375  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:39.616120  3135 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:39.620504  3276 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:16:39.622085  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 142680us
I20260709 13:16:39.557888  5965 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:16:39.631402  6009 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.633490  3250 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:39.636380  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:39.637041  3250 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:39.627727  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:39.638247  3276 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:39.641388  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:39.613641  5952 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:39.605098  5776 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:39.598378  5949 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:39.647599  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2341) took 1152 ms. Trace:
I20260709 13:16:39.654678  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:39.657572  3278 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:39.660876  3842 raft_consensus.cc:2410] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:16:39.658596  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 97466.6us
I20260709 13:16:39.660142  3204 rpcz_store.cc:276] 0709 13:16:38.485357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.490579 (+  5222us) service_pool.cc:224] Handling call
0709 13:16:38.527836 (+ 37257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.595586 (+ 67750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.595633 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.625914 (+ 30281us) log.cc:844] Serialized 26 byte log entry
0709 13:16:39.250343 (+624429us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:39.250403 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.250499 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.449855 (+199356us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:39.621332 (+171477us) raft_consensus.cc:1685] finished
0709 13:16:39.621353 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.637148 (+ 15795us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17563,"raft.queue_time_us":12414,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":12503,"spinlock_wait_cycles":10773888,"thread_start_us":587028,"threads_started":1,"wal-append.queue_time_us":491515}
I20260709 13:16:39.661792  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:39.657840  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:39.663245  3277 raft_consensus.cc:2410] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:39.634608  5974 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:39.600618  5861 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:39.682636  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:39.670370  3249 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:39.651428  5962 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:39.646849  6010 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:39.651026  5952 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:39.668540  5776 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.705209  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:39.706045  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:39.709860  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:39.672886  5959 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:39.639868  5733 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:39.646474  6009 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:39.679581  6001 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:39.729128  3281 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:39.703970  5962 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.703265  5254 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.707454  5978 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:39.753623  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 71116.6us
I20260709 13:16:39.739913  3280 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:39.720968  5776 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:39.714107  5952 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:39.750649  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 88995.9us
I20260709 13:16:39.752115  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:39.756877  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 106359us
I20260709 13:16:39.765825  3285 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:39.757459  3206 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:16:39.770622  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.774506  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.721580  5959 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:39.778694  3100 leader_election.cc:400] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7.
I20260709 13:16:39.779084  3100 leader_election.cc:403] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:39.756529  5978 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:39.780298  3278 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
W20260709 13:16:39.744194  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 141077us
I20260709 13:16:39.739030  6001 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:39.753810  5962 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:39.780000  5978 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:39.755311  5795 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.788364  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:39.788443  3100 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:39.793675  6023 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:39.795483  5795 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:39.797587  6027 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:39.798053  6027 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.798112  5795 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:39.798450  6027 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:39.799199  5885 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.799993  5885 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:39.801545  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 156709us
I20260709 13:16:39.769001  6008 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.784041  5959 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:39.817216  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:39.780491  5644 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:39.784287  5973 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.786757  6001 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:39.781380  5628 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:16:39.831362  3281 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:39.766592  5254 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:39.843956  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 88885.3us
W20260709 13:16:39.836822  6016 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
W20260709 13:16:39.884591  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 48238.5us
W20260709 13:16:39.885881  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.892649  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.905433  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.844359  5865 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:39.844724  6031 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:39.829782  6008 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:39.916421  6032 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.836177  5973 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:39.931056  6031 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:39.942833  5768 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.020s
I20260709 13:16:39.936333  5861 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:39.964221  6031 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:39.972879  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 173433us
I20260709 13:16:39.954119  5949 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:39.965173  5768 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.005s	sys 0.021s
W20260709 13:16:39.985992  6025 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 13:16:39.986366  6013 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.452s	user 0.004s	sys 0.000s
W20260709 13:16:39.986908  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.987389  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 202198us
I20260709 13:16:39.991133  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:39.998322  3842 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:39.986531  6009 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:39.992460  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:40.005702  3204 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:40.026711  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:40.027927  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:40.028702  3210 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
W20260709 13:16:40.083199  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 164492us
I20260709 13:16:40.112710  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:40.124490  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:40.125699  3209 raft_consensus.cc:2410] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:16:40.126799  3208 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:39.991637  6021 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:39.989411  5885 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:40.142319  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:40.150784  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.151962  3207 raft_consensus.cc:2410] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 8 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:40.165108  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:39.961333  6032 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:40.172380  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.177546  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:40.185467  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 74368.7us
I20260709 13:16:40.188321  3249 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:40.199242  5254 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:40.205859  6032 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:40.171516  5768 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:40.211551  5861 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.164294  6021 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:40.211432  6010 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:40.207975  5885 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:40.349447  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.280917  5795 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:40.306393  6028 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.418s	user 0.001s	sys 0.001s
W20260709 13:16:40.368916  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 470934us
I20260709 13:16:40.370306  3806 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:40.281824  5768 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:40.395057  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:40.280800  5861 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:40.402925  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.388828  6023 consensus_meta.cc:287] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.003s
I20260709 13:16:40.375975  6060 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:40.380448  5853 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:40.399158  6052 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 13:16:40.396613  5963 consensus_meta.cc:287] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.414s	user 0.015s	sys 0.001s
W20260709 13:16:40.423815  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 235622us
I20260709 13:16:40.381659  6008 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:40.410468  5960 consensus_meta.cc:287] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.925s	user 0.012s	sys 0.002s
I20260709 13:16:40.427783  3281 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:16:40.443320  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:40.448596  3284 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
W20260709 13:16:40.451424  6030 log.cc:927] Time spent T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.236s	user 0.002s	sys 0.000s
I20260709 13:16:40.417762  6023 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7.
W20260709 13:16:40.457708  6047 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:16:40.422981  5853 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.461567  5853 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:40.465847  6041 log.cc:927] Time spent T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:16:40.420948  6060 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:40.467806  6060 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:40.468989  3249 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:40.427103  5746 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:40.471856  3249 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:40.473027  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:40.395569  5966 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:16:40.474072  3101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.009s	sys 0.041s
I20260709 13:16:40.391099  5795 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:40.475490  3101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.009s	sys 0.042s
I20260709 13:16:40.494714  3131 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:16:40.503723  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:40.505978  6074 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:40.523337  5870 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:40.525900  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 52973.3us
I20260709 13:16:40.527033  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:40.529968  3101 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:40.442024  5963 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:40.490911  6010 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:40.482666  6032 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:40.561604  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:54126 (request call id 20) took 1126 ms. Trace:
W20260709 13:16:40.541915  5952 consensus_meta.cc:287] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.761s	user 0.009s	sys 0.004s
I20260709 13:16:40.537576  5870 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:40.562081  3129 rpcz_store.cc:276] 0709 13:16:39.459460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.468306 (+  8846us) service_pool.cc:224] Handling call
0709 13:16:40.539022 (+1070716us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b54003f4e20. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc16c520 00007fb3bc1e9652 00007fb3c11b760a 00007fb3ba73d7d4 00007fb3ba73d762 00007fb3ba73d691 00007fb3ba73d60c 00007fb3ba73c8c2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:40.553729 (+ 14707us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61551872}
W20260709 13:16:40.569644  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 262697us
I20260709 13:16:40.570852  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:40.569350  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 192954us
W20260709 13:16:40.575660  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.555862  5776 consensus_meta.cc:287] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.769s	user 0.007s	sys 0.005s
I20260709 13:16:40.577126  3806 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:40.557417  5763 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.002s	sys 0.007s
W20260709 13:16:40.580974  5763 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.003s	sys 0.008s
I20260709 13:16:40.586414  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:40.591338  3208 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:40.598254  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:40.598532  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:40.602217  3205 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:40.604082  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:40.604785  3204 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:40.607420  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:40.579119  5949 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:40.613677  3207 raft_consensus.cc:2410] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:16:40.616537  6027 consensus_meta.cc:287] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.818s	user 0.010s	sys 0.001s
I20260709 13:16:40.575388  5952 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:40.618239  5958 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:40.619887  5861 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:40.621754  6045 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.272s	user 0.001s	sys 0.001s
I20260709 13:16:40.623804  5795 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:40.625241  6081 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.625152  6010 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:40.625978  6081 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:40.594405  5935 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:40.629244  6035 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:40.629390  3282 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:40.630828  6031 consensus_meta.cc:287] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.659s	user 0.011s	sys 0.002s
I20260709 13:16:40.631314  6031 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:40.631916  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:40.553962  6032 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:40.633580  3834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 432) took 1024 ms. Trace:
I20260709 13:16:40.634347  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:40.617264  6021 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:40.575778  6009 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:40.578305  6067 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:40.635402  5870 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:40.645882  5861 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:40.646500  5861 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:40.640585  3177 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:40.617033  5943 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:40.585563  5853 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:40.641557  5795 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:16:40.634114  3834 rpcz_store.cc:276] 0709 13:16:39.609556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.609696 (+   140us) service_pool.cc:224] Handling call
0709 13:16:39.626497 (+ 16801us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.881551 (+255054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.881582 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.882108 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:16:40.082543 (+200435us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:40.082603 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.082711 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.633353 (+550642us) raft_consensus.cc:1685] finished
0709 13:16:40.633374 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.633520 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18611,"raft.queue_time_us":66694,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":9288,"thread_start_us":367651,"threads_started":2,"wal-append.queue_time_us":560448}
I20260709 13:16:40.631961  6069 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:40.642877  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:40.593456  5763 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:40.628407  5935 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:40.635191  6032 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:40.638695  6005 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:40.643750  6042 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:40.591225  5776 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:40.691864  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 164940us
I20260709 13:16:40.692488  6078 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:40.693408  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:40.694056  5853 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:40.679041  5962 consensus_meta.cc:287] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.857s	user 0.009s	sys 0.004s
I20260709 13:16:40.676120  5763 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.686142  5861 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:40.617024  6027 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:40.696975  6042 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.693020  6078 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.639577  6050 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:16:40.674291  6009 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:40.731200  6076 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:40.732793  6017 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.974s	user 0.001s	sys 0.003s
I20260709 13:16:40.737389  6005 raft_consensus.cc:2764] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:16:40.746800  5978 consensus_meta.cc:287] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.912s	user 0.007s	sys 0.006s
I20260709 13:16:40.720273  5962 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:40.724951  5795 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.711575  6074 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:40.721505  5763 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:40.726284  5959 consensus_meta.cc:287] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.881s	user 0.013s	sys 0.000s
W20260709 13:16:40.725317  6001 consensus_meta.cc:287] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.881s	user 0.010s	sys 0.003s
I20260709 13:16:40.752281  6042 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.750181  6078 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:40.761704  6076 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.761672  5949 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:40.778926  5795 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:40.782840  6049 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.783564  5943 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.783396  6049 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:40.784090  5943 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:40.784569  5795 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:40.768479  6031 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:40.778389  6076 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:40.777032  5959 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:40.775918  6001 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:40.796597  6001 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:40.770239  6069 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:16:40.792377  6049 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:40.789561  6051 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:40.799502  5959 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:40.800045  6027 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:40.800297  5959 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:40.808892  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 168413us
W20260709 13:16:40.833391  3805 leader_election.cc:336] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.566s (SENT)
W20260709 13:16:40.852023  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 245588us
I20260709 13:16:40.800835  5959 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:40.839579  6069 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.815485  6027 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:40.770372  5978 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:40.847859  6075 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:40.886528  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 128871us
W20260709 13:16:40.889190  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 130921us
W20260709 13:16:40.889889  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 247269us
I20260709 13:16:40.996903  3838 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:41.043757  3249 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:40.993777  3206 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 2362) took 1659 ms (client timeout 1831 ms). Trace:
I20260709 13:16:41.064836  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:41.066344  3133 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:41.068137  3841 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:16:41.069216  6020 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.350s	user 0.001s	sys 0.003s
I20260709 13:16:41.069358  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:41.033861  6090 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:41.071427  6090 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:40.998193  6078 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.074538  6090 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:41.022742  6095 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:16:41.078356  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:40.948297  5935 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:40.978384  6077 log.cc:927] Time spent T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:16:41.080466  3210 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:41.041949  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:41.080879  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:40.875288  6027 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:41.021986  5795 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.142514  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:41.025588  5962 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:41.079756  3206 rpcz_store.cc:269] 0709 13:16:39.334328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.334671 (+   343us) service_pool.cc:224] Handling call
0709 13:16:40.993459 (+1658788us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b5400194e54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:40.993649 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":940436352}
I20260709 13:16:41.071491  6008 raft_consensus.cc:2955] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:40.982645  6081 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:41.046294  5943 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:41.157933  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:41.144099  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1383) took 1597 ms. Trace:
I20260709 13:16:41.090957  3835 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:41.151216  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:41.145390  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:41.105891  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:41.032724  5952 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:40.940522  5776 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:40.959452  6085 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791: Append to log took a long time: real 0.159s	user 0.001s	sys 0.001s
I20260709 13:16:41.152678  5254 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:41.156530  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:41.166994  3133 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:41.142127  3236 heartbeater.cc:646] Failed to heartbeat to 127.1.250.126:33381 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.1.250.126:33381 timed out after 15.000s (SENT)
I20260709 13:16:41.080549  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:41.081364  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:41.168267  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.146203  3210 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:16:40.871977  6069 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.075359  6078 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:41.075491  5628 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.047446  6009 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:41.168465  3128 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:41.169586  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:41.169610  3836 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
W20260709 13:16:41.173511  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 129861us
I20260709 13:16:41.158933  5746 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:41.171336  3102 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:41.104686  5733 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:41.173156  3806 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:41.178647  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:41.180377  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:41.175850  3249 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:41.159511  3127 rpcz_store.cc:276] 0709 13:16:39.546831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.546992 (+   161us) service_pool.cc:224] Handling call
0709 13:16:39.547359 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.670823 (+123464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.670869 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:40.345010 (+674141us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b2c000014c8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:16:40.380576 (+ 35566us) log.cc:844] Serialized 26 byte log entry
0709 13:16:40.592331 (+211755us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:40.592381 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.592471 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:41.143733 (+551262us) raft_consensus.cc:1685] finished
0709 13:16:41.143759 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.144017 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3270,"raft.queue_time_us":10503,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":5722,"spinlock_wait_cycles":14096256,"thread_start_us":292359,"threads_started":2,"wal-append.queue_time_us":362717}
I20260709 13:16:41.181392  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:40.903908  6060 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.184762  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.168541  5959 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:41.223814  3133 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:16:41.155418  5795 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.186753  6089 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:41.152503  6076 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:41.192612  6093 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.199136  3205 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:41.201011  3176 connection.cc:256] RPC call timeout handler was delayed by -3.1534401860001253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 13:16:41.292500  3176 connection.cc:256] RPC call timeout handler was delayed by -2.7860509930001172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260709 13:16:41.293114  3176 connection.cc:256] RPC call timeout handler was delayed by -2.0865040280000358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
W20260709 13:16:41.293496  3176 connection.cc:256] RPC call timeout handler was delayed by -1.9911040280001089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
W20260709 13:16:41.294095  3176 connection.cc:256] RPC call timeout handler was delayed by -1.7816509930000848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27930000000000005s for a response
W20260709 13:16:41.294498  3176 connection.cc:256] RPC call timeout handler was delayed by -1.7679040279999754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
I20260709 13:16:41.203799  6069 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:41.204490  5978 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:41.204805  5974 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.180150  6091 consensus_queue.cc:1059] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:16:41.182634  6001 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:41.162364  5966 consensus_queue.cc:1059] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:16:41.162600  5961 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:16:41.206166  3102 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:41.207293  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:41.207906  6074 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:41.187183  5962 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:41.309495  5962 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.312165  5962 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:41.157650  5926 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:16:41.172423  3832 raft_consensus.cc:2955] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:41.187969  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:41.175133  5969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.516s	user 0.011s	sys 0.014s
W20260709 13:16:41.314352  5969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.662s	user 0.011s	sys 0.014s
I20260709 13:16:41.314379  3207 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:41.189020  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:41.191758  3277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:35794
W20260709 13:16:41.286741  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 95540.5us
I20260709 13:16:41.317379  3277 raft_consensus.cc:606] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:41.317817  3277 raft_consensus.cc:614] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:41.186777  6100 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:16:41.294971  3176 connection.cc:256] RPC call timeout handler was delayed by -1.7274040280001373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 13:16:41.187183  6035 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:41.321658  3176 connection.cc:256] RPC call timeout handler was delayed by -1.2587509930001488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33740000000000003s for a response
I20260709 13:16:41.191610  5887 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:41.322165  5887 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.322352  5795 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:41.322574  5887 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:41.175007  5628 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:41.323988  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:41.324190  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 118548us
I20260709 13:16:41.324285  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.325050  3208 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:41.212337  5733 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:41.280248  5885 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.302330  3206 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:41.286378  6089 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:41.304533  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 128866us
I20260709 13:16:41.306871  3209 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.217612  5943 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:41.334899  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:41.335330  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:41.325431  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.326409  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.320226  6100 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:41.327454  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:41.202291  6042 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.328773  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.298389  5426 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.300064  5959 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:41.333691  3205 raft_consensus.cc:3055] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:41.355336  3205 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:41.338241  3202 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 3.
W20260709 13:16:41.338063  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 115933us
I20260709 13:16:41.339476  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.339596  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:41.329644  5935 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:41.336594  3210 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:41.342680  3133 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:41.340462  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:41.366215  3128 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:41.357856  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:41.360176  3100 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:41.356933  3132 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:16:41.363483  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:41.354938  6102 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:16:41.335806  6089 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.334821  5943 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.371417  3135 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:41.329555  5733 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:41.369499  3205 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.381721  3205 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.381875  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:41.337589  5962 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:41.296808  6093 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:41.373380  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.391149  3204 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:41.372740  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.374974  3282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:16:41.392576  3282 raft_consensus.cc:606] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:41.370033  3210 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:41.393858  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.395172  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.376921  3249 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:41.354470  5959 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.378358  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.306263  5974 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.373106  3100 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:41.387939  3280 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:41.382511  3132 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:41.378648  5870 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:41.414695  3206 raft_consensus.cc:2410] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:41.389753  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:41.415407  3283 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:41.389351  5963 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:41.398234  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.395265  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:41.401322  5962 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:41.404160  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.367413  5426 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.426185  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.381309  5943 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.389921  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.364786  5935 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:41.388386  6074 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:41.419626  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.454228  3280 raft_consensus.cc:2410] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:41.421027  3211 raft_consensus.cc:2393] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 5: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:41.422216  3276 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:41.416620  5870 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.411031  3210 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:41.387789  5978 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:41.339282  5885 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:16:41.388304  5926 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:16:41.439514  3204 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:41.439775  3283 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:41.440500  3284 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:41.460080  3281 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:41.474354  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.405367  5959 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:41.417332  6055 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:41.489950  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.402192  6027 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:41.430856  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:41.416693  6069 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:41.464830  5870 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.471554  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.501258  3210 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:41.470384  5978 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:41.482594  3279 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:41.488193  3135 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:41.490868  3204 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:41.493453  3202 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:41.494655  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:41.495702  3209 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:41.461212  5935 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.471944  3278 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:41.501277  3208 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
W20260709 13:16:41.497145  6104 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:16:41.509522  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.506057  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.504745  3283 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:41.517585  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.511379  3132 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.526218  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.527910  3278 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:41.527876  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:41.513597  3205 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:41.452438  6014 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:16:41.488798  6055 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.487614  6107 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.531574  3284 raft_consensus.cc:2393] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:41.475654  6074 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:41.452798  6103 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:16:41.554252  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:41.553740  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:41.555136  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 115719us
I20260709 13:16:41.545661  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:41.569331  3278 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.569370  3283 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:41.557358  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:41.534268  3204 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:41.510761  5965 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:41.566645  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:41.509606  6060 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:41.500449  5976 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:41.571470  3210 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.532356  6076 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:41.500728  5963 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:41.552656  5763 consensus_meta.cc:287] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.773s	user 0.007s	sys 0.002s
I20260709 13:16:41.577497  3202 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:41.526201  6100 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:41.541420  6098 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.553743  5768 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:41.562007  6055 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.526391  6021 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:16:41.617693  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.618785  3205 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:41.619012  3283 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:41.620909  5426 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:41.621618  5733 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:41.622355  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.588025  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.554600  5628 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:41.636466  5795 raft_consensus.cc:3055] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:41.637125  5795 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:41.576298  5965 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.638299  5795 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.639786  5965 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:41.643378  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.582356  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.607715  6093 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:41.584818  5763 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:41.583841  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.587831  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.712224  3202 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:41.624095  3284 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:41.624666  3283 raft_consensus.cc:2393] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:41.610531  5885 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:41.551589  5974 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:41.644888  5962 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:41.654567  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:41.649618  5795 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.667359  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.667757  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.674675  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:41.587591  5963 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.583369  5976 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.654554  6042 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:41.612700  6098 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.648898  6074 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:41.703943  3278 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:41.707661  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:41.708499  3210 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:41.693521  5733 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:41.720458  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.613039  6107 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.736598  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:41.723275  3205 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.723428  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.727459  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:41.730316  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.737272  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.737838  3284 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:41.731664  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.738770  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.739346  3202 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:41.739886  3283 raft_consensus.cc:2410] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 13:16:41.741483  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 197766us
I20260709 13:16:41.732995  3842 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:41.742345  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.742990  3202 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:41.733695  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:41.732235  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.746764  3276 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:16:41.747110  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.747407  3100 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:41.749460  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.749495  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:41.749934  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 95468.6us
I20260709 13:16:41.750234  3283 raft_consensus.cc:2368] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5.
I20260709 13:16:41.751665  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.751968  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.752373  3278 raft_consensus.cc:2368] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4.
I20260709 13:16:41.751129  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:41.753032  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.754055  3209 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:41.750337  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:41.754469  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:41.757020  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.757385  3210 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:16:41.755472  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.757758  3210 pending_rounds.cc:85] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 3
I20260709 13:16:41.758005  3210 pending_rounds.cc:107] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:16:41.756122  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:41.757071  3276 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:41.758340  3210 raft_consensus.cc:2889] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:41.757668  3279 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:41.759996  3249 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:41.762144  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.748922  5885 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:41.762864  3278 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:41.762838  3249 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:41.771628  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:41.772424  3249 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:41.766705  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.773335  3285 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:41.773962  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:41.774711  3176 leader_election.cc:336] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 3.701s (SENT)
I20260709 13:16:41.775154  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:41.763309  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.770866  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:41.767510  3202 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:41.748719  5978 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:41.759693  5940 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:41.776135  3283 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:41.767117  3210 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:16:41.771956  3100 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:41.753959  5974 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:16:41.782594  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:41.777225  3205 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:41.764590  6067 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:41.764477  5962 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:41.749573  5733 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.785903  3249 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:41.787886  3283 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:41.765985  6014 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:16:41.789805  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:41.785329  5978 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:41.791049  6023 raft_consensus.cc:993] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:16:41.791427  5768 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:41.791859  5768 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:41.792228  5768 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.780364  5940 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:41.794178  5940 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.772737  6010 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:41.777997  6066 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:41.798193  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:41.759084  5887 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:41.808759  5964 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:41.809605  5887 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:41.809360  5964 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:41.810254  6021 raft_consensus.cc:1081] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Signalling peer 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:16:41.760753  5949 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:16:41.811504  5964 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:41.782500  5926 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:41.813772  5963 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:41.815987  3132 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:41.777870  6076 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:41.799362  3249 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:41.773506  6009 consensus_queue.cc:1059] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:16:41.820412  6098 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:41.820977  5733 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:41.821113  6117 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:41.819139  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:41.821918  5733 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:41.823128  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.778378  6103 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:16:41.825986  3249 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:41.824299  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.824388  3279 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:16:41.824047  3127 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:41.826841  3281 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:41.827705  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:41.828287  3281 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.822320  5733 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.829270  5733 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:41.831560  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.833701  5976 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:41.834256  5763 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:41.817121  5966 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:41.815449  6014 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:41.836347  6008 consensus_meta.cc:287] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 13:16:41.845917  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:41.846202  3282 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:41.828310  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.839912  6023 raft_consensus.cc:3055] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:41.818746  5978 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.861766  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:41.862632  3835 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 3.
I20260709 13:16:41.826213  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:41.815218  6066 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.838037  3203 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:16:41.838397  5962 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:41.869254  3203 pending_rounds.cc:85] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 3
I20260709 13:16:41.869596  3203 pending_rounds.cc:107] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:16:41.869758  3203 raft_consensus.cc:2889] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:41.869884  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:41.868420  5861 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:16:41.827927  5926 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:41.846994  3281 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:41.847484  3205 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:41.842242  5959 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:41.852766  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 646231us
I20260709 13:16:41.877902  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:41.872015  3250 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:41.850325  6023 raft_consensus.cc:740] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:41.883806  3805 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:41.858821  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 473373us
I20260709 13:16:41.871368  6066 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:41.854077  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:41.898484  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:41.859818  3842 raft_consensus.cc:2955] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:41.888461  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:41.872771  5966 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:16:41.875787  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:41.894881  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:41.868631  6014 raft_consensus.cc:697] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:41.871414  6091 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:41.897190  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.881229  6107 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:41.899544  3836 raft_consensus.cc:2410] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
W20260709 13:16:41.900942  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 46983.8us
I20260709 13:16:41.852424  5733 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.902395  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.903748  6009 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:41.904075  5817 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:41.905539  3835 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:41.904412  5966 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:41.907825  3203 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:41.871142  5962 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.912919  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:41.927688  3101 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:41.914034  3284 raft_consensus.cc:2368] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 5. Current term is 6.
I20260709 13:16:41.917160  3281 raft_consensus.cc:2393] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:41.930347  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:16:41.920605  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 44922.4us
I20260709 13:16:41.931623  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:41.931679  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:41.932341  3205 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.896541  5976 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:41.891820  5926 raft_consensus.cc:697] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:41.930265  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:41.906946  6076 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:41.942937  3281 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:41.869256  6055 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.907117  6091 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.956888  3102 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:41.970187  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:41.970944  3203 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:41.945267  5795 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:41.939224  5865 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:41.900240  6021 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:16:41.920804  6043 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:41.912473  6038 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:41.931627  5962 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.925896  6035 consensus_queue.cc:1059] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:16:41.894927  5887 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:16:41.931716  5628 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:41.924593  6089 consensus_meta.cc:287] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.531s	user 0.005s	sys 0.007s
I20260709 13:16:41.893275  6042 consensus_queue.cc:1059] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:16:41.908125  6090 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:16:41.939193  5426 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:16:42.032861  3207 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:16:42.032958  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 67555.2us
I20260709 13:16:41.959745  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:42.089136  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 182551us
I20260709 13:16:42.032240  6091 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:42.063349  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:41.966965  3276 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:42.032498  5959 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:41.939188  5881 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:42.069140  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:41.931360  5966 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:41.908205  5763 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 13:16:42.072641  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 188892us
I20260709 13:16:42.100373  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:42.100972  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:42.072896  5254 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:42.073060  3281 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:16:42.075698  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:42.077575  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:42.103065  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:42.103717  3281 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:42.104492  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.943730  5870 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:41.956585  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:42.085916  3205 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:42.076586  6116 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:42.033797  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 76995.3us
I20260709 13:16:41.973021  5861 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:41.949275  5976 raft_consensus.cc:697] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:42.094540  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:41.945062  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:42.095372  3835 raft_consensus.cc:2368] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5.
I20260709 13:16:42.035339  5795 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:42.116135  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 171147us
I20260709 13:16:42.105062  3281 raft_consensus.cc:2410] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:42.081951  5628 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.111465  3279 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:42.117944  5628 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.118722  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:42.119635  5870 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:42.119725  3279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:16:42.120388  3279 raft_consensus.cc:606] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:16:42.120718  3279 raft_consensus.cc:614] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:42.121409  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:42.122118  3127 raft_consensus.cc:2368] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8.
W20260709 13:16:42.123649  5943 consensus_meta.cc:287] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.658s	user 0.006s	sys 0.005s
I20260709 13:16:42.124105  5943 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:42.126061  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:42.125686  5966 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.126906  5966 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.128091  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:42.129216  5795 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:42.130618  5763 raft_consensus.cc:3055] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:42.131115  5763 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:42.131225  3285 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:42.133508  3285 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:42.123677  3279 pending_rounds.cc:85] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 4
I20260709 13:16:42.134661  3279 pending_rounds.cc:107] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:16:42.134941  3279 raft_consensus.cc:2889] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:42.063303  5817 consensus_queue.cc:1059] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
W20260709 13:16:42.092911  6115 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:16:42.112913  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:42.114259  3205 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:42.135926  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:42.111735  3102 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:42.097687  5881 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.949039  5935 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:42.141633  3132 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:42.112998  6116 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:42.082190  6038 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:41.950700  5926 consensus_queue.cc:237] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.163463  3129 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:42.143826  6043 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:42.086540  6089 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:42.113171  6009 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:42.168773  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:42.164923  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:42.175177  3205 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: [5.3-6.4]
I20260709 13:16:42.175711  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:42.176308  3132 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:42.168846  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:42.172045  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 55053.8us
I20260709 13:16:42.033270  6023 consensus_queue.cc:260] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.177134  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:42.178215  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:42.139761  6107 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:42.113415  5865 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:16:42.116120  5964 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:16:42.147987  5881 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.132139  5763 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:42.183455  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:42.144021  5870 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:42.193123  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:42.164356  6116 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:42.169848  5887 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:42.205049  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:42.172454  6008 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.211112  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:42.211831  3127 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.211239  3135 raft_consensus.cc:2368] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8.
I20260709 13:16:42.208420  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:42.214532  3836 raft_consensus.cc:2393] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 8: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:42.184216  6076 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:42.191836  6023 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:42.098230  6014 consensus_queue.cc:237] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.256063  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:42.257409  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:42.257948  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:42.258596  3128 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:42.229533  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:42.260936  3832 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 8: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
W20260709 13:16:42.264478  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.265815  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:42.227850  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 49743.7us
W20260709 13:16:42.230557  6122 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:16:42.268697  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:42.269347  3129 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:42.269888  3834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 516) took 1083 ms. Trace:
I20260709 13:16:42.270962  6038 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:42.228119  5763 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.271942  5959 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:42.231627  6125 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:16:42.233493  6055 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:42.233820  3250 leader_election.cc:400] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8.
I20260709 13:16:42.234194  6078 raft_consensus.cc:3055] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:42.296290  6078 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:42.298874  3133 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:42.235008  6103 raft_consensus.cc:3055] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:42.300776  6103 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:42.301914  6103 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.303449  6103 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.236032  5973 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:42.306878  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:42.233845  5733 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:42.238420  5969 raft_consensus.cc:3055] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:42.308040  5969 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:42.307947  5795 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.309191  5969 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.310209  5969 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:42.238688  5628 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.314649  5628 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:42.239439  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:42.314682  6066 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.212673  5870 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.243873  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:42.316588  3285 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.245380  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:42.246027  5943 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:42.224589  5940 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.249833  3127 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:42.251374  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:42.203445  3841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81"
dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:54892
I20260709 13:16:42.206110  6009 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:42.267274  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:42.330420  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 63239.2us
I20260709 13:16:42.270306  3834 rpcz_store.cc:276] 0709 13:16:41.189700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.189970 (+   270us) service_pool.cc:224] Handling call
0709 13:16:41.280053 (+ 90083us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.857293 (+577240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.857328 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:41.857794 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:16:41.919348 (+ 61554us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:41.919491 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.919589 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.269645 (+350056us) raft_consensus.cc:1685] finished
0709 13:16:42.269667 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.269822 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":568459,"raft.queue_time_us":569720,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":61115,"threads_started":1,"wal-append.queue_time_us":143113}
I20260709 13:16:42.280184  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:42.280272  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:42.280715  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:42.282085  3250 leader_election.cc:403] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:16:42.284356  3128 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:42.281662  5959 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:42.293227  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 192344us
I20260709 13:16:42.335574  3805 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:42.336203  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 102605us
I20260709 13:16:42.337381  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:42.317373  3278 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:42.320192  3283 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: [6.3-7.4]
I20260709 13:16:42.338681  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:42.340269  6038 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:42.340696  6038 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:42.341058  6038 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:42.344463  6089 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:42.345642  5935 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:42.346194  5973 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:42.346626  6071 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.347293  6071 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:42.348987  5963 consensus_queue.cc:1059] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:42.349409  6071 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:42.317729  3277 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:42.337411  3250 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:42.351135  3277 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:16:42.352105  3805 leader_election.cc:336] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.917s (SENT)
W20260709 13:16:42.329015  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 46065.7us
I20260709 13:16:42.352626  3805 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:42.224221  6008 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:42.355084  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.355592  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.356873  3132 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:42.315289  3280 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:42.346619  5973 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:42.352202  3277 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:42.327623  3841 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:42.368993  3841 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:42.332983  3208 raft_consensus.cc:2393] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:42.370255  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 268) took 1046 ms. Trace:
I20260709 13:16:42.370512  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:42.370633  3206 rpcz_store.cc:276] 0709 13:16:41.324185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.340628 (+ 16443us) service_pool.cc:224] Handling call
0709 13:16:42.366559 (+1025931us) spinlock_profiling.cc:243] Waited 45.3 ms on lock 0x7b5400196754. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:42.370190 (+  3631us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104102272}
I20260709 13:16:42.345116  6089 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:42.367189  3209 raft_consensus.cc:2955] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:42.372077  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:42.372671  3835 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:42.359627  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:42.365792  3207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 262) took 1043 ms. Trace:
I20260709 13:16:42.373656  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:42.374434  3280 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.374997  3285 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:42.378144  3100 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:42.379220  5254 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.379685  3100 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:42.385959  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:42.387156  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:42.387712  3208 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:42.373447  3207 rpcz_store.cc:276] 0709 13:16:41.322329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.330040 (+  7711us) service_pool.cc:224] Handling call
0709 13:16:41.972851 (+642811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.088591 (+115740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.365544 (+276953us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54003caad0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:42.365718 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422131456}
I20260709 13:16:42.388469  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:42.391134  3131 raft_consensus.cc:1240] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:42.359725  5887 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:42.393292  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 125761us
I20260709 13:16:42.397974  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:42.398775  3176 leader_election.cc:400] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5.
I20260709 13:16:42.397224  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:42.399115  3176 leader_election.cc:403] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:42.394569  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:42.397624  5254 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:42.400321  5254 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:42.400699  5254 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.400542  3177 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:42.402357  3280 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:42.404193  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:42.405004  5426 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:42.406119  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:42.253316  5976 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:42.406972  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:42.410336  5795 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:42.359997  5733 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:42.415856  5940 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:42.356986  5628 consensus_queue.cc:1059] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:16:42.416887  6089 raft_consensus.cc:697] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:42.417264  5974 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:42.417423  6008 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:42.417918  6089 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:42.419771  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:42.421473  3176 leader_election.cc:400] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4.
I20260709 13:16:42.421795  3176 leader_election.cc:403] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:42.421968  6125 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:42.423732  5966 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5.
I20260709 13:16:42.393594  6098 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:42.424438  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:42.371956  5973 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.386987  5965 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8.
I20260709 13:16:42.415673  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:42.429708  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:42.431314  3208 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.433858  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:42.434455  5254 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:42.436877  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:42.443897  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:42.444911  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:42.446781  3206 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.448112  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:42.451408  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 50943.3us
W20260709 13:16:42.428874  5978 consensus_meta.cc:287] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.000s
I20260709 13:16:42.464931  3277 raft_consensus.cc:2368] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 9. Current term is 10.
I20260709 13:16:42.475490  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:42.476156  3280 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.399605  6055 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:42.484375  3280 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:42.360304  6074 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.083s
W20260709 13:16:42.487121  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 52257.8us
I20260709 13:16:42.466696  3833 raft_consensus.cc:2368] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 9. Current term is 10.
I20260709 13:16:42.495450  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:42.517657  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 69598.3us
W20260709 13:16:42.518006  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 116143us
I20260709 13:16:42.504725  3208 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:42.503767  3841 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:42.519025  3176 leader_election.cc:400] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 5. Current term is 6.
I20260709 13:16:42.520632  3176 leader_election.cc:403] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:42.434826  6093 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:42.360735  5959 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.513734  3280 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:42.464670  5733 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:42.486135  5978 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.550150  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:42.555126  3284 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:42.518674  3285 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:42.534235  3841 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:42.476823  6076 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:42.475627  5795 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:42.556641  5795 raft_consensus.cc:697] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:42.530757  3129 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
W20260709 13:16:42.560002  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.435030  6091 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.533326  3101 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:42.399339  6078 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.578562  3278 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:42.584000  3102 leader_election.cc:400] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 9. Current term is 10.
I20260709 13:16:42.584376  3102 leader_election.cc:403] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:16:42.437350  6038 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:42.586149  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:42.586799  3207 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.538209  5426 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:42.536417  6100 consensus_queue.cc:1059] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:16:42.589715  3202 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:42.551628  5974 consensus_queue.cc:1059] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:16:42.537132  5628 consensus_queue.cc:1059] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:16:42.580447  5969 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:42.597409  3835 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:42.589862  5962 consensus_meta.cc:287] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.003s
W20260709 13:16:42.599924  3806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.008s	sys 0.005s
W20260709 13:16:42.619448  3806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.009s	sys 0.005s
W20260709 13:16:42.619761  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 529262us
I20260709 13:16:42.620039  3282 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:42.591657  5768 consensus_meta.cc:287] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.799s	user 0.011s	sys 0.007s
W20260709 13:16:42.615753  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.590523  6023 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 9. Current term is 10.
I20260709 13:16:42.516567  6009 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.621699  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:42.592466  6066 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:42.651307  6038 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:42.652091  5940 raft_consensus.cc:3055] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:42.652522  5940 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:42.657431  5870 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:42.658056  5795 consensus_queue.cc:237] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.624495  5962 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.663434  5962 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:42.595391  6078 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.667965  3281 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 9. Ops: []
W20260709 13:16:42.677990  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.630652  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:42.617410  6027 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.018s	sys 0.021s
I20260709 13:16:42.632742  5959 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:42.627952  5768 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:42.633313  6091 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:42.625407  5926 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:42.710139  5926 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.710721  5926 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.702473  5966 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4.
I20260709 13:16:42.628394  5426 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:42.713663  3276 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:42.713860  5426 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.714843  5768 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:42.695325  6127 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:42.716348  6127 raft_consensus.cc:697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:16:42.637897  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.717449  6127 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:42.640450  5969 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:42.720677  5969 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.644259  3832 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:42.689517  6027 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.018s	sys 0.021s
I20260709 13:16:42.689839  3837 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:16:42.723750  6116 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:42.691685  3207 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:42.682431  6126 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:42.672576  5973 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:42.683856  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 53321.2us
I20260709 13:16:42.748553  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:42.749514  3129 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:42.753911  3806 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:42.628237  5881 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.767982  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:42.772886  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:42.773303  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.773526  3133 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:16:42.773664  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 435611us
I20260709 13:16:42.773986  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:42.774610  3133 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:42.774793  3131 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 8: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:16:42.743564  6105 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.134s	user 0.006s	sys 0.016s
W20260709 13:16:42.776778  6105 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.006s	sys 0.017s
I20260709 13:16:42.742866  6076 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:42.743415  6098 raft_consensus.cc:697] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:42.784569  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:42.742739  6126 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:42.757881  6129 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.781447  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:42.773747  3203 raft_consensus.cc:2955] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:16:42.836081  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.836619  5966 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:42.856696  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.797683  3133 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:42.868690  3133 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:42.901557  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 120212us
W20260709 13:16:42.910802  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 373729us
I20260709 13:16:42.744118  5940 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:42.865387  6038 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:42.903024  3250 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:42.859628  6126 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:42.943037  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 424125us
I20260709 13:16:42.945459  3250 leader_election.cc:400] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8.
I20260709 13:16:42.949965  3250 leader_election.cc:403] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:42.952339  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.952950  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.958127  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 491397us
I20260709 13:16:42.927224  5965 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:16:42.964980  3206 consensus_meta.cc:287] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.000s
I20260709 13:16:42.966914  3206 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:42.967808  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:42.968065  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:42.941089  6122 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 13:16:42.973059  3249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.007s	sys 0.004s
I20260709 13:16:42.970386  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:42.932474  6038 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.974668  3206 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:42.885301  5966 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:42.974049  3250 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:42.982342  3133 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
W20260709 13:16:42.971623  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 473618us
I20260709 13:16:42.982230  3250 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:42.960465  5976 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:42.970350  6078 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.972815  6091 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.988000  3177 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:42.973963  3249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.007s	sys 0.004s
I20260709 13:16:42.988552  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:42.997678  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:43.011051  3206 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:42.978730  6038 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.995507  3251 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:42.999239  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:43.001533  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:42.975859  6149 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8.
I20260709 13:16:42.993768  5963 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:43.010092  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.013834  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 673979us
I20260709 13:16:43.014690  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:42.985869  5976 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.986063  5965 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:43.031023  5254 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:42.972981  6129 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:16:43.035234  3251 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:43.049559  3209 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.031s	sys 0.039s
W20260709 13:16:43.132946  3209 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.032s	sys 0.039s
I20260709 13:16:42.986343  3280 raft_consensus.cc:2955] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:16:43.093472  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.994457  5959 consensus_queue.cc:1059] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:16:42.996915  5962 consensus_queue.cc:1059] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:16:43.027520  5795 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:43.029863  5865 raft_consensus.cc:3055] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:42.980497  6098 consensus_queue.cc:237] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:43.145181  6141 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:16:43.150609  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.032768  5963 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.070399  5976 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.001684  6091 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:43.004489  6078 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:43.070214  5973 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:43.187403  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.188771  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2301) took 1583 ms. Trace:
I20260709 13:16:43.189395  3277 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:16:43.190073  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1148) took 1463 ms. Trace:
W20260709 13:16:43.145387  5733 consensus_meta.cc:287] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.001s
W20260709 13:16:42.881114  6055 consensus_queue.cc:1175] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" responder_term: 12 status { last_received { term: 11 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:43.204942  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:43.205166  3129 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:43.207955  3130 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:43.145848  6116 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:43.220827  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:43.162803  3279 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.007s	sys 0.006s
I20260709 13:16:43.204001  3281 rpcz_store.cc:276] 0709 13:16:41.726221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.124124 (+397903us) service_pool.cc:224] Handling call
0709 13:16:42.124378 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.668898 (+544520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.188836 (+519938us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54003f2ad4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:43.189941 (+  1105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249284352}
I20260709 13:16:43.209970  3177 leader_election.cc:400] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5.
W20260709 13:16:43.226313  3279 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.007s	sys 0.006s
W20260709 13:16:43.211999  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 244325us
I20260709 13:16:43.202888  3282 rpcz_store.cc:276] 0709 13:16:41.605426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.851784 (+246358us) service_pool.cc:224] Handling call
0709 13:16:41.872439 (+ 20655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.620889 (+748450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.188491 (+567602us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54001e9954. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:43.188703 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718432000}
I20260709 13:16:43.221453  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:43.221859  5966 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:43.185668  3278 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.000s	sys 0.013s
W20260709 13:16:43.230365  3278 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.001s	sys 0.013s
W20260709 13:16:43.240513  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 205362us
W20260709 13:16:43.226766  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 216969us
I20260709 13:16:43.227242  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:43.156381  5865 raft_consensus.cc:740] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:43.159925  5881 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:43.162050  5963 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.226751  3206 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:43.159093  5965 consensus_queue.cc:1059] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.064s
W20260709 13:16:43.350888  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 123728us
I20260709 13:16:43.372098  3251 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:43.371206  5966 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:43.378427  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:43.380165  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.200546  6009 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.374841  5768 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:43.388900  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:43.217535  5733 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:43.396342  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:43.419494  3206 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 8: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:43.392871  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:43.378016  3131 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 9. Ops: []
I20260709 13:16:43.368278  6116 raft_consensus.cc:3055] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:43.371513  6151 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:43.426817  3206 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: [3.4-5.5]
I20260709 13:16:43.427591  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1446) took 1160 ms. Trace:
I20260709 13:16:43.427955  3206 rpcz_store.cc:276] 0709 13:16:42.266945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.426202 (+1159257us) service_pool.cc:224] Handling call
0709 13:16:43.426557 (+   355us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:43.427272 (+   715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.427526 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:43.407722  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 358222us
I20260709 13:16:43.414177  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:43.430182  3284 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:16:43.414181  3134 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:43.412566  3203 consensus_meta.cc:287] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.000s
I20260709 13:16:43.418589  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:43.382776  6145 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:43.392803  5973 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.440110  3206 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:43.423575  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:43.441015  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2420) took 1049 ms. Trace:
I20260709 13:16:43.441407  3206 rpcz_store.cc:276] 0709 13:16:42.391473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.439641 (+1048168us) service_pool.cc:224] Handling call
0709 13:16:43.439953 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.440770 (+   817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.440958 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.443276  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2421) took 1051 ms. Trace:
I20260709 13:16:43.443717  3206 rpcz_store.cc:276] 0709 13:16:42.391800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.442278 (+1050478us) service_pool.cc:224] Handling call
0709 13:16:43.442658 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.442873 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.442909 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.442963 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:43.443012 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.443077 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.443204 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.445916  5973 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:43.448324  5973 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:43.442327  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:43.449476  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:43.451418  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2320) took 1095 ms. Trace:
I20260709 13:16:43.451771  3285 rpcz_store.cc:276] 0709 13:16:42.356107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.559050 (+202943us) service_pool.cc:224] Handling call
0709 13:16:42.559401 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.559830 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.598081 (+ 38251us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.621418 (+ 23337us) log.cc:844] Serialized 26 byte log entry
0709 13:16:43.017460 (+396042us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:43.017504 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.017572 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.451198 (+433626us) raft_consensus.cc:1685] finished
0709 13:16:43.451219 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.451359 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104455,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"thread_start_us":291592,"threads_started":1,"wal-append.queue_time_us":700590}
I20260709 13:16:43.453390  3207 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:43.452137  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2424) took 1059 ms. Trace:
I20260709 13:16:43.454496  3206 rpcz_store.cc:276] 0709 13:16:42.392639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.445013 (+1052374us) service_pool.cc:224] Handling call
0709 13:16:43.451645 (+  6632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.451838 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.451864 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.451905 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:43.451940 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.451990 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.452087 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.456554  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2426) took 1060 ms. Trace:
I20260709 13:16:43.457578  3101 leader_election.cc:400] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 9. Current term is 10.
I20260709 13:16:43.419169  5426 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:43.435602  6137 log.cc:927] Time spent T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.433s	user 0.000s	sys 0.001s
I20260709 13:16:43.439025  5865 consensus_queue.cc:260] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:43.457849  5795 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:43.418809  6009 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:43.470798  6134 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:16:43.471580  6009 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:43.472153  5733 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:43.473132  5964 consensus_queue.cc:1059] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:43.458281  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:43.474646  3133 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:43.475750  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2412) took 1668 ms. Trace:
W20260709 13:16:43.477428  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.483495  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 2422) took 1091 ms. Trace:
W20260709 13:16:43.484220  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.475857  3285 raft_consensus.cc:2955] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:43.487172  5795 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:43.424119  6116 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:43.484054  3208 rpcz_store.cc:276] 0709 13:16:42.392050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.394363 (+  2313us) service_pool.cc:224] Handling call
0709 13:16:43.483303 (+1088940us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b540019e454. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:43.483429 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69004544}
I20260709 13:16:43.476164  3210 rpcz_store.cc:276] 0709 13:16:41.807637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.132124 (+324487us) service_pool.cc:224] Handling call
0709 13:16:42.132430 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.132746 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.132770 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.133233 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.596697 (+463464us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:42.596741 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.596811 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.475506 (+878695us) raft_consensus.cc:1685] finished
0709 13:16:43.475536 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.475684 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":462934,"threads_started":1,"wal-append.queue_time_us":900478}
W20260709 13:16:43.511315  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 143247us
W20260709 13:16:43.466194  6162 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:16:43.439651  5961 raft_consensus.cc:3055] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:43.465696  6153 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:16:43.466796  6147 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 13:16:43.495922  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2405) took 1696 ms. Trace:
I20260709 13:16:43.497676  3134 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:43.450381  6145 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:43.456972  3206 rpcz_store.cc:276] 0709 13:16:42.396155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.455599 (+1059444us) service_pool.cc:224] Handling call
0709 13:16:43.455965 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.456184 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.456220 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.456273 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:43.456327 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.456394 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.456505 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.499403  3283 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:43.495460  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1147) took 1774 ms. Trace:
W20260709 13:16:43.463780  5926 consensus_meta.cc:287] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.753s	user 0.010s	sys 0.000s
W20260709 13:16:43.467917  6142 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:16:43.468314  5865 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.462934  6035 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:43.459965  6027 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:43.482086  5973 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:43.474349  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2417) took 1594 ms. Trace:
W20260709 13:16:43.487627  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 54567.4us
I20260709 13:16:43.490804  6009 raft_consensus.cc:3055] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:43.440798  6151 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:43.531375  6138 log.cc:927] Time spent T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.391s	user 0.001s	sys 0.001s
W20260709 13:16:43.510624  6164 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:16:43.495301  6091 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:43.463356  6148 log.cc:927] Time spent T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 13:16:43.465440  5426 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:43.549219  3209 rpcz_store.cc:276] 0709 13:16:41.799090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.971626 (+172536us) service_pool.cc:224] Handling call
0709 13:16:42.366730 (+395104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.367032 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:42.441895 (+ 74863us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.162158 (+720263us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.162358 (+   200us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.162410 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:43.162463 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.162529 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.449347 (+286818us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b180041fc20. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:16:43.495690 (+ 46343us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b5400196750. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:43.495849 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20640,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":15096,"raft.queue_time_us":1270,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":7002,"spinlock_wait_cycles":750602496,"thread_start_us":691217,"threads_started":1,"wal-append.queue_time_us":1047210}
W20260709 13:16:43.533149  6143 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.388s	user 0.000s	sys 0.001s
I20260709 13:16:43.509222  5959 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:43.549201  5795 raft_consensus.cc:697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:43.577531  3835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 628) took 1191 ms. Trace:
W20260709 13:16:43.581300  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.559206  3279 rpcz_store.cc:276] 0709 13:16:41.721629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.123198 (+401569us) service_pool.cc:224] Handling call
0709 13:16:42.123486 (+   288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:42.173806 (+ 50320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.173850 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:42.179020 (+  5170us) log.cc:844] Serialized 52 byte log entry
0709 13:16:42.236799 (+ 57779us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b18001a54e0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:16:42.593619 (+356820us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:43.229977 (+636358us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.383452 (+153475us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.383680 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.383808 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.495176 (+111368us) raft_consensus.cc:1685] finished
0709 13:16:43.495236 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.495395 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157904,"prepare.queue_time_us":886720,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":274855,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":30147,"spinlock_wait_cycles":56322432,"thread_start_us":955048,"threads_started":2,"wal-append.queue_time_us":774262}
I20260709 13:16:43.580188  6171 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:43.532239  5961 raft_consensus.cc:740] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:43.589442  3283 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:43.584862  3202 rpcz_store.cc:276] 0709 13:16:41.879933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.757815 (+877882us) service_pool.cc:224] Handling call
0709 13:16:42.758104 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.758446 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.758489 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.759036 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:16:43.040418 (+281382us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:43.040478 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.040573 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.474116 (+433543us) raft_consensus.cc:1685] finished
0709 13:16:43.474137 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.474288 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1063,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7644,"thread_start_us":280968,"threads_started":1,"wal-append.queue_time_us":700901}
I20260709 13:16:43.662535  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:43.578256  5926 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:43.663664  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:43.640625  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 111515us
I20260709 13:16:43.642038  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:43.664259  3202 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:43.664510  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.586141  3249 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:43.665529  6103 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:43.665678  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:43.643049  3835 rpcz_store.cc:276] 0709 13:16:42.386306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.388596 (+  2290us) service_pool.cc:224] Handling call
0709 13:16:42.388867 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.618062 (+229195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.577285 (+959223us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54005785d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:43.577461 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475596672}
I20260709 13:16:43.658854  3279 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:43.588558  6009 raft_consensus.cc:740] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:43.667888  6009 consensus_queue.cc:260] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:43.668984  6009 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:43.589956  5969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.019s	sys 0.016s
I20260709 13:16:43.664026  3284 raft_consensus.cc:2368] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9.
I20260709 13:16:43.666211  6103 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:43.602831  6078 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:43.591164  6027 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:43.680260  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 94198.4us
W20260709 13:16:43.682474  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 208674us
W20260709 13:16:43.683495  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 260004us
I20260709 13:16:43.684352  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2321) took 1328 ms. Trace:
I20260709 13:16:43.691344  3249 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:43.584044  6035 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:43.702400  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:43.687067  3202 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:43.692567  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:43.719769  3249 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:43.697407  3176 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:43.704485  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1406) took 1576 ms. Trace:
I20260709 13:16:43.696892  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2414) took 1888 ms. Trace:
I20260709 13:16:43.697235  3278 rpcz_store.cc:276] 0709 13:16:42.356565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.584765 (+228200us) service_pool.cc:224] Handling call
0709 13:16:42.593732 (+  8967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.593987 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:43.381152 (+787165us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.684015 (+302863us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.684063 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:43.684104 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.684182 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.684293 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34225,"prepare.queue_time_us":863411,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":39,"thread_start_us":899721,"threads_started":2,"wal-append.queue_time_us":288481}
I20260709 13:16:43.726629  3205 rpcz_store.cc:276] 0709 13:16:41.807938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.183729 (+375791us) service_pool.cc:224] Handling call
0709 13:16:42.204499 (+ 20770us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.225531 (+ 21032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.225580 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.229441 (+  3861us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.698546 (+469105us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:42.698590 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.698661 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.696628 (+997967us) raft_consensus.cc:1685] finished
0709 13:16:43.696650 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.696824 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9682,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":2557,"spinlock_wait_cycles":1107840,"thread_start_us":378941,"threads_started":1,"wal-append.queue_time_us":876681}
I20260709 13:16:43.734627  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:43.723585  3135 rpcz_store.cc:276] 0709 13:16:42.127776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.258379 (+130603us) service_pool.cc:224] Handling call
0709 13:16:42.279324 (+ 20945us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.282731 (+  3407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.282784 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.310202 (+ 27418us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.698233 (+388031us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:42.698271 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.698334 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.704205 (+1005871us) raft_consensus.cc:1685] finished
0709 13:16:43.704234 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.704413 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2961,"raft.queue_time_us":29556,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":387652,"threads_started":1,"wal-append.queue_time_us":849445}
I20260709 13:16:43.617684  6173 consensus_queue.cc:1059] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.082s
W20260709 13:16:43.695072  6126 consensus_meta.cc:287] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.734s	user 0.011s	sys 0.027s
I20260709 13:16:43.689196  5965 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:43.721153  6147 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:16:43.741560  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 44272.6us
I20260709 13:16:43.743484  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:43.765607  3205 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.590838  6116 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:43.685997  5969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.020s	sys 0.023s
I20260709 13:16:43.744890  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:43.748414  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:43.684499  6184 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:43.699030  6152 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:43.690032  6174 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:43.828933  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:43.829831  3278 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:43.769889  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:43.770694  3127 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:43.771026  3131 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:43.772611  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:43.777166  5887 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:43.780042  6127 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:43.683408  6171 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:43.761965  6091 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:43.785022  5940 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.786331  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2315) took 1551 ms. Trace:
I20260709 13:16:43.788017  3211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2419) took 1907 ms. Trace:
I20260709 13:16:43.789530  3207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2418) took 1909 ms. Trace:
I20260709 13:16:43.858162  3207 rpcz_store.cc:276] 0709 13:16:41.880217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.757193 (+876976us) service_pool.cc:224] Handling call
0709 13:16:42.757493 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.453859 (+696366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.789237 (+335378us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b5400195354. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:43.789455 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599976704}
I20260709 13:16:43.790980  5254 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:43.859324  5254 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.859792  5254 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.792479  5962 raft_consensus.cc:3055] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:43.862347  5962 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:43.863364  5962 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:43.797842  5978 raft_consensus.cc:3055] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:43.849269  6116 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.865288  5978 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:43.865588  6177 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:16:43.865427  5795 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:43.866379  5978 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:43.867463  6145 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:43.867928  5978 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.798185  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:43.869174  3278 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:43.846781  6182 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:43.871390  3278 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:43.848963  6174 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:43.846648  6152 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:43.689496  6156 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:43.764845  6126 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:43.873723  3283 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:43.875432  6126 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:43.846540  6184 raft_consensus.cc:697] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:43.842397  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:16:43.849529  5628 consensus_queue.cc:1175] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "43b01d5a97e149008d543a6615219928" responder_term: 5 status { last_received { term: 5 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 5 index: 3 } }
I20260709 13:16:43.854957  6127 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:43.718894  5881 consensus_queue.cc:1059] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
W20260709 13:16:43.844174  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 65333.1us
I20260709 13:16:43.880417  5881 raft_consensus.cc:3055] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:43.880815  5881 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:43.856424  3277 rpcz_store.cc:276] 0709 13:16:42.235326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.503076 (+267750us) service_pool.cc:224] Handling call
0709 13:16:43.189060 (+685984us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.203710 (+ 14650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.786060 (+582350us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54003f2ad0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:43.786248 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1511679360}
I20260709 13:16:43.857144  3211 rpcz_store.cc:276] 0709 13:16:41.880518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.796204 (+915686us) service_pool.cc:224] Handling call
0709 13:16:42.865875 (+ 69671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.997423 (+131548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.997453 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.997498 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:42.997535 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.787697 (+790162us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400195d54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:43.787768 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.787940 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302040320}
I20260709 13:16:43.881718  5881 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:43.882264  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:43.765295  5961 consensus_queue.cc:260] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:43.882954  3207 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:43.883320  5961 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:43.883936  6139 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.894s	user 0.002s	sys 0.000s
I20260709 13:16:43.884116  6091 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.683192  5959 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:43.782220  3276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1166) took 1906 ms (client timeout 1690 ms). Trace:
I20260709 13:16:43.884634  6091 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:43.885488  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2415) took 2006 ms. Trace:
I20260709 13:16:43.781298  3805 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:43.846072  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:43.885911  3204 rpcz_store.cc:276] 0709 13:16:41.879303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.248894 (+369591us) service_pool.cc:224] Handling call
0709 13:16:42.249225 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.249557 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.249596 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.250089 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.592075 (+341986us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:42.592118 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.592188 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.883323 (+1291135us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:43.885167 (+  1844us) raft_consensus.cc:1685] finished
0709 13:16:43.885190 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.885424 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2808,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":7064832,"thread_start_us":341593,"threads_started":1,"wal-append.queue_time_us":681886}
I20260709 13:16:43.887421  5768 raft_consensus.cc:3055] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:43.887884  5768 raft_consensus.cc:740] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:43.847102  6074 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:43.854621  6170 consensus_queue.cc:1059] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.034s
W20260709 13:16:43.884989  3276 rpcz_store.cc:269] 0709 13:16:41.876067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.094203 (+218136us) service_pool.cc:224] Handling call
0709 13:16:43.781922 (+1687719us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b5400038254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:43.782101 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1374997760}
I20260709 13:16:43.852777  5887 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:43.861869  6151 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:43.858317  6150 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 13:16:43.843132  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:43.892205  3835 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:43.893584  6129 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:16:43.882346  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.900593  3202 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:43.888823  5768 consensus_queue.cc:260] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:43.693693  6027 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:43.906540  3203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2408) took 2099 ms. Trace:
I20260709 13:16:43.906956  3203 rpcz_store.cc:276] 0709 13:16:41.806919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.094886 (+287967us) service_pool.cc:224] Handling call
0709 13:16:42.280966 (+186080us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:42.283017 (+  2051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.283059 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:42.353988 (+ 70929us) log.cc:844] Serialized 582 byte log entry
0709 13:16:42.773595 (+419607us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:43.432555 (+658960us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.453345 (+ 20790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.453419 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.579934 (+126515us) raft_consensus.cc:1685] finished
0709 13:16:43.579955 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.906350 (+326395us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54001d8150. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:43.906475 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20485,"raft.queue_time_us":42282,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":2252,"spinlock_wait_cycles":387542272,"thread_start_us":419169,"threads_started":1,"wal-append.queue_time_us":643799}
I20260709 13:16:43.909777  5926 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:43.877113  6184 consensus_queue.cc:237] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:43.913839  5962 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:43.883466  6181 log.cc:927] Time spent T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.218s	user 0.001s	sys 0.001s
I20260709 13:16:43.916987  6066 raft_consensus.cc:3055] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:43.917512  6066 raft_consensus.cc:740] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:43.918622  6066 consensus_queue.cc:260] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:43.883970  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:43.921994  3207 raft_consensus.cc:2410] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:43.923172  3207 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:43.845055  3205 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:16:43.933326  3202 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:16:43.932857  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 151630us
I20260709 13:16:43.933805  5881 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.937762  3834 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:43.937851  6127 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:43.937950  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:43.939666  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:43.940869  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:43.943799  6171 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:43.944986  5976 consensus_meta.cc:287] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.727s	user 0.020s	sys 0.016s
I20260709 13:16:43.945070  6174 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:43.945600  5976 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:43.947203  5887 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:43.948457  6152 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:43.949651  5963 consensus_meta.cc:287] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.548s	user 0.013s	sys 0.009s
I20260709 13:16:43.950177  6103 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:43.950151  5963 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:43.951557  5768 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:43.960500  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.966287  3203 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:43.976331  3282 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:16:43.960956  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 268434us
W20260709 13:16:43.966279  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.984115  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 264387us
I20260709 13:16:43.985985  3249 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:43.992918  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.999364  3806 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:44.020679  3283 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:16:44.022729  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.002183  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:44.029850  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:44.030988  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.031481  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:44.031679  3206 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:44.032694  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:44.034818  3202 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:16:44.037492  3835 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:43.962728  6066 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.054101  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:44.054731  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 334425us
I20260709 13:16:44.053678  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:16:44.057950  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 74576.4us
I20260709 13:16:44.040601  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:44.040060  5254 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.059206  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.071996  3207 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:44.078234  5254 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:44.087693  3100 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:44.089277  6008 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:44.089798  6008 raft_consensus.cc:697] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:44.090673  6008 consensus_queue.cc:237] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.085227  6155 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:44.094230  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2317) took 1738 ms. Trace:
I20260709 13:16:44.096139  5254 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.096691  5254 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.094650  3280 rpcz_store.cc:276] 0709 13:16:42.355374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.536208 (+180834us) service_pool.cc:224] Handling call
0709 13:16:42.539038 (+  2830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.976327 (+437289us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:43.352155 (+375828us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.038848 (+686693us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:44.039440 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:16:44.039672 (+   232us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:44.039703 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.039785 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.094008 (+ 54223us) raft_consensus.cc:1685] finished
0709 13:16:44.094028 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.094164 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46832,"raft.queue_time_us":240401,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":4831,"thread_start_us":1045001,"threads_started":3,"wal-append.queue_time_us":543539}
I20260709 13:16:44.052637  5976 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:44.040462  6103 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:44.037483  6171 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:16:44.054383  6129 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:44.041064  6169 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.053881  6180 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:44.111320  3101 leader_election.cc:400] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9.
I20260709 13:16:44.093572  6155 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.102605  6156 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:44.143680  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.163537  3211 raft_consensus.cc:2410] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:44.114290  6129 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:44.085657  5887 consensus_queue.cc:1059] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:16:44.186455  6127 raft_consensus.cc:3055] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:44.186923  6127 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:44.187920  6127 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:44.152992  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 386934us
I20260709 13:16:44.148123  6169 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.191025  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 280) took 1224 ms. Trace:
W20260709 13:16:44.154899  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.190915  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 278) took 1225 ms. Trace:
I20260709 13:16:44.111135  5426 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:44.138422  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 277) took 1172 ms. Trace:
I20260709 13:16:44.200695  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:44.201890  3208 rpcz_store.cc:276] 0709 13:16:42.965609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.532667 (+567058us) service_pool.cc:224] Handling call
0709 13:16:43.533015 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:43.533418 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.533455 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:43.571016 (+ 37561us) log.cc:844] Serialized 52 byte log entry
0709 13:16:43.736870 (+165854us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:43.870623 (+133753us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b48002727d8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1118aa1 00007fb3c110fb37 00007fb3c110f9ca 00007fb3c120726f 00007fb3c1206f37 00007fb3c121b55c 00007fb3c121b508 00007fb3c121b488 00007fb3c121b443 00007fb3c121a6ec 00007fb3c0144a96
0709 13:16:43.943558 (+ 72935us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b1800404f80. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b9102522 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:16:44.136886 (+193328us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.137706 (+   820us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.138038 (+   332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.138186 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.138223 (+    37us) raft_consensus.cc:1685] finished
0709 13:16:44.138234 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.138363 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25234,"prepare.queue_time_us":179010,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":83,"raft.queue_time_us":2241,"raft.run_cpu_time_us":2490,"raft.run_wall_time_us":339915,"spinlock_wait_cycles":132872832,"thread_start_us":415111,"threads_started":2,"wal-append.queue_time_us":273712}
I20260709 13:16:44.111438  6035 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:44.156736  3101 leader_election.cc:403] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:16:44.144814  5254 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:44.164389  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.167434  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.135810  5959 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:44.174023  3176 leader_election.cc:336] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.690s (SENT)
I20260709 13:16:44.222484  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:44.183320  6156 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:44.184082  6038 consensus_meta.cc:287] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 1.148s	user 0.015s	sys 0.008s
I20260709 13:16:44.108858  5964 consensus_queue.cc:1059] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:16:44.185423  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:44.191926  3210 rpcz_store.cc:276] 0709 13:16:42.965912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.532611 (+566699us) service_pool.cc:224] Handling call
0709 13:16:43.575814 (+ 43203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.580809 (+  4995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.580854 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:43.641471 (+ 60617us) log.cc:844] Serialized 26 byte log entry
0709 13:16:44.040791 (+399320us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:44.093260 (+ 52469us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.093485 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.093557 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.190620 (+ 97063us) raft_consensus.cc:1685] finished
0709 13:16:44.190647 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.190842 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45063,"prepare.queue_time_us":64338,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":5329,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":14045,"thread_start_us":347832,"threads_started":1,"wal-append.queue_time_us":458477}
I20260709 13:16:44.191530  3209 rpcz_store.cc:276] 0709 13:16:42.966499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.629983 (+663484us) service_pool.cc:224] Handling call
0709 13:16:43.630428 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.682070 (+ 51642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.682115 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:43.693952 (+ 11837us) log.cc:844] Serialized 26 byte log entry
0709 13:16:43.966476 (+272524us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:44.057763 (+ 91287us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.058090 (+   327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.058191 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.190816 (+132625us) raft_consensus.cc:1685] finished
0709 13:16:44.190835 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.190965 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":91013,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":35356,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":54117,"thread_start_us":272101,"threads_started":1,"wal-append.queue_time_us":388929}
I20260709 13:16:44.166236  5870 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:44.197521  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 167945us
I20260709 13:16:44.238600  6078 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.199626  3100 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:44.233631  6184 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:44.240476  6194 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:16:44.245409  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.245774  6035 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:44.246196  3207 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:44.247080  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:44.247592  3207 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.247430  6035 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:44.248684  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.251060  6155 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:44.237674  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.252100  5963 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:44.256232  6184 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9.
I20260709 13:16:44.136286  6014 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:16:44.225775  3202 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:44.136487  6103 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:44.231225  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 120065us
I20260709 13:16:44.158974  6098 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.163381  5976 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:44.235118  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 61153.7us
I20260709 13:16:44.192138  6129 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:44.219489  5865 consensus_meta.cc:287] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.005s
I20260709 13:16:44.223409  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:44.275682  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 76165.9us
I20260709 13:16:44.278400  3127 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:44.234241  6009 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:16:44.282226  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.282703  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.269678  6076 consensus_meta.cc:287] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.480s	user 0.010s	sys 0.006s
W20260709 13:16:44.289263  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.292763  3281 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:44.296389  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:44.297662  3282 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:44.298069  3207 raft_consensus.cc:2410] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:44.299929  3276 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:44.300866  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.301826  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:44.302070  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:44.308018  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:44.309679  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.309700  3278 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:44.313730  5795 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.314471  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.314386  5795 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.315210  3278 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:44.319124  6169 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:44.319207  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:44.320052  3133 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:44.282076  6098 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.320991  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:44.326643  3277 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.322139  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.330967  3134 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:16:44.260824  6038 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:44.280337  5881 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:44.262391  5870 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.361014  3207 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:44.361191  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.362044  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.348865  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:44.305223  6076 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 5. Current term is 6.
I20260709 13:16:44.323190  6175 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:44.394608  6175 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:44.395886  6175 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:44.397405  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.400899  3833 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:44.380396  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 47643.3us
I20260709 13:16:44.402328  3100 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:44.405264  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:44.406055  5940 consensus_meta.cc:287] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.005s
I20260709 13:16:44.406414  3834 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:44.408860  6183 consensus_queue.cc:1059] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:16:44.409979  6183 raft_consensus.cc:3055] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:44.410320  6183 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:16:44.385746  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 146125us
I20260709 13:16:44.350257  6093 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:16:44.353318  5881 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.413550  5881 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:44.416023  5978 consensus_meta.cc:287] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.548s	user 0.014s	sys 0.001s
I20260709 13:16:44.287911  6009 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:44.427230  6009 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:44.388716  5870 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:44.346238  6197 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:16:44.279280  5976 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.379016  3102 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:44.345579  6107 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:44.390297  3276 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:44.310494  6174 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:16:44.387854  6078 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:44.357980  6166 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:16:44.417035  3135 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:16:44.469380  3135 pending_rounds.cc:85] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 3
I20260709 13:16:44.469666  3135 pending_rounds.cc:107] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:44.469899  3135 raft_consensus.cc:2889] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:44.418216  3284 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:44.419260  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:44.419803  3840 raft_consensus.cc:2368] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9.
W20260709 13:16:44.420507  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.471272  3130 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 4: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:44.419658  3806 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:44.322722  6156 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:44.453111  3277 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:16:44.454588  3279 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:44.429889  5426 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:44.455077  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.474581  3283 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:44.450682  5966 consensus_queue.cc:1059] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:16:44.412883  6103 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:44.324883  6184 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:44.463635  3100 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:44.479853  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 60323.9us
I20260709 13:16:44.461289  6205 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.455694  6093 consensus_queue.cc:1059] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:16:44.473349  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.483088  3277 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:44.484091  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.485221  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.476891  3281 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:44.478518  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 99619.7us
I20260709 13:16:44.464561  6107 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.480681  3806 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:44.490000  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.474246  5426 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:44.496688  3283 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
W20260709 13:16:44.500551  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 70977.9us
I20260709 13:16:44.497478  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:44.501624  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:44.483832  6023 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:44.489653  6103 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:44.483610  6126 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:44.479521  5870 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:16:44.502789  5426 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.490833  6027 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:16:44.530668  3281 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:16:44.494131  5961 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:16:44.543203  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.513564  6103 raft_consensus.cc:697] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:44.548761  3202 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:44.544813  3206 raft_consensus.cc:3055] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:44.549928  3206 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:44.545775  6098 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:44.546697  6208 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:16:44.483801  6184 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:44.549641  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 69041.2us
I20260709 13:16:44.512218  6023 raft_consensus.cc:697] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:44.551008  3206 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.491439  6205 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:44.570072  3206 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:44.570971  6211 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.180s	user 0.002s	sys 0.000s
I20260709 13:16:44.576092  6027 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.576697  6027 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.568521  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:44.560281  6193 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:44.584681  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 95411.8us
I20260709 13:16:44.586659  3102 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:44.592305  3206 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 13:16:44.596091  3206 pending_rounds.cc:85] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 2
I20260709 13:16:44.596366  3206 pending_rounds.cc:107] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:44.578927  6038 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:44.596601  3206 raft_consensus.cc:2889] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:44.599643  3206 pending_rounds.cc:107] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:16:44.600010  3206 raft_consensus.cc:2889] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:44.600488  3209 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:44.602128  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.602576  3207 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:44.584097  6220 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.598177  5870 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.605176  6014 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.604785  6027 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:44.620072  6210 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:16:44.613967  5768 consensus_meta.cc:287] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.580s	user 0.006s	sys 0.006s
W20260709 13:16:44.623968  6078 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:16:44.624500  6225 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:44.625108  6225 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:44.626070  6225 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:44.616457  5976 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:44.614009  6103 consensus_queue.cc:237] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.653139  5426 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.655726  3100 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:44.668501  6184 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:44.658939  6107 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:44.626757  6023 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:44.669863  6129 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:44.672529  3835 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:44.636164  6014 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:44.716130  6183 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:44.717927  6193 raft_consensus.cc:3055] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:44.718832  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.782413  3283 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:44.720100  6129 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:44.674664  6205 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:44.745978  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:44.761518  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:44.762347  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.762948  6228 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:44.763057  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:44.793962  3210 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.763729  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.765174  6198 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:44.766981  6196 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.767441  6180 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.766619  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:44.771746  6163 log.cc:927] Time spent T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.223s	user 0.010s	sys 0.020s
I20260709 13:16:44.778810  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.780174  5881 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.711099  6107 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:44.772805  6127 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.793258  3285 raft_consensus.cc:2368] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8.
I20260709 13:16:44.793792  6228 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.797462  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.811620  6228 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.804272  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:44.812433  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.804993  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.783004  6193 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:44.807369  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:44.810196  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 48465.1us
I20260709 13:16:44.803277  6198 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:44.813687  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.818430  3278 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:44.818624  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:44.819237  3283 raft_consensus.cc:2376] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5. Re-sending same reply.
I20260709 13:16:44.815949  3250 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:44.820237  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.803992  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:44.801662  5768 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:44.821331  3205 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:44.821475  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:44.819252  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.826354  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:44.827915  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 249239us
I20260709 13:16:44.827003  3283 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:44.828951  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:44.832487  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:44.832652  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:44.840586  3210 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:44.843318  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.849027  6146 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:44.847265  5959 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:44.844408  5768 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:44.830996  6129 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.860414  3805 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:44.812624  6107 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.866560  6014 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:44.869299  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.874989  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:44.867785  6107 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:44.806936  6180 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.877375  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.874209  6146 raft_consensus.cc:697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:44.893713  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:44.901126  3285 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:16:44.902594  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:44.870591  6193 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:44.968375  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.953958  6107 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:44.991659  6107 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.992461  6198 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:44.812517  6196 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:44.896392  6035 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:45.054176  3282 raft_consensus.cc:2368] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8.
I20260709 13:16:45.086045  6078 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:45.061668  6129 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:45.063359  5881 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:45.086876  6078 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.062049  6146 consensus_queue.cc:237] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.103559  6129 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:45.159610  3100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.008s	sys 0.005s
W20260709 13:16:45.204753  3100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.009s	sys 0.006s
W20260709 13:16:45.205351  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 548724us
W20260709 13:16:45.242966  3101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.021s	sys 0.059s
W20260709 13:16:45.243523  3101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.021s	sys 0.059s
I20260709 13:16:45.267225  6227 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.268000  6227 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.147415  6098 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:45.160043  3176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.007s	sys 0.005s
W20260709 13:16:45.273360  3176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.007s	sys 0.006s
W20260709 13:16:45.293340  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 944579us
I20260709 13:16:45.294589  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:45.296878  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:45.313640  6232 log.cc:927] Time spent T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:16:45.315671  6175 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:45.151227  6180 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:45.342126  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 45335.2us
W20260709 13:16:45.394024  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.535527  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:45.536217  3278 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:45.537333  6035 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:45.537665  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 705209us
I20260709 13:16:45.538226  6237 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:45.538589  3249 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:16:45.540607  6127 consensus_meta.cc:287] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.725s	user 0.005s	sys 0.006s
I20260709 13:16:45.540957  6107 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:45.541172  6193 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:45.507257  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.545553  6196 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:45.538797  6237 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:45.553908  6237 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:45.558590  6205 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.002s	sys 0.015s
W20260709 13:16:45.559134  6205 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.002s	sys 0.015s
I20260709 13:16:45.538509  6035 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:45.350020  6233 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 13:16:45.417490  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.340070  6231 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.563376  6231 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.564515  6175 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.541610  6107 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.574421  6107 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:45.575363  3176 connection.cc:256] RPC call timeout handler was delayed by -1.2168361430001369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
I20260709 13:16:45.574261  6175 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:45.576323  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.580809  6035 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:45.566458  6174 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:45.452741  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 228236us
I20260709 13:16:45.565714  6129 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:45.590991  6174 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.594928  6174 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:45.601393  6174 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:45.597204  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:45.597673  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:45.602569  5768 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:45.604897  6237 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.605129  6174 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.607283  6237 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:45.607502  6174 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:45.607913  6237 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.608430  6237 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.601588  6091 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:45.610620  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:45.611558  3130 raft_consensus.cc:2393] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:16:45.599776  5870 consensus_meta.cc:287] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.982s	user 0.010s	sys 0.002s
W20260709 13:16:45.595705  6103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.003s	sys 0.007s
I20260709 13:16:45.612689  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.613523  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.625712  3134 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:16:45.626786  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.614210  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.615204  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.628575  3129 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:45.617874  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 359) took 1165 ms. Trace:
I20260709 13:16:45.629565  3277 rpcz_store.cc:276] 0709 13:16:44.452817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.485986 (+ 33169us) service_pool.cc:224] Handling call
0709 13:16:44.486305 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:44.794193 (+307888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.794239 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:44.794795 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:16:45.127098 (+332303us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:45.127164 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.127271 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.617642 (+490371us) raft_consensus.cc:1685] finished
0709 13:16:45.617668 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.617812 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":308041,"raft.queue_time_us":308573,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":8846,"thread_start_us":329613,"threads_started":1,"wal-append.queue_time_us":818726}
I20260709 13:16:45.631026  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:45.620930  3132 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:45.633571  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:45.634194  3127 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.636778  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.637719  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.640403  3277 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:45.625500  6127 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:45.642427  3277 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:16:45.644659  3277 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:16:45.647349  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:45.625316  6103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.004s	sys 0.007s
I20260709 13:16:45.609356  6184 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.620672  6098 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.654389  3100 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:45.652485  3133 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:45.655689  3278 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:45.655244  3250 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:45.625164  5870 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:45.633131  6224 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.633260  6156 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:45.666004  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 127504us
I20260709 13:16:45.666461  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1426) took 1367 ms. Trace:
I20260709 13:16:45.668605  3135 rpcz_store.cc:276] 0709 13:16:44.299435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.299544 (+   109us) service_pool.cc:224] Handling call
0709 13:16:44.321818 (+ 22274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.470356 (+148538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.666231 (+1195875us) spinlock_profiling.cc:243] Waited 94.9 ms on lock 0x7b5400075654. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:45.666402 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218174848}
I20260709 13:16:45.670435  3127 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:45.647730  6023 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.653874  6014 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.660387  6238 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.678176  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2456) took 1079 ms. Trace:
I20260709 13:16:45.644536  5940 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:16:45.662156  6196 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:45.679261  3202 rpcz_store.cc:276] 0709 13:16:44.599060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.603114 (+  4054us) service_pool.cc:224] Handling call
0709 13:16:44.603402 (+   288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:44.606190 (+  2788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.606222 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:44.611242 (+  5020us) log.cc:844] Serialized 52 byte log entry
0709 13:16:44.827453 (+216211us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:44.864977 (+ 37524us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.865890 (+   913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.865966 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.883662 (+ 17696us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b1800072b80. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:16:45.674430 (+790768us) raft_consensus.cc:1685] finished
0709 13:16:45.677950 (+  3520us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.678103 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4792,"prepare.queue_time_us":39585,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":3689,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":10634,"spinlock_wait_cycles":2817792,"thread_start_us":192353,"threads_started":1,"wal-append.queue_time_us":453371}
I20260709 13:16:45.665324  6156 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:45.661250  6184 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.683609  6078 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:45.643123  6127 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.677573  6216 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.664011  6055 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:16:45.703646  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:45.669956  6091 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:45.709720  3129 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:45.709955  6091 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.712239  6091 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:45.704782  3176 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.529s (SENT) [suppressed 25 similar messages]
I20260709 13:16:45.680259  6174 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:45.668988  5768 consensus_queue.cc:1059] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:16:45.706388  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2338) took 1410 ms. Trace:
I20260709 13:16:45.717927  3281 rpcz_store.cc:276] 0709 13:16:44.296044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.296171 (+   127us) service_pool.cc:224] Handling call
0709 13:16:45.706156 (+1409985us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54001b80d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:45.706326 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413684608}
I20260709 13:16:45.676489  6234 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:45.681162  6196 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.663370  6098 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.715564  5935 raft_consensus.cc:3055] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:45.704018  6156 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.669605  6224 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.723358  3842 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:45.680539  6014 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.677636  6023 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.723083  5935 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:45.730055  6127 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:45.730007  5935 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.723479  6091 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:45.731036  6231 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:45.731369  5935 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.733008  6066 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:45.735249  3835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 460) took 1232 ms. Trace:
I20260709 13:16:45.735760  3835 rpcz_store.cc:276] 0709 13:16:44.502446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.502668 (+   222us) service_pool.cc:224] Handling call
0709 13:16:44.502959 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.672917 (+169958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.734917 (+1062000us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54002175d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:45.735166 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389517056}
I20260709 13:16:45.731161  6091 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.739161  6091 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:45.740322  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1171) took 1021 ms. Trace:
I20260709 13:16:45.741850  5768 raft_consensus.cc:3055] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:45.740849  3282 rpcz_store.cc:276] 0709 13:16:44.719092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.778436 (+ 59344us) service_pool.cc:224] Handling call
0709 13:16:45.740057 (+961621us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54001e00d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:45.740236 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576354688}
I20260709 13:16:45.720059  6196 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.720276  6234 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.722636  6227 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:45.759431  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 54678.8us
I20260709 13:16:45.681785  6238 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:45.762048  3176 leader_election.cc:336] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.875s (SENT)
I20260709 13:16:45.722501  6247 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:16:45.757827  6234 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.751992  5768 raft_consensus.cc:740] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:45.775463  3176 leader_election.cc:336] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.938s (SENT)
I20260709 13:16:45.721557  6174 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.819555  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:45.809523  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:45.829624  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 54200.7us
W20260709 13:16:45.830168  3176 leader_election.cc:336] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.983s (SENT)
W20260709 13:16:45.831715  3176 leader_election.cc:336] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 2.836s (SENT)
I20260709 13:16:45.832132  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:45.763850  6224 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:45.716293  6216 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:45.835179  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 166310us
I20260709 13:16:45.780794  6237 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:45.835304  3806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.005s	sys 0.005s
I20260709 13:16:45.838780  6252 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:16:45.840670  3806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.005s	sys 0.005s
I20260709 13:16:45.835220  5966 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:45.833371  6197 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:45.837023  6146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.004s	sys 0.008s
I20260709 13:16:45.848907  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:45.846570  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.849507  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:45.849146  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:45.854441  3207 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:45.839954  6091 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:45.856164  6127 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.856885  3202 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:45.857432  3806 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:45.853973  6146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.004s	sys 0.009s
W20260709 13:16:45.853523  6228 consensus_meta.cc:287] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 1.041s	user 0.015s	sys 0.000s
I20260709 13:16:45.861984  3806 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:45.901389  6228 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.902170  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:45.851578  6126 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.856343  6205 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:45.902930  3832 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:45.904039  6227 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:16:45.903892  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:45.908483  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2341) took 1611 ms. Trace:
I20260709 13:16:45.908716  6227 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:45.908908  3284 rpcz_store.cc:276] 0709 13:16:44.296993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.297124 (+   131us) service_pool.cc:224] Handling call
0709 13:16:45.908323 (+1611199us) spinlock_profiling.cc:243] Waited 90.4 ms on lock 0x7b540022d154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:45.908417 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207958400}
I20260709 13:16:45.874679  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:45.875952  6239 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:16:45.876289  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2343) took 1578 ms. Trace:
I20260709 13:16:45.910688  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:45.910919  3279 rpcz_store.cc:276] 0709 13:16:44.297583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.309426 (+ 11843us) service_pool.cc:224] Handling call
0709 13:16:45.876107 (+1566681us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400182254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:45.876225 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329786112}
W20260709 13:16:45.878830  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.859078  6035 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:45.918349  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 337) took 1617 ms. Trace:
I20260709 13:16:45.851337  5768 consensus_queue.cc:260] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.882782  6174 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:45.883627  6098 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:45.884975  5795 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:45.904533  6255 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:45.887056  6014 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:45.889159  6216 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:45.889756  6238 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:45.889833  6247 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:45.891165  5978 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:45.862195  6127 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.869448  6224 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:45.954943  6224 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.894618  6252 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:45.903460  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:45.913195  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 246108us
I20260709 13:16:45.913352  3283 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:45.902838  6038 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:45.957365  6252 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.957923  6038 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:45.958185  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:45.912777  3276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2346) took 1614 ms (client timeout 1700 ms). Trace:
I20260709 13:16:45.923974  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:45.959167  3841 raft_consensus.cc:2410] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:45.959718  6252 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:45.959987  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:45.915683  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:45.918761  3131 rpcz_store.cc:276] 0709 13:16:44.300494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.303369 (+  2875us) service_pool.cc:224] Handling call
0709 13:16:44.346069 (+ 42700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.428067 (+ 81998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.428112 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.428177 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:44.428232 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.918112 (+1489880us) spinlock_profiling.cc:243] Waited 81.7 ms on lock 0x7b5400415fd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:45.918159 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.918289 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187957120}
W20260709 13:16:45.924571  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.926841  3836 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:45.961174  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:45.961503  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.927425  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:45.962095  3102 leader_election.cc:400] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9.
I20260709 13:16:45.962405  3208 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:45.962631  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.962836  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:45.930498  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.963214  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:45.963491  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:45.927471  3207 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:45.964033  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.964938  3127 raft_consensus.cc:2410] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:45.965476  6055 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:45.931461  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.965706  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.966586  6008 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:45.966717  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:45.966857  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.930758  3135 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:16:45.967478  3130 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:45.933777  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:45.958873  3276 rpcz_store.cc:269] 0709 13:16:44.298733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.300653 (+  1920us) service_pool.cc:224] Handling call
0709 13:16:45.912602 (+1611949us) spinlock_profiling.cc:243] Waited 88.8 ms on lock 0x7b54001ea854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:45.912718 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204226944}
I20260709 13:16:45.935642  5795 consensus_queue.cc:1059] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:16:45.934080  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:45.970549  5795 raft_consensus.cc:3055] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:45.970710  3210 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:45.970975  5795 raft_consensus.cc:740] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:45.971382  3833 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:45.921060  5768 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.971648  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:45.972496  3207 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:45.972681  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 362) took 1106 ms. Trace:
I20260709 13:16:45.973448  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:45.974261  3207 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:45.904896  6023 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:45.937176  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:45.938509  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:45.976567  3211 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:45.857184  6175 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.977224  6055 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:45.977641  6116 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:45.854678  6197 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.969272  6127 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:45.946909  5426 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:45.947371  5978 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.921612  6255 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:45.925819  6035 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.978468  6226 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:45.918850  6126 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.922235  5881 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:16:45.952119  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.904224  5870 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:16:46.004849  6258 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.021171  6258 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:45.926505  6156 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.958412  6038 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.929742  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:45.971707  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:45.936363  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.973109  3285 rpcz_store.cc:276] 0709 13:16:44.866343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.537169 (+670826us) service_pool.cc:224] Handling call
0709 13:16:45.537495 (+   326us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:45.609722 (+ 72227us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:45.635422 (+ 25700us) log.cc:844] Serialized 14 byte log entry
0709 13:16:45.847159 (+211737us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:45.861100 (+ 13941us) log.cc:844] Serialized 52 byte log entry
0709 13:16:45.871247 (+ 10147us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:45.871303 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.871401 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.972455 (+101054us) raft_consensus.cc:1685] finished
0709 13:16:45.972480 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.972620 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71786,"prepare.queue_time_us":25514,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":124857,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":11121,"thread_start_us":175569,"threads_started":1,"wal-append.queue_time_us":281032}
I20260709 13:16:45.909327  6205 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.933552  6228 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:45.978986  3205 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:45.980073  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:45.963837  3208 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
W20260709 13:16:46.040635  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 114752us
I20260709 13:16:45.963225  3131 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:45.963996  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:45.964103  3203 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:45.981070  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:45.991418  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:45.993059  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:46.042325  3838 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
W20260709 13:16:45.995020  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.943009  6247 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.044499  3102 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:46.045020  6247 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:46.045585  6247 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:46.045631  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 65614.3us
I20260709 13:16:45.999972  6227 consensus_queue.cc:1059] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:16:46.046464  3249 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.047194  5935 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:46.047542  3249 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:46.047716  5935 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.048259  5935 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.048512  6258 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:46.048732  3249 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:45.996599  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 92974us
W20260709 13:16:45.994818  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 53123.3us
I20260709 13:16:46.050918  3806 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:46.051219  5426 raft_consensus.cc:3055] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:45.950268  6107 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:46.007843  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.058152  3281 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:46.007326  6255 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.008608  3177 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.013129  6035 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:46.015452  6126 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:46.015790  6197 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:46.008558  6055 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.019120  6224 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:45.971814  5795 consensus_queue.cc:260] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:45.926617  6098 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:45.939998  6192 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.049432  6175 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:45.975776  6234 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.049443  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:46.010076  6226 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.997751  3282 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:45.938988  6216 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:46.060878  6252 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:46.102512  6216 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.092869  6126 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:46.105934  6126 raft_consensus.cc:697] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:46.106248  6205 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:46.106837  6126 consensus_queue.cc:237] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.112109  5978 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:46.010450  3128 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:46.058540  3249 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:46.059351  3276 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:46.002655  6152 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:16:46.060297  3100 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:46.061472  6251 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:46.115528  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 57064.1us
W20260709 13:16:46.069168  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 105236us
I20260709 13:16:46.071939  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:46.073225  6146 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:46.078576  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.121315  6146 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:46.121894  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 43900.7us
I20260709 13:16:46.019294  6196 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.056550  6258 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:46.088538  6076 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:46.058162  6262 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.088977  6098 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:46.124601  6262 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.125512  6098 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.126811  6098 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.126982  6262 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:46.127635  6262 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:46.057766  5426 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:46.041706  3130 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:46.095106  6192 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.130144  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:46.130743  6192 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:46.130970  3130 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:46.133473  5795 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.135320  6196 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:46.093933  6226 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.096112  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:46.096339  6156 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:46.079867  6261 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:16:46.141594  3131 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:16:46.115641  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 55425.8us
I20260709 13:16:46.142823  3100 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:46.143100  6223 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:46.143760  3100 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:46.143958  6183 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.132776  3130 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:46.144574  3100 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:46.068640  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 61753.3us
I20260709 13:16:46.144968  6234 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:46.145771  6251 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:46.146214  6251 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.116508  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:46.070946  6023 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:46.117940  5978 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:46.118139  6175 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:46.123729  6146 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:46.176244  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:46.128816  5426 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.067847  5881 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:16:46.149251  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:46.149843  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:46.116976  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 45138.1us
I20260709 13:16:46.149942  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.150012  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.151139  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:16:46.166368  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 49748.8us
W20260709 13:16:46.166726  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 50302.1us
I20260709 13:16:46.104947  6216 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:46.176993  3128 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:16:46.178766  6262 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:46.225519  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:46.226755  3207 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.226615  3281 raft_consensus.cc:2376] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12. Re-sending same reply.
I20260709 13:16:46.228075  3249 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.234974  6038 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:46.244808  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 93736.8us
I20260709 13:16:46.182006  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.239130  3249 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.226687  3832 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:46.246702  3249 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.247282  3177 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:46.166965  6200 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:46.177676  6192 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:46.246034  3282 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:46.251063  3249 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.250432  5978 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:46.252617  3204 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:46.178236  6196 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:46.255247  6193 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:46.254379  6231 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:46.166036  6093 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:46.257629  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 203975us
I20260709 13:16:46.280401  3805 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:46.282120  3207 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:46.258241  3100 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:46.177870  5870 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:46.263120  3249 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:46.174239  6238 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:46.249678  6224 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:46.255951  3101 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:46.266640  3836 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:46.270328  3806 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:46.277164  6237 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.289330  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.249583  5426 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.289919  6038 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:46.259498  6146 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:46.263347  6192 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.289973  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.261301  6107 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:46.260748  6156 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:46.302013  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.176316  6175 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:46.461449  6175 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.308216  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:46.462847  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:46.463781  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:46.372852  3277 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:46.311798  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.463785  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.263079  6200 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:46.310771  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 56696.5us
I20260709 13:16:46.314424  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:46.467144  3282 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:46.363593  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47290.9us
I20260709 13:16:46.312520  6093 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.367599  6286 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.370092  3281 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: [4.3-7.4]
I20260709 13:16:46.371006  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.278234  5768 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:46.285044  5870 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.509106  5870 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.360916  6252 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.363502  6035 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:46.513394  6035 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:46.513857  6035 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.363723  6262 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:46.517292  6262 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.517663  6262 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.373138  6192 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.519536  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:46.520274  3205 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.450656  6107 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:46.521611  6107 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.309939  5978 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.302515  6238 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:46.382719  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.373773  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:46.310727  6258 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:46.360687  6237 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.453418  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:46.533601  3205 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
W20260709 13:16:46.309229  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 51052.8us
W20260709 13:16:46.463848  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 173960us
I20260709 13:16:46.312196  6014 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:46.536247  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:46.465472  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.466480  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:46.471930  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 155091us
I20260709 13:16:46.538333  3207 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.489207  6287 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.540194  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.540884  3277 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:46.488484  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.541708  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.542232  3281 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:46.541994  3251 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:46.542430  3277 raft_consensus.cc:2368] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8.
I20260709 13:16:46.543586  3251 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.486864  3285 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:46.470335  6216 raft_consensus.cc:2764] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:16:46.507720  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.312556  6196 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.541474  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:46.361030  6247 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.550752  3249 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.552127  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.552759  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.553225  3207 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:16:46.545416  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.543648  3100 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:46.546370  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:46.522441  6224 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:46.557415  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.557626  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:46.558399  3281 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:46.559417  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:46.533856  6238 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:46.555316  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:46.559485  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.544617  3282 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:46.564157  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.564456  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.486270  6286 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.560508  3281 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.565056  3282 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:46.565922  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:46.549301  5768 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:46.536479  6014 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.567730  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:46.567391  5795 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:46.522197  5978 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.513386  6252 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.545722  5733 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:46.567589  6279 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:46.581385  3176 leader_election.cc:400] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8.
I20260709 13:16:46.581884  3176 leader_election.cc:403] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:46.570106  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.582542  3277 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:46.583482  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.583721  3100 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:46.584862  3277 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:46.579672  3281 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:46.547638  6258 raft_consensus.cc:697] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:46.585472  3176 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:46.590591  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:46.590986  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.591214  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:46.585884  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:46.572536  6014 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.589287  6183 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8.
I20260709 13:16:46.568802  6231 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:46.611258  6258 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.592078  3281 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:46.559949  6146 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:46.559108  6216 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:46.595292  3282 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:46.599444  6076 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:46.607097  6223 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.545233  6255 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.557102  6156 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:46.572695  5795 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:46.584975  5935 consensus_meta.cc:287] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.003s
I20260709 13:16:46.615211  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.554157  6196 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.627696  3281 raft_consensus.cc:2410] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:16:46.627457  3284 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:46.594836  6151 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:46.629416  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.630856  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:46.631182  3284 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:46.632424  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:46.633603  6280 log.cc:927] Time spent T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:16:46.618654  5733 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:46.559332  6247 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.629626  5795 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.639653  6255 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:46.640547  3840 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:46.641763  6093 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:46.630945  6151 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:46.645812  6151 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:46.637398  5733 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:46.649312  5733 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.631079  5935 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.649714  6200 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:46.651487  5935 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:46.652001  6200 consensus_queue.cc:1059] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:46.630906  5964 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:46.548732  6287 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.563246  6224 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.655158  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.657625  3281 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:46.658778  3284 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:16:46.630378  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 86542.2us
I20260709 13:16:46.658985  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.661386  3281 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:16:46.664695  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:46.628667  6223 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:46.660967  3806 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:46.655821  6078 raft_consensus.cc:3055] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:46.674093  6078 raft_consensus.cc:740] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:46.674916  6078 consensus_queue.cc:260] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.676110  6078 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.676373  6282 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:46.676949  6282 raft_consensus.cc:697] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:46.679354  3285 raft_consensus.cc:2410] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:46.665362  3251 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:46.667991  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:46.682005  3203 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:16:46.682942  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:46.683439  3203 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.625038  6231 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:46.669854  3278 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:16:46.687796  3278 pending_rounds.cc:85] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 2
I20260709 13:16:46.688051  3278 pending_rounds.cc:107] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:46.688282  3278 raft_consensus.cc:2889] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:46.688611  3278 pending_rounds.cc:107] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:46.688841  3278 raft_consensus.cc:2889] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:46.655966  6255 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.676136  6251 consensus_meta.cc:287] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.000s
I20260709 13:16:46.692296  6231 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.694034  6209 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.696391  5870 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.697487  6247 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:46.691772  5978 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:46.708746  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 43482.1us
I20260709 13:16:46.665424  3281 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.722501  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:46.741067  3284 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:46.736127  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:46.747294  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:16:46.757195  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 166264us
I20260709 13:16:46.758893  3282 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:46.670189  6262 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.727491  6146 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:46.767717  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.771422  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.677855  6282 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.680850  6035 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:46.769284  6098 consensus_meta.cc:287] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.004s
I20260709 13:16:46.766932  6216 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.774593  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.781278  3284 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:46.781584  3203 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:46.761847  5426 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:46.778694  3281 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:46.791313  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.791610  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.791920  3284 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:46.709352  6255 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.795383  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:46.796521  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:46.796610  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.794593  3277 raft_consensus.cc:2410] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:16:46.797842  3284 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:46.792831  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.798532  3281 raft_consensus.cc:2368] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9.
I20260709 13:16:46.799304  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:46.775421  6093 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:46.770502  6219 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:46.794284  3806 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:46.800858  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.801527  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.795503  5426 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.775815  6200 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:46.796212  6076 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:46.734725  6251 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:46.796289  6226 consensus_meta.cc:287] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.659s	user 0.011s	sys 0.000s
I20260709 13:16:46.810392  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.838999  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:46.839095  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.739675  6209 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:46.840389  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.844575  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 131868us
I20260709 13:16:46.805811  6093 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:46.848848  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.849851  3280 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:46.848007  3835 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:46.847913  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:46.809551  5426 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:46.835382  6277 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:46.823586  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.858341  5870 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:46.858516  6291 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:46.841148  6183 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:46.797988  6216 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.861634  3840 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:46.852159  3176 leader_election.cc:400] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9.
I20260709 13:16:46.835774  6219 raft_consensus.cc:697] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:46.887588  6291 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:46.887347  6219 consensus_queue.cc:237] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.888643  6209 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:46.867487  6196 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:46.880107  6035 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:46.890203  3176 leader_election.cc:403] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:46.893028  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.855895  6093 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:46.894958  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.859555  5964 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:46.897836  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 46406.3us
I20260709 13:16:46.883100  6183 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.888553  6291 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.885095  6224 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:46.893388  6277 raft_consensus.cc:697] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:46.916582  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:46.896042  6275 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.919755  3284 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.885996  6098 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:16:46.902421  6076 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9.
I20260709 13:16:46.913983  6183 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:46.904400  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:46.893685  6288 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.843823  6226 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.900854  6107 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.946614  3284 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:46.936350  5795 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.950088  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:46.955646  3284 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:46.960629  3134 raft_consensus.cc:2368] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9.
I20260709 13:16:46.914167  6014 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:46.971881  3207 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:46.924203  6275 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:46.977733  6275 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:46.948879  6255 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:47.006991  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 106579us
I20260709 13:16:47.009383  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:47.010115  3284 raft_consensus.cc:2393] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:46.934959  6192 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:46.979894  6175 consensus_meta.cc:287] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.000s
I20260709 13:16:46.958381  6076 consensus_queue.cc:1059] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 13:16:47.012137  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 107819us
I20260709 13:16:47.019027  3203 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:47.004215  6262 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.014075  6078 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:47.024166  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:46.948665  6288 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.016369  6223 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.029816  5795 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.030458  5795 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:47.030753  6223 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:47.030817  5795 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:47.031467  5795 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:47.032755  6266 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.927s	user 0.005s	sys 0.000s
I20260709 13:16:47.023175  6076 raft_consensus.cc:3055] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:47.034053  6076 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:47.034873  6076 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.036080  6076 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.039275  5426 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.040113  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:47.040606  3284 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.992861  5733 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.038390  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2461) took 1112 ms. Trace:
I20260709 13:16:47.043165  3202 rpcz_store.cc:276] 0709 13:16:45.925937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.926107 (+   170us) service_pool.cc:224] Handling call
0709 13:16:45.926459 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.926785 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.926814 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:45.939734 (+ 12920us) log.cc:844] Serialized 26 byte log entry
0709 13:16:46.002061 (+ 62327us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:46.002846 (+   785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.002920 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.017653 (+1014733us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:47.038089 (+ 20436us) raft_consensus.cc:1685] finished
0709 13:16:47.038111 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.038325 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":731,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":4309,"spinlock_wait_cycles":20820736,"thread_start_us":56051,"threads_started":1,"wal-append.queue_time_us":147489}
I20260709 13:16:47.045143  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.003072  6277 consensus_queue.cc:237] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.013778  6175 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.073462  6288 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:47.076009  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.076946  3210 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:47.077982  6107 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:47.039194  6251 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:47.079331  5426 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.082516  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:47.083153  3202 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.069358  6216 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.085498  6175 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.086416  6226 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:47.091536  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.094726  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:47.095342  3210 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:47.099817  3284 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:16:47.100735  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:47.103014  3284 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:16:47.108435  6014 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.131023  6291 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:47.133119  6291 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.134559  3833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 550) took 1233 ms. Trace:
I20260709 13:16:47.135006  3833 rpcz_store.cc:276] 0709 13:16:45.900674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.903617 (+  2943us) service_pool.cc:224] Handling call
0709 13:16:47.134330 (+1230713us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b54006086d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:47.134486 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144405888}
I20260709 13:16:47.137439  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.136745  6291 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.140352  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.141522  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.141950  6192 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.142103  3208 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:47.143096  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:47.144090  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.144793  3208 raft_consensus.cc:2410] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:16:47.138691  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.148319  3207 raft_consensus.cc:2410] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:47.149117  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:47.149509  6151 consensus_meta.cc:287] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 13:16:47.149657  3207 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.149962  6151 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.138942  3805 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:47.152412  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.153298  3208 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:47.154139  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.166378  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:47.180272  3202 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:47.181133  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:47.180138  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:47.181284  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.181212  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:47.182235  3832 raft_consensus.cc:1240] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:47.181907  3842 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:47.183267  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:47.185003  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:47.192824  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:47.193058  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:47.193745  3841 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.192874  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:47.195112  3284 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:47.163007  6225 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.180073  6291 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.192332  6076 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:47.194025  6175 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:47.201615  3835 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:47.206672  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.198990  6302 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:47.207533  3102 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:47.192514  6216 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:47.196259  6107 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:47.212472  3208 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:47.216904  3284 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:47.215512  3210 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:47.220263  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.225466  5426 consensus_queue.cc:1059] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:47.226044  3207 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:16:47.220116  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:47.210990  6076 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:47.197134  6152 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:16:47.214289  6175 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.231365  3805 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:47.232514  3841 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:47.208895  6192 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:47.218736  6107 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.219007  6216 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.231954  6076 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.235042  6216 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.236853  6225 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:47.237413  6225 raft_consensus.cc:697] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:47.238214  6225 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.215271  6014 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:47.212827  6302 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:47.233817  3207 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 13:16:47.211131  6291 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.243081  6107 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.230002  6078 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:47.228478  6226 raft_consensus.cc:3055] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:47.243770  6078 raft_consensus.cc:697] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:47.247717  6078 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.245831  6261 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:47.244494  6302 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.246174  6291 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.234582  6175 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.248865  3207 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:47.249055  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:47.252296  3842 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:47.253595  3284 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:16:47.253372  6238 consensus_meta.cc:287] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.001s
I20260709 13:16:47.253947  6261 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.273521  6238 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.273763  6216 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.275265  6261 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:47.244346  6192 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.248967  6183 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.276117  6238 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.277814  6192 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.278601  6183 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.266777  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:47.279649  3284 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:47.245129  6226 raft_consensus.cc:740] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:47.281071  6226 consensus_queue.cc:260] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.283107  6226 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:47.287348  6261 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:47.288226  6261 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.289333  5795 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.290899  6216 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:47.291244  5795 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.291357  6261 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:47.268365  6093 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.294469  6093 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.297729  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:47.300642  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:47.300151  6076 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.301410  3284 raft_consensus.cc:2368] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9.
I20260709 13:16:47.301247  6175 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.302290  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:47.298739  6302 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.298758  6107 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.303606  6175 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.304157  3284 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:47.304478  6302 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.304728  6107 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.305114  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:47.306038  6076 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.306322  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:47.365131  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:47.364632  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:47.368044  3176 leader_election.cc:400] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9.
I20260709 13:16:47.368631  3176 leader_election.cc:403] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:16:47.368778  3102 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:47.372337  3207 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:47.372150  3208 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:47.375404  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1477) took 1070 ms. Trace:
I20260709 13:16:47.375468  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.280176  3210 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:47.376055  3208 rpcz_store.cc:276] 0709 13:16:46.304629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.233139 (+928510us) service_pool.cc:224] Handling call
0709 13:16:47.249614 (+ 16475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.373397 (+123783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.374823 (+  1426us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400153bd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:47.375256 (+   433us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280051456}
I20260709 13:16:47.381515  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.382589  3208 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:47.383651  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.384526  3208 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:47.386431  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1197) took 1450 ms. Trace:
I20260709 13:16:47.386924  3134 rpcz_store.cc:276] 0709 13:16:45.935933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.936068 (+   135us) service_pool.cc:224] Handling call
0709 13:16:47.385927 (+1449859us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b54002dad54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:47.386197 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2131959040}
I20260709 13:16:47.387605  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:47.391878  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.391156  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.392968  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.393268  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:47.393743  6107 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9.
I20260709 13:16:47.393882  3135 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:47.394608  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.394779  6302 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:47.395210  5870 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:47.395304  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.396229  5870 raft_consensus.cc:697] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:47.396763  6076 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:47.397410  6076 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:47.396255  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.402204  5940 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.403321  5940 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.404341  3134 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:47.407347  3284 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:47.408587  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1187) took 1010 ms. Trace:
I20260709 13:16:47.409063  3284 rpcz_store.cc:276] 0709 13:16:46.398212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.307231 (+909019us) service_pool.cc:224] Handling call
0709 13:16:47.406362 (+ 99131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.407882 (+  1520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.408167 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.397636  6238 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:47.397846  3176 leader_election.cc:400] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9.
I20260709 13:16:47.417508  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:47.424196  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.414913  6076 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.422807  6238 raft_consensus.cc:697] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:47.432991  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.437309  3838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 555) took 1393 ms. Trace:
I20260709 13:16:47.437822  3838 rpcz_store.cc:276] 0709 13:16:46.043847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.056370 (+ 12523us) service_pool.cc:224] Handling call
0709 13:16:46.059636 (+  3266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.071676 (+ 12040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.071709 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.071752 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:46.071781 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.436613 (+1364832us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b5400715554. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:47.436695 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.436994 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27194752}
I20260709 13:16:47.434108  6234 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:47.443945  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 46578.1us
I20260709 13:16:47.439437  6184 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:47.433545  6282 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:47.447144  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:47.448132  6282 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.452054  6282 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.453897  6238 consensus_queue.cc:237] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.457062  3102 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:47.456919  6246 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:16:47.458741  3277 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:16:47.459757  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1189) took 1061 ms. Trace:
I20260709 13:16:47.460207  3277 rpcz_store.cc:276] 0709 13:16:46.398934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.389026 (+990092us) service_pool.cc:224] Handling call
0709 13:16:47.429158 (+ 40132us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:47.459346 (+ 30188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.459682 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.464336  6151 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.464465  5870 consensus_queue.cc:237] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.470974  6224 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:47.473310  3284 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:47.480271  6261 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.481585  6200 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:47.481372  6261 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.482618  6200 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.486034  6261 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:47.486969  6200 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:47.495388  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.481421  6027 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 13:16:47.499631  6268 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 1.404s	user 0.000s	sys 0.002s
I20260709 13:16:47.501463  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1193) took 1572 ms. Trace:
I20260709 13:16:47.501932  3133 rpcz_store.cc:276] 0709 13:16:45.929217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.931007 (+  1790us) service_pool.cc:224] Handling call
0709 13:16:45.931284 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.941302 (+ 10018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.941341 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:47.369540 (+1428199us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b2c000014c8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:16:47.378779 (+  9239us) log.cc:844] Serialized 26 byte log entry
0709 13:16:47.426055 (+ 47276us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:47.427135 (+  1080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.430761 (+  3626us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.488683 (+ 57922us) raft_consensus.cc:1685] finished
0709 13:16:47.488705 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.501244 (+ 12539us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27443,"raft.queue_time_us":22670,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":17961,"spinlock_wait_cycles":2529152,"thread_start_us":44533,"threads_started":1,"wal-append.queue_time_us":74343}
I20260709 13:16:47.504279  6287 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:47.493979  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1201) took 1063 ms. Trace:
I20260709 13:16:47.506608  3284 rpcz_store.cc:276] 0709 13:16:46.415165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.421244 (+1006079us) service_pool.cc:224] Handling call
0709 13:16:47.429289 (+  8045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.478177 (+ 48888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.478958 (+   781us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.504603  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:47.509521  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:47.517313  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:47.529393  6116 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.530156  6116 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.532356  6116 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.542068  6151 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:47.543046  6151 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.553355  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 295) took 1012 ms. Trace:
I20260709 13:16:47.553898  3210 rpcz_store.cc:276] 0709 13:16:46.540514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.219892 (+679378us) service_pool.cc:224] Handling call
0709 13:16:47.552959 (+333067us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b5400194e54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:47.553168 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126187392}
I20260709 13:16:47.555397  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:47.556175  3210 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.556398  5940 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:47.558557  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:47.559568  3207 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:47.560467  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.548610  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.558576  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:47.561626  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.562340  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:47.562814  3136 raft_consensus.cc:2410] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:47.561025  3207 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:47.563449  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1434) took 1951 ms. Trace:
I20260709 13:16:47.564173  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:47.563850  3136 rpcz_store.cc:276] 0709 13:16:45.611968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.613176 (+  1208us) service_pool.cc:224] Handling call
0709 13:16:47.561363 (+1948187us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b5800002798. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caeee 0000000000375939 00007fb3c113e1e0 00007fb3c12070c4 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:47.563388 (+  2025us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5219200}
I20260709 13:16:47.565387  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 367) took 1570 ms. Trace:
I20260709 13:16:47.544646  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.565632  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.566529  3209 raft_consensus.cc:2393] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 8: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:47.567065  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1474) took 1263 ms. Trace:
I20260709 13:16:47.538643  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.567560  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.590516  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1179) took 2833 ms. Trace:
I20260709 13:16:47.590819  3136 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:47.591045  3283 rpcz_store.cc:276] 0709 13:16:44.758252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.847674 (+ 89422us) service_pool.cc:224] Handling call
0709 13:16:45.913014 (+1065340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:45.957556 (+ 44542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.589978 (+1632422us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001ea850. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:47.590285 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2449300224}
I20260709 13:16:47.591962  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.594278  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:47.565572  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.595609  3837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 642) took 1731 ms. Trace:
I20260709 13:16:47.602088  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:47.596019  6151 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.590588  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1200) took 1175 ms. Trace:
I20260709 13:16:47.603734  3285 rpcz_store.cc:276] 0709 13:16:46.414869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.545173 (+130304us) service_pool.cc:224] Handling call
0709 13:16:47.590123 (+1044950us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400182254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:47.590365 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287684992}
I20260709 13:16:47.597642  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:47.608579  6205 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:47.609181  6205 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.609617  6205 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.600184  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:47.600620  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:47.604013  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:47.583705  3101 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:47.599860  6252 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:47.583973  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.567463  3209 rpcz_store.cc:276] 0709 13:16:46.303599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.303783 (+   184us) service_pool.cc:224] Handling call
0709 13:16:47.544289 (+1240506us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b5800102f98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:47.566962 (+ 22673us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10910080}
I20260709 13:16:47.619153  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:47.620750  3207 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 5.
I20260709 13:16:47.565807  3276 rpcz_store.cc:276] 0709 13:16:45.994781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.995508 (+   727us) service_pool.cc:224] Handling call
0709 13:16:45.995891 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.114446 (+118555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.564848 (+1450402us) spinlock_profiling.cc:243] Waited 63.2 ms on lock 0x7b5400296dd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:47.565126 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145326336}
I20260709 13:16:47.625309  3128 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:47.626410  3134 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:47.623157  6237 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:47.634570  3277 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:47.603041  3837 rpcz_store.cc:276] 0709 13:16:45.863701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.872712 (+  9011us) service_pool.cc:224] Handling call
0709 13:16:45.873140 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.013659 (+140519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.013695 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.013752 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:46.013796 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.595030 (+1581234us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54005c8854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:47.595146 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.595437 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322611456}
I20260709 13:16:47.597836  5733 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:47.643105  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.646994  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.648033  3128 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:47.648389  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1444) took 1055 ms. Trace:
I20260709 13:16:47.654358  6066 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:47.655136  6066 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.657430  3209 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 10: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:47.648761  3128 rpcz_store.cc:276] 0709 13:16:46.593600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.644166 (+1050566us) service_pool.cc:224] Handling call
0709 13:16:47.648339 (+  4173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.651566  3208 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.660097  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:47.674651  3210 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:47.659827  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:47.676995  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.679261  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.680823  3209 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:47.682575  3134 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:47.681177  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.683072  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1450) took 1011 ms. Trace:
I20260709 13:16:47.685860  3134 rpcz_store.cc:276] 0709 13:16:46.671945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.650611 (+978666us) service_pool.cc:224] Handling call
0709 13:16:47.683005 (+ 32394us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.688409  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.691043  3210 raft_consensus.cc:2410] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:47.691859  3136 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:47.692248  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.693357  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1184) took 1321 ms. Trace:
I20260709 13:16:47.693804  3278 rpcz_store.cc:276] 0709 13:16:46.371609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.371727 (+   118us) service_pool.cc:224] Handling call
0709 13:16:46.371971 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.689303 (+317332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.692760 (+1003457us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400177ad4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:47.693043 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682500352}
I20260709 13:16:47.695340  3207 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.697413  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:47.697990  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:47.698560  3209 raft_consensus.cc:2410] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 9 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:47.698928  3132 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:47.700093  3209 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:47.700356  3132 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:47.700945  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 348) took 1139 ms. Trace:
I20260709 13:16:47.701464  3132 rpcz_store.cc:276] 0709 13:16:46.561883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.699549 (+1137666us) service_pool.cc:224] Handling call
0709 13:16:47.700031 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.700688 (+   657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.700872 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.702713  3276 raft_consensus.cc:1240] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:47.703409  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2373) took 1198 ms. Trace:
I20260709 13:16:47.703740  3276 rpcz_store.cc:276] 0709 13:16:46.505377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.658886 (+1153509us) service_pool.cc:224] Handling call
0709 13:16:47.702393 (+ 43507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.703151 (+   758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.703337 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.704229  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.705114  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1451) took 1014 ms. Trace:
I20260709 13:16:47.705547  3210 raft_consensus.cc:2410] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:47.705850  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2379) took 1198 ms. Trace:
I20260709 13:16:47.706233  3276 rpcz_store.cc:276] 0709 13:16:46.507710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.704627 (+1196917us) service_pool.cc:224] Handling call
0709 13:16:47.705133 (+   506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.705536 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.705560 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:47.705600 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:47.705637 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.705686 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.705775 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.707649  3210 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:47.708256  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2380) took 1200 ms. Trace:
I20260709 13:16:47.691926  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1437) took 2079 ms. Trace:
I20260709 13:16:47.709458  3129 rpcz_store.cc:276] 0709 13:16:45.612707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.629067 (+ 16360us) service_pool.cc:224] Handling call
0709 13:16:45.629344 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:45.710282 (+ 80938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.691377 (+1981095us) spinlock_profiling.cc:243] Waited 80 ms on lock 0x7b54002da854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:47.691768 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184058624}
I20260709 13:16:47.711525  3129 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:47.712177  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1445) took 1090 ms. Trace:
I20260709 13:16:47.712673  6076 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:47.713972  3204 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 289) took 2117 ms (client timeout 1731 ms). Trace:
W20260709 13:16:47.714454  3204 rpcz_store.cc:269] 0709 13:16:45.596790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.596933 (+   143us) service_pool.cc:224] Handling call
0709 13:16:47.713429 (+2116496us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b5400247f54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:47.713636 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1495710976}
I20260709 13:16:47.715214  6066 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:47.716094  6076 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:47.716240  3204 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:47.703975  3209 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:47.708693  3276 rpcz_store.cc:276] 0709 13:16:46.508005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.707172 (+1199167us) service_pool.cc:224] Handling call
0709 13:16:47.707594 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.707937 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.707960 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:47.708026 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:47.708055 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.708107 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.708195 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:47.741186  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 165157us
I20260709 13:16:47.717931  3203 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:47.722818  3211 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:47.724685  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 375) took 1573 ms. Trace:
W20260709 13:16:47.726408  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 143099us
I20260709 13:16:47.705472  3128 rpcz_store.cc:276] 0709 13:16:46.690541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.675108 (+984567us) service_pool.cc:224] Handling call
0709 13:16:47.705031 (+ 29923us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.712477  3129 rpcz_store.cc:276] 0709 13:16:46.622141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.710552 (+1088411us) service_pool.cc:224] Handling call
0709 13:16:47.711195 (+   643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:47.711885 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.712126 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.739653  3207 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:47.749212  3131 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:47.751947  3208 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:47.742447  3280 rpcz_store.cc:276] 0709 13:16:46.151350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.151490 (+   140us) service_pool.cc:224] Handling call
0709 13:16:46.151742 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.850236 (+698494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.724208 (+873972us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b540042c554. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:47.724506 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1605051136}
I20260709 13:16:47.759217  3208 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:47.756610  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1443) took 1170 ms. Trace:
I20260709 13:16:47.764449  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:47.768589  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.760074  3132 rpcz_store.cc:276] 0709 13:16:46.583058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.702335 (+1119277us) service_pool.cc:224] Handling call
0709 13:16:47.702734 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.748448 (+ 45714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.748489 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:47.752546 (+  4057us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:47.752604 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.752672 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.752964 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38121,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":8801}
I20260709 13:16:47.772127  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:47.777773  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:47.778896  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 346) took 1225 ms. Trace:
I20260709 13:16:47.779304  3135 rpcz_store.cc:276] 0709 13:16:46.561112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.777414 (+1216302us) service_pool.cc:224] Handling call
0709 13:16:47.778836 (+  1422us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.787091  3249 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:47.789579  6066 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:47.790282  6066 raft_consensus.cc:697] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:47.791141  6267 log.cc:927] Time spent T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.689s	user 0.007s	sys 0.000s
I20260709 13:16:47.791600  6066 consensus_queue.cc:237] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.793651  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2473) took 1847 ms. Trace:
I20260709 13:16:47.793889  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:47.795948  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 381) took 1269 ms. Trace:
I20260709 13:16:47.796255  6225 consensus_queue.cc:1059] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:47.796388  3276 rpcz_store.cc:276] 0709 13:16:46.526605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.741611 (+1215006us) service_pool.cc:224] Handling call
0709 13:16:47.795290 (+ 53679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.795641 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.795666 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:47.795707 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:47.795749 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.795799 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.795893 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.797346  6225 consensus_queue.cc:1059] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:47.797904  6243 raft_consensus.cc:3055] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:47.798456  6243 raft_consensus.cc:740] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:47.798879  6225 raft_consensus.cc:3055] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:47.799335  6225 raft_consensus.cc:740] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:47.800022  6243 consensus_queue.cc:260] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.787176  6234 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:47.801702  6234 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.801824  6205 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.802712  6287 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.803205  3841 raft_consensus.cc:2368] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9.
I20260709 13:16:47.803340  6287 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.805029  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1210) took 1574 ms. Trace:
I20260709 13:16:47.805557  6261 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:47.806360  6261 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.806712  3100 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:47.807423  6256 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:47.809906  3211 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:47.810110  6228 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:47.810627  6228 raft_consensus.cc:697] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:47.811300  3282 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1209) took 1374 ms (client timeout 1729 ms). Trace:
I20260709 13:16:47.811920  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 382) took 1284 ms. Trace:
I20260709 13:16:47.811843  6228 consensus_queue.cc:237] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:47.815047  6205 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:47.816182  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.816608  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1447) took 1184 ms. Trace:
I20260709 13:16:47.817044  3128 rpcz_store.cc:276] 0709 13:16:46.632093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.748338 (+1116245us) service_pool.cc:224] Handling call
0709 13:16:47.769594 (+ 21256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.816012 (+ 46418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.816046 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:47.816120 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:47.816185 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.816399 (+   214us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.816512 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.812503  3280 rpcz_store.cc:276] 0709 13:16:46.527848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.754767 (+1226919us) service_pool.cc:224] Handling call
0709 13:16:47.811184 (+ 56417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.811528 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.811568 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:47.811614 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:47.811713 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.811764 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.811865 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.805461  3130 rpcz_store.cc:276] 0709 13:16:46.230403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.230516 (+   113us) service_pool.cc:224] Handling call
0709 13:16:46.230870 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.260316 (+ 29446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.260345 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:46.264443 (+  4098us) log.cc:844] Serialized 26 byte log entry
0709 13:16:47.804239 (+1539796us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540040bda0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc159090 00007fb3bc1666b8 00007fb3bc1ef92b 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c
0709 13:16:47.804333 (+    94us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:47.804417 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.804525 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.804582 (+    57us) raft_consensus.cc:1685] finished
0709 13:16:47.804591 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.804875 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12436,"raft.queue_time_us":13196,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":11891,"spinlock_wait_cycles":293388032,"thread_start_us":93740,"threads_started":1,"wal-append.queue_time_us":66904,"wal-append.run_cpu_time_us":5553,"wal-append.run_wall_time_us":1145756}
I20260709 13:16:47.794126  3206 rpcz_store.cc:276] 0709 13:16:45.948870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.948993 (+   123us) service_pool.cc:224] Handling call
0709 13:16:45.949406 (+   413us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:45.969787 (+ 20381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.969919 (+   132us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:45.970705 (+   786us) log.cc:844] Serialized 78 byte log entry
0709 13:16:46.034051 (+ 63346us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:46.179765 (+145714us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.180215 (+   450us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.180421 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.180491 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.074391 (+893900us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b18001bb800. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:16:47.486830 (+412439us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b18001bb800. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90d02a6 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db
0709 13:16:47.630083 (+143253us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b18001bb800. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:16:47.790169 (+160086us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:47.792992 (+  2823us) raft_consensus.cc:1685] finished
0709 13:16:47.793013 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.793302 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22598,"prepare.queue_time_us":104041,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":70,"raft.queue_time_us":20882,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":42815,"spinlock_wait_cycles":391175552,"thread_start_us":181583,"threads_started":2,"wal-append.queue_time_us":108871}
I20260709 13:16:47.808812  6261 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:47.827656  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 350) took 1264 ms. Trace:
I20260709 13:16:47.835227  3134 rpcz_store.cc:276] 0709 13:16:46.562797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.740503 (+1177706us) service_pool.cc:224] Handling call
0709 13:16:47.827604 (+ 87101us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:47.826337  3282 rpcz_store.cc:269] 0709 13:16:46.436630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.565708 (+129078us) service_pool.cc:224] Handling call
0709 13:16:47.810730 (+1245022us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b540022d154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:47.810993 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66311040}
W20260709 13:16:47.850062  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.823067  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:47.845669  3204 raft_consensus.cc:1275] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:47.866976  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:47.877991  3129 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:16:47.880255  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:47.887252  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1454) took 1095 ms. Trace:
I20260709 13:16:47.887784  3129 rpcz_store.cc:276] 0709 13:16:46.783420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.748388 (+964968us) service_pool.cc:224] Handling call
0709 13:16:47.862375 (+113987us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:47.878646 (+ 16271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.878940 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.800694  6225 consensus_queue.cc:260] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:47.893508  5943 consensus_queue.cc:1059] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:16:47.902518  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 79566.8us
I20260709 13:16:47.885859  6076 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:47.921223  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 46774.5us
I20260709 13:16:47.922410  6286 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:47.923486  6258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.015s	sys 0.017s
W20260709 13:16:47.923959  6258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.221s	user 0.015s	sys 0.017s
I20260709 13:16:47.927783  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:47.933457  6243 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.952193  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2369) took 1477 ms. Trace:
I20260709 13:16:47.952715  3283 rpcz_store.cc:276] 0709 13:16:46.475089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.592197 (+1117108us) service_pool.cc:224] Handling call
0709 13:16:47.592787 (+   590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:47.598899 (+  6112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.598938 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:47.599675 (+   737us) log.cc:844] Serialized 26 byte log entry
0709 13:16:47.758051 (+158376us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:47.767720 (+  9669us) log.cc:844] Serialized 14 byte log entry
0709 13:16:47.783433 (+ 15713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.783506 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.951900 (+168394us) raft_consensus.cc:1685] finished
0709 13:16:47.951925 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.952096 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57309,"prepare.queue_time_us":10003,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":50,"raft.queue_time_us":19855,"raft.run_cpu_time_us":462,"raft.run_wall_time_us":36678,"thread_start_us":143570,"threads_started":1,"wal-append.queue_time_us":282272}
I20260709 13:16:47.955278  3283 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:47.955813  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2384) took 1206 ms. Trace:
I20260709 13:16:47.956111  3283 rpcz_store.cc:276] 0709 13:16:46.749495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.954511 (+1205016us) service_pool.cc:224] Handling call
0709 13:16:47.954906 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.955588 (+   682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.955745 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:47.958671  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 47509.5us
I20260709 13:16:47.957823  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 385) took 1151 ms. Trace:
I20260709 13:16:47.966257  3283 rpcz_store.cc:276] 0709 13:16:46.806059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.956779 (+1150720us) service_pool.cc:224] Handling call
0709 13:16:47.957209 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.957469 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.957493 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:47.957548 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:47.957613 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.957676 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.957771 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:47.999027  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 209929us
I20260709 13:16:47.975561  6287 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:47.977514  6076 raft_consensus.cc:697] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:48.007315  3283 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:48.008044  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2383) took 1256 ms. Trace:
I20260709 13:16:48.009255  3282 rpcz_store.cc:276] 0709 13:16:46.749238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.868989 (+1119751us) service_pool.cc:224] Handling call
0709 13:16:47.899114 (+ 30125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.999635 (+100521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.999673 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:48.004807 (+  5134us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:48.004853 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.004924 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.005054 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:48.011569  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 387) took 1167 ms. Trace:
I20260709 13:16:48.012072  3282 rpcz_store.cc:276] 0709 13:16:46.844504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.010373 (+1165869us) service_pool.cc:224] Handling call
0709 13:16:48.010813 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.011172 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.011207 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:48.011271 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:48.011311 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.011376 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.011506 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:48.015926  3282 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:48.021275  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 151591us
I20260709 13:16:47.997385  6205 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:48.008044  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 386) took 1198 ms. Trace:
I20260709 13:16:48.026037  3283 rpcz_store.cc:276] 0709 13:16:46.810124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.975959 (+1165835us) service_pool.cc:224] Handling call
0709 13:16:48.006167 (+ 30208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.007777 (+  1610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.007976 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:48.021754  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 62159.2us
I20260709 13:16:47.985790  6234 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:48.030822  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2386) took 1179 ms. Trace:
I20260709 13:16:48.042799  3282 rpcz_store.cc:276] 0709 13:16:46.848524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.015024 (+1166500us) service_pool.cc:224] Handling call
0709 13:16:48.015517 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.024436 (+  8919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.027392 (+  2956us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:48.053462  3177 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:48.054594  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 57323.7us
I20260709 13:16:48.045687  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:48.039119  6225 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:48.067633  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2388) took 1145 ms. Trace:
I20260709 13:16:48.070623  3283 rpcz_store.cc:276] 0709 13:16:46.908275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.026834 (+1118559us) service_pool.cc:224] Handling call
0709 13:16:48.053089 (+ 26255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.053376 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.053409 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:48.053458 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:48.053505 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.053556 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.053672 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:48.073128  3836 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:48.077131  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:48.078598  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 345) took 1531 ms. Trace:
I20260709 13:16:48.078738  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:48.079027  3136 rpcz_store.cc:276] 0709 13:16:46.547172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.692723 (+1145551us) service_pool.cc:224] Handling call
0709 13:16:47.693386 (+   663us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:47.693833 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:47.693859 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:47.694387 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:16:47.870068 (+175681us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:47.870110 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.870182 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.078368 (+208186us) raft_consensus.cc:1685] finished
0709 13:16:48.078389 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.078523 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":174430,"threads_started":1,"wal-append.queue_time_us":289946}
W20260709 13:16:48.080144  6316 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.216s	user 0.001s	sys 0.001s
W20260709 13:16:48.081337  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.079135  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:48.080912  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:48.058804  6205 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:48.122610  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2372) took 1635 ms. Trace:
I20260709 13:16:48.123247  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2376) took 1616 ms. Trace:
I20260709 13:16:48.123864  6205 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:48.067505  6146 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:48.125475  6146 raft_consensus.cc:697] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:48.125564  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:48.126593  6146 consensus_queue.cc:237] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:48.129683  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 233346us
I20260709 13:16:48.123696  3278 rpcz_store.cc:276] 0709 13:16:46.506867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.694838 (+1187971us) service_pool.cc:224] Handling call
0709 13:16:47.695268 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:47.765497 (+ 70229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.765528 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:47.818806 (+ 53278us) log.cc:844] Serialized 26 byte log entry
0709 13:16:47.891457 (+ 72651us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:47.891512 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.891608 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.123024 (+231416us) raft_consensus.cc:1685] finished
0709 13:16:48.123048 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.123189 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57484,"raft.queue_time_us":66171,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":37227,"thread_start_us":66123,"threads_started":1,"wal-append.queue_time_us":209700}
I20260709 13:16:48.067374  6116 consensus_queue.cc:1059] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:16:48.130823  3177 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:48.131331  6103 raft_consensus.cc:3055] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:48.131896  6103 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:48.132925  6103 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:48.133997  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 392) took 1127 ms. Trace:
I20260709 13:16:48.134451  6103 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:48.134455  3282 rpcz_store.cc:276] 0709 13:16:47.006727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.071077 (+1064350us) service_pool.cc:224] Handling call
0709 13:16:48.133360 (+ 62283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.133571 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.133595 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:48.133641 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:48.133668 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.133714 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.133922 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:48.137368  6214 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:48.140167  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:48.073097  6237 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:48.141316  6237 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:48.143862  6237 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:48.131374  3278 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:16:48.086874  6322 log.cc:927] Time spent T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:16:48.123066  3285 rpcz_store.cc:276] 0709 13:16:46.487387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.604964 (+1117577us) service_pool.cc:224] Handling call
0709 13:16:47.605523 (+   559us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:47.752660 (+147137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.752688 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:47.781724 (+ 29036us) log.cc:844] Serialized 52 byte log entry
0709 13:16:47.893614 (+111890us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:47.893952 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.024514 (+130562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.027223 (+  2709us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.122358 (+ 95135us) raft_consensus.cc:1685] finished
0709 13:16:48.122380 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.122545 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85057,"prepare.queue_time_us":841,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":105956,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":3630,"thread_start_us":241618,"threads_started":2,"wal-append.queue_time_us":224778}
I20260709 13:16:48.154466  6093 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:48.156159  3282 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:48.159570  6234 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:48.159968  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:48.160998  3128 raft_consensus.cc:2393] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:48.160957  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:48.161799  3136 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:48.162663  6214 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:48.164535  6214 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:48.166273  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 87952.4us
I20260709 13:16:48.167461  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:48.170125  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:48.171599  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 88788.5us
I20260709 13:16:48.172887  3100 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:48.173852  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:48.174701  3282 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:48.174738  6116 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:48.175410  6116 raft_consensus.cc:697] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:48.176628  6116 consensus_queue.cc:237] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:48.175014  6076 consensus_queue.cc:237] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:48.161021  3283 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:48.188684  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2375) took 1675 ms. Trace:
W20260709 13:16:48.194205  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 85204.7us
I20260709 13:16:48.197360  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 384) took 1463 ms. Trace:
I20260709 13:16:48.198570  3100 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:48.206984  3129 raft_consensus.cc:2410] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:48.216781  6205 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:48.189234  3277 rpcz_store.cc:276] 0709 13:16:46.506578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.652680 (+1146102us) service_pool.cc:224] Handling call
0709 13:16:47.653147 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:47.678004 (+ 24857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.678056 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:47.740630 (+ 62574us) log.cc:844] Serialized 26 byte log entry
0709 13:16:47.988668 (+248038us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:48.007304 (+ 18636us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.020644 (+ 13340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.020722 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.181752 (+161030us) raft_consensus.cc:1685] finished
0709 13:16:48.181772 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.181886 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17184,"prepare.queue_time_us":24436,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":38625,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":6798,"thread_start_us":217966,"threads_started":1,"wal-append.queue_time_us":388450}
I20260709 13:16:48.220890  6129 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:48.223361  6129 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:48.225399  6129 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:48.229271  3249 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:48.230752  3249 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:48.211457  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:48.248097  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:48.198819  3276 rpcz_store.cc:276] 0709 13:16:46.733558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.797855 (+1064297us) service_pool.cc:224] Handling call
0709 13:16:47.826283 (+ 28428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.912083 (+ 85800us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:47.985711 (+ 73628us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.196997 (+211286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:48.197050 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:48.197119 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.197182 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.197303 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":71701,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":1633,"thread_start_us":183145,"threads_started":1}
I20260709 13:16:48.212857  6066 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:48.191296  6234 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:16:48.258610  6066 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.264242  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:48.240321  6238 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:48.270635  3101 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:48.271683  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:48.272502  3136 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 8: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:48.273387  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:48.274297  3128 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:48.268397  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:48.268443  3132 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:16:48.286685  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2368) took 1727 ms. Trace:
I20260709 13:16:48.287171  3281 rpcz_store.cc:276] 0709 13:16:46.474816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.562572 (+1087756us) service_pool.cc:224] Handling call
0709 13:16:47.563021 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.563515 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:47.660753 (+ 97238us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.183772 (+523019us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.198288 (+ 14516us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:48.198358 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:48.201213 (+  2855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.201293 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.202557 (+  1264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37548,"prepare.queue_time_us":43389,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":6145,"raft.queue_time_us":22640,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":37294,"thread_start_us":498409,"threads_started":3,"wal-append.queue_time_us":388483}
I20260709 13:16:48.289285  6338 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:48.289911  6338 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.290380  3100 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:48.283674  6238 raft_consensus.cc:697] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:48.291647  3805 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:48.260854  6066 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:48.261471  6258 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:48.398744  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 128226us
W20260709 13:16:48.401750  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 127000us
I20260709 13:16:48.261627  6337 consensus_queue.cc:1059] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 13:16:48.355506  6103 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:48.290392  6338 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:48.431856  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 163566us
I20260709 13:16:48.303020  6129 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:48.397531  6273 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
W20260709 13:16:48.437264  6055 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.146s	user 0.015s	sys 0.021s
I20260709 13:16:48.418110  6258 raft_consensus.cc:697] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:48.424161  6234 consensus_queue.cc:1243] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:48.414065  6287 consensus_queue.cc:1059] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:16:48.317071  6228 consensus_queue.cc:1059] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.138s
I20260709 13:16:48.415349  6256 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:16:48.399901  6238 consensus_queue.cc:237] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:48.445405  6055 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.338s	user 0.015s	sys 0.021s
I20260709 13:16:48.436407  6286 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.485834  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:48.505185  6348 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:16:48.442461  6146 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:48.508646  6258 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:48.511180  6287 raft_consensus.cc:3055] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:48.512291  3209 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:48.513245  3210 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:48.516484  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:48.446874  6193 consensus_queue.cc:1059] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.263s
W20260709 13:16:48.520148  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 103834us
I20260709 13:16:48.522701  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2381) took 1789 ms. Trace:
W20260709 13:16:48.525763  6349 log.cc:927] Time spent T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:16:48.437182  6129 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:48.533437  6330 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.485s	user 0.002s	sys 0.000s
I20260709 13:16:48.536315  6226 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:48.536711  6342 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:48.537901  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 80746.9us
I20260709 13:16:48.576457  3834 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:48.576153  6286 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:48.562587  6146 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:16:48.576957  6347 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:16:48.577965  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2367) took 2103 ms. Trace:
I20260709 13:16:48.588900  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2382) took 1840 ms. Trace:
W20260709 13:16:48.576504  6243 consensus_meta.cc:287] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.642s	user 0.013s	sys 0.001s
I20260709 13:16:48.485241  6234 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:16:48.598991  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:48.574631  3279 rpcz_store.cc:276] 0709 13:16:46.733275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.780675 (+1047400us) service_pool.cc:224] Handling call
0709 13:16:47.825227 (+ 44552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.027409 (+202182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.027444 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.057844 (+ 30400us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.401926 (+344082us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:48.401963 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.402629 (+   666us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.522346 (+119717us) raft_consensus.cc:1685] finished
0709 13:16:48.522367 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.522526 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13795,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":13375,"spinlock_wait_cycles":11008,"thread_start_us":287241,"threads_started":2,"wal-append.queue_time_us":305369}
W20260709 13:16:48.606434  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 154554us
I20260709 13:16:48.607383  3282 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:16:48.573535  6287 raft_consensus.cc:740] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:48.610878  6252 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.620455  6252 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:48.622510  6317 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.965s	user 0.009s	sys 0.000s
I20260709 13:16:48.623111  6252 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:48.613313  6286 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:48.624006  6193 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:48.588984  6129 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:48.624665  6193 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:48.627045  6193 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:48.629398  6342 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:48.630162  6342 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:48.615087  6023 raft_consensus.cc:3055] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:48.615865  6256 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.599216  3280 rpcz_store.cc:276] 0709 13:16:46.748805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.834639 (+1085834us) service_pool.cc:224] Handling call
0709 13:16:47.904384 (+ 69745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.020479 (+116095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.020524 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.069892 (+ 49368us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.204961 (+135069us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:48.204998 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.205061 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.587066 (+382005us) raft_consensus.cc:1685] finished
0709 13:16:48.587085 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.588722 (+  1637us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":777,"raft.queue_time_us":15947,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":18855,"thread_start_us":127261,"threads_started":1,"wal-append.queue_time_us":327689}
W20260709 13:16:48.617624  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 175841us
I20260709 13:16:48.618352  6362 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:48.610862  6226 raft_consensus.cc:697] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:48.598407  3284 rpcz_store.cc:276] 0709 13:16:46.474510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.533019 (+1058509us) service_pool.cc:224] Handling call
0709 13:16:47.637373 (+104354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.637946 (+   573us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:47.638335 (+   389us) log.cc:844] Serialized 14 byte log entry
0709 13:16:47.770435 (+132100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:47.770498 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:47.770564 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.770646 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.577760 (+807114us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b5400125cd0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:48.577901 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6626,"prepare.queue_time_us":7559,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"raft.queue_time_us":13317,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"spinlock_wait_cycles":81730432,"thread_start_us":118241,"threads_started":1,"wal-append.queue_time_us":270987}
I20260709 13:16:48.641039  3249 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:48.600615  6146 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:48.620523  6338 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:48.632915  6023 raft_consensus.cc:740] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:48.630395  6066 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:48.702212  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:48.708696  3206 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:48.710358  3203 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:48.711059  6338 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:48.671609  6256 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:48.714133  5870 raft_consensus.cc:3055] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:48.714577  5870 raft_consensus.cc:740] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:48.715512  5870 consensus_queue.cc:260] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:48.716739  3204 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:48.717398  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:48.716751  5870 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:48.717217  6287 consensus_queue.cc:260] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:48.718567  6287 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:48.721992  6103 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:16:48.737406  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 96287.5us
I20260709 13:16:48.737207  6023 consensus_queue.cc:260] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:48.738904  6023 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:48.739363  6209 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:48.742249  6286 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:48.742719  3127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1202) took 2782 ms (client timeout 2114 ms). Trace:
I20260709 13:16:48.742877  6286 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:48.743296  3127 rpcz_store.cc:269] 0709 13:16:45.960445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.966631 (+  6186us) service_pool.cc:224] Handling call
0709 13:16:48.742364 (+2775733us) spinlock_profiling.cc:243] Waited 2.69 s on lock 0x7b5400074254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:48.742514 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6195166592}
I20260709 13:16:48.738709  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:48.769970  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:48.745033  6286 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:48.868041  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:48.753259  6129 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:48.885869  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 267210us
W20260709 13:16:49.259317  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.758518  6076 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.967993  6192 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:48.850950  6226 consensus_queue.cc:237] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:48.742303  6277 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:48.892819  6361 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:48.758690  6237 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.278669  3102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.008s	sys 0.021s
W20260709 13:16:49.329277  3102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.009s	sys 0.021s
I20260709 13:16:48.902057  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:49.337700  3134 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:49.338503  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1463) took 1178 ms. Trace:
I20260709 13:16:49.338904  3134 rpcz_store.cc:276] 0709 13:16:48.159793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.850559 (+690766us) service_pool.cc:224] Handling call
0709 13:16:49.338429 (+487870us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:49.223676  6258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.003s	sys 0.006s
W20260709 13:16:49.223973  6234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.006s	sys 0.002s
I20260709 13:16:49.357365  3130 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:49.363283  3208 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.009s	sys 0.010s
W20260709 13:16:49.364629  3208 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.010s	sys 0.010s
I20260709 13:16:49.378259  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1458) took 1299 ms. Trace:
I20260709 13:16:49.378819  3130 rpcz_store.cc:276] 0709 13:16:48.079017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.258106 (+1179089us) service_pool.cc:224] Handling call
0709 13:16:49.333596 (+ 75490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.357871 (+ 24275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.378176 (+ 20305us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:49.329414  6318 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 1.496s	user 0.015s	sys 0.000s
I20260709 13:16:49.258630  6261 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.303622  6192 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:49.435942  3135 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:16:49.436918  3100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.016s	sys 0.019s
W20260709 13:16:49.440611  3100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.016s	sys 0.019s
W20260709 13:16:49.354735  6258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.004s	sys 0.006s
W20260709 13:16:49.365839  6234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.007s	sys 0.002s
W20260709 13:16:49.420339  6103 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.006s	sys 0.022s
I20260709 13:16:49.465307  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1464) took 1292 ms. Trace:
I20260709 13:16:49.385205  6243 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.479120  3135 rpcz_store.cc:276] 0709 13:16:48.160126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.752964 (+592838us) service_pool.cc:224] Handling call
0709 13:16:49.452705 (+699741us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:49.486966  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 185811us
I20260709 13:16:49.482383  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:49.501760  3278 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:49.457983  6238 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.009s	sys 0.072s
I20260709 13:16:49.501879  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:49.502727  3251 leader_election.cc:400] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9.
I20260709 13:16:49.509563  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:49.517002  3251 leader_election.cc:403] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:49.332378  6076 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:49.475733  6103 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.007s	sys 0.023s
W20260709 13:16:49.482232  6228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.027s	sys 0.046s
I20260709 13:16:49.357015  6237 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:49.571471  3284 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:49.560698  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:49.616261  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 256410us
W20260709 13:16:49.522961  6238 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.009s	sys 0.073s
W20260709 13:16:49.626978  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 127143us
I20260709 13:16:49.616484  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:49.635094  3276 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:49.504458  6377 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.552523  6357 raft_consensus.cc:3055] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:16:49.576188  6228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.028s	sys 0.046s
I20260709 13:16:49.406364  6277 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:49.625638  5870 consensus_meta.cc:287] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.908s	user 0.008s	sys 0.003s
I20260709 13:16:49.464845  6261 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:49.669044  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:49.554986  6337 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.615725  6256 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:49.509953  6243 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:49.653607  3031 catalog_manager.cc:5697] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 5 to 6, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 6 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:49.669632  6258 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9.
I20260709 13:16:49.654374  6357 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:49.752018  3175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.008s	sys 0.014s
W20260709 13:16:49.770237  3175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.008s	sys 0.014s
I20260709 13:16:49.653713  6192 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:49.738400  6256 consensus_queue.cc:1059] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:16:49.784621  6261 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:49.785589  6371 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:16:49.789561  6258 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:49.825763  6076 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:49.790196  6383 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:49.817548  6364 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.483s	user 0.000s	sys 0.001s
I20260709 13:16:49.826481  6383 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:49.716280  6377 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:49.798874  6277 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:49.796634  3249 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:49.754273  6337 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:49.802543  6146 consensus_meta.cc:287] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.146s	user 0.009s	sys 0.008s
W20260709 13:16:49.803073  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 201774us
I20260709 13:16:49.741772  5733 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:49.815500  6243 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:49.774834  6384 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:49.806536  6362 consensus_meta.cc:287] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.153s	user 0.007s	sys 0.012s
W20260709 13:16:49.806738  6342 consensus_meta.cc:287] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.176s	user 0.019s	sys 0.013s
I20260709 13:16:49.769675  5870 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:49.824337  3278 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:49.825450  6258 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:49.789757  6129 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:49.831161  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 401) took 1582 ms. Trace:
I20260709 13:16:49.836607  3276 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:49.836959  6380 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.842672  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.859666  6261 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:49.859932  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 206405us
I20260709 13:16:49.885854  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:49.886831  3276 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:49.880260  3285 rpcz_store.cc:276] 0709 13:16:48.248314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.255645 (+  7331us) service_pool.cc:224] Handling call
0709 13:16:48.257084 (+  1439us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:48.424041 (+166957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.424665 (+   624us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:48.456935 (+ 32270us) log.cc:844] Serialized 78 byte log entry
0709 13:16:48.657210 (+200275us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:48.703499 (+ 46289us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.706463 (+  2964us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.706656 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.706723 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.830806 (+1124083us) raft_consensus.cc:1685] finished
0709 13:16:49.830839 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.831072 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16117,"prepare.queue_time_us":80291,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":74,"raft.queue_time_us":141468,"raft.run_cpu_time_us":486,"raft.run_wall_time_us":91162,"thread_start_us":252511,"threads_started":2,"wal-append.queue_time_us":289906}
I20260709 13:16:49.862846  6066 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:49.870441  6076 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.843922  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 47394.3us
I20260709 13:16:49.837025  6383 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:49.867741  6228 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.878901  5870 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:49.843526  6379 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.881691  3282 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:49.884020  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:49.856632  3284 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:16:49.907758  6381 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:49.882431  6362 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:49.930735  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:49.889551  6234 raft_consensus.cc:3055] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:49.862709  6146 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:49.931665  3285 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
W20260709 13:16:49.909868  3250 connection.cc:256] RPC call timeout handler was delayed by -1.0523409039999478s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29940000000000005s for a response
I20260709 13:16:50.004570  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:50.005780  3284 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:49.903210  6129 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:49.874580  5733 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:50.004871  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 400) took 1756 ms. Trace:
I20260709 13:16:49.880090  6342 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:50.026130  3283 rpcz_store.cc:276] 0709 13:16:48.247982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.256052 (+  8070us) service_pool.cc:224] Handling call
0709 13:16:48.277189 (+ 21137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.542564 (+265375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.542591 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.587009 (+ 44418us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.792337 (+205328us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:48.792393 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.792495 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.004608 (+1212113us) raft_consensus.cc:1685] finished
0709 13:16:50.004628 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.004784 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59583,"raft.queue_time_us":146000,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":13480,"thread_start_us":300576,"threads_started":2,"wal-append.queue_time_us":773656}
I20260709 13:16:50.033838  3279 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:50.024917  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:50.034703  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:50.034925  3276 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:49.969973  6383 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.039354  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:49.991319  6066 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.046955  3285 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:49.986766  6234 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:50.052990  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 140468us
I20260709 13:16:50.008867  6391 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.880626  6357 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:49.909439  6076 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:49.880759  6384 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:50.032577  6362 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.033460  6385 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:50.065104  6387 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.033355  6129 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:50.075937  3202 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.009s	sys 0.026s
W20260709 13:16:50.114706  3202 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.009s	sys 0.026s
I20260709 13:16:50.113667  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:50.075837  6391 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:50.076493  6357 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:50.076365  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:50.117658  3130 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:50.077531  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:50.078163  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:50.078995  6366 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:50.124766  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:50.125109  6366 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:50.079085  6076 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:50.127492  6076 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:50.127769  6366 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:50.128180  6076 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:50.129765  6378 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.346s	user 0.000s	sys 0.000s
I20260709 13:16:50.131104  6076 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:50.131832  6076 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.079900  5733 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:50.056859  6369 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:50.133823  5733 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:50.134111  6369 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:50.134555  5733 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:49.984890  6381 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:49.892706  6380 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:50.137338  6193 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:50.137775  6193 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:50.138628  6193 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:50.139101  6380 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:50.046500  6377 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:50.052892  6388 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.113639  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:50.062409  6372 log.cc:927] Time spent T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.344s	user 0.001s	sys 0.001s
I20260709 13:16:49.970253  6228 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:50.113484  6027 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:50.154987  6027 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:50.120985  6387 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:50.123096  6391 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:50.158432  3806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.020s	sys 0.052s
W20260709 13:16:50.174340  3806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.020s	sys 0.053s
W20260709 13:16:50.174691  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 674185us
I20260709 13:16:50.123504  6129 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:50.124541  6368 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
W20260709 13:16:50.181926  6287 consensus_meta.cc:287] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.463s	user 0.016s	sys 0.021s
I20260709 13:16:50.182576  6287 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.183048  6287 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:50.184451  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:50.187013  6384 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:50.188926  6337 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:50.189898  5733 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:50.191591  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 406) took 1575 ms. Trace:
I20260709 13:16:50.191969  3279 rpcz_store.cc:276] 0709 13:16:48.616074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.735979 (+119905us) service_pool.cc:224] Handling call
0709 13:16:48.736267 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.045954 (+1309687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.191352 (+145398us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400037354. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:50.191527 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2983713152}
I20260709 13:16:50.159053  6362 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:50.193419  6027 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:50.153534  6237 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:50.195564  6342 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:50.195905  6362 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:50.197535  6146 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:50.197891  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:50.199972  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:50.139097  6381 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:50.200748  6234 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:50.201452  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:50.201839  5870 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:50.202298  3136 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:50.152043  6393 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:50.111953  6066 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:50.132453  6076 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:49.985164  6379 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:50.074877  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:50.267238  3285 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.165053  3130 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:50.159363  3278 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
W20260709 13:16:50.102274  3250 leader_election.cc:336] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.619s (SENT)
W20260709 13:16:50.200217  6365 log.cc:927] Time spent T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.056s	user 0.001s	sys 0.001s
I20260709 13:16:50.176247  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:50.067665  6383 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:50.206920  3135 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:50.210032  3283 raft_consensus.cc:2410] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:50.277300  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:50.213042  3276 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:16:50.220932  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:50.150928  6369 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:50.120386  3804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.003s	sys 0.020s
W20260709 13:16:50.284515  3804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.003s	sys 0.021s
I20260709 13:16:50.221563  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:50.119076  6385 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:50.307009  3250 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:50.342173  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:50.343966  3129 raft_consensus.cc:2410] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:50.202965  6387 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:50.343093  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:50.345677  6374 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.340s	user 0.000s	sys 0.000s
I20260709 13:16:50.308066  6380 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:50.347417  6380 raft_consensus.cc:697] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:50.348474  6380 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:50.354223  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 399) took 2116 ms. Trace:
I20260709 13:16:50.354454  6228 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:50.354651  3277 rpcz_store.cc:276] 0709 13:16:48.237864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.245719 (+  7855us) service_pool.cc:224] Handling call
0709 13:16:48.262440 (+ 16721us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.414317 (+151877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.414349 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.434820 (+ 20471us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.885460 (+450640us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:48.885518 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.885622 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.199572 (+1313950us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:50.353925 (+154353us) raft_consensus.cc:1685] finished
0709 13:16:50.353948 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.354160 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9701,"raft.queue_time_us":131555,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4456,"spinlock_wait_cycles":11586816,"thread_start_us":474524,"threads_started":2,"wal-append.queue_time_us":1594852}
I20260709 13:16:50.356328  6379 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:50.157369  6388 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:50.357520  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2523) took 1623 ms. Trace:
I20260709 13:16:50.358011  3208 rpcz_store.cc:276] 0709 13:16:48.734396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.736474 (+  2078us) service_pool.cc:224] Handling call
0709 13:16:48.736777 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.737202 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.737226 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.737684 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.365159 (+627475us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:49.365220 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.365316 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.357246 (+991930us) raft_consensus.cc:1685] finished
0709 13:16:50.357271 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.357453 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4093,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":101,"thread_start_us":627013,"threads_started":1,"wal-append.queue_time_us":1130139}
I20260709 13:16:50.362107  3128 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:16:50.362924  3279 raft_consensus.cc:2393] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:50.364254  3280 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
W20260709 13:16:50.274080  3209 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.066s	sys 0.128s
W20260709 13:16:50.269063  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 92906.3us
W20260709 13:16:50.366322  3209 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.066s	sys 0.128s
I20260709 13:16:50.366883  3832 raft_consensus.cc:1240] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:50.219954  6287 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:50.397522  3834 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:50.398103  6287 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:50.398581  3129 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:50.399761  6385 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:50.356760  6383 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:50.401260  3131 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:50.209671  6377 consensus_queue.cc:1059] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.233s
W20260709 13:16:50.774468  3176 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.375s	user 0.003s	sys 0.016s
I20260709 13:16:50.542379  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:50.862076  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:50.433771  3285 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
W20260709 13:16:50.774312  3175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.000s	sys 0.017s
W20260709 13:16:50.870324  3175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.000s	sys 0.018s
W20260709 13:16:50.727191  3249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.004s	sys 0.007s
W20260709 13:16:50.871377  3249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.004s	sys 0.010s
W20260709 13:16:50.402240  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 333130us
W20260709 13:16:50.871964  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.637784  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:50.656311  3099 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.017s	sys 0.012s
W20260709 13:16:50.873212  3099 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.022s	sys 0.012s
W20260709 13:16:50.873391  3176 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.474s	user 0.005s	sys 0.017s
W20260709 13:16:50.529608  3177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.000s	sys 0.019s
W20260709 13:16:50.873831  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 1.53918e+06us
W20260709 13:16:50.874191  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:50.873984  3177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.008s	sys 0.023s
W20260709 13:16:50.655784  3101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.011s	sys 0.018s
I20260709 13:16:50.857810  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2515) took 2134 ms. Trace:
I20260709 13:16:50.401984  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:50.860836  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:50.864002  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 405) took 2301 ms. Trace:
W20260709 13:16:50.528715  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 454288us
I20260709 13:16:50.870260  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1230) took 1077 ms. Trace:
W20260709 13:16:50.276101  6023 consensus_meta.cc:287] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 1.537s	user 0.017s	sys 0.004s
I20260709 13:16:50.877389  3285 rpcz_store.cc:276] 0709 13:16:49.792699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.074506 (+281807us) service_pool.cc:224] Handling call
0709 13:16:50.870188 (+795682us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:50.442951  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 44543.8us
I20260709 13:16:50.641749  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:50.875478  3101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.014s	sys 0.020s
W20260709 13:16:50.879647  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 800757us
I20260709 13:16:50.413551  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:50.872071  3250 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.641s (SENT) [suppressed 27 similar messages]
I20260709 13:16:50.883644  3836 raft_consensus.cc:2410] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:16:50.604241  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2516) took 1903 ms. Trace:
I20260709 13:16:50.876248  3281 rpcz_store.cc:276] 0709 13:16:48.562784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.562957 (+   173us) service_pool.cc:224] Handling call
0709 13:16:48.566019 (+  3062us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.585949 (+ 19930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.585978 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.608604 (+ 22626us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.891333 (+282729us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:48.891397 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.891498 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.494905 (+1603407us) raft_consensus.cc:1685] finished
0709 13:16:50.494935 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.863922 (+368987us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12245,"raft.queue_time_us":131,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":15187,"spinlock_wait_cycles":1188736,"thread_start_us":227424,"threads_started":1,"wal-append.queue_time_us":902810}
I20260709 13:16:50.888067  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:50.875520  3209 rpcz_store.cc:276] 0709 13:16:48.694983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.695273 (+   290us) service_pool.cc:224] Handling call
0709 13:16:48.707494 (+ 12221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.759560 (+ 52066us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:50.378038 (+1618478us) log.cc:844] Serialized 14 byte log entry
0709 13:16:50.828983 (+450945us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:50.829063 (+    80us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:50.829152 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.829248 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.829404 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":920544,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":1711,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":1367606,"threads_started":2}
I20260709 13:16:50.888746  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:50.889204  3835 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:50.889376  3840 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.890234  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:50.890821  3835 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:50.892097  3835 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:50.888900  3838 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 8: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
W20260709 13:16:50.680676  6397 log.cc:927] Time spent T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:16:50.773208  6226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.005s	sys 0.004s
I20260709 13:16:50.891053  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:50.906077  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:50.760043  6066 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:50.404346  6362 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:50.744349  6076 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:50.884166  3202 rpcz_store.cc:276] 0709 13:16:48.701057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.920541 (+219484us) service_pool.cc:224] Handling call
0709 13:16:49.303994 (+383453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.359068 (+ 55074us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:50.116984 (+757916us) log.cc:844] Serialized 14 byte log entry
0709 13:16:50.603193 (+486209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:50.603591 (+   398us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:50.603882 (+   291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.603981 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.604155 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":821565,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":20702,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":129,"spinlock_wait_cycles":1933568,"thread_start_us":1120650,"threads_started":2}
I20260709 13:16:50.901994  3842 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:50.923775  3285 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:50.755384  6388 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:50.924782  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:50.929605  3281 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:50.933845  3132 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
W20260709 13:16:50.901777  6226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.005s	sys 0.007s
I20260709 13:16:50.267823  6393 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:50.895674  6377 consensus_queue.cc:1243] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:50.895008  6379 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:50.947679  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:50.952420  3842 raft_consensus.cc:2410] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:16:50.948669  3841 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:50.950173  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:50.953935  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 66647.9us
I20260709 13:16:50.955544  6379 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:50.963613  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:50.936808  6129 consensus_queue.cc:1059] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:16:50.947191  6383 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:50.952129  6406 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:50.937711  6409 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.978919  3281 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:16:50.937659  6405 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:50.948377  6076 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.939342  6362 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:50.998214  3840 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
W20260709 13:16:50.998745  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 126683us
W20260709 13:16:51.020340  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 118671us
W20260709 13:16:51.020583  3250 leader_election.cc:336] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.731s (SENT)
I20260709 13:16:51.021003  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:51.021178  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:51.022161  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:50.958449  6023 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:16:51.087891  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:51.088744  3281 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:51.114023  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 176861us
I20260709 13:16:51.014967  6393 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:51.010850  6379 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:50.989174  6375 consensus_queue.cc:1059] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 13:16:51.092263  6066 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:51.097002  6369 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:51.181200  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 203111us
W20260709 13:16:51.191809  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 171239us
I20260709 13:16:50.987591  6383 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:51.195854  6429 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:51.196517  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 232155us
I20260709 13:16:50.992182  6405 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:51.154263  6362 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:51.197158  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 297153us
I20260709 13:16:51.164012  6370 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.086424  6076 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:50.993885  6409 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:51.207857  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.234504  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:50.990303  6406 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:51.236251  3280 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1220) took 1769 ms (client timeout 1580 ms). Trace:
I20260709 13:16:51.283785  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:51.283922  3280 rpcz_store.cc:269] 0709 13:16:49.466534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.489467 (+ 22933us) service_pool.cc:224] Handling call
0709 13:16:51.236036 (+1746569us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b5400077454. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:51.236164 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900918144}
I20260709 13:16:51.284415  3133 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.192373  6415 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.283202  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:51.289266  3840 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:51.267864  3128 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:51.285421  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:51.287693  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.194228  6379 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:51.288434  3207 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:16:51.283166  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.310803  3211 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:51.310803  3210 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:51.204923  6429 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:16:51.326771  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:51.330639  3250 leader_election.cc:336] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.800s (SENT)
I20260709 13:16:51.341360  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.342211  3128 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:16:51.342553  3206 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:51.319710  6415 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:51.351624  3250 connection.cc:256] RPC call timeout handler was delayed by -1.1227892780002549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2743s for a response
W20260709 13:16:51.352545  3250 connection.cc:256] RPC call timeout handler was delayed by -1.0993110060001072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
I20260709 13:16:51.191251  6402 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.142s
I20260709 13:16:51.345857  3280 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.348698  6415 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:51.379624  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:51.380177  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.227567  6369 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:51.407277  6292 raft_consensus.cc:3055] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:51.381182  3129 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:16:51.425560  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:51.425765  3250 leader_election.cc:336] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.952s (SENT)
I20260709 13:16:51.328013  6429 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.338725  6226 raft_consensus.cc:3055] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:51.328022  6420 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:51.438697  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1226) took 1711 ms. Trace:
I20260709 13:16:51.439553  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.441668  3276 rpcz_store.cc:276] 0709 13:16:49.726914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.280399 (+553485us) service_pool.cc:224] Handling call
0709 13:16:50.280800 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:50.369033 (+ 88233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:50.369095 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:50.861045 (+491950us) log.cc:844] Serialized 26 byte log entry
0709 13:16:51.189031 (+327986us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:51.189111 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.189194 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:51.438410 (+249216us) raft_consensus.cc:1685] finished
0709 13:16:51.438440 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.438623 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18274,"raft.queue_time_us":9965,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":67211,"thread_start_us":271260,"threads_started":1,"wal-append.queue_time_us":308635}
I20260709 13:16:51.444551  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:51.452801  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:51.453343  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:51.454582  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:51.455528  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:51.455986  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.458422  6421 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:51.459053  6421 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:51.461148  6066 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.461691  6066 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:51.458575  6412 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:16:51.463726  6066 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:51.466279  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:51.422952  6415 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.325206  6379 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:51.469604  6383 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:51.469851  6421 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:51.469745  6393 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:51.470288  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:51.498324  3840 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:51.470988  3131 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 8: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:51.471431  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.472075  3133 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:16:51.441334  6226 raft_consensus.cc:740] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:51.501876  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.472522  3250 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:51.483543  3280 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:51.422637  6292 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:51.310889  6370 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:51.493371  6420 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.486644  6415 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:51.497375  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:51.506495  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:51.508275  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 340313us
W20260709 13:16:51.514845  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 314048us
I20260709 13:16:51.517678  3276 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.475385  6409 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:51.520494  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:51.522002  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 49598.4us
I20260709 13:16:51.526563  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:51.527007  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.528115  3128 raft_consensus.cc:2410] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:51.523669  3102 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:16:51.512640  6403 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.451s	user 0.001s	sys 0.001s
I20260709 13:16:51.501307  6375 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.541836  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:51.541965  3250 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:51.550246  3129 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.517184  6421 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:51.556375  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.562609  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1233) took 1769 ms. Trace:
I20260709 13:16:51.565002  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:51.565069  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.565768  3280 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 4.
I20260709 13:16:51.566633  3177 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
W20260709 13:16:51.567740  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 545630us
I20260709 13:16:51.553649  6424 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:51.556560  6409 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.574477  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:51.576985  3280 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:16:51.563019  3277 rpcz_store.cc:276] 0709 13:16:49.793602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.356537 (+562935us) service_pool.cc:224] Handling call
0709 13:16:50.356885 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:50.574447 (+217562us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:50.936136 (+361689us) log.cc:844] Serialized 14 byte log entry
0709 13:16:51.175414 (+239278us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:51.201016 (+ 25602us) log.cc:844] Serialized 26 byte log entry
0709 13:16:51.201255 (+   239us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:51.203722 (+  2467us) log.cc:844] Serialized 14 byte log entry
0709 13:16:51.220325 (+ 16603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.220454 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:51.562412 (+341958us) raft_consensus.cc:1685] finished
0709 13:16:51.562433 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.562555 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":430837,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":37477,"raft.run_cpu_time_us":738,"raft.run_wall_time_us":83841,"thread_start_us":521563,"threads_started":2,"wal-append.queue_time_us":375559}
I20260709 13:16:51.577466  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.579553  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:51.580679  3280 raft_consensus.cc:2410] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:51.579610  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:51.581571  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:51.582386  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:51.582587  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:51.582940  3277 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:16:51.583348  6429 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:51.583686  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:51.584334  3277 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:51.570367  6292 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:51.586141  6292 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.570757  6226 consensus_queue.cc:260] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:51.590894  6226 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.592365  3129 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:51.583606  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:51.593261  3280 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:51.525749  6420 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:51.598956  6420 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:51.599711  6420 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:51.600063  6420 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.600381  6420 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.553109  6375 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:51.556414  5870 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:16:51.600291  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:51.604820  3281 consensus_meta.cc:287] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.000s
W20260709 13:16:51.613703  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 45634.6us
I20260709 13:16:51.613869  3281 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:51.604745  3277 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:51.605700  6369 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:51.606321  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 83509.2us
I20260709 13:16:51.624624  3250 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:51.607542  6415 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:51.608103  6405 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:51.636416  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 67410.3us
I20260709 13:16:51.611050  6409 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:51.611568  3282 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:51.644364  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1235) took 1850 ms. Trace:
I20260709 13:16:51.644812  3282 rpcz_store.cc:276] 0709 13:16:49.794350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.508874 (+714524us) service_pool.cc:224] Handling call
0709 13:16:51.610880 (+1102006us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b5800160e98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:16:51.611142 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.644008 (+ 32866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.644294 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5550848}
I20260709 13:16:51.612566  6421 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:16:51.613276  3283 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1224) took 1951 ms (client timeout 2066 ms). Trace:
W20260709 13:16:51.614199  3806 connection.cc:256] RPC call timeout handler was delayed by -1.3649547649999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
I20260709 13:16:51.631546  3276 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:51.632473  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.635025  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:51.646459  3283 rpcz_store.cc:269] 0709 13:16:49.661493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.034446 (+372953us) service_pool.cc:224] Handling call
0709 13:16:51.613060 (+1578614us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400038c54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:51.613218 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386202496}
I20260709 13:16:51.650836  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:51.651432  3806 connection.cc:256] RPC call timeout handler was delayed by -1.3514547649999713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
I20260709 13:16:51.651603  3205 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
W20260709 13:16:51.651916  3806 connection.cc:256] RPC call timeout handler was delayed by -1.2610503800001425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 13:16:51.653615  6433 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:51.654328  3806 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:51.613246  6393 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:16:51.686049  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 47234.1us
I20260709 13:16:51.799041  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:51.706708  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:51.801558  3204 raft_consensus.cc:1813] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Handling vote request from an unknown peer fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:51.805749  3175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.004s	sys 0.023s
I20260709 13:16:51.759202  3282 raft_consensus.cc:1275] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:51.771412  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:51.810384  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 156126us
I20260709 13:16:51.802907  3204 raft_consensus.cc:2368] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9.
I20260709 13:16:51.628810  6076 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:51.807229  3175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.005s	sys 0.023s
I20260709 13:16:51.657704  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:51.804363  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 179804us
I20260709 13:16:51.800426  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1234) took 2006 ms. Trace:
I20260709 13:16:51.706094  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:51.810117  3206 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
W20260709 13:16:51.773449  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.811048  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:51.663370  3132 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1223) took 1573 ms (client timeout 1580 ms). Trace:
W20260709 13:16:51.821404  3132 rpcz_store.cc:269] 0709 13:16:50.090372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.090518 (+   146us) service_pool.cc:224] Handling call
0709 13:16:51.663141 (+1572623us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b54003f7d54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:51.663290 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1806280192}
W20260709 13:16:51.770319  6129 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.006s	sys 0.019s
I20260709 13:16:51.825541  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.655692  6432 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:51.756609  6258 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:51.798763  6406 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:51.655385  6429 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:51.667368  6192 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.841286  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.667706  6379 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:51.807992  6423 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:51.838869  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:51.665619  6361 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:51.840119  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.816615  6234 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.842072  3128 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:16:51.850674  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:51.817915  3279 rpcz_store.cc:276] 0709 13:16:49.794042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.363740 (+569698us) service_pool.cc:224] Handling call
0709 13:16:50.865173 (+501433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:51.097575 (+232402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.097620 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:51.165284 (+ 67664us) log.cc:844] Serialized 26 byte log entry
0709 13:16:51.473584 (+308300us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:51.473633 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.473720 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:51.800116 (+326396us) raft_consensus.cc:1685] finished
0709 13:16:51.800136 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.800343 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14806,"raft.queue_time_us":34433,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":1779,"spinlock_wait_cycles":1920,"thread_start_us":363096,"threads_started":2,"wal-append.queue_time_us":440298}
I20260709 13:16:51.851330  3207 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:16:51.845247  3100 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:51.845544  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:51.828965  6129 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.006s	sys 0.022s
I20260709 13:16:51.847661  3250 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:51.855459  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.854914  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:51.855939  3204 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
W20260709 13:16:51.862262  6445 log.cc:927] Time spent T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:16:51.862917  6424 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:51.862941  6383 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:51.863507  6424 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.863897  6424 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.866784  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:51.870036  3250 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:51.873708  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.848524  6370 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:51.874923  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.853771  6361 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.833391  6146 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:16:51.873884  3100 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:51.878618  3204 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:51.876593  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.879498  3128 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:16:51.881975  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:51.883534  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.875036  6423 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:51.878145  6454 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
W20260709 13:16:51.885452  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 46636us
I20260709 13:16:51.942560  3806 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:51.846200  6367 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:16:51.873543  6432 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:51.860496  6258 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.880236  6383 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:51.838507  6055 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:16:51.955848  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.956669  3205 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:16:51.926047  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:51.926964  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 53150.9us
I20260709 13:16:51.927747  6256 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:51.928184  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:51.931154  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 747361us
I20260709 13:16:51.960218  3279 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:51.963064  3100 leader_election.cc:400] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9.
I20260709 13:16:51.963308  3100 leader_election.cc:403] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:51.932202  3128 raft_consensus.cc:2368] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9.
W20260709 13:16:51.950182  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 80199.8us
W20260709 13:16:51.951591  3278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1227) took 2209 ms (client timeout 1619 ms). Trace:
W20260709 13:16:51.965462  3278 rpcz_store.cc:269] 0709 13:16:49.742546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.883093 (+140547us) service_pool.cc:224] Handling call
0709 13:16:51.951386 (+2068293us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400125cd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:51.951491 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":573400960}
I20260709 13:16:51.965993  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:51.951277  3135 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1218) took 1897 ms (client timeout 1847 ms). Trace:
W20260709 13:16:51.967244  3135 rpcz_store.cc:269] 0709 13:16:50.053708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.060814 (+  7106us) service_pool.cc:224] Handling call
0709 13:16:51.951017 (+1890203us) spinlock_profiling.cc:243] Waited 87.2 ms on lock 0x7b54000e33d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:51.951185 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200483072}
I20260709 13:16:51.966802  3128 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:16:51.972963  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:51.944824  6357 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:51.973608  3128 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 4.
I20260709 13:16:51.954254  6383 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:51.975677  6383 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.980368  6357 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:51.981750  6375 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:51.961966  6256 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.983072  6256 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.955523  6451 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:51.986268  3209 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:51.950337  6432 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:51.987149  6432 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.988402  3282 raft_consensus.cc:1240] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:51.990736  3282 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:51.994098  3276 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:51.995373  6454 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.997331  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:51.998225  3806 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:51.999439  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:52.000270  6426 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:52.000648  6426 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:52.001176  6426 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.004792  6243 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:52.005754  6243 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:52.006191  6243 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:52.006604  6243 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:52.010265  6408 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 1.025s	user 0.004s	sys 0.006s
I20260709 13:16:52.016374  6426 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:52.018683  6426 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:52.019672  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:52.020411  3837 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:52.020916  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:52.021359  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:52.020977  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:52.021849  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:52.022575  3835 raft_consensus.cc:2410] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:52.005363  6424 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:52.028111  3136 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:52.029450  6424 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:52.030023  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1237) took 1829 ms. Trace:
I20260709 13:16:52.030493  3136 rpcz_store.cc:276] 0709 13:16:50.200593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.345161 (+1144568us) service_pool.cc:224] Handling call
0709 13:16:51.381115 (+ 35954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.028488 (+647373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.029740 (+  1252us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b5400076054. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:52.029951 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1487224064}
I20260709 13:16:52.035205  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.035280  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.041193  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:52.042878  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:52.048740  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.045877  3177 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:52.050631  3279 raft_consensus.cc:2410] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:52.062961  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.063153  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.063730  3127 raft_consensus.cc:2410] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:16:52.067395  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.068864  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.070326  6429 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:52.070679  6406 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:52.070935  6429 raft_consensus.cc:697] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:52.071578  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.072431  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:52.088205  3207 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:52.076911  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:52.088778  3204 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.083956  6406 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:52.271930  3284 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:52.268923  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.278050  3211 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:52.279022  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.279611  3211 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:52.280508  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.267509  6380 raft_consensus.cc:3055] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:52.204233  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.238521  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:52.281036  3211 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:16:52.169046  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.079955  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.285678  3131 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:52.285854  3208 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:16:52.286928  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.089607  6429 consensus_queue.cc:237] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:52.288091  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.288642  3208 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:16:52.281412  6146 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:52.289479  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.289695  6146 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:52.290370  3208 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:52.291127  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:52.291777  3208 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.291908  6146 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:52.074548  6414 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:52.281529  6393 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.095027  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.292740  6414 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:52.293041  6393 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:52.126891  6454 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9.
I20260709 13:16:52.169694  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.282429  6243 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:52.295578  3132 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:52.296883  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1470) took 1029 ms. Trace:
I20260709 13:16:52.297323  3833 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:52.297457  3132 rpcz_store.cc:276] 0709 13:16:51.267250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.961152 (+693902us) service_pool.cc:224] Handling call
0709 13:16:52.169540 (+208388us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b5800002798. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:52.296794 (+127254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7340288}
I20260709 13:16:52.298174  6243 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:52.282500  6380 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:52.171550  6258 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:52.298872  6393 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:52.308081  3277 raft_consensus.cc:1240] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:52.093918  6420 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:52.281787  3031 catalog_manager.cc:5697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 3 to 6, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 6 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.129635  6432 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:52.307539  6380 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:52.293349  3207 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:16:52.310113  6380 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.310704  6432 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:52.170269  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.311158  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.311594  3135 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:16:52.070724  6453 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:52.312145  3207 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:52.312507  6453 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:52.093604  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.313159  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.314142  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.314205  3207 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:52.072664  6286 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.315018  6453 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:52.221127  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:52.315965  3834 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:52.301411  6256 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:52.315798  6286 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:52.234977  6410 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 1.033s	user 0.000s	sys 0.002s
I20260709 13:16:52.317250  3128 raft_consensus.cc:2368] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8.
I20260709 13:16:52.305711  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.306082  6146 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.318392  6286 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:52.305143  6406 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:52.184523  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:52.314868  3202 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:16:52.318787  6146 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:52.320596  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:52.320812  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 319751us
I20260709 13:16:52.320945  6146 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:52.321826  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.322463  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.323704  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.324306  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.096549  6361 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:52.325450  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.326802  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.327144  6361 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:52.167115  6357 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:52.186049  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:52.258679  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 447677us
I20260709 13:16:52.329493  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:52.330092  3207 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:52.330224  6406 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:52.331290  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:52.211457  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:52.282829  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 184355us
I20260709 13:16:52.342396  3249 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:52.321872  3806 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:52.293337  6414 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:52.377729  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:52.385241  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 52851.6us
W20260709 13:16:52.389541  3127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1221) took 2325 ms (client timeout 1565 ms). Trace:
I20260709 13:16:52.391438  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:52.391142  3127 rpcz_store.cc:269] 0709 13:16:50.063713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.071209 (+  7496us) service_pool.cc:224] Handling call
0709 13:16:52.283951 (+2212742us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b5400074254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:52.389436 (+105485us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4471203072}
W20260709 13:16:52.391929  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 49634.3us
I20260709 13:16:52.392700  3208 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:52.393347  3207 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 13:16:52.392904  3249 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:52.406658  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.407240  3207 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:52.408161  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:52.408635  3207 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.403826  3249 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:52.409706  3249 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:52.410352  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:52.411096  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:52.411999  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:52.413308  3249 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:52.415477  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:52.416221  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.417747  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:52.419529  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:52.420580  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 98769us
I20260709 13:16:52.414320  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:52.427405  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.435937  3031 catalog_manager.cc:5697] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 1 to 2, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 2 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.438045  3031 catalog_manager.cc:5697] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 1 to 5, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 5 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.445685  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:52.446620  3209 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:52.454221  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.455438  3133 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:52.456023  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1485) took 1001 ms. Trace:
I20260709 13:16:52.460568  6256 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:52.464675  3206 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:52.466377  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.466758  3206 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:52.468309  3131 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:52.456437  3133 rpcz_store.cc:276] 0709 13:16:51.454966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.275689 (+820723us) service_pool.cc:224] Handling call
0709 13:16:52.454019 (+178330us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b5800002798. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:52.455943 (+  1924us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52497152}
I20260709 13:16:52.468451  3206 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:52.471211  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 51758.6us
I20260709 13:16:52.471443  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:52.469427  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1220) took 2406 ms. Trace:
I20260709 13:16:52.473351  3806 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:52.468899  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1476) took 1029 ms. Trace:
I20260709 13:16:52.475052  3208 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:52.475622  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:52.412000  6357 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:52.482769  3131 rpcz_store.cc:276] 0709 13:16:51.439583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.286652 (+847069us) service_pool.cc:224] Handling call
0709 13:16:52.467780 (+181128us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b5800002798. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:16:52.467978 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.468682 (+   704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.468848 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44880640}
I20260709 13:16:52.480036  3134 rpcz_store.cc:276] 0709 13:16:50.063367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.063484 (+   117us) service_pool.cc:224] Handling call
0709 13:16:50.078128 (+ 14644us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:50.121424 (+ 43296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:50.121461 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:51.983345 (+1861884us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b2c000014c8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:16:51.983914 (+   569us) log.cc:844] Serialized 52 byte log entry
0709 13:16:52.394679 (+410765us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:52.394725 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.394832 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:52.469093 (+ 74261us) raft_consensus.cc:1685] finished
0709 13:16:52.469115 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:52.469347 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35145,"raft.queue_time_us":49870,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":148,"spinlock_wait_cycles":43713280,"thread_start_us":410389,"threads_started":1,"wal-append.queue_time_us":482653}
I20260709 13:16:52.491843  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:52.481422  3100 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:52.412567  6361 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:52.418321  6146 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:52.498188  3100 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:52.419158  6258 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:52.419333  6393 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:52.507028  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:52.518636  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 95360.4us
I20260709 13:16:52.098594  6383 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:52.519603  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:52.405798  6379 consensus_queue.cc:1059] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:16:52.472239  6449 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:52.404915  6453 consensus_queue.cc:1059] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:16:52.424371  6286 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:52.526712  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:52.472295  6432 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:52.474005  6421 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:52.488587  6415 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:52.537703  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:52.493762  6357 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.501339  6361 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.512303  6146 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.542135  3207 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:52.519006  6426 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:52.512585  6369 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:52.546216  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:52.520107  6258 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:52.524825  6393 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:52.526443  6234 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:52.552162  3208 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:52.553617  3207 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:52.545176  6421 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:52.566617  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 144785us
I20260709 13:16:52.546139  6076 raft_consensus.cc:3055] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:52.552207  6146 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:52.530308  6467 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:16:52.551084  6357 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:52.557875  6258 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.614962  6434 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:52.615393  6386 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.637218  6473 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:52.638767  6383 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:52.641093  3250 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:52.559407  6234 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.553993  6449 raft_consensus.cc:697] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:52.560240  6379 raft_consensus.cc:3055] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:52.550125  6464 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:16:52.551041  6361 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:52.580961  3203 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:52.554204  6369 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.560644  6393 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.680699  3250 leader_election.cc:400] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9.
W20260709 13:16:52.733151  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 52647.3us
I20260709 13:16:52.735231  3250 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:52.685177  6449 consensus_queue.cc:237] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:52.677644  6234 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.567464  6421 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.687469  6193 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:52.571826  6076 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:52.711246  3208 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:52.577533  6286 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
W20260709 13:16:52.728818  3176 connection.cc:256] RPC call timeout handler was delayed by -3.0116492190002191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
W20260709 13:16:52.764122  3176 connection.cc:256] RPC call timeout handler was delayed by -2.9648492190001434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
W20260709 13:16:52.764626  3176 connection.cc:256] RPC call timeout handler was delayed by -2.9513492190001216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 13:16:52.765019  3176 connection.cc:256] RPC call timeout handler was delayed by -2.9252492190000794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:16:52.765415  3176 connection.cc:256] RPC call timeout handler was delayed by -2.9162492190000648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
W20260709 13:16:52.765787  3176 connection.cc:256] RPC call timeout handler was delayed by -2.8586492190001991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260709 13:16:52.766310  3176 connection.cc:256] RPC call timeout handler was delayed by -2.7110492190001878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 13:16:52.766731  3176 connection.cc:256] RPC call timeout handler was delayed by -2.7092492190001849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 13:16:52.767097  3176 connection.cc:256] RPC call timeout handler was delayed by -2.5598492190001707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
W20260709 13:16:52.767474  3176 connection.cc:256] RPC call timeout handler was delayed by -2.5517492190001576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
W20260709 13:16:52.767910  3176 connection.cc:256] RPC call timeout handler was delayed by -2.5148492190000979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 13:16:52.768316  3176 connection.cc:256] RPC call timeout handler was delayed by -2.5139492190000965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260709 13:16:52.768694  3176 connection.cc:256] RPC call timeout handler was delayed by -2.3951492190001318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2198s for a response
W20260709 13:16:52.769069  3176 connection.cc:256] RPC call timeout handler was delayed by -2.3951492190001318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2198s for a response
W20260709 13:16:52.770648  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 251225us
I20260709 13:16:52.749642  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:52.750882  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:16:52.708607  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.775818  3806 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:52.759054  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:52.762158  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.782657  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.772467  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:52.791714  3176 connection.cc:256] RPC call timeout handler was delayed by -1.7489492190002238s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2916s for a response
I20260709 13:16:52.687883  6379 raft_consensus.cc:740] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:16:52.792364  3176 connection.cc:256] RPC call timeout handler was delayed by -1.5878492190001907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30950000000000005s for a response
I20260709 13:16:52.791627  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:52.791627  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.794066  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:52.802697  3285 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.783483  3136 raft_consensus.cc:2376] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9. Re-sending same reply.
I20260709 13:16:52.738250  6369 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:52.731117  6383 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:52.815838  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.826324  3131 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:52.731848  6454 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:52.839517  3206 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:52.761567  6192 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.819219  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:52.823884  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2403) took 1621 ms. Trace:
W20260709 13:16:52.834064  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.682480  6386 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:52.817397  3134 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:52.768090  6226 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.873417  6226 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:52.876313  6226 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:52.878822  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:52.879655  3127 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.848254  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.880795  3128 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:16:52.848959  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 62139us
I20260709 13:16:52.851121  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:52.881711  3282 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:52.847299  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:52.882933  3284 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
W20260709 13:16:52.884337  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.895823  6386 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:52.861361  6454 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:52.899502  6454 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:52.878427  6192 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:52.904170  6468 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
W20260709 13:16:52.905962  6472 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 13:16:52.907899  6469 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:16:52.892177  6379 consensus_queue.cc:260] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:52.914189  6379 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:52.929018  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:52.933766  3129 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:52.939944  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:52.942159  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.853148  3281 rpcz_store.cc:276] 0709 13:16:51.202167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.807402 (+605235us) service_pool.cc:224] Handling call
0709 13:16:51.826603 (+ 19201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.858444 (+ 31841us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:51.883177 (+ 24733us) log.cc:844] Serialized 14 byte log entry
0709 13:16:51.944077 (+ 60900us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:51.944125 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:51.944172 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.823560 (+879388us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b540022e554. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:52.823629 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:52.823819 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1086,"prepare.queue_time_us":39926,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":6480,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5152,"spinlock_wait_cycles":72736128,"thread_start_us":80727,"threads_started":2,"wal-append.queue_time_us":190823}
I20260709 13:16:52.859421  3276 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:52.775496  6427 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.863108  3277 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:52.791595  6243 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:52.869109  6076 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:52.777359  6420 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:52.953945  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.852404  3209 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:52.960937  3101 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:52.973054  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.904814  6192 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:52.956110  6429 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.000s	sys 0.020s
I20260709 13:16:52.979048  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:52.988976  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:52.988915  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 417909us
I20260709 13:16:52.989949  3207 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:52.999358  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:53.001365  3134 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.002465  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1493) took 1144 ms. Trace:
I20260709 13:16:53.002981  3129 rpcz_store.cc:276] 0709 13:16:51.856754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.150116 (+293362us) service_pool.cc:224] Handling call
0709 13:16:52.466215 (+316099us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b5800002798. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:53.000884 (+534669us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b5400076054. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:53.001034 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123653376}
I20260709 13:16:53.004575  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:53.007659  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 46846.9us
I20260709 13:16:53.009011  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:53.020349  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:53.020459  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:53.026508  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:52.977949  6431 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:53.028329  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 247134us
I20260709 13:16:53.042852  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:53.043486  3136 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:53.021098  3131 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:16:53.045608  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:53.045881  3277 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:53.047851  3204 consensus_meta.cc:287] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.924s	user 0.012s	sys 0.000s
I20260709 13:16:53.048295  3204 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:16:53.038841  3207 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:53.040421  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:53.048878  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 2556) took 1003 ms. Trace:
I20260709 13:16:53.052614  3204 rpcz_store.cc:276] 0709 13:16:52.045491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.076640 (+ 31149us) service_pool.cc:224] Handling call
0709 13:16:53.048816 (+972176us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:52.985731  6429 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.000s	sys 0.020s
I20260709 13:16:53.066740  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:53.060351  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:53.059823  3100 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:53.059391  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:53.019677  6076 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.016681  6286 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:53.042315  6473 raft_consensus.cc:697] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:53.019135  6192 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:16:53.089607  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 81276.9us
I20260709 13:16:52.966292  6427 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:53.095804  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:53.117681  3203 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:53.098664  3207 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
W20260709 13:16:53.121794  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.059653  3285 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:16:53.125335  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:53.101605  3281 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:16:53.125499  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 59227.5us
I20260709 13:16:52.962209  6383 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:16:53.006680  6243 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:16:53.087827  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:53.054868  6431 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:53.054302  6406 raft_consensus.cc:2764] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
W20260709 13:16:53.110267  6380 consensus_meta.cc:287] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.800s	user 0.004s	sys 0.009s
I20260709 13:16:53.105305  6286 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:53.017835  6426 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:16:53.118290  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:53.127812  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 68070us
I20260709 13:16:53.138221  3127 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:16:53.155462  3282 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:53.156064  3134 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:53.163812  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2411) took 1601 ms. Trace:
W20260709 13:16:53.168836  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 433668us
I20260709 13:16:53.168859  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:53.178733  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:53.190620  3203 raft_consensus.cc:2393] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:16:53.191525  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 419134us
I20260709 13:16:53.161537  6431 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.201930  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:53.202236  3250 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:53.197415  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 67124.7us
W20260709 13:16:53.210145  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.187116  3283 rpcz_store.cc:276] 0709 13:16:51.562105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.401738 (+839633us) service_pool.cc:224] Handling call
0709 13:16:52.402069 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.402337 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:52.406070 (+  3733us) log.cc:844] Serialized 14 byte log entry
0709 13:16:52.614897 (+208827us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b1800418660. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f23a 00007fb3bc1f9a2a
0709 13:16:53.163272 (+548375us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:53.163395 (+   123us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:53.163469 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.163567 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.163734 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":316,"prepare.queue_time_us":2761,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"spinlock_wait_cycles":15169408,"thread_start_us":548058,"threads_started":2,"wal-append.queue_time_us":612952}
I20260709 13:16:53.174937  6423 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:53.185398  6286 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.117019  6361 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:53.184728  6238 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:53.130952  6486 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 13:16:53.221311  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 96064us
I20260709 13:16:53.222983  3101 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:53.227916  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 226245us
W20260709 13:16:53.229550  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 44795.6us
I20260709 13:16:53.230891  3100 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:53.236668  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 191858us
I20260709 13:16:53.243216  3279 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:53.218941  6192 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:53.259696  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:53.255288  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 53471.5us
I20260709 13:16:53.260941  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:53.253976  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:53.244992  6479 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:16:53.261695  6238 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:53.265697  6485 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:16:53.269042  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 46187.4us
I20260709 13:16:53.262169  6226 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:53.284158  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:53.284945  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:53.306320  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45504.8us
I20260709 13:16:53.309367  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:53.311825  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 250246us
W20260709 13:16:53.314585  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 94583.3us
I20260709 13:16:53.314795  3209 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:16:53.322263  3101 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:53.321859  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:53.320013  6488 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.308972  6429 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:53.343504  3136 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:16:53.253961  6490 consensus_queue.cc:1059] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 13:16:53.362540  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:53.337962  6481 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.240s	user 0.001s	sys 0.001s
I20260709 13:16:53.374816  3832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 588) took 1091 ms. Trace:
W20260709 13:16:53.377513  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 184852us
W20260709 13:16:53.386153  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 64353.6us
I20260709 13:16:53.325314  6380 consensus_queue.cc:1059] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:16:53.344820  6424 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:53.406208  6484 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.271s	user 0.000s	sys 0.004s
I20260709 13:16:53.346203  6452 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:53.346226  6226 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:53.379489  3832 rpcz_store.cc:276] 0709 13:16:52.283489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.283618 (+   129us) service_pool.cc:224] Handling call
0709 13:16:52.416765 (+133147us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:52.424700 (+  7935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.424750 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:52.489423 (+ 64673us) log.cc:844] Serialized 26 byte log entry
0709 13:16:52.739519 (+250096us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:52.739562 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.739636 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.374547 (+634911us) raft_consensus.cc:1685] finished
0709 13:16:53.374568 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.374726 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":51843,"thread_start_us":232808,"threads_started":1,"wal-append.queue_time_us":481361}
W20260709 13:16:53.446080  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 243971us
I20260709 13:16:53.457497  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:53.257958  6473 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:53.331110  6426 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:16:53.371702  6379 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:53.468557  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:53.375252  6429 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:16:53.411720  6393 consensus_meta.cc:287] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.002s
I20260709 13:16:53.346822  6488 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:53.447412  6424 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:53.448921  6386 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:53.536652  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 214435us
W20260709 13:16:53.525249  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.459813  6192 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:53.538159  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:53.559000  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:53.570621  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:53.572271  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 159840us
I20260709 13:16:53.573328  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:53.578142  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:53.536664  6424 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:53.593320  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 213239us
I20260709 13:16:53.390486  6238 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:53.594173  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:53.570751  6361 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:53.527093  6393 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:53.593258  6503 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:53.574079  6386 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:53.591223  6502 consensus_queue.cc:1059] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.102s
I20260709 13:16:53.688834  3211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2561) took 1204 ms. Trace:
I20260709 13:16:53.689216  3280 raft_consensus.cc:1813] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Handling vote request from an unknown peer fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:53.728634  3280 raft_consensus.cc:2368] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 10.
I20260709 13:16:53.613108  6490 raft_consensus.cc:3055] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:16:53.733255  3805 leader_election.cc:336] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.143s (SENT)
I20260709 13:16:53.733904  3805 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:53.738507  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 165298us
I20260709 13:16:53.740485  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:53.640605  6449 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:53.748363  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.727898  3211 rpcz_store.cc:276] 0709 13:16:52.484536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.646243 (+161707us) service_pool.cc:224] Handling call
0709 13:16:52.652481 (+  6238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:52.665711 (+ 13230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.665764 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:52.666895 (+  1131us) log.cc:844] Serialized 26 byte log entry
0709 13:16:52.956431 (+289536us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:52.956486 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.956597 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.405572 (+448975us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:16:53.681806 (+276234us) raft_consensus.cc:1685] finished
0709 13:16:53.681830 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.688757 (+  6927us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4777,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":15735,"spinlock_wait_cycles":12928896,"thread_start_us":289093,"threads_started":1,"wal-append.queue_time_us":375128}
W20260709 13:16:53.751345  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 293931us
I20260709 13:16:53.615396  6510 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:53.693595  6497 log.cc:927] Time spent T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 13:16:53.696666  6493 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:16:53.575556  3129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "404209c6105f4945b077c33471d63370"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:16:53.781407  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:16:53.785240  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 44827.4us
W20260709 13:16:53.759133  6487 log.cc:927] Time spent T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.414s	user 0.001s	sys 0.000s
I20260709 13:16:53.773756  3250 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:53.782021  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 211491us
I20260709 13:16:53.702303  6488 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:53.693116  6393 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:53.795909  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 201113us
I20260709 13:16:53.785355  3129 raft_consensus.cc:606] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:53.742969  6490 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:53.807528  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.808257  3101 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:53.807385  3249 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:53.768597  6366 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:53.786541  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:53.744285  6511 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:53.809609  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:53.803766  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 238013us
I20260709 13:16:53.786286  6380 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:53.610103  6226 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:53.802556  6483 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:53.793412  6464 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:53.800757  6480 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:53.794360  6467 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:53.782893  6449 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:53.681697  6429 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:53.787323  6510 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:53.743346  6361 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:16:53.835850  6517 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:53.840945  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:53.843103  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 56683.7us
I20260709 13:16:53.864881  3203 raft_consensus.cc:2376] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7. Re-sending same reply.
I20260709 13:16:53.865394  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:53.843007  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:53.867133  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:53.825790  6488 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.837111  6513 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:53.862462  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:53.859680  3101 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:53.871717  3276 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:53.873703  3100 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:53.874799  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:53.875407  3203 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.842414  6406 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:53.837509  6423 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:53.841787  6393 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.888039  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:53.842062  6467 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:53.849349  6449 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.826188  6511 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:53.829320  6525 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:16:53.913931  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 378) took 1129 ms. Trace:
W20260709 13:16:53.917521  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 108011us
I20260709 13:16:53.918838  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:53.878011  6380 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.847519  6366 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:16:53.914351  3135 rpcz_store.cc:276] 0709 13:16:52.784312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.784490 (+   178us) service_pool.cc:224] Handling call
0709 13:16:52.784935 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:52.804003 (+ 19068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.804049 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:52.849017 (+ 44968us) log.cc:844] Serialized 26 byte log entry
0709 13:16:53.199765 (+350748us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:53.219793 (+ 20028us) log.cc:844] Serialized 14 byte log entry
0709 13:16:53.252099 (+ 32306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.252205 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.913696 (+661491us) raft_consensus.cc:1685] finished
0709 13:16:53.913720 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.913868 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26927,"prepare.queue_time_us":19717,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":46126,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":31353,"thread_start_us":219967,"threads_started":1,"wal-append.queue_time_us":386518}
W20260709 13:16:53.923636  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 190437us
W20260709 13:16:53.925936  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 66388.7us
I20260709 13:16:53.926726  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:53.909807  6076 consensus_meta.cc:287] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.805s	user 0.012s	sys 0.000s
I20260709 13:16:53.924417  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:53.894347  6467 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:53.933096  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:16:53.946113  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.890219  6423 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:53.919059  6406 raft_consensus.cc:697] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:53.957981  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1499) took 2099 ms. Trace:
I20260709 13:16:53.958395  3132 rpcz_store.cc:276] 0709 13:16:51.858386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.320572 (+462186us) service_pool.cc:224] Handling call
0709 13:16:52.320943 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:52.414986 (+ 94043us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:52.621488 (+206502us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b18003ef380. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b90ff455 00007fb3bfbe73c7 00007fb3bc1f99a7 00007fb3bc2090bf 00007fb3bc209038
0709 13:16:52.981519 (+360031us) log.cc:844] Serialized 14 byte log entry
0709 13:16:53.256570 (+275051us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:53.257165 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:16:53.257344 (+   179us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:53.257586 (+   242us) log.cc:844] Serialized 14 byte log entry
0709 13:16:53.257752 (+   166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.257837 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.957743 (+699906us) raft_consensus.cc:1685] finished
0709 13:16:53.957771 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.957912 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123811,"prepare.queue_time_us":144922,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":88,"raft.queue_time_us":135998,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":61551,"spinlock_wait_cycles":25150208,"thread_start_us":502285,"threads_started":2,"wal-append.queue_time_us":360269}
I20260709 13:16:53.910007  6393 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:53.963433  3250 leader_election.cc:400] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8.
I20260709 13:16:53.882422  6490 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:53.966320  3250 leader_election.cc:403] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:53.938060  6517 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:53.882813  6488 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:53.922658  6473 consensus_queue.cc:1059] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:16:53.955772  6421 consensus_meta.cc:287] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.178s	user 0.010s	sys 0.005s
I20260709 13:16:53.984333  6513 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:53.970552  6234 consensus_meta.cc:287] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 1.155s	user 0.013s	sys 0.000s
W20260709 13:16:53.968223  6369 consensus_meta.cc:287] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 1.088s	user 0.008s	sys 0.005s
I20260709 13:16:53.966009  6076 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:53.930238  6380 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:53.998670  6473 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:53.999138  6473 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:53.999421  6243 raft_consensus.cc:3055] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:53.999879  6243 raft_consensus.cc:740] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:53.995841  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:53.999912  6517 raft_consensus.cc:697] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:53.999518  6473 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:53.978291  6357 consensus_meta.cc:287] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.290s	user 0.011s	sys 0.005s
I20260709 13:16:53.976999  6192 consensus_queue.cc:1059] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:16:53.968180  6519 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:53.987954  6514 log.cc:927] Time spent T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:16:53.981376  6386 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:53.992599  6414 consensus_meta.cc:287] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.519s	user 0.013s	sys 0.003s
W20260709 13:16:53.995069  6146 consensus_meta.cc:287] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.241s	user 0.014s	sys 0.000s
I20260709 13:16:53.994968  6361 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:54.021754  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:16:54.031327  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 135996us
I20260709 13:16:54.001957  6380 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:54.031311  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:53.990536  6421 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:53.998685  6076 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:54.010293  6490 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:54.038913  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.010525  6519 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.021059  6523 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:54.047122  6507 log.cc:927] Time spent T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.192s	user 0.002s	sys 0.000s
I20260709 13:16:54.047287  6529 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:54.047441  6523 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:54.048110  6529 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:54.048399  6531 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:54.048713  6529 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.049283  6520 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:54.049566  6492 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:53.987177  6513 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.054687  3836 raft_consensus.cc:1240] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:54.039415  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.003250  6234 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:54.059000  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.000895  6243 consensus_queue.cc:260] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.026466  6361 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:54.004884  6454 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:16:54.059355  3129 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:54.061502  3132 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
W20260709 13:16:54.067267  6505 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:16:54.067705  6518 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8.
I20260709 13:16:54.010188  6357 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.068118  6509 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:54.069525  6533 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:16:54.067312  6532 consensus_queue.cc:1059] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:16:54.005170  6369 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:54.073854  6530 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:16:54.067298  6537 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.051638  6366 consensus_queue.cc:1059] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:16:54.077522  6517 consensus_queue.cc:237] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.078018  6511 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:54.122025  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:54.068246  6539 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:54.080204  6488 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:54.058728  6522 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:54.085423  6510 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:54.053012  6515 raft_consensus.cc:3055] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:54.087116  3285 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:54.136085  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.136842  3285 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:54.087174  6393 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:54.092455  3203 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:16:54.094597  3132 raft_consensus.cc:1240] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:16:54.067387  6508 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:16:54.026691  6146 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:54.100564  6512 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:16:54.052031  6519 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.037395  6386 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:16:54.088610  6467 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:54.092530  6258 consensus_meta.cc:287] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.403s	user 0.005s	sys 0.009s
I20260709 13:16:54.033350  6414 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.111176  3129 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:54.092764  6361 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.096516  6243 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:54.101536  6509 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.129251  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:54.132172  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 207859us
I20260709 13:16:54.139936  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.142295  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.140138  6380 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.156368  3132 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:54.152786  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.131408  6522 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.139001  6234 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:54.039963  6406 consensus_queue.cc:237] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.135123  6515 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:54.146080  6366 consensus_queue.cc:1243] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer 48080cf0460346769ab046a4f9457aa5 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:54.159883  3208 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:54.160557  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.162074  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.148370  6544 raft_consensus.cc:3055] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:54.168133  3285 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:54.168247  3132 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:54.154930  3135 raft_consensus.cc:2376] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7. Re-sending same reply.
W20260709 13:16:54.180274  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.202431  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.168208  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:54.155548  6509 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:54.202450  3806 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:54.161049  6424 consensus_meta.cc:287] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.518s	user 0.001s	sys 0.010s
I20260709 13:16:54.221295  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:54.221801  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 53682.8us
I20260709 13:16:54.120332  6537 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.132131  6076 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.157871  6522 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:54.150624  6258 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.175161  6544 raft_consensus.cc:740] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:54.238813  3131 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:16:54.235790  6516 log.cc:927] Time spent T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:16:54.143908  6539 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.160516  6380 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:54.246922  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 44566.3us
W20260709 13:16:54.241433  6383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.036s	sys 0.054s
I20260709 13:16:54.254640  6537 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:54.248754  3279 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:54.248626  6193 consensus_meta.cc:287] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 1.475s	user 0.012s	sys 0.003s
I20260709 13:16:54.198808  6520 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:16:54.281607  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.223163  6424 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.283206  3285 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:54.245213  6421 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:54.283484  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:54.286717  3131 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:16:54.258988  6383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.036s	sys 0.055s
W20260709 13:16:54.289455  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.290195  6535 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:54.288442  3806 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:54.296362  3277 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:54.296633  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.297338  3285 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:54.298383  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.298624  3101 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:54.299422  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:54.300092  3285 raft_consensus.cc:2368] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8.
I20260709 13:16:54.301774  6535 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:54.302345  6414 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:54.315572  6425 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:54.317057  6431 consensus_meta.cc:287] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 1.100s	user 0.013s	sys 0.000s
I20260709 13:16:54.317629  6431 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.319007  6480 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:54.319525  6480 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.320225  6431 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:54.322245  6380 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:54.290745  6544 consensus_queue.cc:260] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.326077  6544 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:54.326375  6424 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:54.291615  6432 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:54.329371  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:54.339702  3249 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:54.348320  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.332872  6483 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:54.354750  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 66379.6us
W20260709 13:16:54.356640  6553 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:16:54.357434  6521 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:54.345395  6421 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:54.364352  6369 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:54.249472  6515 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.346786  6427 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:54.366370  6380 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:54.367594  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:54.390401  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:54.344939  6517 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:54.367422  6483 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:54.371639  6467 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:54.380956  6549 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:16:54.381510  6515 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.394141  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:54.379094  3836 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:16:54.402236  6489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.007s	sys 0.007s
I20260709 13:16:54.308147  6524 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.240s
I20260709 13:16:54.353207  6361 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:54.398067  6286 consensus_meta.cc:287] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.172s	user 0.012s	sys 0.003s
I20260709 13:16:54.407997  6491 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:54.316258  6425 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.403491  6432 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:54.402916  6483 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.429570  6550 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.430128  6550 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.432300  6550 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:54.433642  6498 raft_consensus.cc:3055] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:54.434262  6498 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:54.418195  6379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.006s	sys 0.023s
I20260709 13:16:54.420635  6286 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.438841  3130 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
W20260709 13:16:54.439415  6545 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:16:54.439721  6286 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:54.440647  3282 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:54.441216  6432 raft_consensus.cc:697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:54.442018  6539 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:54.442353  6432 consensus_queue.cc:237] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.408788  6517 raft_consensus.cc:697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:54.446113  6517 consensus_queue.cc:237] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.448770  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:54.449182  6491 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:16:54.451185  6379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.007s	sys 0.024s
I20260709 13:16:54.450506  6491 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.451251  6423 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.412523  6490 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:16:54.452854  3285 raft_consensus.cc:2393] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:54.438453  6498 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.456091  6498 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:54.429230  6555 log.cc:927] Time spent T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:16:54.421592  6489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.008s	sys 0.008s
I20260709 13:16:54.462925  3283 raft_consensus.cc:1240] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:54.428871  6449 consensus_meta.cc:287] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.003s
W20260709 13:16:54.474936  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.480206  6565 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:54.480445  6449 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.481124  6565 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.483656  6449 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:54.489319  3135 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:54.462477  6379 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:54.496471  6361 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:54.497447  6519 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:54.499754  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.500051  6519 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:54.503976  6483 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.506174  6522 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.508770  6522 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:54.509538  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:54.510377  6464 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:16:54.516376  3034 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38226 (request call id 251) took 28792 ms (client timeout 15000 ms). Trace:
I20260709 13:16:54.532115  6425 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:54.536252  6146 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:54.536926  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:54.549366  3840 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:54.540174  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 135730us
I20260709 13:16:54.489393  6565 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:54.546751  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 308449us
I20260709 13:16:54.547003  6464 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:54.557406  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.559082  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.561445  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 428) took 1223 ms. Trace:
I20260709 13:16:54.561863  3279 rpcz_store.cc:276] 0709 13:16:53.337867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.338024 (+   157us) service_pool.cc:224] Handling call
0709 13:16:53.376065 (+ 38041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.284949 (+908884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.561217 (+276268us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b5400038754. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:54.561386 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2006529408}
I20260709 13:16:54.562834  6522 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.563277  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.563375  6522 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.564528  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.566788  3279 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:54.550993  6490 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.573046  3840 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:16:54.565783  6565 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.580055  6565 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.582542  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.583262  3279 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:54.584375  3101 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:54.588049  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:54.593142  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:54.594280  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:54.595450  6404 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:54.595954  6404 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:54.596320  6404 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.599015  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:54.550077  6509 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.594264  6513 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:54.594422  6473 consensus_meta.cc:287] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.003s
I20260709 13:16:54.604001  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.604027  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:54.604863  3131 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
W20260709 13:16:54.608882  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.603250  6513 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:54.618076  3129 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:54.597493  6429 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:54.602432  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:54.600407  6146 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.584074  6490 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.626760  3279 raft_consensus.cc:2410] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:54.602016  6467 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:54.629253  3208 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:16:54.635407  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:54.636878  3206 raft_consensus.cc:2393] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:54.635761  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:54.638238  3207 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:54.639358  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:54.640206  3207 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:16:54.641355  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:54.643370  3207 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:54.619315  6423 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:54.647511  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:54.621405  6513 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.589531  6379 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.647981  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:54.648100  3203 raft_consensus.cc:2376] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8. Re-sending same reply.
I20260709 13:16:54.590095  6480 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.649322  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:54.649976  3206 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 4.
I20260709 13:16:54.627823  6449 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:54.546587  3034 rpcz_store.cc:269] 0709 13:16:25.728245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.729221 (+   976us) service_pool.cc:224] Handling call
0709 13:16:54.516079 (+28786858us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:39.757468 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:39.942792 (+185324us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:39.957579 (+ 14787us) write_op.cc:435] Acquired schema lock
0709 13:16:39.960489 (+  2910us) tablet.cc:662] Decoding operations
0709 13:16:40.204076 (+243587us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:40.204181 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:40.204222 (+    41us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:16:40.205569 (+  1347us) tablet.cc:701] Row locks acquired
0709 13:16:40.205627 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:16:40.205821 (+   194us) write_op.cc:270] Start()
0709 13:16:40.205984 (+   163us) write_op.cc:276] Timestamp: P: 1783603000205755 usec, L: 0
0709 13:16:40.206007 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:16:40.443642 (+237635us) log.cc:844] Serialized 5576 byte log entry
0709 13:16:40.920168 (+476526us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b54000a87d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1eae28 00007fb3bfc25581 00007fb3bfc24d58 00007fb3bfc299f1 00007fb3bfc299a9 00007fb3bfc29939 00007fb3bfc29901 00007fb3bfc28b2d 000000000038f354 000000000038f199
0709 13:16:41.500526 (+580358us) op_driver.cc:464] REPLICATION: finished
0709 13:16:42.348678 (+848152us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3b90e50ac 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bfc25ef0
0709 13:16:43.026538 (+677860us) write_op.cc:301] APPLY: starting
0709 13:16:43.052165 (+ 25627us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:43.252711 (+200546us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:43.370717 (+118006us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:43.473495 (+102778us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:43.473840 (+   345us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:16:43.473884 (+    44us) write_op.cc:312] APPLY: finished
0709 13:16:43.576672 (+102788us) log.cc:844] Serialized 101 byte log entry
0709 13:16:43.843472 (+266800us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:43.853971 (+ 10499us) write_op.cc:454] Released schema lock
0709 13:16:43.875122 (+ 21151us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:43.875576 (+   454us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:43.875606 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":81654,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":1466877,"apply.run_cpu_time_us":28021,"apply.run_wall_time_us":879063,"num_ops":14,"prepare.queue_time_us":306428,"prepare.run_cpu_time_us":42088,"prepare.run_wall_time_us":1210730,"raft.queue_time_us":204740,"raft.run_cpu_time_us":24525,"raft.run_wall_time_us":1361145,"replication_time_us":1244146,"spinlock_wait_cycles":56070912,"thread_start_us":1788938,"threads_started":5,"wal-append.queue_time_us":666735,"wal-append.run_cpu_time_us":89246,"wal-append.run_wall_time_us":2640972}]]}
I20260709 13:16:54.652674  3204 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:54.658362  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:54.588835  6567 consensus_queue.cc:1059] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 13:16:54.675164  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.662513  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:54.666350  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:54.672124  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:54.610893  6473 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.672840  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:54.646050  6483 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:54.677403  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.633404  6146 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:54.661597  6569 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:16:54.694708  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.652489  6515 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.681870  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:54.696256  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:54.651165  6522 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:54.677372  3176 leader_election.cc:336] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.729s (SENT)
I20260709 13:16:54.691351  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:54.700423  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:54.698146  3134 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:54.700570  3204 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:54.691707  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:54.707672  6146 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:54.711438  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.712682  3279 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:54.672091  6449 raft_consensus.cc:697] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:16:54.718106  6501 log.cc:927] Time spent T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 1.157s	user 0.004s	sys 0.000s
I20260709 13:16:54.718195  6449 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.714891  6480 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:54.692389  6243 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.730108  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.730823  3134 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:54.731683  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.732847  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.733933  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:54.734611  3134 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:54.735349  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.735886  3134 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:54.736889  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.730185  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2400) took 3640 ms. Trace:
I20260709 13:16:54.738332  3280 rpcz_store.cc:276] 0709 13:16:51.089644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.594135 (+504491us) service_pool.cc:224] Handling call
0709 13:16:52.475473 (+881338us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b5800160e98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:16:54.729882 (+2254409us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400038254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:54.730073 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2783524864}
I20260709 13:16:54.678119  6441 raft_consensus.cc:3055] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:54.739605  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.751690  3280 raft_consensus.cc:2410] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:16:54.741727  3281 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:54.752382  3177 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:54.753448  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2571) took 1471 ms. Trace:
I20260709 13:16:54.743371  3101 leader_election.cc:400] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 10.
I20260709 13:16:54.731721  3278 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:54.761230  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.762106  3134 raft_consensus.cc:2410] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:16:54.744930  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.753947  3205 rpcz_store.cc:276] 0709 13:16:53.282160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.283062 (+   902us) service_pool.cc:224] Handling call
0709 13:16:53.315555 (+ 32493us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:53.336924 (+ 21369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.336960 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:53.385034 (+ 48074us) log.cc:844] Serialized 52 byte log entry
0709 13:16:53.603591 (+218557us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:53.603638 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.603709 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:54.735090 (+1131381us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b24001b7748. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b8f889c4 00007fb3b8f86acb 00007fb3b9141dc9 00007fb3b9141a55 00007fb3b9140fb0 00007fb3bbdb7488 00007fb3bbdb7be8 00007fb3bbd8f398 00007fb3bbd8a76a 00007fb3bbd89bb6
0709 13:16:54.742196 (+  7106us) raft_consensus.cc:1685] finished
0709 13:16:54.742225 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:54.753360 (+ 11135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5725,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":11783,"spinlock_wait_cycles":8956800,"thread_start_us":139415,"threads_started":1,"wal-append.queue_time_us":341858}
I20260709 13:16:54.764370  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:54.747126  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.770375  6564 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:54.773164  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.773697  6423 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:54.774307  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:54.774201  6423 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.774852  3134 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:54.776979  6509 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:54.755649  6524 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:54.778044  6524 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.778647  6429 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:54.779212  6429 raft_consensus.cc:697] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:54.777482  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:54.781528  3127 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:54.806519  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:54.810642  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:54.811314  3279 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.811172  6429 consensus_queue.cc:237] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.816191  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.818595  6258 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:54.819839  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:54.820525  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.821497  3283 raft_consensus.cc:2393] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 10: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:54.821599  3834 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:54.823190  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:54.823807  3135 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.824640  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:54.825218  3835 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.825444  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:54.826000  3838 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:54.812598  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.770385  6380 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:54.829969  3284 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:54.770543  6441 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:54.830953  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:54.831104  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.831594  3131 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.831475  6441 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.834242  6473 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:54.840291  3249 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:54.842625  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:54.842831  3835 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:16:54.850453  3134 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:16:54.854799  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:54.856045  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:54.868054  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:54.868649  3203 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
W20260709 13:16:54.868944  3210 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1531) took 2532 ms (client timeout 3251 ms). Trace:
W20260709 13:16:54.869396  3210 rpcz_store.cc:269] 0709 13:16:52.336199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.427063 (+ 90864us) service_pool.cc:224] Handling call
0709 13:16:54.868739 (+2441676us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54001540d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:54.868886 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2670206336}
I20260709 13:16:54.869745  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:54.870421  3203 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:54.857304  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:54.859843  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 182478us
I20260709 13:16:54.875352  3206 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:54.861927  3101 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:54.876721  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:54.816715  6404 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.889987  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:54.890787  3128 raft_consensus.cc:2393] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 5: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:54.883369  3207 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:54.836257  6441 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.892043  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:54.930110  3207 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.847271  6467 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:54.932001  6467 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.853160  6473 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:54.933535  6473 raft_consensus.cc:697] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:54.933893  6524 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:54.934540  6473 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.764292  6565 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:54.758039  6491 consensus_queue.cc:1059] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:16:54.751510  6515 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.938792  6464 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:54.940017  6515 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:54.940685  3136 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:54.904264  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:54.859381  6425 consensus_queue.cc:1059] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:16:54.941743  3206 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:54.947347  6380 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:54.947892  6380 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.955891  6467 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:54.911759  6404 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:54.922313  3249 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:54.957655  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:54.960151  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:54.960199  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:54.962244  6452 raft_consensus.cc:3055] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:54.962819  6452 raft_consensus.cc:740] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:54.963846  6452 consensus_queue.cc:260] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:54.918735  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.927749  6513 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:54.984541  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 107892us
I20260709 13:16:54.985800  3176 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:54.997421  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.997335  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.924945  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:54.928768  6243 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:54.853571  6258 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:55.000494  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:54.932296  6529 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:54.888137  3131 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
W20260709 13:16:55.043643  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 48131.9us
I20260709 13:16:55.018877  3128 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:55.078166  3279 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
W20260709 13:16:55.100270  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.109527  3837 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:55.098861  3836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.008s	sys 0.020s
I20260709 13:16:55.000162  3127 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:55.002876  3206 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:16:55.153887  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:54.928066  3135 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
W20260709 13:16:55.152165  3836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.009s	sys 0.021s
I20260709 13:16:54.965032  6452 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.972466  6425 raft_consensus.cc:3055] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:16:55.162740  6498 consensus_meta.cc:287] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.701s	user 0.010s	sys 0.005s
I20260709 13:16:55.091611  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 433) took 1008 ms. Trace:
I20260709 13:16:55.306890  3281 rpcz_store.cc:276] 0709 13:16:54.083271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.086254 (+  2983us) service_pool.cc:224] Handling call
0709 13:16:54.086510 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.752761 (+666251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.091267 (+338506us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54002977d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:55.091526 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506252544}
I20260709 13:16:55.308220  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:54.970494  6192 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:55.309269  6192 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.035398  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:55.160001  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 425) took 2153 ms. Trace:
I20260709 13:16:55.310199  3276 rpcz_store.cc:276] 0709 13:16:53.023714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.081215 (+ 57501us) service_pool.cc:224] Handling call
0709 13:16:53.081862 (+   647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.874123 (+792261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.159684 (+1285561us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b5400037354. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:55.159935 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1815839616}
I20260709 13:16:55.311266  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.311797  3276 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:55.312222  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1256) took 1009 ms. Trace:
I20260709 13:16:55.312500  3276 rpcz_store.cc:276] 0709 13:16:54.302470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.311033 (+1008563us) service_pool.cc:224] Handling call
0709 13:16:55.312173 (+  1140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.047693  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:55.102669  3203 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:16:55.314000  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:55.315599  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.151335  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.317585  3279 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:55.317958  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52014 (request call id 437) took 1233 ms. Trace:
I20260709 13:16:55.318248  3279 rpcz_store.cc:276] 0709 13:16:54.084326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.151080 (+1066754us) service_pool.cc:224] Handling call
0709 13:16:55.317907 (+166827us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:55.011406  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.321892  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.322269  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.969334  6515 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:55.253916  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.036149  6243 raft_consensus.cc:3055] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:54.969651  6502 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:55.038784  6464 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:55.299311  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 87897.8us
I20260709 13:16:55.156317  3207 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:16:55.302627  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:55.214756  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:55.315447  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:55.356395  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 141723us
I20260709 13:16:55.356652  3203 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:16:55.067495  3130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1233) took 4849 ms (client timeout 2198 ms). Trace:
I20260709 13:16:55.356804  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:55.357448  3249 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:55.357362  3130 rpcz_store.cc:269] 0709 13:16:50.199341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.307351 (+108010us) service_pool.cc:224] Handling call
0709 13:16:55.048818 (+4741467us) spinlock_profiling.cc:243] Waited 3.56 s on lock 0x7b54000695d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:55.048982 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8185766144}
I20260709 13:16:55.308833  3281 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:16:55.359038  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2431) took 1148 ms. Trace:
I20260709 13:16:55.359468  3281 rpcz_store.cc:276] 0709 13:16:54.210772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.307944 (+1097172us) service_pool.cc:224] Handling call
0709 13:16:55.358963 (+ 51019us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.357702  3206 raft_consensus.cc:2368] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11.
I20260709 13:16:55.332321  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.077111  6226 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:55.372896  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.376091  3279 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:55.164549  6426 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:55.218101  6574 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:16:55.373381  6226 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:55.249370  6535 raft_consensus.cc:3055] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:55.378017  6535 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:55.378934  6535 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:55.379892  6226 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:55.014083  6560 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:55.350781  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 432) took 1267 ms. Trace:
I20260709 13:16:55.361979  6486 consensus_queue.cc:1059] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:55.362850  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:55.381246  3282 rpcz_store.cc:276] 0709 13:16:54.083005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.085770 (+  2765us) service_pool.cc:224] Handling call
0709 13:16:54.086065 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.441057 (+354992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.350523 (+909466us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54001e8f54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:55.350722 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":814982528}
I20260709 13:16:55.381919  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:55.382409  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.382580  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:55.383121  3282 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:55.383247  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:55.383601  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:55.383878  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.309676  6192 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.389912  3282 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:55.390364  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.390829  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:55.391396  3282 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:55.391568  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.392324  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1240) took 1267 ms. Trace:
I20260709 13:16:55.392633  3280 rpcz_store.cc:276] 0709 13:16:54.124470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.391314 (+1266844us) service_pool.cc:224] Handling call
0709 13:16:55.392260 (+   946us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.342994  6515 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.393430  6515 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:55.396184  6550 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:55.343673  6243 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:55.300144  6425 raft_consensus.cc:740] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:55.366915  6480 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:55.367360  6258 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:55.367726  6509 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:55.376513  3100 leader_election.cc:400] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11.
I20260709 13:16:55.000536  6406 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:55.380048  6535 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:55.384006  3203 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:55.405581  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:55.406512  3203 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 10: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:55.384651  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:55.365341  6467 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:55.385504  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.385852  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.386915  6503 raft_consensus.cc:3055] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:55.360951  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:55.229950  6513 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:55.004420  6524 consensus_queue.cc:1059] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.362s
W20260709 13:16:55.413964  3205 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.016s	sys 0.035s
I20260709 13:16:55.400646  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:55.416280  3205 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.016s	sys 0.036s
I20260709 13:16:55.416601  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1258) took 1113 ms. Trace:
I20260709 13:16:55.416978  3280 rpcz_store.cc:276] 0709 13:16:54.303021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.400197 (+1097176us) service_pool.cc:224] Handling call
0709 13:16:55.416544 (+ 16347us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:55.418531  3804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.012s	sys 0.043s
I20260709 13:16:55.404646  6406 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:55.347846  6502 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:55.342360  6023 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:55.410851  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:55.398571  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:55.415042  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:55.425459  3276 raft_consensus.cc:2410] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:55.418965  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.426407  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.426681  3280 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
W20260709 13:16:55.426898  3250 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.006s	sys 0.021s
I20260709 13:16:55.403016  3100 leader_election.cc:403] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:16:55.427239  3250 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.006s	sys 0.021s
I20260709 13:16:55.427206  3276 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
W20260709 13:16:55.427614  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 654816us
I20260709 13:16:55.428534  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.427232  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1248) took 1268 ms. Trace:
I20260709 13:16:55.421144  3206 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:16:55.515331  3206 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:55.422101  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:55.423547  3806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.016s	sys 0.040s
W20260709 13:16:55.520650  3806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.016s	sys 0.040s
W20260709 13:16:55.521092  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 676071us
W20260709 13:16:55.420604  3833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.006s	sys 0.022s
W20260709 13:16:55.523250  3833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.006s	sys 0.022s
W20260709 13:16:55.431849  3805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.019s	sys 0.024s
W20260709 13:16:55.524045  3805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.019s	sys 0.024s
W20260709 13:16:55.524400  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 827390us
I20260709 13:16:55.405301  6480 raft_consensus.cc:697] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:55.410715  6258 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:16:55.420876  3804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.012s	sys 0.043s
W20260709 13:16:55.530464  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.531065  3282 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
I20260709 13:16:55.409991  6503 raft_consensus.cc:740] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:55.446705  3207 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:16:55.420506  6379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.011s	sys 0.019s
W20260709 13:16:55.449947  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 74840us
I20260709 13:16:55.452950  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1246) took 1318 ms. Trace:
I20260709 13:16:55.540416  3276 rpcz_store.cc:276] 0709 13:16:54.134370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.428247 (+1293877us) service_pool.cc:224] Handling call
0709 13:16:55.452855 (+ 24608us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.405606  6509 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:55.424530  6502 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.405869  6243 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:55.414031  6467 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:55.421752  6380 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:55.457954  6513 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11.
I20260709 13:16:55.434803  6498 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:55.484812  6429 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.025s	sys 0.039s
I20260709 13:16:55.421018  6425 consensus_queue.cc:260] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:55.432710  6023 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:55.501428  3133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.001s	sys 0.029s
W20260709 13:16:55.429033  3250 leader_election.cc:336] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.665s (SENT)
W20260709 13:16:55.564073  3133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.001s	sys 0.029s
I20260709 13:16:55.528033  3280 rpcz_store.cc:276] 0709 13:16:54.159060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.417937 (+1258877us) service_pool.cc:224] Handling call
0709 13:16:55.427176 (+  9239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.423017  6406 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:55.501371  6473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.008s	sys 0.004s
W20260709 13:16:55.501770  6414 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.010s	sys 0.017s
W20260709 13:16:55.501693  6449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.004s	sys 0.024s
I20260709 13:16:55.549692  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.572367  3276 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:55.575644  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1247) took 1432 ms. Trace:
I20260709 13:16:55.576040  3276 rpcz_store.cc:276] 0709 13:16:54.142996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.549372 (+1406376us) service_pool.cc:224] Handling call
0709 13:16:55.575575 (+ 26203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.550203  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:55.500896  6567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.051s	sys 0.072s
W20260709 13:16:55.541955  6379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.011s	sys 0.019s
I20260709 13:16:55.564361  3250 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:55.565663  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:16:55.562009  6429 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.026s	sys 0.039s
I20260709 13:16:55.583230  3282 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:55.607605  3211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1537) took 1763 ms. Trace:
I20260709 13:16:55.584867  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 436) took 1500 ms. Trace:
I20260709 13:16:55.614981  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1242) took 1489 ms. Trace:
I20260709 13:16:55.614378  3211 rpcz_store.cc:276] 0709 13:16:53.844256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.930266 (+ 86010us) service_pool.cc:224] Handling call
0709 13:16:53.951976 (+ 21710us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.954996 (+  3020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.955026 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:53.963010 (+  7984us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.671914 (+708904us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b18002f7ac0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:16:55.008892 (+336978us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:55.008945 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.009037 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.607171 (+598134us) raft_consensus.cc:1685] finished
0709 13:16:55.607201 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.607513 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35793,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":10033,"spinlock_wait_cycles":16274304,"thread_start_us":336734,"threads_started":1,"wal-append.queue_time_us":1526806}
I20260709 13:16:55.564136  6243 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:55.619827  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 189911us
W20260709 13:16:55.574925  6449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.004s	sys 0.025s
W20260709 13:16:55.574707  6414 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.010s	sys 0.018s
W20260709 13:16:55.575065  6473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.008s	sys 0.005s
W20260709 13:16:55.665644  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.579402  6498 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.673033  6498 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:55.675385  6498 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:55.675968  6498 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:55.634203  3250 leader_election.cc:336] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.672s (SENT)
W20260709 13:16:55.637521  3208 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.011s	sys 0.012s
W20260709 13:16:55.678414  3208 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.011s	sys 0.012s
I20260709 13:16:55.679098  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 336) took 1041 ms. Trace:
I20260709 13:16:55.677618  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 390) took 1063 ms. Trace:
I20260709 13:16:55.679476  3208 rpcz_store.cc:276] 0709 13:16:54.637248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.647157 (+  9909us) service_pool.cc:224] Handling call
0709 13:16:54.647439 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.647647 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:54.843531 (+195884us) log.cc:844] Serialized 14 byte log entry
0709 13:16:55.678760 (+835229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:55.678811 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:55.678864 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.678944 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.679044 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":401846,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":4815,"thread_start_us":1008316,"threads_started":2}
I20260709 13:16:55.684041  3208 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:55.680323  3136 rpcz_store.cc:276] 0709 13:16:54.614430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.624353 (+  9923us) service_pool.cc:224] Handling call
0709 13:16:54.624829 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.941058 (+316229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.677341 (+736283us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b540036abd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:55.677554 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725922688}
I20260709 13:16:55.676720  3250 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:55.689630  6473 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:55.690629  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 56476.9us
W20260709 13:16:55.691404  3250 leader_election.cc:336] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.827s (SENT)
W20260709 13:16:55.693032  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.653518  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2435) took 1437 ms. Trace:
I20260709 13:16:55.695437  3280 rpcz_store.cc:276] 0709 13:16:54.215702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.565324 (+1349622us) service_pool.cc:224] Handling call
0709 13:16:55.653399 (+ 88075us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.696210  6432 raft_consensus.cc:3055] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:55.696643  6432 raft_consensus.cc:740] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:55.696867  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 438) took 1606 ms. Trace:
I20260709 13:16:55.697844  3250 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:55.697521  6432 consensus_queue.cc:260] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:55.698640  6473 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:55.699394  3285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1254) took 1397 ms (client timeout 1515 ms). Trace:
W20260709 13:16:55.699831  3285 rpcz_store.cc:269] 0709 13:16:54.301808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.336200 (+ 34392us) service_pool.cc:224] Handling call
0709 13:16:55.699219 (+1363019us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54001e00d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:55.699341 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237918592}
I20260709 13:16:55.701014  3285 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:55.701587  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1236) took 1581 ms. Trace:
I20260709 13:16:55.701936  3285 rpcz_store.cc:276] 0709 13:16:54.120226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.700558 (+1580332us) service_pool.cc:224] Handling call
0709 13:16:55.700847 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.701391 (+   544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.701523 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.614414  3276 rpcz_store.cc:276] 0709 13:16:54.084084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.583806 (+1499722us) service_pool.cc:224] Handling call
0709 13:16:55.584216 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.584439 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.584476 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:55.584534 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:55.584579 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.584650 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.584792 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:55.618239  6567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.056s	sys 0.072s
I20260709 13:16:55.615955  3282 rpcz_store.cc:276] 0709 13:16:54.125142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.549222 (+1424080us) service_pool.cc:224] Handling call
0709 13:16:55.614914 (+ 65692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.610453  6425 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.671648  3204 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:55.704470  3208 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:55.707149  3285 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:55.707931  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1237) took 1584 ms. Trace:
I20260709 13:16:55.708312  3285 rpcz_store.cc:276] 0709 13:16:54.123485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.703208 (+1579723us) service_pool.cc:224] Handling call
0709 13:16:55.706761 (+  3553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.707635 (+   874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.707863 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.633188  6429 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.697280  3280 rpcz_store.cc:276] 0709 13:16:54.090902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.696168 (+1605266us) service_pool.cc:224] Handling call
0709 13:16:55.696417 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.696561 (+   144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.696582 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:55.696617 (+    35us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:55.696653 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.696710 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.696816 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:55.677754  6579 log.cc:927] Time spent T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:16:55.717684  3250 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:55.709918  3208 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:16:55.728272  3208 pending_rounds.cc:85] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 3
I20260709 13:16:55.578322  6503 consensus_queue.cc:260] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:55.590629  6258 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:55.707333  6473 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.735690  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2437) took 1516 ms. Trace:
I20260709 13:16:55.621798  6480 consensus_queue.cc:237] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:55.751101  6357 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:55.751395  6584 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:16:55.751960  6357 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:55.752358  6357 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.752739  6357 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.753805  6467 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:55.755597  6192 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:55.759310  3209 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 2577) took 2210 ms (client timeout 1767 ms). Trace:
W20260709 13:16:55.759771  3209 rpcz_store.cc:269] 0709 13:16:53.548878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.548996 (+   118us) service_pool.cc:224] Handling call
0709 13:16:55.759085 (+2210089us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b5400224f54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:55.759228 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4733073280}
W20260709 13:16:55.765205  6590 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:16:55.765755  3129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1511) took 1613 ms (client timeout 1543 ms). Trace:
I20260709 13:16:55.765918  3132 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:16:55.766163  3129 rpcz_store.cc:269] 0709 13:16:54.152089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.152370 (+   281us) service_pool.cc:224] Handling call
0709 13:16:55.765520 (+1613150us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54002a9ed4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:55.765674 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1059082624}
I20260709 13:16:55.767567  6509 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:55.741406  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 399300us
I20260709 13:16:55.777243  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:55.779982  3838 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 10: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:55.743610  3280 rpcz_store.cc:276] 0709 13:16:54.219732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.715009 (+1495277us) service_pool.cc:224] Handling call
0709 13:16:55.735043 (+ 20034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.735276 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.735312 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:55.735365 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:55.735413 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.735480 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.735618 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.731397  3208 pending_rounds.cc:107] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:16:55.746400  6023 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:55.782828  3208 raft_consensus.cc:2889] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:55.788205  3177 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:55.790269  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:55.763402  6515 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:55.799276  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:55.772805  6473 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.787367  6503 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.805605  3280 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:55.811733  3202 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.028s	sys 0.058s
W20260709 13:16:55.815809  3202 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.028s	sys 0.058s
I20260709 13:16:55.734207  6429 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:55.819612  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.819911  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.809636  6498 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.849934  3280 raft_consensus.cc:2410] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:16:55.841293  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.796725  6449 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 13:16:55.852023  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.823529  6380 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:55.872995  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 387) took 1318 ms. Trace:
I20260709 13:16:55.890080  6429 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:55.892611  3031 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55102 (request call id 135) took 27180 ms (client timeout 15000 ms). Trace:
I20260709 13:16:55.893492  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 419) took 3033 ms. Trace:
I20260709 13:16:55.893915  3278 rpcz_store.cc:276] 0709 13:16:52.860271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.965545 (+105274us) service_pool.cc:224] Handling call
0709 13:16:54.731474 (+1765929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.759878 (+ 28404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.893276 (+1133398us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b5400038250. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:55.893428 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3965252352}
I20260709 13:16:55.895226  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.895918  3278 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:16:55.897747  6596 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:55.898746  6596 consensus_queue.cc:1059] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:55.902182  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:55.903393  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.903909  3281 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:16:55.904631  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:55.910709  6423 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:55.911335  6423 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.911985  6192 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:55.913232  6515 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:55.914772  6502 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:55.915725  6560 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:55.916431  3279 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:55.916762  6560 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:55.918282  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:55.919035  3279 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:55.919663  6580 raft_consensus.cc:3055] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:55.920064  6580 raft_consensus.cc:740] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:55.920239  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:55.920871  3279 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:55.924557  6483 raft_consensus.cc:993] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:16:55.925045  6483 raft_consensus.cc:1081] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Signalling peer 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:16:55.857442  6498 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:55.927626  6498 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:55.915186  6426 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:55.911744  6423 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:55.896852  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:55.939919  3278 raft_consensus.cc:2393] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 5: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:16:55.945837  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.884430  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:55.953007  3280 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.885524  3132 rpcz_store.cc:276] 0709 13:16:54.554301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.554541 (+   240us) service_pool.cc:224] Handling call
0709 13:16:55.765650 (+1211109us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:55.766373 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.872725 (+106352us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002a9ed0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:55.872926 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2783728512}
I20260709 13:16:55.944247  3279 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:16:55.967386  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:55.968858  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:55.970078  3279 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:55.970883  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:55.971992  3278 raft_consensus.cc:2393] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 11: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:55.931114  6426 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:55.958221  6535 consensus_meta.cc:287] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.549s	user 0.006s	sys 0.006s
I20260709 13:16:55.982566  3833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 601) took 1163 ms. Trace:
W20260709 13:16:55.999727  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 459703us
I20260709 13:16:55.957587  6498 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.010278  3281 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:56.012673  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1265) took 1330 ms. Trace:
I20260709 13:16:56.013338  3281 rpcz_store.cc:276] 0709 13:16:54.682180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.009450 (+1327270us) service_pool.cc:224] Handling call
0709 13:16:56.009851 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.012351 (+  2500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.012601 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.015170  3281 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:56.017359  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 440) took 1318 ms. Trace:
I20260709 13:16:56.018146  3281 rpcz_store.cc:276] 0709 13:16:54.699332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.014512 (+1315180us) service_pool.cc:224] Handling call
0709 13:16:56.014922 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.017005 (+  2083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.017282 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.918646  6357 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:55.946732  3031 rpcz_store.cc:269] 0709 13:16:28.712007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.712242 (+   235us) service_pool.cc:224] Handling call
0709 13:16:28.839574 (+127332us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b5400270010. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90cb0b2 00007fb3c2044a89 00007fb3c1fdcda6 00007fb3c1fae088 00007fb3c20ac37e 00007fb3c056d2a4 00007fb3c056d232 00007fb3c056d161 00007fb3c056d0dc
0709 13:16:55.892482 (+27052908us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:52.456005 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:52.456666 (+   661us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:52.456714 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:16:52.456749 (+    35us) tablet.cc:662] Decoding operations
0709 13:16:52.457469 (+   720us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:52.457557 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:52.457588 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:16:52.458150 (+   562us) tablet.cc:701] Row locks acquired
0709 13:16:52.458198 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:16:52.458378 (+   180us) write_op.cc:270] Start()
0709 13:16:52.458529 (+   151us) write_op.cc:276] Timestamp: P: 1783603012458310 usec, L: 0
0709 13:16:52.458552 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:16:52.459339 (+   787us) log.cc:844] Serialized 1674 byte log entry
0709 13:16:53.199373 (+740034us) op_driver.cc:464] REPLICATION: finished
0709 13:16:53.702471 (+503098us) write_op.cc:301] APPLY: starting
0709 13:16:53.702628 (+   157us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:53.702829 (+   201us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:53.702974 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:53.847649 (+144675us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:53.943339 (+ 95690us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:16:53.952018 (+  8679us) write_op.cc:312] APPLY: finished
0709 13:16:53.968525 (+ 16507us) log.cc:844] Serialized 41 byte log entry
0709 13:16:54.057553 (+ 89028us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.064920 (+  7367us) write_op.cc:454] Released schema lock
0709 13:16:54.077607 (+ 12687us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:54.078160 (+   553us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.078196 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3726892,"reported_tablets":19,"spinlock_wait_cycles":7059200,"child_traces":[["op",{"apply.queue_time_us":394945,"apply.run_cpu_time_us":12792,"apply.run_wall_time_us":435128,"num_ops":4,"prepare.queue_time_us":13499,"prepare.run_cpu_time_us":4409,"prepare.run_wall_time_us":5280,"raft.queue_time_us":659848,"raft.run_cpu_time_us":10377,"raft.run_wall_time_us":278218,"replication_time_us":711984,"spinlock_wait_cycles":64640,"thread_start_us":554703,"threads_started":5,"wal-append.queue_time_us":154012,"wal-append.run_cpu_time_us":290913,"wal-append.run_wall_time_us":2699758}]]}
W20260709 13:16:56.047384  3805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.026s	sys 0.033s
I20260709 13:16:55.973963  6192 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.983367  3833 rpcz_store.cc:276] 0709 13:16:54.818594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.823273 (+  4679us) service_pool.cc:224] Handling call
0709 13:16:54.823522 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.823702 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:54.823979 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 13:16:55.981476 (+1157497us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:55.981568 (+    92us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:55.981648 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.981750 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.982460 (+   710us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5364,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":137903,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":18021,"thread_start_us":1156978,"threads_started":2,"wal-append.queue_time_us":898246}
I20260709 13:16:56.052386  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:56.050501  3100 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:56.054557  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 255234us
W20260709 13:16:56.047786  3805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.026s	sys 0.033s
I20260709 13:16:56.017105  6483 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.057214  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 531703us
I20260709 13:16:56.058377  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:56.059063  3281 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:16:56.017385  6509 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.071818  3806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.008s	sys 0.038s
W20260709 13:16:56.123775  3806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.008s	sys 0.038s
W20260709 13:16:56.124553  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:56.125347  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:56.126788  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 76800us
W20260709 13:16:56.055703  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 337558us
I20260709 13:16:56.058991  3805 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:56.119823  3281 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:56.130721  3132 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:56.121732  3280 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:16:56.131868  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:56.132193  3280 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:56.132486  3176 connection.cc:256] RPC call timeout handler was delayed by -1.0498836609999671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27540000000000003s for a response
I20260709 13:16:56.134832  3131 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:16:56.139787  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 80849.4us
I20260709 13:16:56.140797  3805 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:56.141018  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.131191  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:56.144328  3281 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:56.145784  3100 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:56.146530  6486 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:56.146972  6486 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.147315  6486 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:56.114102  6502 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:56.149372  6496 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:56.149900  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:56.150307  6496 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:56.150691  6496 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:56.150839  3136 raft_consensus.cc:2410] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:55.920934  6580 consensus_queue.cc:260] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:56.054473  6490 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:56.163089  3805 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:56.174769  3805 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:16:56.177726  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.178519  6565 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:56.178685  6567 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:56.180538  6567 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.180696  6597 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:56.180899  6567 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:56.181304  6597 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:56.181737  6379 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.182233  6379 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:56.183533  6597 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:56.184211  6379 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:56.178310  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.163089  3806 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:56.166020  6357 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:56.151187  6496 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:56.019959  6406 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:56.019761  6498 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:56.190150  3279 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:56.199405  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1271) took 1054 ms. Trace:
I20260709 13:16:56.199560  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:56.200013  3279 rpcz_store.cc:276] 0709 13:16:55.144566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.122359 (+977793us) service_pool.cc:224] Handling call
0709 13:16:56.189979 (+ 67620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.199064 (+  9085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.199337 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:56.201232  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.172222  3250 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:56.194667  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:56.195907  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1542) took 1342 ms. Trace:
I20260709 13:16:56.203991  3204 rpcz_store.cc:276] 0709 13:16:54.853725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.854010 (+   285us) service_pool.cc:224] Handling call
0709 13:16:54.944825 (+ 90815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:55.704453 (+759628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.195672 (+491219us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b540019ee54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:56.195851 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670888704}
I20260709 13:16:56.209492  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:56.210949  3279 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:56.192265  3249 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.528s (SENT) [suppressed 45 similar messages]
I20260709 13:16:56.053486  6192 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:56.151593  6483 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:56.184698  6369 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.405501  6603 raft_consensus.cc:2764] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:16:56.275712  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:56.602958  3804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.063s	user 0.029s	sys 0.062s
W20260709 13:16:57.155398  3804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.624s	user 0.030s	sys 0.064s
W20260709 13:16:57.155741  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:57.155980  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.164551  6509 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:56.238194  6425 consensus_meta.cc:287] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
W20260709 13:16:56.641227  3202 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.014s	sys 0.030s
W20260709 13:16:57.172031  3202 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.356s	user 0.015s	sys 0.031s
I20260709 13:16:57.172899  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 328) took 2544 ms. Trace:
I20260709 13:16:57.173333  3202 rpcz_store.cc:276] 0709 13:16:54.628804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.628919 (+   115us) service_pool.cc:224] Handling call
0709 13:16:54.629235 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.634627 (+  5392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.634653 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:54.652014 (+ 17361us) log.cc:844] Serialized 26 byte log entry
0709 13:16:55.055930 (+403916us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:55.816132 (+760202us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.172473 (+1356341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.172576 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.172635 (+    59us) raft_consensus.cc:1685] finished
0709 13:16:57.172651 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.172829 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8899,"prepare.queue_time_us":108243,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":87971,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":9628,"thread_start_us":2470953,"threads_started":3,"wal-append.queue_time_us":847028,"wal-append.run_cpu_time_us":21342,"wal-append.run_wall_time_us":1577881}
I20260709 13:16:57.176309  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:56.697261  3284 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.005s	sys 0.009s
W20260709 13:16:57.177747  3284 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.171s	user 0.006s	sys 0.009s
W20260709 13:16:56.705371  3176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.006s	sys 0.006s
W20260709 13:16:56.708700  6467 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.002s	sys 0.013s
I20260709 13:16:56.180099  6601 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:56.316448  3281 raft_consensus.cc:1217] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[5.3-8.4]   Dedup: 5.3->[8.4-8.4]
I20260709 13:16:57.187440  3281 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: [5.3-8.4]
I20260709 13:16:57.188144  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2443) took 1412 ms. Trace:
I20260709 13:16:57.188452  3281 rpcz_store.cc:276] 0709 13:16:55.775244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.162123 (+386879us) service_pool.cc:224] Handling call
0709 13:16:56.162605 (+   482us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:57.187842 (+1025237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.188084 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:56.617105  3203 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.016s	sys 0.027s
I20260709 13:16:57.079320  3210 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:16:57.189514  3203 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.373s	user 0.023s	sys 0.038s
I20260709 13:16:57.079515  6491 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.619096  3285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.015s	sys 0.028s
I20260709 13:16:57.080452  6406 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:57.193427  3285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.383s	user 0.027s	sys 0.035s
W20260709 13:16:56.626744  3276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.028s	sys 0.024s
W20260709 13:16:57.194265  3276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.406s	user 0.028s	sys 0.042s
I20260709 13:16:57.081434  6587 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.079393  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 916313us
W20260709 13:16:57.083418  6503 consensus_meta.cc:287] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.266s	user 0.013s	sys 0.007s
W20260709 13:16:56.580394  3282 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.012s	sys 0.013s
W20260709 13:16:57.214633  3282 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.496s	user 0.015s	sys 0.015s
I20260709 13:16:56.233750  6464 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:57.085621  6192 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:57.086269  6426 consensus_meta.cc:287] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 1.068s	user 0.000s	sys 0.018s
I20260709 13:16:57.226007  3211 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:57.086575  6560 consensus_meta.cc:287] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.169s	user 0.008s	sys 0.038s
I20260709 13:16:57.087724  3838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "404209c6105f4945b077c33471d63370"
dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:54892
I20260709 13:16:57.088779  6432 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:57.190941  6520 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.090700  6566 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.091336  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:57.079854  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 854214us
W20260709 13:16:57.095492  6591 log.cc:927] Time spent T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.412s	user 0.000s	sys 0.005s
I20260709 13:16:57.096619  6580 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:57.083248  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 911087us
I20260709 13:16:57.264341  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:57.099062  6588 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:57.093890  3835 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:57.100646  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:57.273135  3206 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:57.104036  6496 consensus_meta.cc:287] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.871s	user 0.012s	sys 0.004s
W20260709 13:16:56.579231  3205 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.008s	sys 0.015s
W20260709 13:16:56.630208  3277 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.010s	sys 0.014s
W20260709 13:16:57.107076  6567 consensus_meta.cc:287] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.926s	user 0.011s	sys 0.012s
I20260709 13:16:57.319541  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:57.320536  3835 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:57.321712  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:56.707883  6404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.003s	sys 0.008s
I20260709 13:16:57.110787  6498 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:56.687071  3278 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.000s	sys 0.010s
W20260709 13:16:57.112417  3279 consensus_meta.cc:287] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.901s	user 0.012s	sys 0.000s
W20260709 13:16:57.328243  3278 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.279s	user 0.000s	sys 0.014s
I20260709 13:16:57.328351  3279 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:57.113204  6423 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:56.672710  6480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.007s	sys 0.026s
I20260709 13:16:57.115707  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:57.339958  3207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 2608) took 1150 ms. Trace:
I20260709 13:16:56.170464  6535 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:57.277892  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:57.117152  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:57.349020  3204 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
W20260709 13:16:57.347865  3277 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.579s	user 0.013s	sys 0.022s
I20260709 13:16:57.349535  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1561) took 1153 ms. Trace:
I20260709 13:16:57.349846  3204 rpcz_store.cc:276] 0709 13:16:56.196158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.435996 (+239838us) service_pool.cc:224] Handling call
0709 13:16:57.349479 (+913483us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:57.118643  6243 consensus_meta.cc:287] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 1.457s	user 0.013s	sys 0.010s
I20260709 13:16:56.170886  6380 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.121367  6376 consensus_queue.cc:1059] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:57.122159  6427 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.575577  6258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.045s	sys 0.072s
I20260709 13:16:56.151136  6602 consensus_queue.cc:1059] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.167s
W20260709 13:16:56.653750  6420 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.006s	sys 0.010s
W20260709 13:16:57.129535  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:57.408672  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 144384us
W20260709 13:16:57.409740  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:57.108628  6473 consensus_meta.cc:287] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.285s	user 0.009s	sys 0.018s
I20260709 13:16:57.140631  3834 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:57.144549  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.147962  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:57.145099  6529 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:16:57.154050  6369 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.158169  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:57.378123  6423 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:16:57.178972  3176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.006s	sys 0.006s
W20260709 13:16:57.394537  6258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.636s	user 0.052s	sys 0.078s
I20260709 13:16:57.180907  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:16:57.148345  6486 consensus_meta.cc:287] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 1.001s	user 0.015s	sys 0.008s
W20260709 13:16:57.198554  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 1.01204e+06us
I20260709 13:16:57.205343  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:57.217625  3210 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1554) took 2298 ms (client timeout 1528 ms). Trace:
I20260709 13:16:57.139434  6452 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:16:57.186910  6467 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.256s	user 0.002s	sys 0.013s
W20260709 13:16:57.408815  6420 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.509s	user 0.013s	sys 0.010s
I20260709 13:16:57.237785  3838 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:57.453751  3838 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.089850  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:57.244195  3211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2596) took 1940 ms. Trace:
I20260709 13:16:57.269714  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2609) took 1079 ms. Trace:
I20260709 13:16:57.328938  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2464) took 1159 ms. Trace:
I20260709 13:16:57.243965  6192 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.455420  3279 rpcz_store.cc:276] 0709 13:16:56.169407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.201065 (+ 31658us) service_pool.cc:224] Handling call
0709 13:16:57.328879 (+1127814us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.455214  3208 rpcz_store.cc:276] 0709 13:16:56.190405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.190806 (+   401us) service_pool.cc:224] Handling call
0709 13:16:56.191053 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.191274 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:56.316733 (+125459us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.206762 (+890029us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.269332 (+ 62570us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.269392 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:57.269439 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.269510 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.269639 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48217,"prepare.queue_time_us":125489,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":7528,"raft.queue_time_us":332976,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":48782,"spinlock_wait_cycles":35812224,"thread_start_us":113347,"threads_started":2}
I20260709 13:16:57.456804  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:57.457605  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1276) took 1243 ms. Trace:
I20260709 13:16:57.457672  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:57.457938  3279 rpcz_store.cc:276] 0709 13:16:56.214266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.456560 (+1242294us) service_pool.cc:224] Handling call
0709 13:16:57.457550 (+   990us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:57.346742  3205 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.577s	user 0.009s	sys 0.025s
I20260709 13:16:57.458438  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1568) took 1255 ms. Trace:
I20260709 13:16:57.340404  3207 rpcz_store.cc:276] 0709 13:16:56.190021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.190519 (+   498us) service_pool.cc:224] Handling call
0709 13:16:57.339865 (+1149346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.204802  6601 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:57.214704  6491 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.227138  6586 consensus_queue.cc:1059] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
W20260709 13:16:57.329300  6404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.406s	user 0.005s	sys 0.010s
I20260709 13:16:57.424718  6023 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.226052  6587 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.243345  6426 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:57.346954  6480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.436s	user 0.009s	sys 0.035s
I20260709 13:16:57.387542  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1263) took 2723 ms. Trace:
I20260709 13:16:57.381645  6509 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:57.329048  6496 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.340739  6567 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.348079  6535 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:57.392812  6376 raft_consensus.cc:3055] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:57.330268  6603 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.258006  6449 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:57.347635  6498 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:57.257063  6464 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:57.410503  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:57.418546  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:57.425484  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:57.179392  3129 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:57.376411  6380 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:57.380451  6483 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:57.432463  3281 raft_consensus.cc:2410] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:16:57.432163  3210 rpcz_store.cc:269] 0709 13:16:54.919878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.016845 (+ 96967us) service_pool.cc:224] Handling call
0709 13:16:57.217318 (+2200473us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b5400374bd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:57.217525 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4068317056}
I20260709 13:16:57.435390  3834 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:57.389385  6565 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.443943  3206 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:16:57.458791  3208 rpcz_store.cc:276] 0709 13:16:56.203198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.457453 (+1254255us) service_pool.cc:224] Handling call
0709 13:16:57.458381 (+   928us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.452925  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:57.455096  3211 rpcz_store.cc:276] 0709 13:16:55.304050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.620476 (+316426us) service_pool.cc:224] Handling call
0709 13:16:57.218317 (+1597841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.226755 (+  8438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.243940 (+ 17185us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400374bd0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:57.244111 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3554907008}
I20260709 13:16:57.250735  6560 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:57.474414  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.580842  3204 raft_consensus.cc:2410] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:16:57.581459  3206 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1567) took 1378 ms (client timeout 1749 ms). Trace:
I20260709 13:16:57.423797  6243 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.424978  6524 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.272464  6566 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.466632  6486 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.587992  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:57.485159  6258 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:57.514734  3842 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:57.517119  3251 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:57.549504  6376 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:57.607940  6376 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:57.579731  6380 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.609319  6376 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.613329  6467 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:57.613878  6467 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:57.614449  6560 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:57.614756  6467 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:57.615465  6486 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:57.617370  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:57.617849  6566 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:57.618113  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1560) took 1422 ms. Trace:
I20260709 13:16:57.618643  3210 rpcz_store.cc:276] 0709 13:16:56.195830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.587663 (+1391833us) service_pool.cc:224] Handling call
0709 13:16:57.618051 (+ 30388us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.618956  3203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2584) took 2635 ms. Trace:
I20260709 13:16:57.619837  6602 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.521428  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 47566.3us
I20260709 13:16:57.525295  6637 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:16:57.526860  6616 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:16:57.540557  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:57.529393  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2432) took 3317 ms. Trace:
I20260709 13:16:57.520624  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2606) took 2152 ms. Trace:
I20260709 13:16:57.428375  6588 consensus_queue.cc:1059] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:16:57.477243  6633 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.486101  6629 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:57.428293  6473 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:57.542285  3832 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:57.633785  6602 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.629348  6596 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:57.633680  3205 rpcz_store.cc:276] 0709 13:16:55.368105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.768487 (+400382us) service_pool.cc:224] Handling call
0709 13:16:55.768799 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.768991 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:55.769603 (+   612us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.520246 (+1750643us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.520311 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:57.520360 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.520430 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.520560 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79402,"prepare.queue_time_us":201,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":70016,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":9640,"thread_start_us":1688885,"threads_started":1,"wal-append.queue_time_us":1606437}
I20260709 13:16:57.635241  6596 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:16:57.636006  6624 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.083s	user 0.001s	sys 0.001s
I20260709 13:16:57.636235  3205 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:57.636122  6596 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:57.519559  6515 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:57.464890  6452 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.519734  6605 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:57.575052  3835 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:57.539991  6509 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.428186  6550 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.582065  3206 rpcz_store.cc:269] 0709 13:16:56.202911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.100201 (+897290us) service_pool.cc:224] Handling call
0709 13:16:57.581390 (+481189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.564410  3837 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:57.468454  6192 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:57.468566  6606 consensus_queue.cc:1059] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 13:16:57.589620  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1562) took 1393 ms. Trace:
I20260709 13:16:57.401957  6427 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.592720  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1275) took 1379 ms. Trace:
I20260709 13:16:57.511981  6023 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.588727  3208 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:57.638324  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 691) took 1231 ms. Trace:
I20260709 13:16:57.679806  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1559) took 1484 ms. Trace:
W20260709 13:16:57.593552  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 183250us
W20260709 13:16:57.594094  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 168712us
I20260709 13:16:57.578292  6498 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:57.595983  6627 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:16:57.578481  6464 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:57.591868  6565 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.592068  6243 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.597484  6491 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:57.598187  6601 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:57.598994  6369 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:57.599248  6426 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:57.599476  6535 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.600169  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:57.545192  6621 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:16:57.597507  6524 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.601357  6258 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:57.602097  6610 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
W20260709 13:16:57.602566  6625 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.258s	user 0.002s	sys 0.000s
I20260709 13:16:57.603983  6587 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:57.566211  6603 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.574548  6449 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.605893  6496 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:57.578914  6425 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.639966  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:57.631801  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 114786us
I20260709 13:16:57.636977  3276 rpcz_store.cc:276] 0709 13:16:54.211981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.703352 (+1491371us) service_pool.cc:224] Handling call
0709 13:16:55.703654 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:55.711605 (+  7951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.711642 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:55.712255 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.194678 (+1482423us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:57.501912 (+307234us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.510242 (+  8330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.510621 (+   379us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.528733 (+ 18112us) raft_consensus.cc:1685] finished
0709 13:16:57.528907 (+   174us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.529260 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":590,"prepare.queue_time_us":411637,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":16173,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":36641,"thread_start_us":1666362,"threads_started":2,"wal-append.queue_time_us":1783832}
I20260709 13:16:57.644667  3836 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:16:57.721940  6423 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:57.588203  6586 raft_consensus.cc:3055] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:57.709930  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2439) took 1935 ms. Trace:
I20260709 13:16:57.714171  3283 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:16:57.677353  3838 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.621268  6648 raft_consensus.cc:2764] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:57.623363  6420 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.622833  6567 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:57.709272  6646 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:16:57.637291  6596 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.675832  6619 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:57.632040  6643 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:57.680145  3842 rpcz_store.cc:276] 0709 13:16:56.406688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.124056 (+717368us) service_pool.cc:224] Handling call
0709 13:16:57.138627 (+ 14571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.592271 (+453644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.638051 (+ 45780us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54002175d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:57.638255 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":864063744}
I20260709 13:16:57.680015  6509 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:57.719249  6626 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:57.679693  6550 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:57.833066  6509 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:57.834751  6550 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:57.835773  6380 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.822814  6425 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.837984  6243 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:57.838163  6603 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:57.822918  6423 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:57.840307  6520 consensus_meta.cc:287] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.582s	user 0.005s	sys 0.005s
I20260709 13:16:57.840755  6520 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:57.813128  6357 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.819851  6535 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:57.679896  6515 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:57.816267  6586 raft_consensus.cc:740] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:57.679566  6633 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:57.846143  6427 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:57.679886  6629 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.846803  6473 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:57.847196  6633 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:57.827042  6420 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:57.831902  6619 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.837328  6626 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:57.849778  6464 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:57.850800  6498 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:57.850903  6626 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:57.851696  6420 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:57.851907  6586 consensus_queue.cc:260] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.853544  6452 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:57.854341  6580 consensus_meta.cc:287] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.004s
I20260709 13:16:57.843696  6357 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:57.854851  6604 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.855377  6604 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:57.856449  6357 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:57.859134  6586 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.679654  6605 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:57.711196  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:57.581526  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 116369us
I20260709 13:16:57.728159  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:57.920843  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 194282us
I20260709 13:16:57.922444  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:57.924070  3101 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:57.927081  3101 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:57.929172  3101 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:57.932051  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:57.715301  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 241268us
W20260709 13:16:57.753788  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.619308  3203 rpcz_store.cc:276] 0709 13:16:54.983398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.425783 (+442385us) service_pool.cc:224] Handling call
0709 13:16:55.426075 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.426287 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:55.433345 (+  7058us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.618528 (+2185183us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b1800468ca0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3bbd974bc 00007fb3b90e548b 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b90ff455 00007fb3bc1e7060 00007fb3bc1f9716 00007fb3bc20a287
0709 13:16:57.618620 (+    92us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.618671 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:57.618725 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.618794 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.618904 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6756,"prepare.queue_time_us":52109,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":82889,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":76,"spinlock_wait_cycles":40580992,"thread_start_us":1756137,"threads_started":2,"wal-append.queue_time_us":744905,"wal-append.run_cpu_time_us":1126,"wal-append.run_wall_time_us":1008664}
I20260709 13:16:57.941730  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1270) took 1812 ms. Trace:
I20260709 13:16:57.942435  3202 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.944608  3203 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:57.711512  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:57.945518  3203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1563) took 1748 ms. Trace:
I20260709 13:16:57.945978  3203 rpcz_store.cc:276] 0709 13:16:56.196833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.942813 (+1745980us) service_pool.cc:224] Handling call
0709 13:16:57.943608 (+   795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.945109 (+  1501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.945417 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:57.947742  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 236199us
I20260709 13:16:57.949193  3203 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:57.950016  3203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1565) took 1747 ms. Trace:
I20260709 13:16:57.950491  3203 rpcz_store.cc:276] 0709 13:16:56.202289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.948060 (+1745771us) service_pool.cc:224] Handling call
0709 13:16:57.948659 (+   599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.949722 (+  1063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.949938 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.953016  3203 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:16:57.636909  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2612) took 1445 ms. Trace:
I20260709 13:16:57.954501  3205 rpcz_store.cc:276] 0709 13:16:56.191612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.635527 (+1443915us) service_pool.cc:224] Handling call
0709 13:16:57.635903 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.636670 (+   767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.636855 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.956169  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:57.958087  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:57.942473  3133 rpcz_store.cc:276] 0709 13:16:56.129066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.129246 (+   180us) service_pool.cc:224] Handling call
0709 13:16:56.150607 (+ 21361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:57.122710 (+972103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.122744 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:57.123282 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.349064 (+225782us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:57.349127 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.479414 (+130287us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b54000e1ad4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:57.479473 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.940334 (+460861us) raft_consensus.cc:1685] finished
0709 13:16:57.940450 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.941375 (+   925us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38814,"raft.queue_time_us":39009,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":2145384192,"thread_start_us":225355,"threads_started":1,"wal-append.queue_time_us":705037}
I20260709 13:16:57.959991  3205 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:57.642560  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2611) took 1451 ms. Trace:
I20260709 13:16:57.961670  3210 rpcz_store.cc:276] 0709 13:16:56.191328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.619342 (+1428014us) service_pool.cc:224] Handling call
0709 13:16:57.641904 (+ 22562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.642136 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.642173 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.642231 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:57.642281 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.642368 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.642490 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.963567  3210 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:57.724340  3211 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:57.675372  3204 rpcz_store.cc:276] 0709 13:16:56.196482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.407976 (+1211494us) service_pool.cc:224] Handling call
0709 13:16:57.589540 (+181564us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.708762  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2613) took 1513 ms. Trace:
I20260709 13:16:57.966099  3206 rpcz_store.cc:276] 0709 13:16:56.191861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.671764 (+1479903us) service_pool.cc:224] Handling call
0709 13:16:57.679409 (+  7645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.702932 (+ 23523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.704915 (+  1983us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.704995 (+    80us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:57.705047 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.705155 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.705334 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.670991  3207 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:57.967777  3210 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:57.680186  3208 rpcz_store.cc:276] 0709 13:16:56.195446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.587681 (+1392235us) service_pool.cc:224] Handling call
0709 13:16:57.679741 (+ 92060us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.630064  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2610) took 1439 ms. Trace:
W20260709 13:16:57.808202  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.968979  3209 rpcz_store.cc:276] 0709 13:16:56.191019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.191128 (+   109us) service_pool.cc:224] Handling call
0709 13:16:57.124305 (+933177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.508588 (+384283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.508637 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.508697 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:57.508744 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.629735 (+120991us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400195354. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:57.629800 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.629989 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883045248}
I20260709 13:16:57.722754  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:57.972683  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 249879us
I20260709 13:16:57.692373  3250 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:57.976739  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 284337us
I20260709 13:16:57.977653  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:57.978216  3250 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:57.978740  3249 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:57.815286  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:57.974690  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:57.984530  3276 raft_consensus.cc:2393] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 10: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:57.984416  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2438) took 3724 ms. Trace:
W20260709 13:16:57.985599  3276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1277) took 1771 ms (client timeout 2130 ms). Trace:
I20260709 13:16:57.985960  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:16:57.986326  3276 rpcz_store.cc:269] 0709 13:16:56.214575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.815002 (+1600427us) service_pool.cc:224] Handling call
0709 13:16:57.985450 (+170448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.987273  6467 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.987949  6467 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:57.722358  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1260) took 3061 ms. Trace:
I20260709 13:16:57.675491  3281 rpcz_store.cc:276] 0709 13:16:56.213712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.204992 (+991280us) service_pool.cc:224] Handling call
0709 13:16:57.592643 (+387651us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.988788  6467 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.987883  6258 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:57.989377  6420 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:57.997174  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.997738  3838 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:57.820160  3841 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:57.812970  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 122430us
I20260709 13:16:58.018872  6612 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:58.019586  6357 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:58.020539  6357 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:58.021603  6612 consensus_queue.cc:1059] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:58.022114  6357 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.022949  6643 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.024047  6643 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.816525  3280 rpcz_store.cc:276] 0709 13:16:55.774283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.132929 (+358646us) service_pool.cc:224] Handling call
0709 13:16:56.177844 (+ 44915us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.196517 (+ 18673us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:57.158729 (+962212us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.338563 (+179834us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:57.603422 (+264859us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b2c00138fe8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:16:57.603815 (+   393us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.603969 (+   154us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:57.662067 (+ 58098us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.662369 (+   302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.662477 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.709650 (+ 47173us) raft_consensus.cc:1685] finished
0709 13:16:57.709682 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.709856 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57635,"prepare.queue_time_us":1466053,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":80,"raft.queue_time_us":136636,"raft.run_cpu_time_us":17443,"raft.run_wall_time_us":864192,"spinlock_wait_cycles":71315456,"thread_start_us":169482,"threads_started":2,"wal-append.queue_time_us":347782}
I20260709 13:16:58.024583  6643 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:58.024771  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 43897.3us
I20260709 13:16:58.025588  6648 consensus_queue.cc:1059] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:58.026053  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:58.027628  6653 raft_consensus.cc:3055] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:58.028128  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:58.028798  6643 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.017576  6503 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:16:58.028149  6653 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:58.033744  6653 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.034440  6483 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.035668  6483 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:58.036155  6483 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.036662  6483 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:58.002704  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:58.004263  3202 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:58.010375  3833 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:58.009878  6404 consensus_queue.cc:1059] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:58.011212  6596 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.011967  6644 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.012106  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2436) took 3794 ms. Trace:
I20260709 13:16:58.012670  6498 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:57.990362  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2434) took 3776 ms. Trace:
I20260709 13:16:58.013646  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:58.014019  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:58.014622  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:58.015693  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:58.016016  6192 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.016614  6369 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.042855  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 61839.3us
I20260709 13:16:58.017550  6258 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:58.018174  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:58.018411  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1269) took 1889 ms. Trace:
I20260709 13:16:58.023728  6441 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:57.992669  6023 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:57.988701  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:58.043593  3285 rpcz_store.cc:276] 0709 13:16:54.217287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.709308 (+1492021us) service_pool.cc:224] Handling call
0709 13:16:55.714091 (+  4783us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:55.715251 (+  1160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.715281 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:55.731652 (+ 16371us) log.cc:844] Serialized 52 byte log entry
0709 13:16:57.193921 (+1462269us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:57.193980 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.194065 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:58.011655 (+817590us) raft_consensus.cc:1685] finished
0709 13:16:58.011695 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.011910 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":714,"raft.queue_time_us":22880,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":33439,"thread_start_us":1382842,"threads_started":1,"wal-append.queue_time_us":2028290}
I20260709 13:16:57.994547  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:58.042192  3205 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:16:58.043993  3280 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:58.045047  6486 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:58.045735  6473 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.077816  6404 raft_consensus.cc:3055] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:58.077543  6473 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.078348  6404 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:58.078497  3276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1278) took 1839 ms (client timeout 2130 ms). Trace:
W20260709 13:16:58.079025  3276 rpcz_store.cc:269] 0709 13:16:56.215004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.987919 (+1772915us) service_pool.cc:224] Handling call
0709 13:16:58.054250 (+ 66331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:58.080212  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:58.079782  6404 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.047374  3208 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
W20260709 13:16:58.073661  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 59682.8us
I20260709 13:16:58.048347  3129 rpcz_store.cc:276] 0709 13:16:56.128749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.149170 (+ 20421us) service_pool.cc:224] Handling call
0709 13:16:56.149536 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.578370 (+1428834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.017826 (+439456us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000e29d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:58.018223 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2363134848}
I20260709 13:16:58.052800  3211 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 10: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:58.054957  6509 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.083999  6509 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:58.085906  6258 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:58.088445  3276 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:16:58.035699  6653 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.055919  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:58.089617  6449 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:58.056170  6369 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.057876  6192 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.091331  6192 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.055161  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:58.058511  3209 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.055946  6427 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.094583  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:58.057415  6467 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.036944  6660 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:16:58.065330  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 71120.4us
I20260709 13:16:58.045199  3277 rpcz_store.cc:276] 0709 13:16:54.661244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.767666 (+1106422us) service_pool.cc:224] Handling call
0709 13:16:55.768025 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.768219 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:57.349584 (+1581365us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.721596 (+372012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.721693 (+    97us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:57.721768 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.722107 (+   339us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.722269 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1257,"prepare.queue_time_us":1571082,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":8635,"raft.queue_time_us":1748,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":2493,"thread_start_us":1951033,"threads_started":2,"wal-append.queue_time_us":506075}
W20260709 13:16:58.067270  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.067879  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:58.068964  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:58.070412  6638 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:58.069908  6644 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.070996  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:58.073629  3281 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:58.074340  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:58.046550  3282 rpcz_store.cc:276] 0709 13:16:54.213869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.704057 (+1490188us) service_pool.cc:224] Handling call
0709 13:16:55.717936 (+ 13879us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:57.097992 (+1380056us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b4800130158. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1118aa1 00007fb3c110fb37 00007fb3c110f9ca 00007fb3c120726f 00007fb3c1206f37 00007fb3c121b55c 00007fb3c121b508 00007fb3c121b488 00007fb3c121b443 00007fb3c121a6ec 00007fb3c0144a96
0709 13:16:57.215096 (+117104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.215128 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:57.215580 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.465802 (+250222us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:57.517672 (+ 51870us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.517949 (+   277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.518051 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.989568 (+471517us) raft_consensus.cc:1685] finished
0709 13:16:57.989734 (+   166us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.990119 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":140667,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":53411,"raft.run_cpu_time_us":4619,"raft.run_wall_time_us":1357891,"spinlock_wait_cycles":54783360,"thread_start_us":1683709,"threads_started":2,"wal-append.queue_time_us":469606}
I20260709 13:16:58.016680  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:58.032655  6452 consensus_queue.cc:1059] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:16:58.054463  6486 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.985334  3284 rpcz_store.cc:276] 0709 13:16:54.259584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.746487 (+1486903us) service_pool.cc:224] Handling call
0709 13:16:55.746904 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:55.747250 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.747281 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:55.928211 (+180930us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b2c00138fe8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:16:55.928789 (+   578us) log.cc:844] Serialized 52 byte log entry
0709 13:16:57.178276 (+1249487us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:57.456144 (+277868us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.457932 (+  1788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.458009 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.983501 (+525492us) raft_consensus.cc:1685] finished
0709 13:16:57.983674 (+   173us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.984070 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42027,"prepare.queue_time_us":411770,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":54779,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":32983,"spinlock_wait_cycles":58285952,"thread_start_us":1349770,"threads_started":2,"wal-append.queue_time_us":1374358}
I20260709 13:16:58.090266  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:58.100386  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1279) took 1530 ms. Trace:
I20260709 13:16:58.092828  6369 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.104877  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:58.108542  3837 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:58.109292  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2452) took 2295 ms. Trace:
I20260709 13:16:58.109397  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:58.109679  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:58.110376  3834 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:58.110685  3284 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.109709  3282 rpcz_store.cc:276] 0709 13:16:55.813856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.108164 (+2294308us) service_pool.cc:224] Handling call
0709 13:16:58.108619 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.108907 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.108931 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:58.108986 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:58.109031 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.109113 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.109200 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:58.111485  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.113559  3276 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:58.112674  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:58.103184  6486 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.119140  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2454) took 2292 ms. Trace:
I20260709 13:16:58.120218  3276 rpcz_store.cc:276] 0709 13:16:55.826879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.112468 (+2285589us) service_pool.cc:224] Handling call
0709 13:16:58.112916 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.118768 (+  5852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.119035 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:58.099625  6638 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.103718  3281 rpcz_store.cc:276] 0709 13:16:56.569953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.013411 (+1443458us) service_pool.cc:224] Handling call
0709 13:16:58.100307 (+ 86896us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:58.122923  3280 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:58.123538  3836 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 5: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:58.126273  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:16:58.123106  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.138911  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2450) took 2358 ms. Trace:
I20260709 13:16:58.139547  3280 rpcz_store.cc:276] 0709 13:16:55.776940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.102523 (+2325583us) service_pool.cc:224] Handling call
0709 13:16:58.122604 (+ 20081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.134714 (+ 12110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.135000 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:58.122905  6467 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:58.128103  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:58.142024  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:58.146422  6452 raft_consensus.cc:3055] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:58.147135  6452 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:58.150604  6452 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.151010  3102 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:58.121016  6619 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:58.129866  6638 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.162323  6404 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.513931  3278 rpcz_store.cc:276] 0709 13:16:54.663679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.972763 (+1309084us) service_pool.cc:224] Handling call
0709 13:16:56.016039 (+ 43276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.016326 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:57.328735 (+1312409us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.387149 (+ 58414us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.387204 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:57.387260 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.387342 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.387476 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1408046,"prepare.run_wall_time_us":51,"raft.queue_time_us":81723,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":12766,"thread_start_us":1337057,"threads_started":2}
I20260709 13:16:58.164172  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:58.165380  6652 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:58.165904  6652 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.166093  3277 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:58.166294  6652 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.166893  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2460) took 2199 ms. Trace:
I20260709 13:16:58.167320  3277 rpcz_store.cc:276] 0709 13:16:55.967269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.141761 (+2174492us) service_pool.cc:224] Handling call
0709 13:16:58.165516 (+ 23755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.166565 (+  1049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.166800 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:58.173063  3277 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:16:58.164947  3278 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:16:58.159121  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:58.174715  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:58.194036  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:58.204567  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 272837us
W20260709 13:16:58.205746  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.209072  3836 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:58.212502  3279 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:16:58.212986  3279 pending_rounds.cc:85] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 4
I20260709 13:16:58.213277  3279 pending_rounds.cc:107] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:58.213551  3279 raft_consensus.cc:2889] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:58.214505  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1281) took 1099 ms. Trace:
I20260709 13:16:58.214825  6452 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.214884  3279 rpcz_store.cc:276] 0709 13:16:57.114926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.157149 (+1042223us) service_pool.cc:224] Handling call
0709 13:16:58.211602 (+ 54453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.214173 (+  2571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.214418 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:58.216281  3281 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:58.217362  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2458) took 2366 ms. Trace:
I20260709 13:16:58.217974  3281 rpcz_store.cc:276] 0709 13:16:55.851097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.137278 (+2286181us) service_pool.cc:224] Handling call
0709 13:16:58.198846 (+ 61568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.216903 (+ 18057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.217278 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:58.220237  3281 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:16:58.222285  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 80335.2us
I20260709 13:16:58.223834  6369 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:58.225603  6660 raft_consensus.cc:3055] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:58.226154  6660 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:58.227574  6660 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.229914  6644 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:58.230296  6660 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.213007  6629 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:58.233618  6490 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:16:58.237643  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:58.238516  6640 raft_consensus.cc:3055] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:58.239094  6640 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:58.240324  6629 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:58.241415  6640 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.243268  6640 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.242089  3176 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:58.246789  3832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 695) took 1076 ms. Trace:
I20260709 13:16:58.180464  6192 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.258481  6643 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.260615  6602 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.261521  3280 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:58.264722  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1274) took 2051 ms. Trace:
W20260709 13:16:58.262249  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 234836us
I20260709 13:16:58.265329  3282 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:58.265684  3278 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:58.266032  3250 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:58.266661  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2457) took 2416 ms. Trace:
I20260709 13:16:58.267089  3282 rpcz_store.cc:276] 0709 13:16:55.850583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.111718 (+2261135us) service_pool.cc:224] Handling call
0709 13:16:58.112287 (+   569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.265764 (+153477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.266416 (+   652us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540022d154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:58.266581 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351397248}
I20260709 13:16:58.267680  3250 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:58.265030  3280 rpcz_store.cc:276] 0709 13:16:56.213193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.143567 (+1930374us) service_pool.cc:224] Handling call
0709 13:16:58.261204 (+117637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.264475 (+  3271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.264663 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:58.178359  6376 consensus_queue.cc:1059] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:16:58.269285  6502 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:58.269891  6376 raft_consensus.cc:3055] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:58.245699  6606 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:58.270287  6376 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:58.270577  6606 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.271335  6606 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.271871  3250 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:58.273242  6258 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.249987  3832 rpcz_store.cc:276] 0709 13:16:57.170205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.175474 (+  5269us) service_pool.cc:224] Handling call
0709 13:16:57.175802 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.671312 (+495510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.246341 (+575029us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54005785d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:58.246597 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841776896}
I20260709 13:16:58.263783  6515 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:58.282030  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 101689us
I20260709 13:16:58.286247  3285 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:58.286307  3276 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:58.286732  3209 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:16:58.247025  6420 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.288220  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2461) took 2281 ms. Trace:
I20260709 13:16:58.292045  3276 rpcz_store.cc:276] 0709 13:16:56.006704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.142348 (+2135644us) service_pool.cc:224] Handling call
0709 13:16:58.251716 (+109368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.287975 (+ 36259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.288160 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:58.245067  6604 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.206255  6483 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.297219  3284 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:16:58.287739  6619 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.295953  6502 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.301923  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:58.302918  3211 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:16:58.304476  3100 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:58.313512  3251 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:58.317317  6520 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.318552  6619 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.318993  6490 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:58.319147  3202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1566) took 2116 ms (client timeout 2243 ms). Trace:
I20260709 13:16:58.319517  6619 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.295678  6643 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:58.320019  3202 rpcz_store.cc:269] 0709 13:16:56.202629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.180571 (+977942us) service_pool.cc:224] Handling call
0709 13:16:58.318900 (+1138329us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b5400375fd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:16:58.319064 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174300416}
I20260709 13:16:58.310948  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:58.328681  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:58.329805  3206 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:58.330930  6425 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:16:58.334601  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 92657.5us
I20260709 13:16:58.337296  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1259) took 3676 ms. Trace:
I20260709 13:16:58.337693  3283 rpcz_store.cc:276] 0709 13:16:54.660583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.757304 (+1096721us) service_pool.cc:224] Handling call
0709 13:16:55.757879 (+   575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:57.816658 (+2058779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.336806 (+520148us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b540022ef54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:58.337106 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4494942976}
I20260709 13:16:58.334720  6605 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:58.342581  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:58.271914  6376 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.345995  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:58.346617  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:58.347021  3283 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:58.345955  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:58.348735  3284 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
W20260709 13:16:58.350028  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 54556.9us
I20260709 13:16:58.319857  6515 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:16:58.354532  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:58.355253  6423 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:58.355577  3205 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:58.319585  6490 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.325837  6357 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:58.366199  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:58.347697  6376 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:58.348227  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:58.372467  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:58.366045  6490 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.365723  6648 raft_consensus.cc:3055] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:58.381387  3206 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:58.378180  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:58.363219  6483 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.369340  6357 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.325407  6652 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.380990  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:58.365343  6524 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:58.394832  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 77486.5us
W20260709 13:16:58.389941  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 93627.1us
I20260709 13:16:58.399865  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:58.400615  3202 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:58.401960  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:58.403213  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:58.357059  6638 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.410087  3208 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:16:58.410979  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:58.412307  6420 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:58.412849  6420 raft_consensus.cc:697] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:58.412976  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:58.387977  6452 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:58.386585  6648 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:58.388979  6423 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.397415  6192 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:58.395902  6357 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.392589  6258 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.417749  6524 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:58.441296  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 144563us
I20260709 13:16:58.413561  6638 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.431957  6452 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.447269  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:58.444887  6524 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.451040  6524 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:58.452385  3833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 617) took 2046 ms. Trace:
W20260709 13:16:58.453351  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.452922  3833 rpcz_store.cc:276] 0709 13:16:56.406070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.086391 (+680321us) service_pool.cc:224] Handling call
0709 13:16:57.086769 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.049402 (+962633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.436240 (+386838us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b54003abbd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:58.452312 (+ 16072us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2115119360}
I20260709 13:16:58.440609  6483 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.449596  6452 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:58.462116  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 84128.1us
I20260709 13:16:58.463359  6520 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:58.464103  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 154755us
I20260709 13:16:58.467592  6661 consensus_queue.cc:1059] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:58.468931  6427 raft_consensus.cc:3055] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:58.467595  3100 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:58.469360  6427 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:58.470311  6427 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.471544  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:58.471982  6427 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.472043  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:16:58.472482  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.472992  3211 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:16:58.472229  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:58.473536  3207 raft_consensus.cc:2393] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:16:58.474978  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.478335  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:58.472853  6661 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:58.494648  6473 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:58.494951  6661 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.495563  6661 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.496666  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:58.497020  6491 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:16:58.497357  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.497677  3806 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:58.498725  6491 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:58.499148  6491 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.499492  6491 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.499825  6604 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:58.500285  6604 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.500648  6604 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.497375  6640 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:16:58.502903  3032 catalog_manager.cc:5697] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:58.504284  3101 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:58.505205  6425 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:58.505211  6588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.036s	sys 0.037s
W20260709 13:16:58.506362  6588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.036s	sys 0.037s
I20260709 13:16:58.506188  3032 catalog_manager.cc:5697] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 5 to 6, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 6 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:58.508404  6432 raft_consensus.cc:3055] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:58.509109  6432 raft_consensus.cc:740] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:58.510376  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:58.510131  6432 consensus_queue.cc:260] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.511449  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:58.487043  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2446) took 2711 ms. Trace:
I20260709 13:16:58.512115  3285 rpcz_store.cc:276] 0709 13:16:55.775898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.095893 (+2319995us) service_pool.cc:224] Handling call
0709 13:16:58.096425 (+   532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.290190 (+193765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.486704 (+196514us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54004362d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:58.486936 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433348352}
W20260709 13:16:58.488188  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.483734  6659 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:58.513525  6659 raft_consensus.cc:697] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:58.515053  6659 consensus_queue.cc:237] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.483158  6486 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.519156  3100 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:58.519681  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:58.520311  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:16:58.521505  6420 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.511569  6432 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.483839  6380 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:58.508330  3032 catalog_manager.cc:5697] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.496515  6404 consensus_queue.cc:1059] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:58.530308  6425 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:58.535060  6509 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:16:58.535888  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 123090us
I20260709 13:16:58.530951  6483 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.532385  6425 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.538034  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:58.546552  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:58.541478  6425 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:58.549435  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 90862.9us
I20260709 13:16:58.549495  6520 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.550130  6520 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:58.550531  6520 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.530522  6648 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.552590  6648 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:58.553309  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.542580  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:58.548731  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:58.542407  6404 raft_consensus.cc:3055] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:58.554400  6404 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:58.554473  6621 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:58.554921  6621 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:58.555335  6621 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.555409  6404 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.540867  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:58.557518  6629 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:58.557888  3210 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:58.558032  6629 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:58.558491  6629 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.553843  3211 raft_consensus.cc:2376] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8. Re-sending same reply.
I20260709 13:16:58.544791  6606 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.562280  6606 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.562644  6565 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.550413  3250 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:58.565357  6473 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.565696  3250 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:58.566074  6425 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.566675  6612 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:58.566242  6404 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.567250  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:58.568755  6652 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:58.543622  3209 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:58.577368  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:58.577574  6620 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:58.577927  6619 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:58.571513  6425 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.578428  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:58.578687  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:58.584358  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.519189  6486 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:58.590317  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 86156.2us
W20260709 13:16:58.590309  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.602252  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.602563  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:58.605325  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:58.589761  6612 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.610236  6671 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:16:58.613652  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 46495.2us
I20260709 13:16:58.614666  3250 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:16:58.615631  6423 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:58.616138  6357 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.616772  6423 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:58.617543  3032 catalog_manager.cc:5697] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 4 to 5, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 5 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:16:58.618006  6423 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.619174  3032 catalog_manager.cc:5697] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 1 to 5, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 5 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:16:58.616830  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:58.537578  6604 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.604223  6502 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:58.633893  3276 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 11: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:58.627658  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:58.642372  3838 raft_consensus.cc:2393] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:58.638885  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:58.643349  3211 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.644179  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:58.633788  3840 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:16:58.638671  3101 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:58.608889  6612 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.652081  3208 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:58.638541  6653 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:16:58.657424  3032 catalog_manager.cc:5697] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.662787  3249 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:58.647486  6515 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.682703  6515 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:16:58.683213  6515 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.685402  6661 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.647789  6502 raft_consensus.cc:697] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:58.687602  6661 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.688366  6502 consensus_queue.cc:237] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:58.691591  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 90493.8us
I20260709 13:16:58.691429  6520 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.693254  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:58.694123  6638 consensus_queue.cc:1059] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:58.694949  6467 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:58.673903  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 49538.3us
I20260709 13:16:58.660948  6619 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.672961  6491 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.656679  6258 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:58.698422  6491 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.699288  3842 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:58.699525  3211 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:16:58.681311  6659 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:58.693172  6599 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:58.695037  6638 raft_consensus.cc:3055] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:58.667618  6604 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.701462  6638 raft_consensus.cc:740] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:58.700775  6659 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:58.702791  6659 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.702585  6638 consensus_queue.cc:260] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.703308  6621 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.704205  6638 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.706152  6621 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.675140  6357 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:58.696013  3101 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:16:58.712749  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.713744  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.713809  6520 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:58.779978  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 84200.1us
I20260709 13:16:58.780308  6604 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.780977  6604 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:58.714943  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 98296.2us
W20260709 13:16:58.715517  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 65987.4us
I20260709 13:16:58.715833  6659 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.716354  6643 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.785409  6643 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:58.785972  6643 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.786830  6659 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:58.787556  6659 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:58.787997  6659 raft_consensus.cc:697] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:58.714267  6612 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:58.735252  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:58.790175  3835 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:58.736919  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:58.791761  3280 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.738144  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:58.795086  3249 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:58.799973  6357 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:58.800559  6357 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:58.800943  6357 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.804961  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:58.805914  3278 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:16:58.807505  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:58.808378  6491 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:58.808787  6491 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.809640  6491 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:58.757458  3032 catalog_manager.cc:5697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.834795  3032 catalog_manager.cc:5697] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 6 to 7, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 7 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:16:58.694674  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:16:58.837182  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 142568us
I20260709 13:16:58.838245  3176 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:58.839177  6520 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.838632  6491 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.847071  3176 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:58.762686  6509 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:58.781651  3101 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:58.908162  6509 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:16:58.908466  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 127428us
I20260709 13:16:58.811540  3276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:16:58.909525  3276 raft_consensus.cc:606] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:16:58.909957  3276 raft_consensus.cc:614] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:58.788868  6659 consensus_queue.cc:237] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.915023  6660 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:58.809196  6604 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.815615  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:58.919236  3835 raft_consensus.cc:2368] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11.
I20260709 13:16:58.628211  6524 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.850771  3249 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:58.922926  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 72270.8us
I20260709 13:16:58.923789  3249 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:58.762485  3100 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:58.859233  6258 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.861485  3838 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:58.864528  6612 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.865057  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.848039  6621 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.755481  6490 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.869947  6629 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.725570  6452 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.877185  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:58.941540  3282 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:58.894771  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.895246  3032 catalog_manager.cc:5697] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 4 to 6, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 6 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.908685  6509 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:16:58.943428  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 96491.6us
I20260709 13:16:58.926060  6483 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:58.867527  6515 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:58.940201  3102 leader_election.cc:400] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11.
W20260709 13:16:58.925254  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 162884us
W20260709 13:16:58.947031  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.880658  6491 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:58.950697  6612 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.951027  6509 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.951474  6653 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:58.956108  3102 leader_election.cc:403] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:16:58.933617  6423 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.957983  3284 raft_consensus.cc:2393] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:58.959183  3209 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:58.947713  3280 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:16:58.926232  6258 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:58.966290  6520 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.871417  6357 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:16:58.977532  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 50233.3us
I20260709 13:16:58.974778  6509 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.983074  6376 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.983307  6429 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.962425  6483 raft_consensus.cc:697] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:58.989414  3280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c414d51e428042c596cb410c48956c63"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:16:58.990852  3206 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:58.968205  6423 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:16:58.994603  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:58.991477  3280 raft_consensus.cc:606] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:16:59.006285  3280 raft_consensus.cc:614] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:59.018817  3101 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:16:59.020941  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.987658  3032 catalog_manager.cc:5697] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 4 to 6, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 6 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.022925  3032 catalog_manager.cc:5697] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 1 to 6, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 6 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.024592  3278 consensus_queue.cc:237] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:59.025559  3032 catalog_manager.cc:5697] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 2 to 5, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 5 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:59.029021  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:59.032058  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 103636us
I20260709 13:16:59.028368  3032 catalog_manager.cc:5697] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 3 to 7, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 7 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.041340  6643 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.041946  6515 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:59.043669  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.041944  3210 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:59.044363  3206 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:16:59.016803  6423 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:59.052742  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 58402.5us
I20260709 13:16:59.054514  3101 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:59.054813  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.031966  6473 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.063186  6369 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:59.068264  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:59.077185  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.057798  3032 catalog_manager.cc:5697] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 4 to 6, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 6 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:59.084668  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 98745.2us
W20260709 13:16:59.089146  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.089016  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:16:59.055655  6425 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:59.059211  6621 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:59.101624  3806 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:59.166031  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 64546.5us
I20260709 13:16:59.093588  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:59.133490  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:59.170702  3210 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.117136  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:59.171983  3204 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.122195  3284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:16:59.173409  3284 raft_consensus.cc:606] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:16:59.174086  3284 raft_consensus.cc:614] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:59.109797  3280 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:59.107987  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.161171  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:59.106046  3032 catalog_manager.cc:5697] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 1 to 4, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 4 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.112185  3133 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:59.178333  3032 catalog_manager.cc:5697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 5 to 6, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 6 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.119299  3129 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:59.180502  3209 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.182381  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:59.112505  6357 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:59.105346  6524 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:59.195071  3032 catalog_manager.cc:5697] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.112768  6693 raft_consensus.cc:2764] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:59.200570  6369 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:59.105376  6425 raft_consensus.cc:697] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:59.165686  6621 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:16:59.116583  6420 consensus_queue.cc:1059] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:16:59.203125  6452 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:59.189070  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:59.205627  3136 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:59.183612  6604 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:59.103525  6473 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.139005  6483 consensus_queue.cc:237] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.275970  3209 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:59.276655  3210 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:59.114352  6429 consensus_queue.cc:1059] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 13:16:59.276053  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.138445  6612 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:59.258312  6621 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.114058  6520 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.099s
W20260709 13:16:59.213528  6687 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:16:59.183151  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:16:59.196921  3032 catalog_manager.cc:5697] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 5 to 7, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 7 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.302608  3838 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.303205  3032 catalog_manager.cc:5697] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 2 to 5, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 5 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.112186  6629 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:59.304893  3032 catalog_manager.cc:5697] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:16:59.306641  3032 catalog_manager.cc:5697] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:59.227420  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.308504  3032 catalog_manager.cc:5697] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 2 to 3, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:59.230190  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.099674  6694 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.131s
I20260709 13:16:59.311324  3032 catalog_manager.cc:5697] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.231304  3133 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:59.314337  3838 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:59.232955  6661 consensus_queue.cc:1059] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:59.262598  6524 consensus_queue.cc:1059] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:16:59.234972  6486 consensus_queue.cc:1059] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:59.316211  6369 raft_consensus.cc:3055] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:59.316551  6524 raft_consensus.cc:3055] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:59.317114  6524 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:59.238374  6376 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11.
I20260709 13:16:59.191115  6643 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:59.242127  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:59.242635  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 188197us
I20260709 13:16:59.318142  6524 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:59.320006  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.242969  6404 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.247952  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.249265  3135 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:59.221566  6660 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:59.250174  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:59.252885  3176 connection.cc:256] RPC call timeout handler was delayed by -1.2294700209999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
I20260709 13:16:59.252990  6638 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:59.254733  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.256549  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.241729  6425 consensus_queue.cc:237] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.261785  3276 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:59.263586  3833 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:59.273157  3204 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:16:59.182050  6490 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:59.282438  3130 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:59.358857  3835 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:59.285599  6429 raft_consensus.cc:3055] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:59.285871  6432 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.285445  3282 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:16:59.359916  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.360911  3209 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:59.286674  6473 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:59.367699  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.291503  6258 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:16:59.292265  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.292616  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.371997  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.314499  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:59.373400  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.313580  3032 catalog_manager.cc:5697] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 4 to 7, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 7 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:16:59.372283  6432 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:59.376148  6432 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:59.111629  6690 consensus_queue.cc:1059] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 13:16:59.318104  6486 raft_consensus.cc:3055] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:59.327059  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:59.377380  6486 raft_consensus.cc:740] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:59.377781  3210 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 8: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:59.320508  6524 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.316607  6369 raft_consensus.cc:740] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:59.378571  3202 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:59.321929  3127 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:16:59.320602  3132 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.380643  3280 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:59.333732  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:59.358512  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.359237  3205 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:59.280965  6604 raft_consensus.cc:697] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:59.334986  6653 raft_consensus.cc:697] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:59.372396  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:59.383411  3285 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:59.382019  3283 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:16:59.384666  3284 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:59.385286  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:59.386986  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.389669  3281 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:59.365010  6429 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:59.396090  6660 consensus_queue.cc:1059] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:59.397958  6690 raft_consensus.cc:3055] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:59.397858  6429 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.399190  6429 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.400256  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.401240  3202 raft_consensus.cc:2410] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:59.398402  6690 raft_consensus.cc:740] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:59.392735  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.402642  3130 raft_consensus.cc:2410] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:16:59.402419  6690 consensus_queue.cc:260] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:59.403731  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.403849  6369 consensus_queue.cc:260] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.404402  3130 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:16:59.405546  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.406420  3283 raft_consensus.cc:2393] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:59.406456  6660 consensus_queue.cc:1059] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:59.407737  6660 raft_consensus.cc:3055] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:59.408129  6660 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:59.408469  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.409246  6652 raft_consensus.cc:3055] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:59.409623  6652 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:59.409657  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:59.369390  6698 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:16:59.402473  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:59.432724  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.435763  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.437438  3277 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:59.333572  6404 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.443379  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.437989  3129 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:16:59.434059  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.445979  3135 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:59.450248  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.450536  3135 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:59.452111  3135 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:16:59.453603  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.454281  3131 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:16:59.457674  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.460184  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:59.460980  3277 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.462823  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.463804  6604 consensus_queue.cc:237] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:59.464709  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.465518  3130 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:59.466760  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.470172  6423 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.471690  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.386747  6653 consensus_queue.cc:237] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.472479  6423 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:59.475577  3279 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:16:59.410717  6652 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.485045  6652 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.488984  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:16:59.438962  6670 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:59.476872  3135 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:59.409024  6660 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.383188  6486 consensus_queue.cc:260] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.478856  6619 raft_consensus.cc:3055] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:59.479735  3203 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:16:59.480435  3130 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:16:59.481016  3132 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:16:59.483747  3277 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
W20260709 13:16:59.490952  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.490607  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.497707  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.498250  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.493626  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.495421  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:59.510820  3203 pending_rounds.cc:85] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 3
I20260709 13:16:59.513288  3276 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:16:59.513890  3203 pending_rounds.cc:107] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:16:59.507745  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.513280  3135 raft_consensus.cc:2376] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8. Re-sending same reply.
I20260709 13:16:59.515558  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.516921  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.517403  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:59.518038  3135 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:59.518265  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.518728  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:59.518952  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.519486  3211 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:59.519994  3207 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:59.520407  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.514403  3203 raft_consensus.cc:2889] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:59.511917  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.522421  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.523950  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.526257  3135 raft_consensus.cc:2410] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:16:59.527396  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:59.528232  3284 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:59.528739  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.492753  6565 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:59.529711  3281 raft_consensus.cc:2410] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 10 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:59.531046  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.531741  3282 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:16:59.533707  3129 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:16:59.492296  6690 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.535173  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.436664  6638 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:59.535648  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.492600  6258 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.535295  3204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af"
dest_uuid: "43b01d5a97e149008d543a6615219928"
mode: GRACEFUL
new_leader_uuid: "fc48eecc27554cb58b15193cd442b1d3"
 from {username='slave'} at 127.0.0.1:50254
I20260709 13:16:59.542688  3279 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 10: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:59.510695  6619 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:59.540794  3282 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:59.541285  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:59.541858  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.540241  6703 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.543035  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:59.547529  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.543088  3130 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:16:59.542698  3204 raft_consensus.cc:606] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Received request to transfer leadership to TS fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:59.527805  6660 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.561232  3207 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.561513  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:59.562230  3277 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.563081  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.563706  3134 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:16:59.564113  3280 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:59.564554  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.566401  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:59.567231  3284 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:59.567898  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:59.573439  3134 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:59.578130  3210 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:59.578629  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:59.579279  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:59.580240  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.581116  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.582666  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.585968  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:59.586804  3281 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:59.588034  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.588618  3130 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:59.589526  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.588730  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.597502  3280 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:16:59.599392  3279 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:59.600116  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.601101  3127 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:59.584939  6703 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:59.602022  6621 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.603035  6703 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:59.603063  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:59.604246  6404 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:59.602023  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.606272  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.606891  3128 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:16:59.607601  3134 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:16:59.549043  3204 raft_consensus.cc:614] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:59.543156  6565 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:59.635697  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.551618  6638 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:59.553038  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:59.548533  6486 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.557192  6258 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:59.557771  6619 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.607797  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.609529  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:59.611234  6369 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.604241  6621 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:59.659889  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.580824  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.613372  6695 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:16:59.545670  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 328553us
W20260709 13:16:59.661202  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.615199  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:59.662283  3284 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.663902  3835 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:16:59.664747  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:59.615975  3207 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:16:59.617447  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.665982  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:59.666563  3205 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:59.666790  3279 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.667477  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:16:59.618722  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.668422  3206 raft_consensus.cc:2393] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:16:59.624148  3278 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:16:59.607810  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.569026  3209 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:59.632110  3203 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:59.549250  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:16:59.633183  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.628978  3132 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:16:59.618084  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:59.626423  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:16:59.678857  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 52518.8us
I20260709 13:16:59.679884  3249 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:59.636395  3202 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:16:59.650272  3130 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
W20260709 13:16:59.682477  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.683112  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.683615  3133 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:59.683810  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:59.651316  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:16:59.653755  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 77603.8us
I20260709 13:16:59.684865  3285 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.684505  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.683944  3130 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:59.686399  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:59.687044  3278 raft_consensus.cc:2368] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11.
I20260709 13:16:59.686936  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.684500  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.657852  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.695992  3134 raft_consensus.cc:2393] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:59.697131  3130 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:59.689735  6695 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.702013  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.703378  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.704141  3128 raft_consensus.cc:2410] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:59.704440  6258 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:59.704994  3206 raft_consensus.cc:3055] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:59.705351  6695 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:16:59.690248  6425 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.705874  6619 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.706682  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.711390  3127 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.706748  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.704897  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.709014  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.712996  3132 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:59.713547  3130 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:59.707542  3100 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:59.705381  3206 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:16:59.712733  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.715552  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.716244  3209 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:59.717041  3134 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:59.719585  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.695366  6502 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:59.722002  3128 raft_consensus.cc:2410] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:59.724825  3277 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:59.728838  3129 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:16:59.695621  6702 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:59.722729  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:59.733029  3282 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:59.733505  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.731848  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.734510  3284 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:16:59.737427  3134 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:16:59.730629  3206 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.738113  3206 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:59.737006  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:59.715833  6629 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:59.739527  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:59.733951  3805 leader_election.cc:336] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.513s (SENT)
I20260709 13:16:59.742810  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:16:59.743597  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.739899  3279 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:16:59.740005  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:59.732095  6705 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.748378  6705 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.749953  3129 raft_consensus.cc:2410] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:16:59.750113  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 132104us
I20260709 13:16:59.740628  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.744647  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:59.747579  6502 raft_consensus.cc:697] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:59.752873  3249 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:59.758466  6423 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:59.752458  6702 raft_consensus.cc:697] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:59.762032  6702 consensus_queue.cc:237] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:59.765910  3283 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:59.767278  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.767874  3276 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:59.768357  6703 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:59.768997  6432 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:59.769451  6432 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.769807  6432 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:59.773766  6707 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:59.743330  6491 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:59.777303  6648 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:59.777913  6648 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:16:59.779458  6648 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.780798  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.781921  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.777372  6629 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:59.782971  3210 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:59.784092  6629 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:16:59.734887  6524 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.785185  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.734613  6467 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:59.786221  3203 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 8: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:16:59.731879  6404 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:59.786888  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:16:59.792595  3284 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:59.755762  3132 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
W20260709 13:16:59.793548  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.794437  3101 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:59.794734  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:16:59.788623  3277 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:59.795938  3281 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:16:59.797562  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:16:59.798838  3133 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5.
I20260709 13:16:59.802192  6659 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.802552  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.802820  6659 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.804169  3128 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:59.709462  6425 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:16:59.813230  3128 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:59.744318  6604 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:59.809435  3285 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:16:59.810760  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.816774  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:16:59.818545  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:16:59.823541  3132 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:16:59.820386  3282 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:59.823591  3280 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 6.
I20260709 13:16:59.819275  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:59.825228  3835 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:16:59.825912  3129 raft_consensus.cc:1240] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 7. Current term is 9. Ops: []
I20260709 13:16:59.827165  3129 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:16:59.827227  3132 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:16:59.828400  3129 raft_consensus.cc:1240] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:59.829068  3132 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:59.760749  6423 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:16:59.768712  6643 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 13:16:59.830325  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 220874us
I20260709 13:16:59.839375  3250 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:59.831202  3133 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 12. Current term is 14. Ops: []
I20260709 13:16:59.833184  3130 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:16:59.786177  6695 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:59.838161  3129 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:59.849794  3134 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:16:59.863030  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 123114us
I20260709 13:16:59.863438  3128 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:16:59.865003  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 131087us
I20260709 13:16:59.867467  3135 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:16:59.831084  6404 raft_consensus.cc:697] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:16:59.785571  6524 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:59.873430  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 79076.7us
I20260709 13:16:59.871126  3806 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:16:59.855002  6652 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:59.853016  6491 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.842123  6604 raft_consensus.cc:697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:16:59.858863  6659 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:16:59.873006  6670 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.060s	user 0.001s	sys 0.001s
W20260709 13:16:59.890291  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.905547  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:59.841351  6420 consensus_queue.cc:1059] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:16:59.875073  6429 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:16:59.786024  6565 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:16:59.945179  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 61527us
W20260709 13:16:59.951200  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45786us
I20260709 13:16:59.954494  3101 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:59.967906  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:59.968240  6425 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:16:59.968406  3835 raft_consensus.cc:1240] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:59.968639  3838 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:16:59.878225  6502 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:59.969591  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:16:59.983577  3833 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
W20260709 13:16:59.973047  6716 log.cc:927] Time spent T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.235s	user 0.000s	sys 0.002s
I20260709 13:16:59.985671  3251 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:16:59.957999  6652 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:59.996697  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 113773us
I20260709 13:16:59.995440  6643 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:00.007098  3250 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:59.951613  6429 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:16:59.986505  6491 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:59.985039  6520 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:17:00.005484  6643 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.005613  6192 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:00.037554  3805 leader_election.cc:336] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.515s (SENT)
I20260709 13:17:00.038017  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:16:59.986397  6420 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:17:00.041628  3177 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:16:59.996031  6693 consensus_queue.cc:1059] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:16:59.986915  6638 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 13:17:00.072940  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 72159.5us
I20260709 13:17:00.074491  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:00.034672  6643 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.035779  6653 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:00.084395  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 132169us
I20260709 13:17:00.085832  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:16:59.990136  6404 consensus_queue.cc:237] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:00.042025  6491 raft_consensus.cc:697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:00.068740  6698 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:00.064977  6702 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:00.104488  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.072714  6705 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:00.112242  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 129475us
I20260709 13:17:00.114650  6695 raft_consensus.cc:2955] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 3 to 7, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:17:00.123808  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 49423.5us
I20260709 13:17:00.125967  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:00.126456  3127 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:16:59.863306  6490 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:00.043484  6192 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:00.137149  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 51411.8us
I20260709 13:17:00.099957  6502 raft_consensus.cc:3055] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:00.035460  6604 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:00.127782  6698 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:00.129081  6717 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:00.133018  6699 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:00.161482  3101 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:00.162593  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.167984  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.168619  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.143137  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 272068us
I20260709 13:17:00.127624  6524 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:00.089674  6653 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:00.181142  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:00.185544  3279 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:17:00.157809  6486 consensus_meta.cc:287] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.004s
I20260709 13:17:00.194320  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:00.191540  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 78117.8us
I20260709 13:17:00.191848  3206 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:17:00.193707  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 67829.2us
I20260709 13:17:00.156769  6502 raft_consensus.cc:740] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:17:00.180660  6719 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:17:00.200307  3131 raft_consensus.cc:2410] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:00.190127  6258 raft_consensus.cc:2764] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
W20260709 13:17:00.217096  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.202572  3250 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:00.221947  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.198449  6420 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:00.224579  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.199777  6698 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:00.227088  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 355344us
I20260709 13:17:00.201445  6659 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:00.200146  6721 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:00.229842  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 192309us
I20260709 13:17:00.241675  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:00.242658  3204 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
W20260709 13:17:00.243450  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 49240.4us
W20260709 13:17:00.246549  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 44162.9us
I20260709 13:17:00.247965  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:00.214174  6486 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:00.241595  3206 raft_consensus.cc:2955] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 3 to 7, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:00.251312  3204 raft_consensus.cc:3055] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:00.254211  3204 raft_consensus.cc:740] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:00.254614  3101 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:00.258375  6192 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:00.258661  6432 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:00.269311  6432 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:00.259539  6690 consensus_meta.cc:287] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.715s	user 0.010s	sys 0.002s
W20260709 13:17:00.261952  6718 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.248s	user 0.000s	sys 0.003s
I20260709 13:17:00.270435  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:00.267061  6369 consensus_meta.cc:287] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.583s	user 0.013s	sys 0.000s
I20260709 13:17:00.271499  6643 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:00.272333  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:00.273458  6733 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:00.277241  6731 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:00.277702  6731 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:00.278087  3211 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:00.278163  6731 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:00.274997  6619 consensus_meta.cc:287] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.001s
I20260709 13:17:00.279731  3205 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:00.279230  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:00.227072  6420 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.283039  3136 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:00.295416  3101 leader_election.cc:400] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11.
I20260709 13:17:00.297817  3101 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:00.298969  3250 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:00.295958  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:00.232959  6638 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.301663  3100 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:00.299980  6369 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:00.302856  6502 consensus_queue.cc:260] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:00.303347  6192 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:00.303745  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:00.304687  6653 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:00.305454  3833 raft_consensus.cc:2393] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:00.244892  6727 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:00.247825  6721 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:00.253014  6429 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:00.239202  6693 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:00.203833  6491 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:00.306358  6643 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:00.301040  6420 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.309159  6619 raft_consensus.cc:2764] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:17:00.333359  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:00.321587  6192 consensus_queue.cc:1243] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:00.321441  6660 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:00.341773  3101 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:00.321201  6661 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:00.357651  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 47584us
I20260709 13:17:00.324589  6727 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:00.317821  3204 consensus_queue.cc:260] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:00.328058  6258 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:00.338855  6502 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.318390  6638 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:00.363019  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:00.365387  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:00.367834  3833 raft_consensus.cc:2410] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:00.363910  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:00.336871  6369 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:17:00.363221  6427 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:00.369593  6732 raft_consensus.cc:2764] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:17:00.370256  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 123076us
I20260709 13:17:00.373057  6733 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:17:00.381204  6429 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:17:00.381767  6729 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:00.389006  6429 consensus_queue.cc:1243] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer fc48eecc27554cb58b15193cd442b1d3 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:00.382190  6427 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:00.389935  6429 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:00.390458  6429 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:00.390667  6427 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:00.372292  6726 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:00.385622  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1299) took 1101 ms. Trace:
W20260709 13:17:00.385366  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 154827us
I20260709 13:17:00.386615  3250 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:00.400249  3136 rpcz_store.cc:276] 0709 13:16:59.284212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.402185 (+117973us) service_pool.cc:224] Handling call
0709 13:17:00.385451 (+983266us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b5400183154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:00.385541 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1923832576}
I20260709 13:17:00.402468  3250 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:00.351186  6660 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.371312  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:00.405602  3204 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.344820  6652 consensus_queue.cc:1059] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:17:00.404068  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:00.389132  6729 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.414191  6729 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.405153  6643 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:00.363982  6258 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.396076  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:17:00.404470  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 93677.6us
I20260709 13:17:00.409308  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:00.410133  6693 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:00.411119  6732 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:00.411466  6619 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:00.424949  3251 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:00.422257  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:00.365624  6698 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:17:00.366132  6659 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:17:00.434314  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:00.435220  3841 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.407980  6660 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.439529  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:00.369757  6486 consensus_queue.cc:1059] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:17:00.434044  6690 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:00.438740  6432 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:17:00.443363  6727 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:00.444167  6705 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:00.445631  6720 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.350s	user 0.000s	sys 0.003s
I20260709 13:17:00.448350  6732 raft_consensus.cc:697] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:00.449257  6621 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:00.423554  6258 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.450523  6698 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:00.451609  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:00.427513  6643 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:00.512419  6738 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:17:00.452282  6744 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:17:00.512406  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:00.440938  6731 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:00.514179  3283 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:17:00.455578  3205 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:17:00.457852  6724 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.294s	user 0.000s	sys 0.003s
I20260709 13:17:00.458521  6638 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:00.464037  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.475169  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 52839us
I20260709 13:17:00.518625  6732 consensus_queue.cc:237] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:00.520608  3250 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:00.511248  6621 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:00.522439  6621 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:00.479158  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.481807  3805 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:00.484437  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:00.524432  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 56883us
I20260709 13:17:00.485949  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:00.525214  3136 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:00.525467  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:00.526142  3276 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:00.527215  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:00.527364  3805 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:00.527830  3284 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.489670  3128 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:00.427354  6726 raft_consensus.cc:697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:00.453532  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:00.529021  6726 consensus_queue.cc:237] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:00.529668  3833 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:17:00.500628  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:00.501349  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:00.512382  6643 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.516002  6731 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:00.517728  6740 log.cc:927] Time spent T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:17:00.484458  6718 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:00.496829  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:00.532158  3805 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:00.550506  3250 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:00.533419  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:00.535956  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.493213  6659 raft_consensus.cc:3055] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:00.481575  6467 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:00.473253  6690 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.536255  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:00.552026  3280 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.550722  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:00.560068  3277 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:17:00.556082  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.558641  3279 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.559051  3285 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:00.530587  6717 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:00.480952  6619 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:00.564996  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.511651  6698 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.568691  3204 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:17:00.575367  3284 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:17:00.511796  6705 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:00.579514  3841 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:17:00.548686  6432 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:00.430125  6429 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:00.594658  3204 pending_rounds.cc:85] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 3
I20260709 13:17:00.557375  6659 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:17:00.586473  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 190583us
I20260709 13:17:00.592106  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:00.599313  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.595537  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:00.601964  6698 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.550935  6565 consensus_queue.cc:1059] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:17:00.551009  6643 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.562391  6690 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.606837  3204 pending_rounds.cc:107] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:17:00.625654  3204 raft_consensus.cc:2889] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:00.558362  6722 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:00.617352  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:00.562582  6423 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:00.621847  3101 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:00.629102  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:00.595335  6467 raft_consensus.cc:697] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:00.629994  6695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:33888 (request call id 89) took 1764 ms. Trace:
I20260709 13:17:00.630920  6467 consensus_queue.cc:237] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:00.630573  6695 rpcz_store.cc:276] 0709 13:16:58.865412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.866720 (+  1308us) service_pool.cc:224] Handling call
0709 13:16:59.029448 (+162728us) log.cc:844] Serialized 494 byte log entry
0709 13:16:59.107279 (+ 77831us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400182254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f5735 00007fb3bc1ed9fa 00007fb3c11b54c9 00007fb3ba731c54 00007fb3ba731be2 00007fb3ba731b11 00007fb3ba731a8c 00007fb3ba730d42 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:16:59.293970 (+186691us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b4c003da740. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3ba4bba20 00007fb3ba4cca29 00007fb3ba4cd13f 00007fb3ba4912ab 00007fb3ba4bef3c 00007fb3ba4bf3fe 00007fb3ba74c50b 00007fb3bc14b381 00007fb3bc14926b 00007fb3bc14fd53 00007fb3bc14fcd9
0709 13:17:00.629895 (+1335925us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":177802,"raft.run_cpu_time_us":2991,"raft.run_wall_time_us":102291,"spinlock_wait_cycles":413793920}
I20260709 13:17:00.633229  6743 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:00.595690  6730 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.602442  6727 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.638948  3279 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
W20260709 13:17:00.639906  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.642000  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:00.645257  3277 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
W20260709 13:17:00.651902  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.662410  3280 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:00.624799  6717 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:00.623696  6648 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:00.696691  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:00.722838  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 172419us
I20260709 13:17:00.699158  3283 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:00.699478  6721 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:00.726166  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 109257us
I20260709 13:17:00.721617  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:00.729067  3281 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
W20260709 13:17:00.724965  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.644284  6404 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:00.627805  6734 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:00.737507  3251 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:00.734405  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:17:00.731482  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 309286us
I20260709 13:17:00.754009  6429 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.760157  6432 raft_consensus.cc:3055] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:17:00.683276  6629 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:17:00.721380  6717 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.627244  6699 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:17:00.682071  6638 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:00.615099  6729 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:00.770148  3283 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:00.771351  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:00.789130  3278 raft_consensus.cc:2410] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:17:00.731340  6753 log.cc:927] Time spent T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.004s
I20260709 13:17:00.763576  6565 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:00.789863  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 52467.4us
I20260709 13:17:00.805909  3841 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:17:00.791965  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 57667.9us
I20260709 13:17:00.793648  6755 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:00.794224  6648 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:00.787142  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:00.735671  6404 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.788527  6638 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:00.770418  6432 raft_consensus.cc:740] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:00.784000  6717 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:00.681687  6730 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:00.781982  3285 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:00.770582  6515 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:17:00.838523  3203 pending_rounds.cc:85] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 4
I20260709 13:17:00.838938  3203 pending_rounds.cc:107] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 10.5
W20260709 13:17:00.833509  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 46497.5us
I20260709 13:17:00.839170  3203 raft_consensus.cc:2889] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:00.840073  3202 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:17:00.840469  3202 pending_rounds.cc:85] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 4
I20260709 13:17:00.840727  3202 pending_rounds.cc:107] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:17:00.835845  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:00.841045  3202 raft_consensus.cc:2889] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:00.845564  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 216541us
I20260709 13:17:00.798852  6369 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:17:00.815601  6648 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:00.829797  6638 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:00.845616  3250 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:00.824735  6404 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.825300  6755 raft_consensus.cc:697] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:00.829325  6746 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.827266  6565 raft_consensus.cc:697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:00.858351  3250 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:00.777230  6734 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:00.788165  6659 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:00.796720  6705 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:00.879356  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:00.857848  6648 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.876111  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:00.861304  6695 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:00.879383  6619 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:00.851604  6725 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:00.894759  3833 raft_consensus.cc:2393] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:00.911592  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:00.844276  6702 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:17:00.920809  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 62540.5us
I20260709 13:17:00.927739  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:00.895140  6699 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:00.880697  6660 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:00.958422  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 46508.9us
I20260709 13:17:00.885365  6746 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:00.950758  6515 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:00.938622  6619 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.965399  6743 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.966604  6768 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:00.895314  6432 consensus_queue.cc:260] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.012962  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:01.016960  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:01.036489  3806 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:00.980728  6764 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:01.038893  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:01.040468  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:01.042781  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.040329  6524 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:01.045971  3127 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:01.044698  3135 raft_consensus.cc:2376] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5. Re-sending same reply.
I20260709 13:17:01.049003  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:01.049666  3134 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:01.013264  6734 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:01.053467  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 125831us
I20260709 13:17:00.981241  6604 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:17:00.960598  6565 consensus_queue.cc:237] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.060741  3128 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:01.034789  6369 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:01.066404  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:01.067349  3131 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:01.041437  6748 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.076297  6730 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:00.985882  6755 consensus_queue.cc:237] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.052462  6427 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.046214  6524 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:01.104249  6766 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
W20260709 13:17:01.087544  6420 consensus_meta.cc:287] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.736s	user 0.005s	sys 0.006s
I20260709 13:17:01.011711  6743 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.071111  6734 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:01.076486  6765 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:01.102000  6432 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:01.142855  6767 log.cc:927] Time spent T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
W20260709 13:17:01.143579  6759 log.cc:927] Time spent T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:17:01.114735  6524 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.143987  6773 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:17:01.112636  6729 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:01.146543  6660 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:01.152047  6743 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:01.158010  6621 consensus_meta.cc:287] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.635s	user 0.006s	sys 0.006s
I20260709 13:17:01.104394  6774 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:01.161146  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 102043us
I20260709 13:17:01.116338  6427 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.181600  3127 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
W20260709 13:17:01.182992  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 68666.1us
I20260709 13:17:01.199615  3250 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:01.115365  6762 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:01.077628  6369 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.205459  6520 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:01.206712  6369 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:01.187203  6258 consensus_meta.cc:287] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.662s	user 0.010s	sys 0.001s
I20260709 13:17:01.168887  6722 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:01.160709  6765 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:01.124706  6730 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:17:01.200665  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:01.207458  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 351784us
I20260709 13:17:01.209012  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:01.125326  6420 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.212517  6765 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.214288  6427 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:01.222306  6643 consensus_meta.cc:287] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.579s	user 0.004s	sys 0.006s
I20260709 13:17:01.221484  6746 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:01.221594  6420 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:01.224913  6690 consensus_meta.cc:287] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.574s	user 0.005s	sys 0.005s
I20260709 13:17:01.211323  6766 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:01.222297  3206 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 8: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:01.229962  6766 raft_consensus.cc:697] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:01.230134  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8e1a4d71ef0f4287999b5ee60fe02740 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 13:17:01.231088  6766 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.231746  6423 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:01.222856  6727 consensus_meta.cc:287] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.000s
I20260709 13:17:01.233529  6722 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.234452  6727 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.234774  6638 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.234931  6727 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.212071  6762 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:01.204622  6621 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.237979  6762 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.240083  6404 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.208493  6734 consensus_queue.cc:1059] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:17:01.245988  6734 raft_consensus.cc:3055] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:01.246377  6734 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:01.247198  6734 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.248306  6702 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:01.223821  6771 log.cc:927] Time spent T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.126s	user 0.001s	sys 0.001s
I20260709 13:17:01.249164  6702 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.250576  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:01.251448  6751 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.435s	user 0.002s	sys 0.002s
I20260709 13:17:01.251497  6702 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:01.251816  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:01.252238  6702 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.208755  6774 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.253275  6725 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:01.253734  6725 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:01.254156  6725 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:01.242221  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:01.254670  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:01.254736  3833 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.252638  6420 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:01.177795  6748 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.256246  6420 raft_consensus.cc:697] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:01.257194  6420 consensus_queue.cc:237] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.248389  6734 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.259922  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:01.266011  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:01.266335  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:01.266752  3841 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:01.228955  6429 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:01.269299  6621 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:01.259397  6638 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:01.269295  6774 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:01.225790  6643 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.274680  3833 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:01.276732  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:01.219276  6726 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:01.280710  3276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:17:01.288491  3276 raft_consensus.cc:606] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:01.288959  3276 raft_consensus.cc:614] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:01.262259  6698 consensus_meta.cc:287] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.005s
I20260709 13:17:01.283751  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:01.285534  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:01.286285  6429 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:01.306224  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:01.286551  6769 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:17:01.228282  6427 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:17:01.292913  6693 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:01.322259  6643 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:01.322005  6693 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.308809  6698 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.241259  6690 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.325170  6726 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.326678  6690 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:01.327488  6726 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:01.328135  3204 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:17:01.209182  6775 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:17:01.329559  6775 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:01.329929  6775 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:01.330099  6661 raft_consensus.cc:3055] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:01.330550  6661 raft_consensus.cc:740] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:01.331557  6661 consensus_queue.cc:260] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.326679  6698 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:01.241644  6717 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.335371  6765 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.336786  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:01.337003  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:01.211670  6755 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:17:01.217559  6258 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.306999  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:01.344180  3207 raft_consensus.cc:2376] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 5. Re-sending same reply.
I20260709 13:17:01.286708  6520 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:01.306790  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:01.308055  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:01.345932  3206 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.264914  6425 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.310196  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:01.252749  6702 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.337611  3209 raft_consensus.cc:2393] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 8: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:01.338693  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:01.332938  6661 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:01.306764  6429 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.351303  3210 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:01.353323  3282 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:01.338445  6783 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.354467  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:01.354616  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:01.338043  6404 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:01.350600  6502 consensus_meta.cc:287] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.958s	user 0.012s	sys 0.001s
I20260709 13:17:01.360347  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:01.365057  3206 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:01.366277  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:01.366971  3206 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:17:01.354368  6429 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.396344  3276 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:01.398420  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:01.399518  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:01.400115  3284 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.367978  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:01.401681  3280 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:01.368294  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:01.352978  6425 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.404808  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:01.372267  6748 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:01.374191  3202 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:01.411542  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:01.355546  6520 raft_consensus.cc:697] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:01.381158  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:01.387192  6702 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:01.387884  6717 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:01.423630  3805 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:01.364416  6693 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:01.402642  3207 raft_consensus.cc:2393] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:01.403251  3279 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:01.357524  6783 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.407778  6192 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.393045  3835 raft_consensus.cc:2955] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 3 to 7, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:01.418707  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:01.479285  3210 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:17:01.423877  3285 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:01.440222  3278 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:17:01.480182  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:01.440641  6425 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:01.440317  6520 consensus_queue.cc:237] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.443286  6659 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:01.485229  6524 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.487435  6524 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:01.487556  3135 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:01.426735  6727 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:01.477341  6486 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.446156  6765 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:01.449952  3805 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:01.451859  6725 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.453325  6432 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:01.438112  6491 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:17:01.457053  3211 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:01.495523  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:01.368605  6775 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.463397  6258 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:01.468725  3127 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:01.470911  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:01.471175  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:01.504578  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:01.505043  3133 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.470885  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:01.506661  3249 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:01.417614  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:01.507730  3834 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:01.476544  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:01.476859  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:01.481343  3283 raft_consensus.cc:2368] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8.
I20260709 13:17:01.483566  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:01.508628  3841 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:01.484186  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:01.508787  3128 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.490247  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:01.491142  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:01.496227  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:01.401916  3206 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:17:01.497570  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:01.507032  3210 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:17:01.504464  3129 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:01.435308  6648 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.519595  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:01.524938  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 75072.4us
I20260709 13:17:01.475503  3284 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:01.488874  6486 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.527552  3279 raft_consensus.cc:2393] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:01.526348  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:01.539861  3834 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:17:01.529887  6695 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.530176  6775 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:01.547844  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:01.548511  3135 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:01.530584  3131 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:01.498358  6619 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:01.484200  6783 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:01.528280  3284 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:01.543018  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:01.544204  3208 raft_consensus.cc:2393] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:01.564805  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:01.565558  3279 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:01.545248  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:01.566998  3134 raft_consensus.cc:2393] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:01.524070  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:01.526598  3805 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:01.569417  3277 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:01.507421  6732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.012s	sys 0.011s
I20260709 13:17:01.549446  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:01.546993  3128 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:01.489048  6192 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.495335  6524 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:01.560211  3133 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:01.553576  6695 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.571861  6621 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:01.547379  6734 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:01.602461  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 75925.6us
I20260709 13:17:01.597402  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:01.597363  3282 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.605373  3210 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:01.568154  6258 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:01.607466  6192 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:01.615513  6565 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:01.553258  6755 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:01.635787  3177 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:01.578110  6717 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:01.598197  6732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.012s	sys 0.012s
I20260709 13:17:01.643220  6565 raft_consensus.cc:697] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:01.644573  6648 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:01.651171  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 53842.2us
I20260709 13:17:01.641757  3805 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
W20260709 13:17:01.757361  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 115715us
I20260709 13:17:01.758994  3805 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:01.555186  6730 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:17:01.566583  6502 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.773146  3282 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:01.776943  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:17:01.760957  3806 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.536s (SENT) [suppressed 15 similar messages]
W20260709 13:17:01.815999  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 55073.9us
I20260709 13:17:01.600756  6638 consensus_queue.cc:1059] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.175s
W20260709 13:17:01.814899  6767 log.cc:927] Time spent T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.197s	user 0.002s	sys 0.007s
I20260709 13:17:01.862958  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:01.818897  6619 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:01.818408  6727 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:01.866707  6766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.011s	sys 0.033s
I20260709 13:17:01.854612  6734 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:01.856587  6705 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.819111  6721 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
W20260709 13:17:01.875582  6789 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:17:01.874070  6727 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:01.880111  6747 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:01.872898  6778 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:01.856218  6731 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:17:01.852008  6502 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.871901  6619 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:01.881873  6766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.011s	sys 0.034s
I20260709 13:17:01.892977  6727 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.891213  6747 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:01.890529  6661 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:17:01.893818  6638 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.897464  6427 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.900672  6619 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.886526  6734 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.887375  6705 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:01.908671  6486 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:01.938966  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 181989us
I20260709 13:17:01.925246  6747 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:01.929643  6429 consensus_meta.cc:287] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.004s
I20260709 13:17:01.925560  6661 consensus_queue.cc:1243] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer 48080cf0460346769ab046a4f9457aa5 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:17:01.932528  6427 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.945328  6427 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:01.941486  6717 raft_consensus.cc:697] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:01.946978  6717 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.950634  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:01.940192  6788 log.cc:927] Time spent T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.083s	user 0.001s	sys 0.001s
I20260709 13:17:01.888180  6565 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.953689  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:01.956722  6800 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:01.929993  6638 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:01.952456  6429 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:01.966854  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 88276.8us
I20260709 13:17:01.971242  3176 leader_election.cc:400] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8.
I20260709 13:17:01.971748  3176 leader_election.cc:403] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:01.958743  6798 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:01.966305  6721 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.963868  6420 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:17:01.961349  6765 consensus_queue.cc:1059] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:17:01.993709  3100 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:01.996042  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:02.003189  6800 raft_consensus.cc:697] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:02.004746  6800 consensus_queue.cc:237] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.014458  6798 raft_consensus.cc:697] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:02.016011  6798 consensus_queue.cc:237] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.022071  6807 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:02.040246  6792 log.cc:927] Time spent T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:17:02.039940  6807 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.043139  6807 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:02.044691  6192 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:02.045369  6192 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.045819  6192 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:02.049453  6795 log.cc:927] Time spent T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:17:02.025642  6765 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8.
I20260709 13:17:02.024675  6425 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:17:02.061667  6807 raft_consensus.cc:3055] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:02.062418  6807 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:02.064159  6765 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:02.064504  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 433456us
I20260709 13:17:02.064875  6765 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.066741  6734 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:02.067806  6765 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:02.062034  6796 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:17:02.000505  6659 consensus_queue.cc:1059] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:17:01.999248  6721 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.080413  3206 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:17:02.075206  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 72389.4us
I20260709 13:17:02.035612  6502 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:02.052800  6803 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:02.093931  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 126817us
I20260709 13:17:02.095688  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:02.097450  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.105516  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.118599  3206 raft_consensus.cc:2410] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:02.114852  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.115991  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:02.120636  3279 raft_consensus.cc:2393] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 7: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:02.120450  3276 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:02.115361  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:02.111692  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:02.122879  3280 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.122975  3282 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.125114  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.129146  3277 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:02.132920  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.134684  3176 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:02.136682  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.137763  3281 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:17:02.140478  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.142145  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.142917  3278 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:02.097273  6653 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:02.126672  6659 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.116360  6773 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.063731  6807 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.156737  3282 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:02.127946  6705 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:02.321501  6775 consensus_meta.cc:287] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.755s	user 0.013s	sys 0.000s
I20260709 13:17:02.263602  6467 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:02.146541  6621 raft_consensus.cc:3055] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:02.262055  6729 consensus_queue.cc:1059] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:17:02.273217  3211 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:02.105098  6801 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.147s
I20260709 13:17:02.150779  6808 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:02.299403  6721 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:02.142424  6429 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:02.251534  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 99400.3us
I20260709 13:17:02.158764  6659 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.150622  6653 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.433310  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:02.157135  6258 raft_consensus.cc:697] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:02.434569  6729 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:02.160534  6638 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:02.117268  6803 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 13:17:02.253778  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.375187  6727 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.257665  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.452790  3285 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:02.251066  6773 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.277995  6690 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:02.207079  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 213540us
I20260709 13:17:02.258324  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.130597  6491 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 13:17:02.363999  6793 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.580s	user 0.000s	sys 0.002s
I20260709 13:17:02.365541  6425 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:02.367774  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.367786  3282 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:02.369268  6695 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:02.370764  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.374150  6731 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:02.451823  6775 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:02.391960  3805 leader_election.cc:336] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.873s (SENT)
I20260709 13:17:02.486712  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:02.391768  6619 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.405834  6778 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:02.314345  6807 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.117194  6427 consensus_queue.cc:1059] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:17:02.412794  3280 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:02.461519  6702 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:02.424810  6621 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:02.450732  3283 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:17:02.136238  6192 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.450229  6659 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:02.468449  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:02.473364  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:02.474458  3202 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:02.376408  6755 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.484580  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.484788  3284 raft_consensus.cc:2410] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:02.422009  6747 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.453987  6638 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:02.460932  6766 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.455454  6429 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:02.455636  6721 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:02.461134  6705 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.437794  6258 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.431734  3211 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:02.461318  6515 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:02.514254  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:02.506987  6778 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.524760  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.507098  6801 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:17:02.558238  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 165190us
I20260709 13:17:02.504915  6813 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.510932  6423 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.561704  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.470733  6690 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.562697  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.606457  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.490746  6425 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.584275  3203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2673) took 1305 ms. Trace:
I20260709 13:17:02.584748  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.505586  6775 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.554136  6820 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.600365  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.564239  6467 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:02.569432  6755 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.520766  6702 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.641598  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.642488  3211 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:02.643062  6702 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:02.606653  3204 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 5.
I20260709 13:17:02.643611  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.644294  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:02.644910  3204 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.646186  6725 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:02.645072  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:02.648128  3211 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.492120  6731 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.608850  3203 rpcz_store.cc:276] 0709 13:17:01.267250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.268250 (+  1000us) service_pool.cc:224] Handling call
0709 13:17:01.286600 (+ 18350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.286986 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.287015 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:01.391830 (+104815us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b2c00136548. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:17:01.392196 (+   366us) log.cc:844] Serialized 26 byte log entry
0709 13:17:01.543046 (+150850us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:01.543080 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.543144 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:02.363417 (+820273us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:02.572389 (+208972us) raft_consensus.cc:1685] finished
0709 13:17:02.572411 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.572569 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":170,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":17474,"spinlock_wait_cycles":84630272,"thread_start_us":150475,"threads_started":1,"wal-append.queue_time_us":225152}
I20260709 13:17:02.649271  6653 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:02.650373  6821 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:17:02.650254  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.650993  6731 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:02.615592  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:02.652215  6823 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:02.653831  3202 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:02.592598  6766 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.603935  6638 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.602324  6804 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.657384  6804 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.657897  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:02.658492  6766 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:02.602751  6621 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.625535  6819 consensus_queue.cc:1059] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:02.626472  6727 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:02.660074  3202 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:17:02.627630  6490 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:02.629755  6502 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:02.660509  3202 pending_rounds.cc:85] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 6
I20260709 13:17:02.662014  3202 pending_rounds.cc:107] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:17:02.662245  3202 raft_consensus.cc:2889] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:02.658509  3277 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.608824  6813 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.598218  6705 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.632428  6820 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.640323  6690 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:02.656859  3209 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:17:02.671955  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:02.672351  3202 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:17:02.673877  3202 pending_rounds.cc:85] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 5
I20260709 13:17:02.674269  3202 pending_rounds.cc:107] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:17:02.674590  3202 raft_consensus.cc:2889] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:02.591929  6429 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.591626  6721 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.683128  3203 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:02.660145  6819 raft_consensus.cc:3055] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:02.690793  6819 raft_consensus.cc:740] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:02.660310  6621 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.691525  6773 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:02.693117  6638 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:02.613740  6423 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.695127  6429 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:02.696597  6423 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:02.698683  6705 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:02.699927  6619 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:02.671703  6425 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:02.607743  6515 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.701807  6820 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:02.702739  3280 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:02.709192  3204 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:02.692185  6819 consensus_queue.cc:260] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.704274  6755 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.708591  3211 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:17:02.668324  3278 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:17:02.712183  3277 raft_consensus.cc:2410] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:02.714841  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.690871  6775 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:02.670614  6467 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.717582  3276 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.720770  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.723002  6721 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:02.723945  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:02.731319  3277 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:02.731642  3279 raft_consensus.cc:2368] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10.
I20260709 13:17:02.732936  3176 leader_election.cc:400] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10.
I20260709 13:17:02.733364  3176 leader_election.cc:403] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:17:02.720192  6819 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.734284  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:02.737658  6807 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.741112  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:02.741714  3283 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.745760  6807 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10.
I20260709 13:17:02.746130  6813 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:02.747831  6755 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:02.749897  6515 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:02.750437  6467 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:02.752226  3210 raft_consensus.cc:2410] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:02.736325  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.736480  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.754979  3279 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:02.755962  6747 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:02.756248  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.759200  3279 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:02.756620  6747 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.756978  6192 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:02.757835  6659 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.761641  6659 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.762940  3279 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:02.763002  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.763747  3203 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:17:02.760638  6747 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.764483  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.764662  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.765612  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.768126  3209 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:02.766862  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:02.793721  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:02.746129  6722 raft_consensus.cc:3055] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:02.800333  3835 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:02.780652  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:02.805599  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:02.806598  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:02.765919  3277 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:02.812515  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:02.813011  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:02.813927  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:02.814481  3277 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:02.815047  6813 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:02.815503  6813 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.815816  6813 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.815955  6705 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:02.816588  6705 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.818725  6705 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:02.812042  6192 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.819878  6192 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.798128  6621 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:02.825594  6621 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.828035  6621 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:02.824889  3285 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:02.831825  6807 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:02.769194  6515 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.835692  3206 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:17:02.822419  6192 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:02.849555  3134 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:02.779521  6467 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:02.796463  3276 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:02.841192  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:02.846055  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.853277  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.854027  3283 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:02.846022  3209 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:02.855942  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.857021  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:02.854826  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.858606  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:02.811879  6815 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.793457  6798 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:02.868525  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:02.867455  3135 raft_consensus.cc:3055] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:02.868863  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:02.873682  3135 raft_consensus.cc:740] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:02.874140  3209 raft_consensus.cc:2410] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 13 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:02.858636  3206 raft_consensus.cc:2410] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:17:02.870921  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:02.871464  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:02.806366  6722 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:02.837344  6775 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.791043  6778 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.922071  3277 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:02.923934  3129 raft_consensus.cc:1275] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:02.874459  3135 consensus_queue.cc:260] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.882211  3842 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:03.049801  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.049976  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:03.045310  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 179765us
I20260709 13:17:03.015177  3211 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:03.026443  3132 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:03.051581  3128 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 5.
I20260709 13:17:02.999701  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:03.009217  3134 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:03.024068  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.025730  3130 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:03.055691  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:02.856997  6467 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.926178  3209 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:03.056377  3133 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:03.056588  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.057339  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:03.058331  3133 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.059134  3129 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:03.054418  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:02.962839  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.057337  3130 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:03.054073  3100 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:03.062809  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:02.867432  6432 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.062712  3135 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:03.101423  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 47364.1us
I20260709 13:17:03.099093  3133 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:03.095717  3102 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:02.868355  6638 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.231s
I20260709 13:17:03.015358  6619 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:03.028618  6730 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:03.110678  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:02.881494  6766 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.998298  6747 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:02.857452  6515 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.873502  6836 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.921800  6659 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:03.020895  6813 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.994299  6775 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:02.930063  6490 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.006295  6768 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:03.130259  3211 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:03.040463  6423 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:02.924911  6798 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:02.881621  6502 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.246s
I20260709 13:17:03.025884  6722 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:03.186995  3203 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:03.003567  6837 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.155s
I20260709 13:17:02.924206  6815 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:03.102882  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:03.176175  3277 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:03.101540  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 243036us
I20260709 13:17:03.098865  6467 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:03.146791  6846 log.cc:927] Time spent T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:17:03.183842  3134 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:03.110669  6820 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:03.148761  6838 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:17:03.121011  6807 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:17:03.122242  6783 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:03.147322  6844 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:17:03.209997  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.131944  6425 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:03.212235  6690 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.152189  6730 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:03.155233  6766 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:03.121364  6432 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:03.227276  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 124543us
I20260709 13:17:03.225972  6722 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:03.183802  6725 consensus_queue.cc:1059] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:17:03.247575  3205 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:03.187294  6768 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:03.235330  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 317294us
I20260709 13:17:03.237974  3133 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:03.240638  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.225255  6783 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.185635  6490 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:03.239456  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.246250  6778 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:03.246389  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:03.266495  3132 raft_consensus.cc:2393] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:03.198666  6423 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:03.246942  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.269845  3135 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:03.236295  3211 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:03.240921  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.232661  6659 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:03.271535  6659 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.271565  3129 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:03.272145  6659 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.183284  6836 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:03.246798  6705 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.263779  3130 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:03.244901  6747 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:03.275420  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.280916  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.224877  6820 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:03.263981  6783 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.260473  6835 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.251619  6638 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:03.267081  6725 consensus_queue.cc:1243] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer fc48eecc27554cb58b15193cd442b1d3 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:03.292163  3130 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 10. Current term is 11. Ops: [6.4-10.6]
I20260709 13:17:03.235663  6690 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:03.288936  3283 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:03.301355  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:03.240738  6730 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:03.312263  6730 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:03.273209  6653 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:03.313378  6653 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:03.315624  6653 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:03.307612  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.318234  6490 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:03.319667  6423 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:03.330475  6515 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:03.336697  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 155720us
I20260709 13:17:03.342535  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:03.343341  3130 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:03.343847  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:03.348269  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.292825  6778 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 13:17:03.354938  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 143203us
I20260709 13:17:03.288599  6747 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:03.359323  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:03.357878  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 113112us
I20260709 13:17:03.366235  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:03.362141  3100 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:03.290879  6705 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:03.304711  6638 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:03.374759  3130 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:03.303222  6835 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:03.387530  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.388167  3832 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:17:03.386340  3128 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:03.393306  3835 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:03.393661  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.363500  6813 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:03.400421  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.401249  3832 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:03.402141  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.405434  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.407573  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.407784  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.409096  3127 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:03.408509  3130 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
W20260709 13:17:03.414710  6850 log.cc:927] Time spent T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:17:03.390980  6798 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:03.428654  6432 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:03.434283  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.396795  6832 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:03.438632  3135 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
W20260709 13:17:03.435587  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 70262.3us
I20260709 13:17:03.378517  6847 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:17:03.397558  6815 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:03.440032  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 63606.2us
I20260709 13:17:03.440146  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.401487  6775 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:03.403788  6768 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:03.446807  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.416576  6857 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.446882  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.417006  6813 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:03.432377  6619 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:03.458632  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:03.448387  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 55153.9us
I20260709 13:17:03.451177  3130 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
W20260709 13:17:03.454898  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.455858  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.454979  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:03.434245  6766 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:03.462234  3132 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.430461  6820 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:03.459995  3133 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:03.473608  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.475064  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:03.475728  3133 raft_consensus.cc:2368] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10.
I20260709 13:17:03.479322  6873 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:03.480557  6873 consensus_queue.cc:1243] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:03.483657  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:03.489219  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.463579  6619 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:03.489916  3135 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:17:03.518440  3133 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:17:03.521984  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:03.522967  3129 raft_consensus.cc:2376] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9. Re-sending same reply.
I20260709 13:17:03.467276  6833 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:03.528400  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 86943.4us
I20260709 13:17:03.528626  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:03.530391  3135 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:03.494194  3100 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:03.540732  3135 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:03.542119  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:03.487721  6747 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:03.550375  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 56315.7us
I20260709 13:17:03.469754  6815 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:17:03.513733  6690 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:03.469830  6863 consensus_queue.cc:1059] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:17:03.529392  6429 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:03.547736  6869 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:03.553200  3132 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:03.458563  6857 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:03.562592  3129 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:03.578230  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.562752  3100 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:03.579653  3135 raft_consensus.cc:2376] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11. Re-sending same reply.
I20260709 13:17:03.573942  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:03.559880  6800 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.567405  6747 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:03.548554  6833 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:03.569851  6870 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.596681  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.603134  3135 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:03.574815  6869 raft_consensus.cc:697] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:03.606863  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:03.613004  6864 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 13:17:03.615556  6865 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:17:03.617038  6880 raft_consensus.cc:3055] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:03.617559  6880 raft_consensus.cc:740] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:03.618458  6880 consensus_queue.cc:260] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:03.619845  6880 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:03.622031  6859 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:17:03.627892  6857 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:03.628554  6857 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.629453  3129 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:03.574129  6863 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:17:03.592439  6638 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:03.630566  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:03.644548  3133 raft_consensus.cc:2376] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11. Re-sending same reply.
I20260709 13:17:03.635847  3250 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:03.647060  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:03.649195  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:03.610972  6807 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:03.664553  6807 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.665059  6807 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.669194  6693 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.607621  6870 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:03.671556  6870 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:03.672451  6869 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:03.673256  6820 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:03.673363  6638 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:03.674074  6638 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:03.674428  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:03.674532  6638 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:03.675757  3250 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:03.676707  6766 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:03.677394  6486 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:17:03.678689  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:03.608325  6835 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:03.682721  6732 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:03.684160  6732 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:03.684541  6693 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:03.688306  6856 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:17:03.688402  6868 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:03.689534  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:03.604393  6705 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:03.690426  6766 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:03.597193  6800 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:03.690860  6766 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.691018  3250 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:03.691301  6766 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.691972  6768 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:03.692368  6768 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:03.692736  6768 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:03.695499  6659 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:03.697404  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2693) took 1187 ms. Trace:
I20260709 13:17:03.697690  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:03.697841  3202 rpcz_store.cc:276] 0709 13:17:02.509714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.679437 (+169723us) service_pool.cc:224] Handling call
0709 13:17:02.679756 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.710123 (+ 30367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.710173 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.710235 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:02.710288 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.697185 (+986897us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b54002a71d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:03.697230 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.697350 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69191040}
I20260709 13:17:03.698657  6775 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:03.699148  6775 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.699182  3250 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:03.699643  6775 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:03.704396  6258 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:03.704908  6258 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.705188  6848 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.705407  6258 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:03.706346  3132 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: []
W20260709 13:17:03.706378  3806 leader_election.cc:336] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.536s (SENT)
I20260709 13:17:03.684003  6783 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:03.713884  3806 leader_election.cc:400] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10.
I20260709 13:17:03.714234  3806 leader_election.cc:403] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:17:03.713727  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:03.716279  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:03.717927  3101 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:03.711490  3250 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:03.661737  6817 raft_consensus.cc:3055] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:03.692961  6800 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:03.629038  6857 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:03.647890  6690 consensus_queue.cc:1059] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.106s
W20260709 13:17:03.768705  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 54948.9us
I20260709 13:17:03.722627  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:03.662168  6873 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:03.769304  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 206623us
W20260709 13:17:03.791148  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.808004  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 85454.7us
I20260709 13:17:03.677412  6820 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.851151  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.899379  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2672) took 2603 ms. Trace:
I20260709 13:17:03.833211  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1319) took 1375 ms. Trace:
I20260709 13:17:03.899780  3205 rpcz_store.cc:276] 0709 13:17:01.266762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.266910 (+   148us) service_pool.cc:224] Handling call
0709 13:17:01.291944 (+ 25034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.250496 (+1958552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.869638 (+619142us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b540027c254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:03.869894 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4497108224}
I20260709 13:17:03.832162  3277 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:03.840910  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:03.850168  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.902009  3281 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:17:03.850723  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.824322  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.834081  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:03.903806  3833 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:17:03.904820  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:03.824747  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.929471  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:03.858078  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1320) took 1398 ms. Trace:
I20260709 13:17:03.930208  3207 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:03.809057  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:03.930544  3278 rpcz_store.cc:276] 0709 13:17:02.459700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.487005 (+ 27305us) service_pool.cc:224] Handling call
0709 13:17:03.857775 (+1370770us) spinlock_profiling.cc:243] Waited 56.2 ms on lock 0x7b540042c554. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:03.857978 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129201536}
I20260709 13:17:03.867175  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:03.930325  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:03.931653  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 122695us
I20260709 13:17:03.932005  3211 pending_rounds.cc:85] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 4
I20260709 13:17:03.932348  3211 pending_rounds.cc:107] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:17:03.932628  3211 raft_consensus.cc:2889] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:03.932660  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.933136  3177 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:03.868767  6856 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:17:03.833789  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1324) took 1321 ms. Trace:
I20260709 13:17:03.938963  3280 rpcz_store.cc:276] 0709 13:17:02.512139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.600027 (+ 87888us) service_pool.cc:224] Handling call
0709 13:17:03.833611 (+1233584us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b5400002154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:03.833734 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201396608}
I20260709 13:17:03.940320  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:03.721104  6693 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:03.813210  6858 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.944101  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:03.830009  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:03.819079  6520 raft_consensus.cc:3055] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:03.723100  6467 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:03.947136  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:03.802713  6874 consensus_queue.cc:1059] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.226s
I20260709 13:17:03.943634  6820 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:17:03.950501  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:03.950750  6467 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:03.726869  6817 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:03.907927  6705 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:03.909391  6879 log.cc:927] Time spent T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:17:03.810832  6425 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:03.910197  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.911652  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:03.913499  6783 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:03.915326  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 2687) took 1431 ms. Trace:
I20260709 13:17:03.898782  6659 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:03.909463  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.920193  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.946590  6565 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:03.924197  3841 raft_consensus.cc:2410] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:17:03.711802  6747 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:17:03.926762  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.927881  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:03.822175  6887 log.cc:927] Time spent T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:17:03.952648  6705 raft_consensus.cc:3055] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:03.893546  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:03.899901  3276 rpcz_store.cc:276] 0709 13:17:02.458161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.468187 (+ 10026us) service_pool.cc:224] Handling call
0709 13:17:03.832960 (+1364773us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400318654. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:03.833106 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359918976}
I20260709 13:17:03.975246  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:03.812700  6837 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.147s
I20260709 13:17:03.934589  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:03.929911  3251 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:03.979828  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 50026.9us
I20260709 13:17:03.712867  6848 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:03.902670  3832 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:17:03.725121  6815 raft_consensus.cc:2764] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:17:03.980002  3100 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:03.987138  3102 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:03.942224  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:03.844815  6862 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:03.994611  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:03.995632  3280 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:03.849411  6799 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.851972  6834 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:03.945245  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.945981  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:04.024756  3277 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:17:03.828649  6833 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:03.812436  6804 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:04.031896  3834 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:03.974285  6705 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:03.895488  6873 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.951069  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:03.952020  6725 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:03.866183  6836 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:03.997711  6467 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:03.945611  3285 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:03.724661  6768 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:03.921806  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:04.007319  6621 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:03.963814  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:03.965576  3177 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:03.944584  6693 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.967435  3209 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:17:03.724857  6192 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.057017  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:04.036130  6869 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:03.784859  6878 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.230s
I20260709 13:17:03.930189  6803 consensus_queue.cc:1059] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:17:03.972409  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:03.946622  6520 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:03.977209  3276 raft_consensus.cc:1217] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[5.3-10.5]   Dedup: 5.3->[8.4-10.5]
I20260709 13:17:03.893779  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1336) took 1020 ms. Trace:
W20260709 13:17:03.978704  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 85441.9us
I20260709 13:17:03.944208  6886 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:03.724485  6423 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:04.063553  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:04.002708  3280 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:17:04.003306  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 360371us
I20260709 13:17:04.063055  3283 rpcz_store.cc:276] 0709 13:17:02.872989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.876800 (+  3811us) service_pool.cc:224] Handling call
0709 13:17:03.893596 (+1016796us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54004358d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:03.893711 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539660160}
I20260709 13:17:03.966816  6565 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.019946  3832 raft_consensus.cc:2393] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:04.022712  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:04.026006  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 46090.5us
I20260709 13:17:04.066161  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:04.027853  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1654) took 1295 ms. Trace:
I20260709 13:17:03.946023  3279 raft_consensus.cc:2393] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:04.034122  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.986300  6425 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:04.068279  3835 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:04.075767  6425 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:04.076260  6425 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:04.059913  6869 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.066927  6890 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.078966  6890 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:03.996438  6695 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.080556  6695 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.081204  6695 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.081624  6890 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:04.076956  6869 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:04.042086  6807 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:04.084761  6705 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:03.962519  3210 rpcz_store.cc:276] 0709 13:17:02.483921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.612886 (+128965us) service_pool.cc:224] Handling call
0709 13:17:03.915045 (+1302159us) spinlock_profiling.cc:243] Waited 78.2 ms on lock 0x7b5400246b54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:03.915239 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179791232}
I20260709 13:17:04.086349  6888 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:04.086808  3101 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:04.087603  6878 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.087996  6878 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:04.088330  6878 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.088727  6857 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:04.089349  6524 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:04.089879  3806 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:04.090471  6872 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:04.091044  6836 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:04.091678  6638 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:04.091885  6775 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:04.086815  6807 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:04.094308  6775 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:04.094491  6524 consensus_queue.cc:1059] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:04.094934  6775 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:04.095731  6836 raft_consensus.cc:3055] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:04.096127  6836 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:04.097124  6836 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:04.098276  6705 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.098573  6836 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.057229  6693 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.100679  3203 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 6: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:04.056502  3209 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:03.968370  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:03.996587  6490 consensus_queue.cc:1059] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:17:04.102811  3838 raft_consensus.cc:2393] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:04.103129  6490 raft_consensus.cc:3055] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:04.103518  6490 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:04.058750  3205 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:04.055114  6467 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:04.108676  6467 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:04.061896  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 96407.1us
I20260709 13:17:04.060066  6621 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:04.111416  6621 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:04.112371  3210 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:04.114176  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:04.114953  3205 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:04.044755  6862 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:04.049438  6835 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:04.118422  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:04.039824  6873 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.985466  3251 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:04.063040  3276 pending_rounds.cc:85] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 3
I20260709 13:17:04.120337  3276 pending_rounds.cc:107] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:17:04.120642  3276 raft_consensus.cc:2889] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:04.043689  6755 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:04.047284  6725 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:04.071092  6520 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:04.074115  3832 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:04.074476  6871 log.cc:927] Time spent T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.595s	user 0.001s	sys 0.003s
I20260709 13:17:04.057289  6192 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.067868  3206 rpcz_store.cc:276] 0709 13:17:02.732776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.926735 (+193959us) service_pool.cc:224] Handling call
0709 13:17:03.060338 (+133603us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:03.061440 (+  1102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:03.061482 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:03.063528 (+  2046us) log.cc:844] Serialized 52 byte log entry
0709 13:17:03.295096 (+231568us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:03.317295 (+ 22199us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.317700 (+   405us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.317861 (+   161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.317930 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:03.687579 (+369649us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:04.027549 (+339970us) raft_consensus.cc:1685] finished
0709 13:17:04.027582 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.027779 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23265,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":4261,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":4250,"spinlock_wait_cycles":9293184,"thread_start_us":137729,"threads_started":1,"wal-append.queue_time_us":223513}
W20260709 13:17:04.120478  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 135073us
I20260709 13:17:04.062229  3208 raft_consensus.cc:1240] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:04.386372  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1569) took 1147 ms. Trace:
W20260709 13:17:04.406981  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.633874  3136 rpcz_store.cc:276] 0709 13:17:03.238513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.238651 (+   138us) service_pool.cc:224] Handling call
0709 13:17:03.246694 (+  8043us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:03.361921 (+115227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:03.361949 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:03.375435 (+ 13486us) log.cc:844] Serialized 26 byte log entry
0709 13:17:03.470714 (+ 95279us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:03.514485 (+ 43771us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.574899 (+ 60414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.574999 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:04.073768 (+498769us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:04.210723 (+136955us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b1800488500. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:04.386027 (+175304us) raft_consensus.cc:1685] finished
0709 13:17:04.386054 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.386253 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14528,"prepare.queue_time_us":33353,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":3155,"raft.queue_time_us":61521,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":10528,"spinlock_wait_cycles":19338240,"thread_start_us":225135,"threads_started":3,"wal-append.queue_time_us":86052}
W20260709 13:17:04.432271  3135 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.026s	sys 0.036s
W20260709 13:17:04.636318  3135 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.027s	sys 0.037s
I20260709 13:17:04.636687  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:04.459734  3838 raft_consensus.cc:2410] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:04.491462  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:04.643378  3132 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:04.643594  6911 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.643877  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:04.644188  6911 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:04.645195  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:04.646450  6911 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:04.499778  3102 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:04.647415  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 147775us
I20260709 13:17:04.648439  3279 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:17:04.541590  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.547879  3205 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:04.549346  6892 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.566118  3130 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:04.651980  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:04.566150  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 71573.5us
W20260709 13:17:04.654502  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.655205  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.655642  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.139746  6192 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.218130  6425 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:04.852771  6425 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:04.120175  6423 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:04.175212  6258 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:04.533363  6429 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:05.022154  6429 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:05.025439  3278 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:05.027679  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2533) took 1118 ms. Trace:
I20260709 13:17:05.028039  3278 rpcz_store.cc:276] 0709 13:17:03.908917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.956802 (+ 47885us) service_pool.cc:224] Handling call
0709 13:17:05.027444 (+1070642us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54004358d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:05.027614 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2218872576}
I20260709 13:17:04.384361  6515 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:04.104542  6490 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:04.151214  6520 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.036206  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:05.039093  6258 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:05.039884  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.067934  6565 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:04.143829  6725 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:04.167155  6638 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:04.117729  6747 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:04.219650  6768 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:04.096320  6775 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.061s
W20260709 13:17:04.327983  6854 log.cc:927] Time spent T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.931s	user 0.000s	sys 0.006s
I20260709 13:17:04.145715  6848 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:04.237254  6858 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10.
I20260709 13:17:04.175566  6873 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:04.218912  6862 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.067312  6873 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:04.260602  6866 log.cc:927] Time spent T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.783s	user 0.001s	sys 0.003s
I20260709 13:17:04.220209  6695 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:04.216037  6693 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.076478  6693 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:04.030040  6799 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.078657  3841 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:04.136641  6690 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.495535  6486 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.088696  6486 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.090191  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:04.059949  6820 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.223516  6653 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:05.096171  6653 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:04.138147  6755 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:04.062399  6812 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:04.021306  6766 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:04.152782  6619 consensus_meta.cc:287] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.619s	user 0.005s	sys 0.008s
I20260709 13:17:05.101696  6619 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.102268  6755 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:05.102301  6766 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:05.103929  6619 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:04.121363  6835 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:05.105329  6835 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.517855  6491 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.119590  6491 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:04.425817  6817 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:04.223412  6869 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:04.666194  3100 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:05.130514  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 464439us
I20260709 13:17:05.128687  6869 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:04.490574  6861 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:04.030201  6834 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.133912  3100 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:05.134702  6404 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:05.135067  6404 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:05.135157  6834 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:05.135450  6404 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:04.605023  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 537443us
I20260709 13:17:04.605850  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.136504  3128 raft_consensus.cc:2376] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10. Re-sending same reply.
I20260709 13:17:05.132592  6861 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.137279  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:05.138190  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:05.138784  3128 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:04.605890  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 227210us
I20260709 13:17:05.139390  6861 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.139618  6491 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.139834  3177 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
W20260709 13:17:05.142036  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.136891  3840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 668) took 1229 ms. Trace:
I20260709 13:17:04.610932  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:04.637212  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 430) took 1028 ms. Trace:
I20260709 13:17:05.142882  3840 rpcz_store.cc:276] 0709 13:17:03.907075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.910783 (+  3708us) service_pool.cc:224] Handling call
0709 13:17:03.911122 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.135931 (+1224809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.135962 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.136126 (+   164us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:05.136165 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.136678 (+   513us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400000d54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:05.136715 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.136822 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2816300800}
I20260709 13:17:05.145267  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:04.669994  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:04.674674  3132 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:04.668787  6892 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.146503  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.144155  6803 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.147945  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:04.705466  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:05.148515  6803 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:04.699653  3283 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:04.707137  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:05.150734  6803 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:04.712611  6912 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.151448  6912 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.151958  6803 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:05.152420  6803 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:05.154038  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:04.719678  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:04.727294  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 424) took 1235 ms. Trace:
I20260709 13:17:04.721518  6909 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.761971  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:04.755230  6888 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:04.778664  6915 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:04.797559  3249 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:05.178880  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:04.800908  6836 consensus_queue.cc:1059] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:04.828779  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:04.836848  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:04.841776  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2697) took 2279 ms. Trace:
I20260709 13:17:04.577860  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:04.914798  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 174077us
I20260709 13:17:05.187033  3134 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:17:04.924819  6524 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:05.186745  3204 rpcz_store.cc:276] 0709 13:17:02.562022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.726440 (+164418us) service_pool.cc:224] Handling call
0709 13:17:02.734524 (+  8084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.768375 (+ 33851us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:03.064317 (+295942us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.211247 (+146930us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.482788 (+271541us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b1800406540. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b90ff455 00007fb3bc1e7060 00007fb3bc1f9716 00007fb3bc20a287 00007fb3bc20a208
0709 13:17:03.516032 (+ 33244us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.516273 (+   241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:03.516324 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:03.516388 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.841375 (+1324987us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b54003750d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:04.841444 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.841705 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":350872,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":135,"raft.queue_time_us":115812,"raft.run_cpu_time_us":479,"raft.run_wall_time_us":13651,"spinlock_wait_cycles":86943360,"thread_start_us":377745,"threads_started":3,"wal-append.queue_time_us":212894,"wal-append.run_cpu_time_us":3504,"wal-append.run_wall_time_us":1284177}
I20260709 13:17:02.510558  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:04.943851  6922 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.203212  6922 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.204512  6817 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.205552  6922 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:04.947458  6872 raft_consensus.cc:697] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:05.206972  6872 consensus_queue.cc:237] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.209244  3834 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.952916  6467 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.214251  6467 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:04.954849  3205 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:05.185537  6888 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.959098  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:05.227205  3206 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:05.228219  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:05.228986  3206 raft_consensus.cc:2410] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:04.959970  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:05.229478  3207 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:05.230283  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:04.960893  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:04.961483  6882 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:04.964867  6192 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:04.965394  6860 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:04.966033  6885 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:04.966272  6874 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:04.970281  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:04.971969  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:05.249550  3834 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:17:05.250053  3208 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 7.
I20260709 13:17:05.001430  3030 catalog_manager.cc:5697] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 7 to 12, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 12 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:05.031873  6515 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.046831  3278 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:05.048147  6490 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.255155  3030 catalog_manager.cc:5697] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 6 to 9, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 9 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:05.256891  3030 catalog_manager.cc:5697] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 6 to 7, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 7 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:05.258378  3030 catalog_manager.cc:5697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 2 to 9, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 9 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:05.053949  6725 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.049485  6423 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.261829  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:05.061667  3032 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38218 (request call id 242) took 28168 ms (client timeout 15000 ms). Trace:
I20260709 13:17:05.261500  6725 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.072464  6565 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.264423  6725 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.264737  6565 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.082175  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 538) took 1165 ms. Trace:
I20260709 13:17:05.266847  6515 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:05.267058  3841 rpcz_store.cc:276] 0709 13:17:03.916301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.073007 (+156706us) service_pool.cc:224] Handling call
0709 13:17:04.073366 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.078981 (+1005615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.080791 (+  1810us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54005e74d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:05.082098 (+  1307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2311096704}
I20260709 13:17:05.081202  6695 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:05.086321  6429 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.270190  6429 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.087931  6690 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:05.270833  6690 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.081830  6799 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.094681  6820 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.275228  6820 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:05.101195  3281 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 10: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:05.276620  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2525) took 1437 ms. Trace:
I20260709 13:17:05.277055  3281 rpcz_store.cc:276] 0709 13:17:03.839442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.934262 (+ 94820us) service_pool.cc:224] Handling call
0709 13:17:05.276361 (+1342099us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001ea354. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:05.276540 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2578838784}
I20260709 13:17:05.109174  3209 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:05.278903  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2719) took 1167 ms. Trace:
I20260709 13:17:05.279222  3209 rpcz_store.cc:276] 0709 13:17:04.111431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.418897 (+307466us) service_pool.cc:224] Handling call
0709 13:17:04.419263 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.278118 (+858855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.278668 (+   550us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54002a6cd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:05.278845 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586073984}
I20260709 13:17:05.112634  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:05.281262  3211 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:05.122249  3838 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:05.114261  6747 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.124461  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:05.284147  3280 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.100021  6653 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:04.158319  6878 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.129330  3127 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:17:05.322216  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:05.323282  3127 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 6: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:05.324421  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:04.403429  6868 raft_consensus.cc:3055] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:05.327929  6868 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:05.131397  6873 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:05.328924  6873 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.329378  6873 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.332728  6872 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:05.132752  6832 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:05.333369  6872 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.334966  6868 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.335824  6872 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:04.216427  6880 consensus_meta.cc:287] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.000s
I20260709 13:17:04.652793  3130 raft_consensus.cc:2376] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9. Re-sending same reply.
I20260709 13:17:05.148149  6892 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:04.704591  3282 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:05.338019  6425 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.154279  6912 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:05.338429  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.144289  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:05.338534  6425 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.339143  3130 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:05.154659  6910 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.340114  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:05.160565  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.340643  3136 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
W20260709 13:17:05.340842  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.341274  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.341656  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:05.342247  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:05.342998  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:05.161037  6862 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.344012  6862 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.345709  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:05.347069  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:05.347502  6862 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:05.154069  6803 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.349409  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:05.352646  6425 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.162714  6404 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:05.179045  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 381567us
I20260709 13:17:05.353725  3249 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:05.354861  6404 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.355010  3249 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:05.355685  3133 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:04.805590  6918 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:17:05.182956  6732 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.183988  6857 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.182363  6886 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.184291  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:05.184854  3176 connection.cc:256] RPC call timeout handler was delayed by -1.0066484960000253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
I20260709 13:17:05.172536  3131 rpcz_store.cc:276] 0709 13:17:03.491502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.492341 (+   839us) service_pool.cc:224] Handling call
0709 13:17:03.492613 (+   272us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:03.529662 (+ 37049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:03.529689 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:03.553273 (+ 23584us) log.cc:844] Serialized 52 byte log entry
0709 13:17:03.711502 (+158229us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:03.753484 (+ 41982us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.781969 (+ 28485us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.782200 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.782312 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:03.863576 (+ 81264us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b4800080058. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1118aa1 00007fb3c110fb37 00007fb3c110f9ca 00007fb3c120726f 00007fb3c1206f37 00007fb3c121b55c 00007fb3c121b508 00007fb3c121b488 00007fb3c121b443 00007fb3c121a6ec 00007fb3c0144a96
0709 13:17:04.724189 (+860613us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b18003f7900. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90d02a6 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1
0709 13:17:04.724840 (+   651us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b18003f7900. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:04.727008 (+  2168us) raft_consensus.cc:1685] finished
0709 13:17:04.727033 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.727213 (+   180us) inbound_call.cc:177] Queueing success response
0709 13:17:04.920901 (+193688us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b18003f7900. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
Metrics: {"mutex_wait_us":20949,"prepare.queue_time_us":82241,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":92,"raft.queue_time_us":27962,"raft.run_cpu_time_us":1613,"raft.run_wall_time_us":97017,"spinlock_wait_cycles":114562560,"thread_start_us":140296,"threads_started":1,"wal-append.queue_time_us":195366}
I20260709 13:17:05.184937  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.191095  6524 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.189424  3284 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 10: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:05.192037  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:05.191757  6486 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:05.195324  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.192592  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:05.197597  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:05.200333  6858 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:05.217423  6890 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.184319  6909 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:04.958124  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:05.218089  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:05.180737  6638 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:05.180972  6520 consensus_queue.cc:1059] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:17:05.186451  6766 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:05.184711  6621 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.218137  6888 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.222424  6491 raft_consensus.cc:3055] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:05.370435  6491 raft_consensus.cc:740] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:05.226434  6467 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.357304  6913 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:05.371583  6491 consensus_queue.cc:260] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.224282  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:05.357991  6857 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.376266  6857 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.246063  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:05.240510  6768 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.377341  3202 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:05.186051  6835 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.253726  6192 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.253901  6874 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.254091  6860 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.379987  6835 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:05.381609  6860 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:05.241014  6882 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.381649  6874 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.358104  6918 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:05.383061  6909 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:05.383589  6882 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:05.358510  6886 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.255168  3251 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:05.083748  3833 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:05.265393  3837 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 10: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
W20260709 13:17:05.262511  3032 rpcz_store.cc:269] 0709 13:16:36.894005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.894383 (+   378us) service_pool.cc:224] Handling call
0709 13:17:05.061537 (+28167154us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:59.738613 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:59.741692 (+  3079us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:59.741743 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:16:59.741791 (+    48us) tablet.cc:662] Decoding operations
0709 13:16:59.748206 (+  6415us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:59.748276 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:59.748303 (+    27us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:16:59.993921 (+245618us) tablet.cc:701] Row locks acquired
0709 13:17:00.010831 (+ 16910us) write_op.cc:260] PREPARE: finished
0709 13:17:00.063620 (+ 52789us) write_op.cc:270] Start()
0709 13:17:00.095192 (+ 31572us) write_op.cc:276] Timestamp: P: 1783603020041891 usec, L: 0
0709 13:17:00.095240 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:17:00.281311 (+186071us) log.cc:844] Serialized 9354 byte log entry
0709 13:17:00.678583 (+397272us) op_driver.cc:464] REPLICATION: finished
0709 13:17:00.884365 (+205782us) write_op.cc:301] APPLY: starting
0709 13:17:00.884470 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:00.949320 (+ 64850us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:00.957885 (+  8565us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:01.137257 (+179372us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:01.138056 (+   799us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 13:17:01.138143 (+    87us) write_op.cc:312] APPLY: finished
0709 13:17:01.138926 (+   783us) log.cc:844] Serialized 164 byte log entry
0709 13:17:01.139189 (+   263us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:01.139493 (+   304us) write_op.cc:454] Released schema lock
0709 13:17:01.139602 (+   109us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:01.188006 (+ 48404us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:01.189864 (+  1858us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":69086,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":205390,"apply.run_cpu_time_us":13353,"apply.run_wall_time_us":255946,"num_ops":24,"prepare.queue_time_us":168615,"prepare.run_cpu_time_us":57088,"prepare.run_wall_time_us":708380,"raft.queue_time_us":106862,"raft.run_cpu_time_us":20695,"raft.run_wall_time_us":99826,"replication_time_us":576277,"thread_start_us":426933,"threads_started":4,"wal-append.queue_time_us":283941,"wal-append.run_cpu_time_us":20915,"wal-append.run_wall_time_us":1578922}]]}
W20260709 13:17:05.266404  3250 leader_election.cc:336] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.565s (SENT)
I20260709 13:17:05.358907  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:05.386489  3250 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:05.387490  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 121120us
I20260709 13:17:05.387581  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:05.290422  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:05.361595  3134 raft_consensus.cc:2393] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 7: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:17:05.294786  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 587707us
I20260709 13:17:05.288154  3030 catalog_manager.cc:5697] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 5 to 6, term changed from 4 to 9, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68), VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New cstate: current_term: 9 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:05.298559  6653 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.391963  6909 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:05.392612  3837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 667) took 1485 ms. Trace:
I20260709 13:17:05.392970  3837 rpcz_store.cc:276] 0709 13:17:03.906762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.909943 (+  3181us) service_pool.cc:224] Handling call
0709 13:17:05.392417 (+1482474us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540064ebd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:05.392552 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2996355968}
I20260709 13:17:05.365270  3277 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:05.368710  3205 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.394556  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:05.362802  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:05.308745  3276 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:17:05.370167  3204 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.306046  3280 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:05.294269  6747 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.368805  6638 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.397152  6913 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:05.386220  3206 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:05.397943  6913 raft_consensus.cc:697] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:05.399189  6747 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:05.398833  6913 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.333874  6832 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:05.369431  6520 raft_consensus.cc:3055] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:05.295281  6429 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:17:05.399787  6832 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:05.399876  6520 raft_consensus.cc:740] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:05.144202  3135 rpcz_store.cc:276] 0709 13:17:03.608747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.608943 (+   196us) service_pool.cc:224] Handling call
0709 13:17:03.609324 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:03.611897 (+  2573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:03.611940 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:03.645318 (+ 33378us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.365841 (+720523us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b4800080058. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1118aa1 00007fb3c110fb37 00007fb3c110f9ca 00007fb3c120726f 00007fb3c1206f37 00007fb3c121b55c 00007fb3c121b508 00007fb3c121b488 00007fb3c121b443 00007fb3c121a6ec 00007fb3c0144a96
0709 13:17:04.636760 (+270919us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:04.636809 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.636889 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:04.636930 (+    41us) raft_consensus.cc:1685] finished
0709 13:17:04.636940 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.637149 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2161,"raft.queue_time_us":68244,"raft.run_cpu_time_us":4058,"raft.run_wall_time_us":688100,"spinlock_wait_cycles":64849664,"thread_start_us":900953,"threads_started":1,"wal-append.queue_time_us":535250}
I20260709 13:17:05.360092  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.401686  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.339790  6910 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.370021  6621 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.395576  3030 catalog_manager.cc:5697] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 2 to 6, term changed from 6 to 7, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:05.342327  6817 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.404496  6817 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.405512  6621 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.405627  6910 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:05.343436  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:05.406394  3210 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:05.406523  6817 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.407075  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.407284  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:05.407936  3136 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:05.362246  6524 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:04.714331  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:05.408805  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:05.342315  3130 raft_consensus.cc:2368] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10.
I20260709 13:17:05.401031  6520 consensus_queue.cc:260] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.176479  6812 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:05.385906  6886 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.410430  6874 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:05.408334  3030 catalog_manager.cc:5697] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:05.237258  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:05.357715  6732 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.356959  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:05.248309  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:05.253165  6885 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.377420  6768 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.385866  3833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54908 (request call id 537) took 1469 ms. Trace:
I20260709 13:17:05.416831  3806 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:05.389938  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:05.421120  6910 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:05.421346  6915 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:05.385031  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 129943us
I20260709 13:17:05.419096  3833 rpcz_store.cc:276] 0709 13:17:03.915981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.056704 (+140723us) service_pool.cc:224] Handling call
0709 13:17:05.385619 (+1328915us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54007945d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:05.385757 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2324862720}
I20260709 13:17:05.421922  6915 raft_consensus.cc:697] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:05.418956  3207 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:17:05.424149  6915 consensus_queue.cc:237] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.360513  3129 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:05.427325  3129 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:05.390682  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:05.357146  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.428625  3129 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:05.428966  3133 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:05.429888  3129 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:05.366973  6890 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.397367  6638 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.432602  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:05.388731  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:05.372709  6491 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:05.443531  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 54884us
I20260709 13:17:05.443658  6890 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:05.358639  3835 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:05.442919  3806 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:05.444438  6890 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:05.442926  6799 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:05.401010  6832 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.177544  3128 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:05.447485  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:05.448333  3283 raft_consensus.cc:2410] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:05.410841  6874 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:05.411213  6429 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:05.418635  6885 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.422065  6524 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:05.390405  3250 leader_election.cc:336] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.577s (SENT)
I20260709 13:17:05.479198  3204 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:05.479430  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:05.480665  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 90301.6us
I20260709 13:17:05.401895  3131 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:05.431484  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:05.432483  3285 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:05.483008  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:05.483585  3131 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:05.483856  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:05.482055  3250 leader_election.cc:336] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.599s (SENT)
I20260709 13:17:05.434563  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:05.485829  3276 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.486734  3205 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
W20260709 13:17:05.486964  3250 leader_election.cc:336] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.676s (SENT)
I20260709 13:17:05.487442  3250 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:05.434859  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:05.488961  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:05.490536  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:05.456238  6874 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:05.491353  3277 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 10: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:05.492619  6925 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:05.455760  6565 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:05.436435  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:05.494468  6766 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:05.437382  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:05.495301  3281 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 10: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:05.494894  6803 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.455623  6909 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.496019  6909 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.496505  3281 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:17:05.497254  6429 raft_consensus.cc:697] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:05.336344  6868 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.498214  6429 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.499217  6873 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.395742  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.501307  6520 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.444833  6858 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:05.501624  3127 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:05.504601  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:05.451768  6886 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:05.494915  3284 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.505486  6886 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:05.507026  6873 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.507573  6886 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.508348  6524 raft_consensus.cc:3055] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:05.508688  6524 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:05.509529  6524 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.510653  6524 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.513471  6858 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:05.513919  6858 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:05.514870  6858 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.516063  6858 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:05.446460  3128 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:05.517066  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.518026  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.519837  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.520073  3276 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:05.520645  3128 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:05.446871  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:05.447069  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:05.524534  3835 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
W20260709 13:17:05.524906  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 80732.9us
I20260709 13:17:05.525709  3177 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:05.527102  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:05.529011  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:05.529721  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 172813us
I20260709 13:17:05.530630  3208 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
W20260709 13:17:05.452683  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 89963.2us
I20260709 13:17:05.457186  3135 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:05.420504  6878 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.461580  6732 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.464160  6817 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.543292  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:05.445104  6799 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.468192  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:05.545699  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:05.546322  3204 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:05.546384  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 78283.6us
I20260709 13:17:05.547561  3101 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:05.420437  6768 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:05.475926  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:05.477258  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:05.478129  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:05.559387  3278 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:05.430207  3133 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:17:05.451076  6918 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:17:05.465916  6747 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:05.449052  3030 catalog_manager.cc:5697] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 3 to 6, term changed from 4 to 8, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to <none>, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:05.461386  6862 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.532256  3100 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:05.533169  3206 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:17:05.533981  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:05.581602  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 49419.1us
I20260709 13:17:05.537612  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:05.540416  3284 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:17:05.541410  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.467248  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:05.582748  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45220.6us
I20260709 13:17:05.549712  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:05.550971  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.584127  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.585500  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.538303  6832 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:05.445055  6890 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:05.558688  3282 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:05.548854  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:05.534262  6565 raft_consensus.cc:697] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:05.544371  6885 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:05.579166  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.539129  6705 consensus_queue.cc:1059] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:17:05.535869  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.582947  3280 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:05.599282  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.539532  6812 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:05.559810  3204 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:17:05.588335  3101 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:05.583087  3100 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:05.589172  3128 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 8: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:05.589321  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:05.592713  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:05.606302  3133 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.542742  6717 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.592166  3030 catalog_manager.cc:5697] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 1 to 5, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 5 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:05.561813  6878 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:05.593420  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.563925  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:05.558617  6799 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.562186  3208 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:05.613701  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:05.610464  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:05.611585  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:05.595077  6747 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:05.616629  6565 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:05.587400  6880 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:05.620257  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.594237  6862 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:05.584302  3864 debug-util.cc:398] Leaking SignalData structure 0x7b080030a9a0 after lost signal to thread 2028
W20260709 13:17:05.639009  3864 debug-util.cc:398] Leaking SignalData structure 0x7b080030a700 after lost signal to thread 3068
W20260709 13:17:05.631204  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 142101us
I20260709 13:17:05.627240  3030 catalog_manager.cc:5697] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:05.640256  3864 debug-util.cc:398] Leaking SignalData structure 0x7b080030af20 after lost signal to thread 3160
W20260709 13:17:05.640576  3864 debug-util.cc:398] Leaking SignalData structure 0x7b080030af00 after lost signal to thread 3161
I20260709 13:17:05.634756  3130 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:05.645766  3864 debug-util.cc:398] Leaking SignalData structure 0x7b0800341240 after lost signal to thread 3235
W20260709 13:17:05.646113  3864 debug-util.cc:398] Leaking SignalData structure 0x7b08003495c0 after lost signal to thread 3236
W20260709 13:17:05.647197  3864 debug-util.cc:398] Leaking SignalData structure 0x7b08003790a0 after lost signal to thread 3309
W20260709 13:17:05.647472  3864 debug-util.cc:398] Leaking SignalData structure 0x7b08003d31e0 after lost signal to thread 3310
W20260709 13:17:05.648605  3864 debug-util.cc:398] Leaking SignalData structure 0x7b08002cfd20 after lost signal to thread 3867
W20260709 13:17:05.650612  3864 debug-util.cc:398] Leaking SignalData structure 0x7b08002ab160 after lost signal to thread 3868
W20260709 13:17:05.651611  3864 debug-util.cc:398] Leaking SignalData structure 0x7b0800394360 after lost signal to thread 6850
I20260709 13:17:05.591957  6885 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.558175  6817 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:05.655550  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 72534.8us
I20260709 13:17:05.664510  3100 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:05.657235  3130 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:05.660877  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 72644.6us
I20260709 13:17:05.661095  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:05.655157  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.661738  3280 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
W20260709 13:17:05.662647  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 49065.8us
I20260709 13:17:05.670368  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:05.677544  3030 catalog_manager.cc:5697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:05.678802  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:05.623289  6910 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:05.609198  6812 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:05.682919  3133 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
W20260709 13:17:05.702492  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.654600  6835 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:05.718725  3030 catalog_manager.cc:5697] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 7 to 8, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 8 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:05.664903  6885 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:05.760175  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.089519  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.089404  3030 catalog_manager.cc:5697] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 5 to 6, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 6 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:17:05.768525  6940 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:17:05.675063  6880 raft_consensus.cc:697] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:17:05.789752  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.689363  6803 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:05.659456  6925 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:17:05.684866  6812 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.629503  6717 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:06.037617  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.770816  6890 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:06.072516  6888 consensus_meta.cc:287] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.702s	user 0.007s	sys 0.010s
I20260709 13:17:05.688587  6892 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:06.073355  6909 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:05.673944  3249 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:06.073957  6690 consensus_meta.cc:287] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.012s
I20260709 13:17:05.683322  6404 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:05.663918  6878 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:05.705478  6768 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:05.675325  6755 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:06.078622  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:06.078042  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:06.215209  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 541332us
W20260709 13:17:06.091338  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 426873us
W20260709 13:17:06.091774  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 295068us
I20260709 13:17:06.077203  6799 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:06.085155  3101 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:06.083928  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:06.079558  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:06.137286  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:06.222877  3205 raft_consensus.cc:2376] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8. Re-sending same reply.
I20260709 13:17:06.081238  3135 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:06.083178  3134 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:17:06.080145  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:06.082720  3131 consensus_meta.cc:287] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.004s
I20260709 13:17:06.225777  3131 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
W20260709 13:17:06.077028  6524 consensus_meta.cc:287] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.566s	user 0.014s	sys 0.007s
W20260709 13:17:06.166967  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.079910  6491 consensus_meta.cc:287] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.003s
W20260709 13:17:06.079514  6868 consensus_meta.cc:287] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.582s	user 0.014s	sys 0.000s
I20260709 13:17:06.079916  6192 raft_consensus.cc:3055] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:06.180362  3030 catalog_manager.cc:5697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 5 to 7, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 7 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.080044  6886 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.078433  6862 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:06.098594  6910 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:06.151680  6705 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:06.151417  6653 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:06.202461  6768 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:06.216625  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:06.216846  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.269790  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 53256.5us
W20260709 13:17:06.079777  3250 leader_election.cc:336] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.072s (SENT)
I20260709 13:17:06.269553  3030 catalog_manager.cc:5697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.270551  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:06.271791  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 192029us
W20260709 13:17:06.217059  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.225814  3210 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
W20260709 13:17:06.149645  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.222214  3206 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:17:06.214277  6755 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:06.246102  3100 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:06.240803  6909 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:06.187556  6748 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:06.261453  3832 raft_consensus.cc:2410] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:06.274180  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:06.276203  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 191166us
I20260709 13:17:06.252724  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:06.271700  3249 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:06.237915  6892 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:06.287474  3030 catalog_manager.cc:5697] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 3 to 5, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 5 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.289129  3100 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:06.189742  6888 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:06.306032  3284 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:06.298036  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:06.310418  3176 leader_election.cc:400] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10.
I20260709 13:17:06.310845  3176 leader_election.cc:403] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:17:06.310673  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.311880  3280 raft_consensus.cc:2393] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:06.313009  3283 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:06.203128  6690 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:06.319990  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.260428  6192 raft_consensus.cc:740] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:06.321539  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:06.325827  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:06.342028  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:06.342813  3206 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:06.326702  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:06.344398  3210 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:06.345546  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:06.327725  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:06.283332  6858 consensus_meta.cc:287] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.767s	user 0.016s	sys 0.000s
I20260709 13:17:06.334117  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:06.335548  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:06.338442  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.338635  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:06.264436  6803 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:17:06.351732  3832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58470 (request call id 746) took 1637 ms. Trace:
I20260709 13:17:06.441928  3832 rpcz_store.cc:276] 0709 13:17:04.713867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.714010 (+   143us) service_pool.cc:224] Handling call
0709 13:17:06.351490 (+1637480us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b540066d5d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:06.351662 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1959210240}
I20260709 13:17:06.442610  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:06.351282  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.444762  3805 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:06.278421  6768 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:06.286193  6755 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:06.354305  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:06.301577  6705 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:06.265259  6873 consensus_queue.cc:1059] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:17:06.386834  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.388136  3132 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:06.301518  6693 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:06.389798  3283 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:06.408910  3279 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:17:06.312701  6868 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:06.409688  3280 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:06.411214  3276 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:06.271226  6886 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.320238  6766 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:06.424561  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1357) took 1261 ms. Trace:
I20260709 13:17:06.354991  6807 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:06.322944  6817 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:06.354943  6869 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:06.293870  6921 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:06.287125  6653 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.356382  6915 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:06.373736  6732 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10.
I20260709 13:17:06.301842  6748 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.514176  6717 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:06.543073  6748 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:06.320675  6878 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.102s
I20260709 13:17:06.554832  6886 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:06.557348  6690 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:06.477562  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:06.427322  6950 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.115s	user 0.001s	sys 0.001s
I20260709 13:17:06.482952  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:06.483625  3805 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:06.500698  3276 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:06.570250  3210 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:17:06.499188  3134 rpcz_store.cc:276] 0709 13:17:05.162794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.395496 (+232702us) service_pool.cc:224] Handling call
0709 13:17:06.391084 (+995588us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54003dca54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:06.424474 (+ 33390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521911168}
I20260709 13:17:06.571708  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:06.572494  3134 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:06.573441  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:06.574621  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:06.575397  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 91923.9us
I20260709 13:17:06.575608  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:06.473552  6858 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:06.512035  6921 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.492810  6192 consensus_queue.cc:260] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.516070  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:06.516368  6942 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.364s	user 0.002s	sys 0.000s
I20260709 13:17:06.517198  6653 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:06.517712  6915 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:06.519794  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.519822  3280 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:06.602800  3281 raft_consensus.cc:2393] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:06.604019  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:06.604609  3281 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:06.607460  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:06.520552  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.521238  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1363) took 1345 ms. Trace:
W20260709 13:17:06.525667  6949 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:17:06.526497  6944 log.cc:927] Time spent T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:17:06.506711  6868 consensus_queue.cc:1059] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 13:17:06.507411  6874 consensus_meta.cc:287] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.013s	user 0.006s	sys 0.030s
I20260709 13:17:06.583081  6524 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:06.527405  6947 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.389s	user 0.003s	sys 0.001s
I20260709 13:17:06.528614  6425 raft_consensus.cc:3055] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:06.528815  6869 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:06.528805  6812 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.499122  6766 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:06.532174  3279 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52014 (request call id 499) took 1862 ms (client timeout 1528 ms). Trace:
I20260709 13:17:06.624862  6869 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:06.625262  3279 rpcz_store.cc:269] 0709 13:17:04.669570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.669721 (+   151us) service_pool.cc:224] Handling call
0709 13:17:06.531931 (+1862210us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400039154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:06.532078 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2904518016}
I20260709 13:17:06.626470  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.627468  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 515) took 1188 ms. Trace:
I20260709 13:17:06.627569  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:06.533507  3132 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 441) took 1895 ms (client timeout 1874 ms). Trace:
I20260709 13:17:06.627940  3277 rpcz_store.cc:276] 0709 13:17:05.439358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.491890 (+ 52532us) service_pool.cc:224] Handling call
0709 13:17:05.492185 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.521484 (+ 29299us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:05.563570 (+ 42086us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.980438 (+416868us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.085839 (+105401us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.085964 (+   125us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:06.085994 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.086054 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.627237 (+541183us) raft_consensus.cc:1685] finished
0709 13:17:06.627258 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.627386 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28876,"prepare.queue_time_us":38956,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":32175,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":17767,"thread_start_us":357504,"threads_started":1,"wal-append.queue_time_us":715562}
W20260709 13:17:06.629238  3132 rpcz_store.cc:269] 0709 13:17:04.637970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.146282 (+508312us) service_pool.cc:224] Handling call
0709 13:17:06.533166 (+1386884us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002da854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:06.533382 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2853539712}
I20260709 13:17:06.630175  6915 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:06.630255  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.630293  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:06.631099  3277 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:06.631590  3132 raft_consensus.cc:2410] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:06.631996  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.632865  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:06.538631  3136 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:17:06.571539  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.328454  6880 consensus_queue.cc:237] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.619172  6425 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:06.634989  3132 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:06.618048  6874 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.635246  6425 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.636391  3132 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:06.636489  6425 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:06.636874  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1351) took 1484 ms. Trace:
I20260709 13:17:06.637142  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1610) took 1171 ms. Trace:
I20260709 13:17:06.581000  3283 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:06.617062  6192 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:06.637311  3129 rpcz_store.cc:276] 0709 13:17:05.152797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.430602 (+277805us) service_pool.cc:224] Handling call
0709 13:17:05.430871 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.458924 (+ 28053us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:05.462997 (+  4073us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.638085 (+175088us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.654907 (+ 16822us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.655065 (+   158us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:05.659068 (+  4003us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.683095 (+ 24027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.683165 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.902762 (+219597us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b4800080058. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1118aa1 00007fb3c110fb37 00007fb3c110f9ca 00007fb3c120726f 00007fb3c1206f37 00007fb3c121b55c 00007fb3c121b508 00007fb3c121b488 00007fb3c121b443 00007fb3c121a6ec 00007fb3c0144a96
0709 13:17:06.636658 (+733896us) raft_consensus.cc:1685] finished
0709 13:17:06.636681 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.636802 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":307419,"prepare.queue_time_us":9799,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":79955,"raft.run_cpu_time_us":2768,"raft.run_wall_time_us":223569,"spinlock_wait_cycles":44577024,"thread_start_us":163925,"threads_started":1,"wal-append.queue_time_us":815233}
W20260709 13:17:06.533681  6948 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:17:06.640424  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1613) took 1173 ms. Trace:
I20260709 13:17:06.640664  3207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 379) took 1114 ms. Trace:
I20260709 13:17:06.585376  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:06.641052  3207 rpcz_store.cc:276] 0709 13:17:05.526392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.527580 (+  1188us) service_pool.cc:224] Handling call
0709 13:17:05.527890 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.528093 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.528119 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.528588 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.723078 (+194490us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:05.723134 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.723233 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.640476 (+917243us) raft_consensus.cc:1685] finished
0709 13:17:06.640498 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.640611 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":139188,"threads_started":1,"wal-append.queue_time_us":749543}
I20260709 13:17:06.609222  3128 rpcz_store.cc:276] 0709 13:17:05.175817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.649384 (+473567us) service_pool.cc:224] Handling call
0709 13:17:05.649727 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.649959 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.649984 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.650423 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.215230 (+564807us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:06.215308 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.215478 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.520984 (+305506us) raft_consensus.cc:1685] finished
0709 13:17:06.521008 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.521179 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":141923,"threads_started":1,"wal-append.queue_time_us":828698}
I20260709 13:17:06.643311  3128 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:06.608692  3285 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:06.582756  6921 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:06.511811  6520 consensus_meta.cc:287] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.973s	user 0.012s	sys 0.011s
I20260709 13:17:06.642210  3134 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:06.615310  6799 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:06.614599  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.615926  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:06.601992  6955 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.647171  6945 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:17:06.646906  6955 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:06.637137  6874 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:06.620209  6886 raft_consensus.cc:3055] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:06.649943  6886 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:06.650729  6812 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:06.566164  6832 consensus_meta.cc:287] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.972s	user 0.005s	sys 0.013s
I20260709 13:17:06.628741  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:06.651580  3837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 550) took 1248 ms. Trace:
I20260709 13:17:06.625231  6766 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:06.634377  3276 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:17:06.637271  3208 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:06.505296  6892 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:06.651999  3837 rpcz_store.cc:276] 0709 13:17:05.403581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.409727 (+  6146us) service_pool.cc:224] Handling call
0709 13:17:05.449209 (+ 39482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.449544 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.449570 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.463405 (+ 13835us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.637860 (+174455us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:05.641735 (+  3875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.641824 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.649174 (+1007350us) raft_consensus.cc:1685] finished
0709 13:17:06.649194 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.651302 (+  2108us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b54005e74d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:06.651516 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15931,"raft.queue_time_us":1798,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":20114,"spinlock_wait_cycles":90062208,"thread_start_us":173527,"threads_started":1,"wal-append.queue_time_us":1021702}
I20260709 13:17:06.655570  3283 raft_consensus.cc:2410] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:06.656163  6955 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:06.650903  6886 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.656388  3132 rpcz_store.cc:276] 0709 13:17:05.465688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.635763 (+1170075us) service_pool.cc:224] Handling call
0709 13:17:06.636147 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.636868 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.637061 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:06.652659  3279 raft_consensus.cc:2368] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10.
I20260709 13:17:06.658041  3130 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:17:06.651758  6921 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.659847  3281 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:06.646342  6888 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:06.640755  3129 rpcz_store.cc:276] 0709 13:17:05.466615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.639658 (+1173043us) service_pool.cc:224] Handling call
0709 13:17:06.639955 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.640124 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.640147 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:06.640184 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:06.640220 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.640268 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.640372 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:06.662563  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.675937  6812 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.676644  6812 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.679391  6812 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:06.651619  6755 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:06.681288  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.661298  6921 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:06.685251  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.686318  3277 raft_consensus.cc:2410] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:06.687376  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.689021  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:06.690141  3280 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:06.566367  6638 consensus_meta.cc:287] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.125s	user 0.015s	sys 0.011s
I20260709 13:17:06.694245  6638 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:06.696108  3203 raft_consensus.cc:2368] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9.
W20260709 13:17:06.698104  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.698663  3203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1664) took 1748 ms (client timeout 2025 ms). Trace:
W20260709 13:17:06.699072  3203 rpcz_store.cc:269] 0709 13:17:04.950179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.957860 (+  7681us) service_pool.cc:224] Handling call
0709 13:17:06.698452 (+1740592us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540019f354. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:06.698594 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3052757376}
I20260709 13:17:06.700014  6755 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:06.702863  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.688787  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.712437  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.714758  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.719413  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.720197  3276 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:17:06.721549  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1605) took 2166 ms. Trace:
I20260709 13:17:06.722023  3136 rpcz_store.cc:276] 0709 13:17:04.555045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.408478 (+853433us) service_pool.cc:224] Handling call
0709 13:17:06.538317 (+1129839us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.633692 (+ 95375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.721301 (+ 87609us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002da850. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:06.721476 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2597433088}
I20260709 13:17:06.617338  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:06.737030  3135 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
W20260709 13:17:06.746594  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 456340us
I20260709 13:17:06.747530  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:06.754276  3205 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:06.754563  3206 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:06.755928  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.756922  3279 raft_consensus.cc:2393] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 11: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:06.757867  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:06.761190  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.765524  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.756816  6425 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:06.774521  3280 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:06.775657  3837 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:06.784673  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:06.785504  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:06.787844  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:06.757666  6768 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.820314  3100 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:06.823544  3101 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:06.789856  6755 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.836880  6952 log.cc:927] Time spent T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:06.842262  3285 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:06.784077  6638 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:06.829370  6921 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:06.831636  6885 consensus_meta.cc:287] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.732s	user 0.006s	sys 0.009s
I20260709 13:17:06.836699  6755 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.822645  6835 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:06.764920  6766 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.846575  3100 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:06.849733  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 392847us
W20260709 13:17:06.859189  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 368579us
I20260709 13:17:06.849535  3101 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:06.850715  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 340202us
W20260709 13:17:06.864094  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.863977  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:17:06.851192  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 416404us
I20260709 13:17:06.866250  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:06.866674  3806 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.943s (SENT) [suppressed 19 similar messages]
I20260709 13:17:06.867416  3281 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:06.868538  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:06.868970  3837 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:06.866894  3285 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:17:06.866838  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:06.870185  3249 leader_election.cc:400] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9.
I20260709 13:17:06.872393  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:06.872054  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:06.852262  6705 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:06.876332  3833 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:06.877522  3278 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:17:06.878392  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.879408  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:06.878566  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:06.858624  6486 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:06.881769  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:06.888348  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:06.888619  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:06.888984  3206 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:06.889132  3205 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.857532  6958 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:06.893322  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:06.852458  6885 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:06.875274  6748 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:06.921958  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:06.922115  3205 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:17:06.881386  6888 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:06.893792  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:06.895455  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:06.898777  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:06.907963  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:06.872628  6192 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:06.891784  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:06.872774  6768 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:06.892035  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:06.893386  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:06.880664  6807 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:06.886483  6812 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:06.919445  3100 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:06.945550  3100 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:06.880863  6862 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:06.880990  6817 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.878535  6638 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:17:06.935174  3210 raft_consensus.cc:3055] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:06.952200  3210 raft_consensus.cc:740] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:06.939170  3204 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:06.942302  3202 raft_consensus.cc:2393] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 9: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:06.909489  6915 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:06.899446  6520 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:06.954762  6915 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.954924  6520 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:06.955299  6915 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.955438  6520 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:06.957439  6404 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:06.957226  6817 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.958161  6404 raft_consensus.cc:697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:06.932206  6192 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.959069  6192 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:06.959028  6404 consensus_queue.cc:237] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:06.959884  6888 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:06.946573  6969 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:17:06.923056  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:06.881309  6429 consensus_queue.cc:1059] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:17:06.914651  6524 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.929179  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:06.926492  6835 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:06.977160  3211 raft_consensus.cc:2410] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:17:06.949250  3206 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:06.969591  3205 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:06.889987  6803 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:17:06.953032  3210 consensus_queue.cc:260] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:06.889415  6916 consensus_queue.cc:1059] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:17:06.970814  3100 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:06.979276  3210 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.977478  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:06.980124  3100 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:06.942777  6807 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.981267  3204 raft_consensus.cc:2368] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9.
I20260709 13:17:06.981443  6807 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:06.985112  3100 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:06.985349  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:06.986099  3205 raft_consensus.cc:2393] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:06.990370  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 389) took 1330 ms. Trace:
I20260709 13:17:06.990866  3202 rpcz_store.cc:276] 0709 13:17:05.659697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.660838 (+  1141us) service_pool.cc:224] Handling call
0709 13:17:06.990164 (+1329326us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400189554. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:06.990308 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2922535296}
I20260709 13:17:06.998683  3203 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:17:07.002995  6956 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:06.951628  6486 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:07.020462  3837 raft_consensus.cc:2410] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:17:06.973248  6888 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:07.026811  3210 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:17:07.027022  3205 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:07.027213  3210 pending_rounds.cc:85] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 8
I20260709 13:17:07.027536  3210 pending_rounds.cc:107] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:17:07.027756  3210 raft_consensus.cc:2889] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:06.952433  6812 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:06.965497  6964 consensus_queue.cc:1059] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:17:07.038703  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:07.041405  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:07.053797  3205 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.041699  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:07.055614  3206 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:07.042291  3210 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:06.986857  6524 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:07.067541  3832 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:17:07.071095  3205 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:07.069006  3251 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:07.032243  6890 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:07.078621  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 186899us
I20260709 13:17:07.037988  6960 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:07.084340  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:07.084542  3250 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:07.034011  6967 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:06.977411  6705 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:07.089767  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:07.090428  3205 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:07.091015  3278 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:17:07.080859  6983 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:07.037127  6880 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:17:07.091775  6885 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:07.092634  6977 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:17:07.092543  6755 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:07.023988  6486 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:07.064484  6888 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:07.099826  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:07.076179  6921 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.095767  6962 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.128360  3278 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:07.128405  6921 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:07.097357  6960 raft_consensus.cc:697] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:07.131160  6960 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:07.105602  6812 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:07.106433  6966 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:07.107095  6886 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.113045  3837 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:07.114496  6983 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:07.135629  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1608) took 1670 ms. Trace:
I20260709 13:17:07.136066  3131 rpcz_store.cc:276] 0709 13:17:05.465149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.226843 (+761694us) service_pool.cc:224] Handling call
0709 13:17:06.227261 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.265121 (+ 37860us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:06.302421 (+ 37300us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.870369 (+567948us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.870841 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.870986 (+   145us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:06.871249 (+   263us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.876564 (+  5315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.876838 (+   274us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.112301 (+235463us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b1800405580. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:07.114208 (+  1907us) spinlock_profiling.cc:243] Waited 9.26 ms on lock 0x7b1800405580. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b9102522 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:07.135312 (+ 21104us) raft_consensus.cc:1685] finished
0709 13:17:07.135334 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.135564 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44485,"prepare.queue_time_us":31580,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":24730,"raft.queue_time_us":60384,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":24603,"spinlock_wait_cycles":36093440,"thread_start_us":452331,"threads_started":1,"wal-append.queue_time_us":649740}
I20260709 13:17:07.145198  6491 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:17:07.148612  6957 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:17:07.150321  6766 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:07.086014  6768 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:07.158102  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1362) took 1990 ms. Trace:
I20260709 13:17:07.161036  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 449) took 1696 ms. Trace:
I20260709 13:17:07.164057  3249 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:07.165324  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:07.166328  3210 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:07.158667  3127 rpcz_store.cc:276] 0709 13:17:05.167436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.636683 (+469247us) service_pool.cc:224] Handling call
0709 13:17:05.676624 (+ 39941us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:17:06.087508 (+410884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.087537 (+    29us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:17:06.153259 (+ 65722us) log.cc:844] Serialized 104 byte log entry
0709 13:17:06.701519 (+548260us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:06.760188 (+ 58669us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.784243 (+ 24055us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.807067 (+ 22824us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.807403 (+   336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.807506 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.834269 (+ 26763us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b18003bdb20. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:06.841522 (+  7253us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b18003bdb20. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b9102522 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:06.957119 (+115597us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b18003bdb20. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b9102557 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:07.157773 (+200654us) raft_consensus.cc:1685] finished
0709 13:17:07.157805 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.158028 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":435202,"prepare.queue_time_us":88862,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":118,"raft.queue_time_us":447329,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":1356,"spinlock_wait_cycles":59887616,"thread_start_us":498585,"threads_started":1,"wal-append.queue_time_us":701812}
I20260709 13:17:07.188592  6880 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:07.189141  6880 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:07.190135  6880 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:07.192137  6880 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:07.193984  6888 raft_consensus.cc:697] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:07.195015  6888 consensus_queue.cc:237] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:07.197240  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 110237us
I20260709 13:17:07.197907  6909 consensus_queue.cc:1059] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:07.198802  6910 raft_consensus.cc:3055] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:07.199291  6910 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:07.199599  6768 raft_consensus.cc:697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:07.084730  6817 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:07.200197  6910 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:07.200575  6768 consensus_queue.cc:237] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:07.095024  6967 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.202616  6967 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.217422  3837 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:17:07.218250  3837 pending_rounds.cc:85] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 7
I20260709 13:17:07.218590  3837 pending_rounds.cc:107] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:17:07.218906  3837 raft_consensus.cc:2889] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:07.224896  6962 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:07.225734  6962 raft_consensus.cc:697] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:07.231930  6962 consensus_queue.cc:237] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:07.237534  6873 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:07.262020  6565 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.262629  6565 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:07.266481  6975 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.171s	user 0.000s	sys 0.002s
W20260709 13:17:07.271078  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.276576  6836 raft_consensus.cc:3055] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:07.277202  6836 raft_consensus.cc:740] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:07.278340  6836 consensus_queue.cc:260] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:07.279946  6836 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:07.161600  3133 rpcz_store.cc:276] 0709 13:17:05.464625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.084874 (+620249us) service_pool.cc:224] Handling call
0709 13:17:06.085213 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:06.148114 (+ 62901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.148156 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:06.148752 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 13:17:06.624524 (+475772us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:06.624842 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.625035 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.625133 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.160605 (+535472us) raft_consensus.cc:1685] finished
0709 13:17:07.160712 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.160951 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73908,"prepare.queue_time_us":3578,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":66642,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":8938,"thread_start_us":372367,"threads_started":1,"wal-append.queue_time_us":627604}
I20260709 13:17:07.338748  3250 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:07.342041  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 138368us
I20260709 13:17:07.342625  3833 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:07.342711  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:07.343580  3209 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:17:07.345973  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:07.348246  3282 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:17:07.348677  3282 pending_rounds.cc:85] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 4
I20260709 13:17:07.348930  3282 pending_rounds.cc:107] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:17:07.349207  3282 raft_consensus.cc:2889] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:07.351686  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:07.351269  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:07.352700  3805 leader_election.cc:336] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.892s (SENT)
I20260709 13:17:07.352787  3282 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.353324  3805 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:07.353791  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.355379  3204 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:07.355580  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:07.356362  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.356480  3280 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:07.348344  3806 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:07.358069  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:07.347026  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:07.358345  3250 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:07.379627  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:07.378465  3806 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:07.383108  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.383354  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:07.384851  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 484081us
I20260709 13:17:07.380553  3131 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.386168  3129 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:07.386610  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.387861  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:07.389698  3805 leader_election.cc:336] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.910s (SENT)
I20260709 13:17:07.389860  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.390509  3134 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:07.390327  3805 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:07.393045  3205 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:07.394968  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:07.396341  3134 raft_consensus.cc:2376] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15. Re-sending same reply.
I20260709 13:17:07.399025  3134 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:07.401490  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.404227  3282 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:07.406674  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:07.408085  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.400622  3131 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:07.408736  3127 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:17:07.409474  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:07.409528  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:07.410197  3127 raft_consensus.cc:2376] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13. Re-sending same reply.
I20260709 13:17:07.410974  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:07.412971  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.412681  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.408555  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:07.367228  6910 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:07.413862  3128 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:07.367722  6766 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:07.368472  6953 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:07.420397  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.368305  6404 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:07.418324  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:07.421737  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.418049  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.430696  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:07.426028  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.431421  3130 raft_consensus.cc:2376] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10. Re-sending same reply.
I20260709 13:17:07.386003  6955 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:07.424263  3135 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:07.422119  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:07.405545  6524 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:07.439584  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:07.407742  6916 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.407051  6491 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:07.431984  3131 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:07.422598  6429 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:07.450469  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.458118  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:07.464943  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:07.471611  3132 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
W20260709 13:17:07.460721  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 397232us
I20260709 13:17:07.417680  6995 raft_consensus.cc:2764] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:17:07.429339  6890 raft_consensus.cc:3055] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:07.467182  6858 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:07.475332  6705 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:07.486622  3132 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:07.488164  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 129882us
I20260709 13:17:07.418515  6835 raft_consensus.cc:697] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:07.511713  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:07.539328  6835 consensus_queue.cc:237] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:07.540277  3250 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:07.484921  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:07.545104  6892 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.545825  6892 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:07.491168  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 119602us
I20260709 13:17:07.447611  6732 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:07.489439  3100 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:07.518543  6921 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:07.520192  6192 consensus_meta.cc:287] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.560s	user 0.020s	sys 0.019s
I20260709 13:17:07.521338  6565 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:07.525540  6885 raft_consensus.cc:3055] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:17:07.530231  6807 consensus_meta.cc:287] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.004s
I20260709 13:17:07.450408  6766 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:07.499362  6638 raft_consensus.cc:3055] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:07.441260  6404 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:07.488977  6890 raft_consensus.cc:740] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:07.534600  6878 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:07.509203  6486 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:07.484285  6985 consensus_queue.cc:1059] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:17:07.477399  6429 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:07.537498  6705 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:07.550025  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.552510  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.470561  6955 raft_consensus.cc:697] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:07.553128  3249 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:07.598623  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45632.7us
I20260709 13:17:07.599413  3249 leader_election.cc:400] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9.
I20260709 13:17:07.599571  3204 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:17:07.560532  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 193737us
I20260709 13:17:07.469882  6491 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:07.490638  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:07.600399  3205 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:17:07.567775  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 178109us
I20260709 13:17:07.488169  6964 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:07.563066  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 73702.8us
I20260709 13:17:07.602767  3204 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:07.469800  6868 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:17:07.553706  6983 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:07.600662  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:07.573405  6969 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:07.607383  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:07.600471  3249 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:07.630340  3249 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:07.594990  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:07.632118  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:07.562533  6732 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.570020  6888 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:07.569327  6885 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:07.581326  6878 consensus_queue.cc:1243] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:07.633858  3806 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:07.580822  6638 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:07.592240  6429 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.605813  6491 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.605584  6964 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:07.645298  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 173493us
W20260709 13:17:07.649453  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 93171.8us
I20260709 13:17:07.571682  6192 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:07.654665  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:07.576097  6807 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:07.627190  6969 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.662575  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:07.658291  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:07.605157  6960 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:07.664146  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.637367  6799 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:07.644614  6732 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.606828  6486 consensus_queue.cc:1059] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:17:07.650018  6888 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.653599  6916 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:07.641908  6524 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:07.660207  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.637609  6766 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:07.685297  6766 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.685694  6766 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.630443  6985 raft_consensus.cc:3055] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:07.687748  6985 raft_consensus.cc:740] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:07.688748  6985 consensus_queue.cc:260] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:07.689275  6885 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:07.690093  6985 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.624621  7000 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:17:07.690502  6885 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.662885  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:07.693552  3131 raft_consensus.cc:2368] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13.
I20260709 13:17:07.665627  6969 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:07.664500  6994 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:17:07.674384  3129 raft_consensus.cc:2393] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:07.675326  3101 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:07.658711  6964 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.684669  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:07.684911  6998 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:07.668915  3136 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:17:07.670403  3176 connection.cc:256] RPC call timeout handler was delayed by -1.0726656039998943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
I20260709 13:17:07.674140  6962 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:07.732880  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 57913.3us
I20260709 13:17:07.681743  6888 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:07.666265  6717 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:17:07.773967  6404 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:07.750522  6880 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:07.775504  6880 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.775913  6880 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:07.733605  6967 consensus_meta.cc:287] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.530s	user 0.013s	sys 0.004s
I20260709 13:17:07.785145  6967 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:07.786075  6966 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.786468  3127 raft_consensus.cc:2393] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 8: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:07.786636  6966 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:07.787597  6967 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:07.735641  6868 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.652232  6890 consensus_queue.cc:260] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:07.678203  6755 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:07.807611  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.808746  3131 raft_consensus.cc:2410] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:07.810070  3210 pending_rounds.cc:85] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 3
I20260709 13:17:07.810159  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:07.810474  3210 pending_rounds.cc:107] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260709 13:17:07.680210  6916 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.696278  6486 raft_consensus.cc:3055] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:07.761754  6192 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:07.763808  6886 consensus_meta.cc:287] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.629s	user 0.015s	sys 0.000s
I20260709 13:17:07.677440  6955 consensus_queue.cc:237] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:07.699033  6892 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:17:07.736596  3176 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:07.841621  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 107177us
I20260709 13:17:07.719863  6638 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:07.791697  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 135322us
I20260709 13:17:07.792218  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:07.793025  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:07.793138  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.794584  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:07.850936  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 192767us
I20260709 13:17:07.797019  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.797070  3128 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:07.806485  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:07.852957  3205 raft_consensus.cc:2393] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 11: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:07.677843  6921 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:07.808729  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:07.810732  3210 raft_consensus.cc:2889] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:07.650267  6909 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:17:07.854462  3127 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:17:07.813107  3211 raft_consensus.cc:2393] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 8: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:07.816910  3206 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:17:07.855507  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 225244us
I20260709 13:17:07.788808  6966 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:07.796507  6836 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.843091  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:07.844136  3207 raft_consensus.cc:2410] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:17:07.664579  6960 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:07.849255  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:07.813409  6916 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:07.749966  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 144856us
I20260709 13:17:07.790159  6524 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:07.858224  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:07.867910  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.867398  3805 leader_election.cc:336] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.163s (SENT)
W20260709 13:17:07.700306  6915 consensus_meta.cc:287] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.740s	user 0.009s	sys 0.013s
I20260709 13:17:07.817401  6486 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:07.872638  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:07.796379  6404 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:17:07.900430  3176 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:07.859468  6995 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:07.868434  6520 consensus_meta.cc:287] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.912s	user 0.013s	sys 0.008s
I20260709 13:17:07.815040  6868 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:07.934062  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 84869.1us
W20260709 13:17:07.934710  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 66722.4us
W20260709 13:17:07.934762  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 65016us
W20260709 13:17:07.993259  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 92886.9us
I20260709 13:17:07.999987  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:08.008435  3250 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:07.857669  6766 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.017414  6766 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:07.900228  6966 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:07.893543  6755 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:07.898128  6921 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:07.894690  6717 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:07.868829  6832 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
W20260709 13:17:08.061273  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.029745  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:08.044369  6995 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:07.896787  6915 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:08.082012  6983 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:08.142637  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:08.143275  3134 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.078639  7003 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:08.147493  3209 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:17:08.149585  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 140350us
W20260709 13:17:08.151240  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 142875us
W20260709 13:17:08.152127  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 122510us
I20260709 13:17:07.993434  6878 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
I20260709 13:17:08.133994  6524 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:08.136149  6969 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.131791  6717 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:08.137566  3207 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1685) took 1241 ms (client timeout 1612 ms). Trace:
W20260709 13:17:08.177068  3207 rpcz_store.cc:269] 0709 13:17:06.895847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.907221 (+ 11374us) service_pool.cc:224] Handling call
0709 13:17:08.137329 (+1230108us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b5400374bd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:08.137498 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2103786752}
I20260709 13:17:08.137864  6755 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:08.139482  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 145046us
I20260709 13:17:08.153507  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:07.990463  6990 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.248s
I20260709 13:17:08.155215  3134 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:17:08.008153  6565 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.993709  6520 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:07.932168  6886 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.195s
I20260709 13:17:08.150367  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:08.140733  6983 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:08.086962  7011 raft_consensus.cc:3055] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:08.155441  6807 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.174585  7014 raft_consensus.cc:2764] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:17:08.186677  7005 log.cc:927] Time spent T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
W20260709 13:17:08.224893  6910 consensus_meta.cc:287] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.797s	user 0.012s	sys 0.000s
I20260709 13:17:08.274176  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:08.278227  3208 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:08.154088  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:08.186725  6969 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.171645  6766 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 13:17:08.226307  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 364843us
I20260709 13:17:08.179466  6915 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.150795  6486 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:08.244935  7010 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
W20260709 13:17:08.248474  6491 consensus_meta.cc:287] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.000s
W20260709 13:17:08.290326  6732 consensus_meta.cc:287] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.000s
I20260709 13:17:08.263257  6868 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:08.264062  7020 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:17:08.218771  7002 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:08.195796  7006 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:08.268600  6890 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.269341  6959 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:08.271659  6705 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.199060  6717 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:08.275557  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:08.157366  6966 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.242605  6983 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.258033  6960 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:08.288236  6888 consensus_meta.cc:287] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.521s	user 0.002s	sys 0.009s
W20260709 13:17:08.293223  6985 consensus_meta.cc:287] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.603s	user 0.006s	sys 0.006s
I20260709 13:17:08.242321  7011 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:08.279379  6988 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.292688  7004 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:08.290081  6885 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:08.300736  6967 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:17:08.317195  6966 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.304930  6486 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.316864  6959 raft_consensus.cc:697] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:08.304456  6732 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.315510  7002 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:08.344163  7002 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.339797  6959 consensus_queue.cc:237] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.291483  6921 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.304303  6491 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:08.331110  6988 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:08.329959  6888 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.330670  6565 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:08.331188  7004 raft_consensus.cc:697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:08.342960  6732 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:08.369300  6958 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.011s	sys 0.022s
W20260709 13:17:08.377149  6958 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.011s	sys 0.022s
W20260709 13:17:08.396770  7018 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.090s	user 0.000s	sys 0.002s
I20260709 13:17:08.365989  7011 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:08.392119  7004 consensus_queue.cc:237] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:08.409004  7011 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:08.294719  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:17:08.448246  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 153498us
I20260709 13:17:08.276110  3101 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:08.451287  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 175402us
W20260709 13:17:08.454787  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.279230  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 125293us
I20260709 13:17:08.460430  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:08.200320  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 47268.5us
I20260709 13:17:08.468492  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:08.475775  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 325318us
I20260709 13:17:08.478881  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:08.486380  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:08.487550  3284 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.490131  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1678) took 1601 ms. Trace:
I20260709 13:17:08.452916  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:08.494004  3176 leader_election.cc:400] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10.
I20260709 13:17:08.501729  6520 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.373013  6638 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:08.507642  3832 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:08.508948  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:08.509795  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45295.4us
I20260709 13:17:08.513592  6748 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:08.513605  6732 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.514695  6425 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:08.560159  6812 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:08.519125  3208 rpcz_store.cc:276] 0709 13:17:06.888869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.892286 (+  3417us) service_pool.cc:224] Handling call
0709 13:17:06.926468 (+ 34182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.278615 (+1352147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.489449 (+210834us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003ca5d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:08.489885 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3108279552}
I20260709 13:17:08.567548  6988 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:08.572628  7000 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:08.574400  7000 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.578675  6732 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:08.581755  7003 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.583365  7003 consensus_queue.cc:1059] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:08.585318  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.592504  6892 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.593320  3249 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:08.594015  7000 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:08.595201  7002 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:08.597394  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 104045us
I20260709 13:17:08.597540  7002 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.598285  7002 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:08.599380  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:08.601655  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:08.601810  3278 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:08.603571  3278 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:08.605005  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:08.606187  3279 raft_consensus.cc:2410] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:17:08.609313  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:08.609845  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.610387  3285 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
W20260709 13:17:08.616112  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 71489.1us
W20260709 13:17:08.595824  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 44085.8us
I20260709 13:17:08.598655  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:08.647042  3284 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:17:08.657227  3285 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:08.657486  6910 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.658179  6520 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.658417  6910 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.658960  6520 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.657277  6962 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.661229  6892 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.662266  6520 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.662070  6962 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.664492  6962 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:08.667783  3249 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:08.668385  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 215866us
I20260709 13:17:08.669739  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:08.671929  7003 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:08.672412  6192 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:08.673441  6705 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.674199  6705 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.674883  3249 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:08.676329  6192 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.676167  6832 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:08.677359  6832 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.672997  7003 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:08.672502  6486 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:08.664701  6892 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:08.652525  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:08.694201  6491 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.643345  7000 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.685722  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:08.695231  7000 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.685920  6766 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.686143  6748 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:08.686689  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 401416us
I20260709 13:17:08.687055  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:08.701442  3284 raft_consensus.cc:2368] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8.
I20260709 13:17:08.701346  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:08.689885  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:08.690171  6520 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:08.676844  6705 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.641908  6988 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:08.718065  3208 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:08.735582  3284 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:08.736140  3210 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:08.717475  7000 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:08.747745  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 149413us
W20260709 13:17:08.752377  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 99282.2us
I20260709 13:17:08.753223  3276 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:08.753469  3250 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:08.714068  7003 raft_consensus.cc:697] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:08.754429  6966 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.755431  7003 consensus_queue.cc:237] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:08.757472  6524 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.758198  6524 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:08.759711  6988 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:08.761173  6990 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:08.761508  6524 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.761873  6990 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:08.762511  6988 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:08.764351  6990 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:08.767289  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.771047  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:08.772675  6429 consensus_meta.cc:287] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.105s	user 0.018s	sys 0.003s
I20260709 13:17:08.775574  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:08.777486  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:08.750954  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:08.781580  6910 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:08.787869  3279 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:08.715652  6520 raft_consensus.cc:697] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:08.713706  6748 raft_consensus.cc:697] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:17:08.789603  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 114925us
I20260709 13:17:08.777331  6768 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.793831  6832 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.797832  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:08.798861  3842 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:17:08.799363  6909 raft_consensus.cc:3055] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:08.802860  3277 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:08.804601  6766 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:08.807541  6717 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:08.810053  6966 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.810117  6732 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:08.813228  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:08.822310  6874 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.824478  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:08.825383  6967 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:08.826081  6520 consensus_queue.cc:237] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:08.831192  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 77875.6us
W20260709 13:17:08.836761  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.843261  6888 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.839061  6909 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:08.781100  6192 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.784019  6429 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:08.869813  6880 consensus_meta.cc:287] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 1.093s	user 0.015s	sys 0.004s
I20260709 13:17:08.870436  3250 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:08.870337  6880 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.871150  6874 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.872730  6880 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.874275  6874 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.876262  6732 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:08.853976  7002 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.879312  3285 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:17:08.877420  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 64477us
I20260709 13:17:08.880247  7002 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:08.861929  6967 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.890147  6910 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:08.880266  6966 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.853204  6748 consensus_queue.cc:237] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.923700  6966 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.931586  6967 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:08.937290  6916 consensus_meta.cc:287] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 1.039s	user 0.004s	sys 0.013s
I20260709 13:17:08.937850  6916 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:08.938594  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:08.939316  3207 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:08.939636  7011 consensus_meta.cc:287] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.530s	user 0.013s	sys 0.000s
I20260709 13:17:08.941253  6429 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.858120  6768 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:08.942606  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:08.943552  3279 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:08.945420  3805 leader_election.cc:336] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.517s (SENT)
I20260709 13:17:08.945904  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:08.946393  6768 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:08.948021  7047 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:08.951517  3203 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:08.952795  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:08.953540  6909 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:08.954278  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:08.954593  6962 consensus_queue.cc:1059] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:08.955246  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:08.955546  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:08.956068  3202 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.956584  3203 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:08.957469  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:08.958166  3203 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:08.959394  3203 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:08.962136  6192 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.912954  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:08.969130  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 75391.2us
I20260709 13:17:08.971738  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:08.909405  7000 consensus_queue.cc:1059] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 13:17:08.974349  7050 log.cc:927] Time spent T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
W20260709 13:17:08.981333  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 113154us
W20260709 13:17:08.984186  6890 consensus_meta.cc:287] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.671s	user 0.013s	sys 0.000s
I20260709 13:17:08.954114  3211 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:08.942533  6717 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:08.995213  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:08.995922  3280 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.993003  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:08.999056  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 82282.6us
I20260709 13:17:08.995034  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:09.015453  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:09.030515  3832 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:09.035326  3276 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.038276  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:09.043076  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.036103  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.018538  6966 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:09.045346  3279 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
W20260709 13:17:09.050339  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.034250  6890 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:09.040388  6832 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.023437  6192 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:09.061188  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.067920  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.066744  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:09.050010  6524 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:09.073056  3207 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 13: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:09.064110  6565 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:09.071555  6983 consensus_meta.cc:287] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.718s	user 0.014s	sys 0.005s
I20260709 13:17:09.071636  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:09.074081  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 102490us
I20260709 13:17:09.069454  6910 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.064860  6880 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.090878  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 145505us
I20260709 13:17:09.096446  3210 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:17:09.103905  6964 consensus_meta.cc:287] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.302s	user 0.007s	sys 0.011s
I20260709 13:17:09.104655  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:09.096175  6910 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.118358  6964 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.120756  6910 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:09.104655  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.106385  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.109163  3832 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:09.130740  6835 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:09.110450  3835 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:09.132059  6958 consensus_queue.cc:1059] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:09.112506  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:09.092374  6832 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.133944  6955 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.134020  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:09.134632  6955 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:09.135059  6832 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:09.095772  7002 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:09.136023  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:09.137328  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:09.090588  6983 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.115468  3276 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:09.138662  3276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:17:09.139436  3276 raft_consensus.cc:606] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:09.139283  7033 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:09.139808  6983 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:09.098517  6524 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:09.139822  3276 raft_consensus.cc:614] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:09.140302  7033 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:09.141852  3276 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:09.142539  6524 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:09.082636  6192 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.143121  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:09.144696  6192 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:09.136672  7002 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:09.146240  6638 consensus_meta.cc:287] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.528s	user 0.014s	sys 0.000s
I20260709 13:17:09.147161  7002 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:09.116215  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:09.148509  3282 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:09.117631  7011 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.149508  7011 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:09.150408  6909 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.117377  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:09.120595  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:09.153488  3278 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:09.154512  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:09.155685  6910 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:09.105353  6880 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:09.134027  7054 log.cc:927] Time spent T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:17:09.159198  6880 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:09.121174  3209 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:09.121348  6520 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:09.159740  6958 raft_consensus.cc:3055] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:09.125624  3285 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 11. (term mismatch)
I20260709 13:17:09.160609  3285 pending_rounds.cc:85] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 10
I20260709 13:17:09.161140  3285 pending_rounds.cc:107] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 13:17:09.161688  3285 raft_consensus.cc:2889] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:09.102548  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.163277  3207 raft_consensus.cc:2393] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:09.160378  6638 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:09.164242  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.159967  6520 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:09.163090  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:09.165246  6520 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.166533  6966 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:09.167711  3202 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:09.168669  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:09.124658  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:09.160527  6958 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:09.169541  3208 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.170279  6958 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.171545  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.171831  6958 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.172269  3202 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:17:09.173183  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.173892  3202 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:17:09.174844  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.179545  3202 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:17:09.181504  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:09.182420  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.183342  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:09.126405  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.183678  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:09.183980  3129 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.152175  7011 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:09.184921  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.185593  3210 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:17:09.186539  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.187057  3210 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 6.
I20260709 13:17:09.187793  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.183090  3202 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:09.189090  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.189709  3202 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:09.190582  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:09.191212  6916 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:09.191963  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.120988  6964 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:09.161054  6983 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:09.197651  3280 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:09.188905  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.179690  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:09.141785  7033 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:09.200924  3285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:17:09.199613  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:09.206261  3285 raft_consensus.cc:606] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:09.206821  3285 raft_consensus.cc:614] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:09.209306  3210 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
W20260709 13:17:09.213601  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 215583us
I20260709 13:17:09.204411  7033 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:09.204265  6983 raft_consensus.cc:697] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:09.219839  6983 consensus_queue.cc:237] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.224766  3278 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:17:09.226447  3278 pending_rounds.cc:85] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 7
I20260709 13:17:09.226665  3278 pending_rounds.cc:107] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:17:09.211054  7000 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:09.226830  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:09.226877  3278 raft_consensus.cc:2889] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:09.224045  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.233680  7011 consensus_queue.cc:1059] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:09.229878  3210 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:09.245206  3210 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:09.234755  7011 raft_consensus.cc:3055] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:09.236027  7000 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:09.248426  7051 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.272s	user 0.003s	sys 0.002s
I20260709 13:17:09.238792  6962 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:09.251269  6955 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:09.253619  3134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:09.258271  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.260246  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:09.264325  3134 raft_consensus.cc:606] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:09.266892  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:09.267084  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:09.267529  3130 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.267823  3134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d10d3c525b541649db9c882a1398789"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:09.268410  3134 raft_consensus.cc:606] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:09.268723  3134 raft_consensus.cc:614] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:09.247537  7011 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:09.268683  3208 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:09.270076  7011 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.271572  7011 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.272303  3208 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:09.275125  3129 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
W20260709 13:17:09.275437  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 48693.9us
I20260709 13:17:09.284400  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:09.286783  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:09.289454  6835 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:09.261790  7000 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.295207  3208 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:09.299300  3210 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:17:09.299127  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:09.300925  6832 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:09.301393  3278 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.301875  6955 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:09.307924  3285 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:09.300961  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:09.243963  6910 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:17:09.326515  6858 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:09.329424  7033 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:09.330324  3133 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c414d51e428042c596cb410c48956c63"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:09.331028  3133 raft_consensus.cc:606] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:09.331290  7033 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:09.333134  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:09.336985  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:09.345193  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:09.346098  3136 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.348639  3278 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:09.350155  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:09.351068  3278 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:09.353245  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:09.370978  3129 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 6.
W20260709 13:17:09.362380  7003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.000s	sys 0.015s
I20260709 13:17:09.380039  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:09.381816  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:09.383687  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:09.379732  7003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.000s	sys 0.016s
W20260709 13:17:09.393215  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 154719us
W20260709 13:17:09.395824  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.378702  6955 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:09.397356  7059 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.159s	user 0.002s	sys 0.000s
I20260709 13:17:09.401818  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:09.413638  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:09.412062  3130 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:09.414563  3278 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:09.348688  6835 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:09.421360  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:09.434654  3133 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.425365  3128 raft_consensus.cc:2410] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:09.426187  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:09.426936  6832 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:09.500532  3136 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:09.428956  6192 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:17:09.455189  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.505366  3101 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:09.506927  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:09.508680  3176 leader_election.cc:400] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13.
I20260709 13:17:09.509017  3176 leader_election.cc:403] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:17:09.513762  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:09.518931  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:09.524405  3283 raft_consensus.cc:2410] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:17:09.527310  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:09.530575  3281 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 11: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:09.530550  3129 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:09.538842  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:09.535696  3134 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:09.543494  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:09.548728  7023 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:09.549547  7023 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:09.551892  7023 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:09.560180  3278 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.560696  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:09.568084  6404 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.566766  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:09.568948  6404 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.572667  3281 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:17:09.575207  3281 raft_consensus.cc:1240] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:09.577508  3276 raft_consensus.cc:2410] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:09.578626  6835 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:09.579945  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 150826us
I20260709 13:17:09.581442  3101 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:09.583318  3101 leader_election.cc:400] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8.
I20260709 13:17:09.583693  3101 leader_election.cc:403] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:09.584393  7023 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:09.585110  6638 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:09.589339  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:09.590377  3127 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.590895  3278 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
W20260709 13:17:09.594408  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 78097.8us
I20260709 13:17:09.597191  6983 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:09.602159  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.602720  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.603437  3206 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
W20260709 13:17:09.605788  7065 log.cc:927] Time spent T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 13:17:09.608075  7072 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:17:09.610144  6962 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:09.530339  6995 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13.
I20260709 13:17:09.626624  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:09.511487  6955 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:09.629832  3133 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:09.536756  6958 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:09.631999  7023 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.633021  6192 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8.
I20260709 13:17:09.633360  6888 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:17:09.636029  7023 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:09.638628  3176 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:09.642302  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.640574  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 85890.7us
I20260709 13:17:09.640290  6638 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:09.646235  6404 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:09.637965  6520 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.647038  6995 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:09.659214  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:09.654515  6638 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:09.664022  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:09.665313  3210 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:09.661567  6732 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:09.668151  6955 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:09.668675  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.667692  6638 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.672288  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:09.672956  3833 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:17:09.674003  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:09.677961  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:09.679741  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:09.681288  6995 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:09.681743  6995 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.682113  6995 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:09.687248  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.690348  6732 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:09.693909  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:09.696643  3127 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:09.692978  6520 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:09.706542  3102 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:09.701850  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.708561  3211 raft_consensus.cc:1813] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Handling vote request from an unknown peer fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:09.702088  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:09.709386  3211 raft_consensus.cc:2410] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:17:09.698581  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:09.717767  3833 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 11: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:09.689247  6404 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:09.722708  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 60635.4us
I20260709 13:17:09.726796  6890 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:09.732401  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.734368  3100 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:09.735355  3277 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:09.735577  6958 raft_consensus.cc:993] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:17:09.743346  6192 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:09.745553  6192 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.755201  6192 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.755534  3203 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:09.756801  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.755645  3835 raft_consensus.cc:1240] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:09.764899  6192 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.765493  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.766381  3205 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:17:09.766971  6192 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:09.769706  7023 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:09.745850  6958 raft_consensus.cc:1081] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:17:09.719990  6835 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:09.775697  6835 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.776165  6835 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.781646  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.789675  6766 raft_consensus.cc:3055] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:09.790256  6766 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:09.800287  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:09.803925  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 393320us
I20260709 13:17:09.807500  7011 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.808051  7011 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.807535  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2766) took 1059 ms. Trace:
I20260709 13:17:09.809995  6892 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:09.753232  6890 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.810606  6892 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.811517  6890 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.811403  7011 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:09.809790  3209 rpcz_store.cc:276] 0709 13:17:08.748100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.753191 (+  5091us) service_pool.cc:224] Handling call
0709 13:17:08.753651 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.159846 (+406195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.805435 (+645589us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54003750d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:09.807468 (+  2033us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":720645504}
W20260709 13:17:09.814396  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 63677.1us
I20260709 13:17:09.815671  6892 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:09.824707  3205 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:09.840363  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 160647us
I20260709 13:17:09.862797  3101 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:09.828088  3100 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:09.867379  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:09.791904  6766 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.869515  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:09.880919  6955 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.882009  6955 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:09.868732  7074 log.cc:927] Time spent T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.223s	user 0.005s	sys 0.000s
W20260709 13:17:09.884738  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 56738.6us
I20260709 13:17:09.891201  6192 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:09.863775  6520 consensus_queue.cc:1059] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:17:09.885526  6958 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:09.866029  6888 consensus_queue.cc:1059] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:17:09.899376  6766 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:09.903432  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 157133us
I20260709 13:17:09.848330  7000 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:09.912776  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 107851us
I20260709 13:17:09.942054  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:09.943308  3202 raft_consensus.cc:2410] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:09.944329  3249 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:09.904059  6732 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:09.952163  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:09.955032  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.955714  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.956125  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.958276  3209 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:09.958904  3835 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:09.968499  6192 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:17:09.973404  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 130588us
W20260709 13:17:09.974401  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 51555.6us
I20260709 13:17:09.947044  6520 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:09.980072  3210 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:09.977815  3206 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:09.979036  3101 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:09.995123  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:09.998494  3101 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:10.001147  6732 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:09.980468  6909 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:10.009686  6909 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:10.010375  6768 consensus_queue.cc:1059] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:10.010805  6909 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:10.011492  6768 raft_consensus.cc:3055] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:10.011894  6768 raft_consensus.cc:740] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:09.971985  6638 raft_consensus.cc:3055] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:09.977691  6192 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:10.009699  3249 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:09.978986  6955 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:09.976824  6404 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:17:10.021644  6404 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:10.012913  6768 consensus_queue.cc:260] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:10.022411  6404 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:10.023574  6404 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:10.018270  6935 consensus_queue.cc:1059] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:17:10.026646  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:10.027787  3283 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:10.030025  7034 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:09.982115  6890 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:09.983160  7002 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:10.032814  3249 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:10.008081  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:10.031927  7000 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:10.016597  6638 raft_consensus.cc:740] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:10.084960  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 52279.9us
I20260709 13:17:09.987640  6880 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:17:10.033174  6520 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:10.091022  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 83169.2us
I20260709 13:17:10.091975  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:10.101161  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:10.022468  6995 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:10.077446  7002 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:17:10.110693  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 222534us
I20260709 13:17:10.062458  6835 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:10.089300  6910 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:10.089632  6404 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:10.119335  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:10.122843  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:10.102473  6890 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:10.114385  7080 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:10.131691  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:10.134691  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 176298us
I20260709 13:17:10.118201  6910 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:10.113915  6935 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:10.174894  6935 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:10.171903  6910 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:10.172834  7085 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:17:10.173177  6755 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:10.183213  3276 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:10.129978  6892 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:17:10.185148  6935 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:10.186733  6983 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:10.186854  6935 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.159459  3100 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:10.188795  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:10.189296  3100 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:10.121300  7088 raft_consensus.cc:2764] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:10.190385  3805 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:10.126123  7034 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:10.129700  6964 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:10.194110  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:10.194216  3284 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:10.143501  7082 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:10.210183  3136 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:10.187536  7002 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:10.225385  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:10.147522  7011 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:17:10.199456  7003 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.197319  6964 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:10.275719  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 217175us
I20260709 13:17:10.289875  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:10.201181  6983 raft_consensus.cc:697] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:10.319854  3207 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:10.224803  7082 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:10.329496  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:10.329737  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:10.330236  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:10.328620  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 128564us
I20260709 13:17:10.329497  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:10.330627  3277 raft_consensus.cc:2410] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:17:10.332247  3283 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:10.332654  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:10.333329  3280 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:10.259562  6835 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:10.330139  3282 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:10.313529  7002 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:10.315219  6964 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.200520  7034 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:10.358875  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:10.321269  7094 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:10.359618  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:10.370599  3284 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:10.161198  6638 consensus_queue.cc:260] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:10.372152  6638 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.368640  3278 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 11: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
W20260709 13:17:10.372359  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.358875  3285 raft_consensus.cc:1275] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:17:10.366605  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 176494us
I20260709 13:17:10.364066  6890 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:10.391619  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:10.359900  6491 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:10.402446  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.404398  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:10.405247  3285 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:10.258741  6404 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:10.284471  7003 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:10.396528  6835 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.418507  6835 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:10.418309  6890 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:10.412638  7083 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:10.421533  3279 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:10.394377  3100 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:10.379664  6958 raft_consensus.cc:3055] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:10.428962  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.381614  7094 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.259029  6520 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:10.398185  6491 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:10.429633  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 48349.7us
I20260709 13:17:10.432574  7094 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:10.441310  6995 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:10.449527  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:17:10.426539  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 297797us
I20260709 13:17:10.475798  3837 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:10.455745  6491 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.429118  6958 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:10.444780  7090 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:10.499779  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:10.507463  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:10.485535  7095 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:10.496215  7089 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:17:10.509859  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:10.473332  6955 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:17:10.492719  6835 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:10.526054  3278 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:10.477957  6909 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:17:10.527525  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:10.532070  3206 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.430681  6983 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:10.534454  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 344114us
I20260709 13:17:10.534507  3203 pending_rounds.cc:85] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 4
I20260709 13:17:10.536263  3203 pending_rounds.cc:107] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:17:10.536633  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:10.537534  3211 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:10.539261  3134 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:10.545535  3284 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:10.536600  3203 raft_consensus.cc:2889] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:10.547644  3805 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:10.548641  3805 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:10.514001  7091 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.513779  7100 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:10.557884  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:10.523128  7110 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:10.567159  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:10.536080  3209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:17:10.569949  3136 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:17:10.570055  3128 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.574882  3805 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:10.575076  3176 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:10.473610  7082 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:10.558048  7104 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:10.594837  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:10.591037  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:10.595646  3136 raft_consensus.cc:2368] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10.
I20260709 13:17:10.542642  6835 consensus_queue.cc:1059] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:17:10.524050  7095 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:10.593799  7104 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:10.625986  6995 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:10.676467  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.676894  6192 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.596884  7114 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:10.647416  7106 log.cc:927] Time spent T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
W20260709 13:17:10.700345  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 144567us
W20260709 13:17:10.700901  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.702330  3130 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:10.573233  6958 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:10.634130  6858 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:17:10.720469  6192 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:10.675947  7104 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.568329  7100 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:10.700977  6890 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:10.790190  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:10.687480  7114 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:10.757715  3835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.005s	sys 0.009s
W20260709 13:17:10.860586  3835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.005s	sys 0.009s
I20260709 13:17:10.574092  7110 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:10.759292  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:10.724512  7034 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:10.797108  7116 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.797555  7112 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:10.799043  7118 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:17:10.799762  7101 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
W20260709 13:17:10.802676  7107 log.cc:927] Time spent T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
W20260709 13:17:10.803462  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.804888  7095 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:10.805053  3211 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
W20260709 13:17:10.807538  6910 consensus_meta.cc:287] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.630s	user 0.013s	sys 0.000s
I20260709 13:17:10.813541  7033 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:10.813920  7119 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:17:10.843106  7100 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:10.847985  7098 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.263s	user 0.001s	sys 0.001s
I20260709 13:17:10.846555  3206 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:10.767464  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:10.885136  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:10.905995  6755 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.903512  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:10.918125  7116 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:10.955042  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.964370  7088 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:10.992884  3202 raft_consensus.cc:2393] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:10.899372  6995 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:10.973115  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:10.983752  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 216397us
I20260709 13:17:10.989382  3835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 569) took 1005 ms. Trace:
W20260709 13:17:10.992599  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.883643  7114 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:10.884052  6890 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:10.956035  7121 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:10.994037  3135 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
W20260709 13:17:11.016932  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 250801us
I20260709 13:17:11.021000  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:11.021749  3283 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:10.963963  6910 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:10.967137  7033 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:10.997045  3835 rpcz_store.cc:276] 0709 13:17:09.983795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.983987 (+   192us) service_pool.cc:224] Handling call
0709 13:17:09.984305 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.984509 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:10.209567 (+225058us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.987965 (+778398us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.988349 (+   384us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:10.988607 (+   258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.988996 (+   389us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.989313 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":342546,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"thread_start_us":994111,"threads_started":3}
W20260709 13:17:11.034665  7103 log.cc:927] Time spent T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
I20260709 13:17:11.072224  3128 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:17:11.037487  6910 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:10.998327  6755 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:11.004940  6995 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:11.025913  7126 log.cc:927] Time spent T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:17:11.041647  3207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1718) took 1293 ms. Trace:
I20260709 13:17:11.087172  3207 rpcz_store.cc:276] 0709 13:17:09.748080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.748256 (+   176us) service_pool.cc:224] Handling call
0709 13:17:09.753435 (+  5179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.327180 (+573745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.041388 (+714208us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54003cb9d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:11.041579 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1284508928}
I20260709 13:17:11.088778  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:11.043165  3030 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55102 (request call id 136) took 20037 ms (client timeout 15000 ms). Trace:
I20260709 13:17:11.090428  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:10.812732  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:11.047832  7123 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:17:11.050349  6916 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:11.093421  6916 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.093870  6768 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:11.089550  3030 rpcz_store.cc:269] 0709 13:16:51.005696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.016438 (+ 10742us) service_pool.cc:224] Handling call
0709 13:17:11.042913 (+20026475us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:07.005393 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:07.141436 (+136043us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:07.141485 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:17:07.141512 (+    27us) tablet.cc:662] Decoding operations
0709 13:17:07.143318 (+  1806us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:07.143399 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:07.143438 (+    39us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:17:07.144960 (+  1522us) tablet.cc:701] Row locks acquired
0709 13:17:07.144986 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:17:07.207502 (+ 62516us) write_op.cc:270] Start()
0709 13:17:07.221377 (+ 13875us) write_op.cc:276] Timestamp: P: 1783603027187097 usec, L: 0
0709 13:17:07.221416 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:17:07.465693 (+244277us) log.cc:844] Serialized 6320 byte log entry
0709 13:17:08.400020 (+934327us) op_driver.cc:464] REPLICATION: finished
0709 13:17:08.411748 (+ 11728us) write_op.cc:301] APPLY: starting
0709 13:17:08.411968 (+   220us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:08.412394 (+   426us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:08.563287 (+150893us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:08.766423 (+203136us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:08.766859 (+   436us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:17:08.766960 (+   101us) write_op.cc:312] APPLY: finished
0709 13:17:08.767634 (+   674us) log.cc:844] Serialized 113 byte log entry
0709 13:17:08.767931 (+   297us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:08.768450 (+   519us) write_op.cc:454] Released schema lock
0709 13:17:08.768532 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:08.789451 (+ 20919us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:08.792114 (+  2663us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":446687,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":11416,"apply.run_cpu_time_us":7664,"apply.run_wall_time_us":357333,"num_ops":16,"prepare.queue_time_us":373363,"prepare.run_cpu_time_us":44789,"prepare.run_wall_time_us":701834,"raft.queue_time_us":250543,"raft.run_cpu_time_us":1384,"raft.run_wall_time_us":7482,"replication_time_us":1178378,"spinlock_wait_cycles":7040,"thread_start_us":703991,"threads_started":4,"wal-append.queue_time_us":631370,"wal-append.run_cpu_time_us":15669,"wal-append.run_wall_time_us":1640217}]]}
I20260709 13:17:11.054883  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:11.055094  7088 consensus_queue.cc:1059] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:11.096228  6916 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:11.057287  6890 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:11.097600  6916 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:11.098397  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:11.098814  6916 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.099416  6916 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:11.099921  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:10.967090  7112 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 13:17:11.063822  7002 consensus_meta.cc:287] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.697s	user 0.012s	sys 0.000s
I20260709 13:17:11.064684  6921 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:11.065913  7091 consensus_meta.cc:287] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.001s
W20260709 13:17:11.066411  6964 consensus_meta.cc:287] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.001s
I20260709 13:17:11.018625  7110 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:11.128178  6935 consensus_meta.cc:287] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.941s	user 0.013s	sys 0.001s
I20260709 13:17:11.027652  7121 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:11.071887  3134 consensus_meta.cc:287] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.000s
I20260709 13:17:11.166400  3134 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:17:11.035386  7116 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:11.081877  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.086006  3204 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.005s	sys 0.007s
W20260709 13:17:11.168076  3204 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.005s	sys 0.008s
I20260709 13:17:11.203922  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:11.204836  3134 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.132367  7080 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:11.114746  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:11.127481  3132 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:11.133014  3128 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:11.142300  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.086759  6192 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:11.171329  7002 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.248183  3128 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:11.162335  7091 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:11.245399  6835 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.080s	sys 0.094s
W20260709 13:17:11.256042  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 285791us
I20260709 13:17:11.139295  6921 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:11.133409  7034 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 13:17:11.265300  3134 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:11.166015  6964 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:11.135018  7133 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
W20260709 13:17:11.255460  6491 consensus_meta.cc:287] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.758s	user 0.013s	sys 0.000s
I20260709 13:17:11.278188  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:11.296468  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:11.317345  6755 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:11.317539  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:11.318473  3128 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:11.319550  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:11.261123  6835 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.081s	sys 0.094s
I20260709 13:17:11.320636  3135 raft_consensus.cc:2410] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:11.363386  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:11.364351  3135 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 8: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:11.257004  7080 raft_consensus.cc:697] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:11.322316  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:11.367148  3129 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:11.323333  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:11.367457  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 371809us
I20260709 13:17:11.324024  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:11.325345  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:11.278895  3805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.062s	sys 0.197s
W20260709 13:17:11.369429  3805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.068s	sys 0.197s
W20260709 13:17:11.369831  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 675913us
I20260709 13:17:11.326012  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:11.251619  7002 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:11.370841  3130 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:11.371833  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:11.372555  7002 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:11.326699  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:11.374079  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:11.374804  3128 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
W20260709 13:17:11.375670  7094 consensus_meta.cc:287] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.886s	user 0.011s	sys 0.000s
I20260709 13:17:11.375885  3128 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:11.376372  3136 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:11.376150  7094 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:11.377424  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:11.328675  6755 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.378720  6755 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:11.332249  7000 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.381407  7000 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:11.382212  7114 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.383664  7000 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:11.333267  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:11.363942  6491 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.389482  6491 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:11.390625  7104 consensus_meta.cc:287] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.000s
I20260709 13:17:11.341464  6995 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:11.342283  3207 raft_consensus.cc:2368] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9.
I20260709 13:17:11.343441  6964 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:11.350346  7133 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:11.351769  7033 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:11.292186  7034 consensus_queue.cc:1243] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:11.358527  6921 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:11.276997  7146 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:11.393206  7146 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:11.394285  3282 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.009s	sys 0.011s
I20260709 13:17:11.359604  7110 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.361176  7121 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:11.365473  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:11.377596  3136 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:11.330068  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:11.400487  3281 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
W20260709 13:17:11.394647  3282 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.009s	sys 0.011s
I20260709 13:17:11.397910  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:11.331426  6916 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.403091  3130 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:11.403939  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:11.404696  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:11.380873  6755 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:11.404168  3806 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:11.413865  3127 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:17:11.423478  3135 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:11.425642  3128 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:11.426787  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:11.426936  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:11.429454  3210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.001s	sys 0.023s
W20260709 13:17:11.429862  3210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.001s	sys 0.023s
I20260709 13:17:11.430642  3209 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:11.431244  3209 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:11.404314  6983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.010s	sys 0.011s
W20260709 13:17:11.413679  7082 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.004s	sys 0.016s
W20260709 13:17:11.431005  3203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.013s	sys 0.010s
W20260709 13:17:11.449781  3203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.013s	sys 0.010s
I20260709 13:17:11.406109  7121 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:11.446643  6983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.011s	sys 0.011s
W20260709 13:17:11.449308  7082 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.004s	sys 0.016s
I20260709 13:17:11.403738  7110 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:11.468714  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 401543us
I20260709 13:17:11.455019  6491 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:11.481904  3133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.003s	sys 0.021s
W20260709 13:17:11.482412  3133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.003s	sys 0.021s
I20260709 13:17:11.407178  7104 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.496984  3132 raft_consensus.cc:2410] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:11.501901  3206 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:11.499555  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1407) took 1302 ms. Trace:
I20260709 13:17:11.503023  3133 rpcz_store.cc:276] 0709 13:17:10.184978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.187352 (+  2374us) service_pool.cc:224] Handling call
0709 13:17:10.187597 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.187813 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:10.319730 (+131917us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.930328 (+610598us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b1800433b40. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f23a 00007fb3bc1f9a2a
0709 13:17:11.485099 (+554771us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:11.485188 (+    89us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:11.485266 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.485375 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.487358 (+  1983us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":132592,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":2796,"raft.queue_time_us":11801,"spinlock_wait_cycles":8320896,"thread_start_us":685916,"threads_started":2}
W20260709 13:17:11.507287  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.472507  6491 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.516680  3837 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.460814  7121 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:11.527978  3211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2804) took 1008 ms. Trace:
I20260709 13:17:11.514794  6755 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.527609  6638 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:11.536435  7121 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:11.524220  6491 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.538340  7110 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:11.541488  7114 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:11.584162  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 158959us
I20260709 13:17:11.509429  7137 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:17:11.543331  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2803) took 1025 ms. Trace:
I20260709 13:17:11.543469  7104 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:11.550401  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 436489us
I20260709 13:17:11.554569  3211 rpcz_store.cc:276] 0709 13:17:10.519133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.966308 (+447175us) service_pool.cc:224] Handling call
0709 13:17:10.966667 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.966881 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:10.988041 (+ 21160us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.525894 (+537853us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:11.525962 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:11.526016 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.527786 (+  1770us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.527919 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20962,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":146127,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":537368,"threads_started":2}
I20260709 13:17:11.467058  7080 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:11.570289  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2802) took 1052 ms. Trace:
I20260709 13:17:11.576834  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:11.550077  6921 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:11.585239  3208 rpcz_store.cc:276] 0709 13:17:10.518170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.917503 (+399333us) service_pool.cc:224] Handling call
0709 13:17:10.917855 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.133916 (+216061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.133951 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:11.133998 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:11.134032 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.543090 (+409058us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400194e54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:11.543153 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.543267 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496420608}
I20260709 13:17:11.589398  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:11.603040  7088 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:11.603627  7088 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:11.604171  7088 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.598155  3101 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:11.578099  7091 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.592043  3204 rpcz_store.cc:276] 0709 13:17:10.517889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.517996 (+   107us) service_pool.cc:224] Handling call
0709 13:17:10.535370 (+ 17374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.535572 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:11.168549 (+632977us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.569818 (+401269us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:11.569893 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:11.569964 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.570050 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.570207 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18257,"prepare.queue_time_us":261073,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":44,"raft.queue_time_us":18626,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":3809,"thread_start_us":962403,"threads_started":2}
I20260709 13:17:11.621306  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:11.628818  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:11.630798  3101 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:11.655853  3835 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:11.659003  6916 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:11.598095  7094 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:11.578563  6755 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.662957  3835 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:17:11.591564  7104 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:11.619616  7097 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.024s	sys 0.020s
I20260709 13:17:11.598462  7146 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:11.630191  7090 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:11.623238  7091 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:11.654358  7132 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:11.619879  7110 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.693795  3209 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:11.630326  7151 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.695838  3837 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:11.631275  6921 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.687366  6755 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:11.695605  7104 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.727785  7104 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:11.678112  7097 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.027s	sys 0.024s
I20260709 13:17:11.729815  6921 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:11.733273  7164 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:17:11.736420  7112 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:11.737030  7112 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.739270  7112 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:11.739719  7091 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:11.740335  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1735) took 1043 ms. Trace:
I20260709 13:17:11.741362  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:11.743705  7104 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:11.755488  7110 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:11.756055  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:11.755759  7104 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.756351  7110 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.757643  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:11.758328  3208 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:11.759205  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:11.759965  7003 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:11.760281  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:11.760497  6192 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.761186  6192 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.762036  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1406) took 1577 ms. Trace:
I20260709 13:17:11.762473  3127 rpcz_store.cc:276] 0709 13:17:10.184620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.186857 (+  2237us) service_pool.cc:224] Handling call
0709 13:17:10.187177 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:11.423278 (+1236101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.761570 (+338292us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540032ebd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:11.761966 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2820475136}
I20260709 13:17:11.764182  6192 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:11.766777  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:11.769578  7110 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:11.770113  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:11.770690  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:11.724208  6983 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.772192  6983 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.773494  3204 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:11.774634  6983 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:11.749845  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:11.752704  3206 rpcz_store.cc:276] 0709 13:17:10.697065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.987408 (+290343us) service_pool.cc:224] Handling call
0709 13:17:11.019844 (+ 32436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.502472 (+482628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.740087 (+237615us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b540019e454. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:11.740271 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107819264}
I20260709 13:17:11.770807  3832 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
W20260709 13:17:11.701982  7144 log.cc:927] Time spent T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 13:17:11.787545  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 181309us
W20260709 13:17:11.790320  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 159583us
I20260709 13:17:11.695427  7132 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:11.795791  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.796896  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.801355  7088 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:11.802793  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:11.803869  3203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2797) took 1287 ms. Trace:
I20260709 13:17:11.805609  6192 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:11.689216  7090 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:11.804239  3203 rpcz_store.cc:276] 0709 13:17:10.516478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.516585 (+   107us) service_pool.cc:224] Handling call
0709 13:17:10.534330 (+ 17745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:10.564853 (+ 30523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:10.564890 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:10.565507 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 13:17:11.450222 (+884715us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:11.450334 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.450429 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:11.803620 (+353191us) raft_consensus.cc:1685] finished
0709 13:17:11.803645 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.803795 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":823858,"threads_started":1,"wal-append.queue_time_us":944504}
I20260709 13:17:11.807212  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:11.811628  7034 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:11.827668  7034 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.827812  7161 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:11.829097  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:11.811981  6983 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.830036  6404 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:11.830309  6983 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:11.830790  3209 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:11.831348  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:34332 (request call id 2795) took 1315 ms. Trace:
I20260709 13:17:11.831696  3209 rpcz_store.cc:276] 0709 13:17:10.515903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.518285 (+  2382us) service_pool.cc:224] Handling call
0709 13:17:11.819506 (+1301221us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b5400189f54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1e6a3d 00007fb3c11b6cd0 00007fb3ba73b254 00007fb3ba73b1e2 00007fb3ba73b111 00007fb3ba73b08c 00007fb3ba73a342 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:11.831238 (+ 11732us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1979953024}
I20260709 13:17:11.832625  6983 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:11.696875  7139 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.833546  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:11.834824  3282 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:11.835031  7033 consensus_queue.cc:1059] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:11.701208  6890 raft_consensus.cc:2764] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:11.820652  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:11.823217  3842 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:11.834826  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:11.839574  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:11.839807  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 170102us
I20260709 13:17:11.803325  7132 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:11.841122  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 44233.9us
I20260709 13:17:11.854355  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:11.857064  6491 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.858408  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:11.857748  3033 catalog_manager.cc:5697] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 5 to 7, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 7 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:11.859648  3100 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:11.860138  6491 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:11.860488  6835 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:11.861162  6835 raft_consensus.cc:697] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:17:11.861565  7155 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:17:11.862879  3101 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:11.775892  7172 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 13:17:11.838434  7090 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.859911  3033 catalog_manager.cc:5697] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 3 to 8, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 8 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.838933  7011 raft_consensus.cc:3055] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:11.830036  7034 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:11.839016  6921 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.871110  7139 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:11.876479  3805 leader_election.cc:336] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.899s (SENT)
I20260709 13:17:11.842429  6755 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:11.879247  3805 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:11.859683  7138 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:11.884222  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1739) took 1185 ms. Trace:
I20260709 13:17:11.823993  7003 consensus_queue.cc:1059] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:17:11.885156  3202 rpcz_store.cc:276] 0709 13:17:10.698520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.140869 (+442349us) service_pool.cc:224] Handling call
0709 13:17:11.141421 (+   552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:11.502016 (+360595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.502082 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:11.504329 (+  2247us) log.cc:844] Serialized 26 byte log entry
0709 13:17:11.602887 (+ 98558us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:11.602931 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.603015 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:11.883985 (+280970us) raft_consensus.cc:1685] finished
0709 13:17:11.884009 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.884157 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1727,"raft.queue_time_us":208284,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":95,"thread_start_us":407450,"threads_started":2,"wal-append.queue_time_us":368461}
I20260709 13:17:11.873389  7080 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:11.871227  7117 raft_consensus.cc:3055] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:17:11.881443  7162 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:17:11.891140  7173 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:11.874694  7011 raft_consensus.cc:740] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:17:11.895936  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.882184  7151 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:11.903792  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:11.881101  3249 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:11.905620  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:11.908816  3250 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.211s (SENT) [suppressed 23 similar messages]
I20260709 13:17:11.912173  3202 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:11.921864  3209 raft_consensus.cc:2393] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 9: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:11.890050  7138 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:11.925841  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:11.929239  7121 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.916947  6732 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:17:11.930430  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:11.930644  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:11.931059  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:11.931574  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1743) took 1222 ms. Trace:
I20260709 13:17:11.931372  7115 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:17:11.864418  6835 consensus_queue.cc:237] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:11.932068  3837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 711) took 1392 ms (client timeout 1595 ms). Trace:
I20260709 13:17:11.955549  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:11.903048  7151 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.949694  3127 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:11.955726  3837 rpcz_store.cc:269] 0709 13:17:10.539199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.539414 (+   215us) service_pool.cc:224] Handling call
0709 13:17:11.931849 (+1392435us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b5400475254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:11.931977 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198885120}
I20260709 13:17:11.950613  3133 raft_consensus.cc:2376] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16. Re-sending same reply.
I20260709 13:17:11.884425  6921 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.948067  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:11.953953  3211 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:11.947124  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:11.935230  3136 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:11.935478  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:11.935215  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:11.968736  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:11.932982  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:11.974087  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:11.888691  6755 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:11.974608  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:11.967875  3033 catalog_manager.cc:5697] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 6 to 7, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 7 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.975452  3206 raft_consensus.cc:2368] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10.
I20260709 13:17:11.894743  7117 raft_consensus.cc:740] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:11.974727  3130 raft_consensus.cc:2376] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7. Re-sending same reply.
W20260709 13:17:11.980019  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 97181.7us
I20260709 13:17:11.981714  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:11.982160  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.982508  3206 raft_consensus.cc:2410] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:11.932543  7094 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.932230  7102 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:11.987231  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:11.987231  7163 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:11.987941  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:11.950240  3210 rpcz_store.cc:276] 0709 13:17:10.708831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.515476 (+806645us) service_pool.cc:224] Handling call
0709 13:17:11.532426 (+ 16950us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:11.533601 (+  1175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.533645 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:11.552599 (+ 18954us) log.cc:844] Serialized 26 byte log entry
0709 13:17:11.661171 (+108572us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:11.661255 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.661455 (+   200us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:11.931345 (+269890us) raft_consensus.cc:1685] finished
0709 13:17:11.931365 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.931513 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14982,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":1507,"thread_start_us":43219,"threads_started":1,"wal-append.queue_time_us":312372}
I20260709 13:17:11.996114  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:11.993484  3129 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:11.994369  7139 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.997038  7163 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:11.997886  7139 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:11.999660  7163 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:12.000250  7139 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:11.992722  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:11.902129  7166 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:17:11.986637  3206 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:17:11.909380  7011 consensus_queue.cc:260] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:12.007310  3033 catalog_manager.cc:5697] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:11.975384  7151 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.020371  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:12.020157  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:11.957947  7003 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:17:12.025524  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:11.996277  7102 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.038317  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:11.993621  7080 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:12.036159  3805 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:12.034009  3127 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:17:12.043540  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:12.044667  3805 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:12.038987  3129 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:12.040355  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:12.006142  7088 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:12.050377  3805 leader_election.cc:400] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10.
I20260709 13:17:12.050834  3805 leader_election.cc:403] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:17:12.051652  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:12.053220  6491 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10.
I20260709 13:17:12.055328  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:12.056670  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:12.057482  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:12.057852  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:12.058475  3133 raft_consensus.cc:2376] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11. Re-sending same reply.
I20260709 13:17:12.057499  3136 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 8: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:12.059404  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:12.060019  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:12.060689  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:12.049453  3131 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:11.981467  7121 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.066632  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:12.056936  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:12.067337  3211 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:17:12.070639  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:12.062048  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:12.050241  3033 catalog_manager.cc:5697] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 4 to 8, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 8 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:12.065276  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:12.074223  3805 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:12.083215  6404 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.083894  6404 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:12.068694  7138 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:12.092141  6921 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:12.006439  7094 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.041559  7102 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.050078  7172 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.059137  7147 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:12.105707  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:12.116560  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:12.116889  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 60054.5us
I20260709 13:17:12.119220  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:12.121006  3806 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:12.060806  3127 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:12.118757  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:12.151544  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:12.153301  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:12.159404  3100 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:12.165730  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:12.167033  3131 raft_consensus.cc:2410] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:17:12.167958  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 47005.4us
I20260709 13:17:12.171154  3033 catalog_manager.cc:5697] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:12.168814  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:12.168879  3100 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:12.179978  6192 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:12.162477  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:12.125938  6491 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:12.126107  7112 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:12.184581  3250 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:12.139204  7000 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.191304  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:12.063290  7080 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:12.148608  6983 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:12.169292  7091 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.183280  6888 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:12.186900  7147 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:12.193277  7161 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.197307  7177 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:12.194873  7082 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:12.063669  7117 consensus_queue.cc:260] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.207298  7160 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:12.223162  3033 catalog_manager.cc:5697] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.203210  6491 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:12.225318  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:12.221367  3211 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:17:12.215308  6888 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.202792  7000 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.221194  7187 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:12.316677  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 296059us
I20260709 13:17:12.212996  6983 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.223250  7147 raft_consensus.cc:697] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:12.326196  3033 catalog_manager.cc:5697] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:12.236984  7003 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:12.339207  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:12.231923  7177 raft_consensus.cc:697] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:12.237879  7033 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.311750  6888 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.320695  7180 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:12.345333  3131 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:12.229205  7090 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.227259  7161 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:12.333510  6755 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:12.229415  7082 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.339514  7003 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:12.350292  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 159092us
I20260709 13:17:12.354015  7180 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.375825  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:12.391752  3131 raft_consensus.cc:3055] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:12.317315  7160 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:12.374341  3033 catalog_manager.cc:5697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:12.393419  3033 catalog_manager.cc:5697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 7, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 7 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.395251  3033 catalog_manager.cc:5697] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 5 to 6, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 6 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.388929  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:12.392206  3131 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:12.402411  7177 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:12.406481  3131 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.407606  3131 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.407774  7160 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:12.410142  7000 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:12.412905  3033 catalog_manager.cc:5697] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 2 to 5, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 5 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:12.414983  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:12.415840  3208 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:12.418627  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:12.419942  7034 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.362226  7189 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:12.426149  7082 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:12.423719  3033 catalog_manager.cc:5697] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:12.430508  6909 raft_consensus.cc:3055] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:12.430979  6909 raft_consensus.cc:740] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:12.437053  3202 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:12.438900  3209 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:12.440189  3209 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:12.441438  7011 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.444410  7082 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.390779  7121 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:12.445047  7082 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:12.448558  3131 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:12.455642  3209 raft_consensus.cc:3055] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:12.455469  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:12.456046  3209 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:12.432206  3033 catalog_manager.cc:5697] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 1 to 8. New cstate: current_term: 8 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:12.461481  3208 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:12.388653  7003 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:12.463728  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.331983  7187 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.404969  7180 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.482234  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:12.479547  3209 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.402880  6958 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:12.490192  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.491058  6192 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:12.424201  7090 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:12.403199  7133 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:12.488173  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:12.448894  7082 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:12.521763  3209 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.390170  7033 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:17:12.529928  3276 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:12.531181  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:12.531971  3832 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:12.480203  7183 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:12.431984  6909 consensus_queue.cc:260] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:12.539551  3207 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1747) took 1493 ms (client timeout 1820 ms). Trace:
I20260709 13:17:12.410236  7190 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:17:12.543056  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:12.544883  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:12.545632  3207 rpcz_store.cc:269] 0709 13:17:11.038999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.088486 (+ 49487us) service_pool.cc:224] Handling call
0709 13:17:12.532586 (+1444100us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b5400189a54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:12.532717 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580995840}
I20260709 13:17:12.389390  6491 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:12.546411  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 157870us
I20260709 13:17:12.561561  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:12.553665  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:12.578444  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:12.562243  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:12.563560  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:12.580822  3284 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:12.547160  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:12.562320  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:12.547537  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:12.460677  7189 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.552855  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:12.581781  3280 raft_consensus.cc:2410] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:12.546658  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:12.584965  3250 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:12.586694  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 379953us
I20260709 13:17:12.583112  3283 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
W20260709 13:17:12.580579  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 92507.5us
I20260709 13:17:12.546931  7181 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:12.646200  7104 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:12.646387  7181 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:12.647316  7172 consensus_meta.cc:287] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.543s	user 0.004s	sys 0.004s
I20260709 13:17:12.647759  7172 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:12.654148  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:12.654808  3281 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.656214  3276 raft_consensus.cc:2410] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:17:12.581557  3277 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
W20260709 13:17:12.662547  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.535375  7033 consensus_queue.cc:1243] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:12.648790  7181 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:12.668322  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:12.669103  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:12.682963  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:12.683467  3284 raft_consensus.cc:2410] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:17:12.555938  7184 log.cc:927] Time spent T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.331s	user 0.002s	sys 0.000s
W20260709 13:17:12.693445  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 108537us
I20260709 13:17:12.697904  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:12.563122  7188 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:12.713621  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:12.701273  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:12.700812  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:12.549198  7080 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:12.480393  7147 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:12.710140  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:12.722502  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:12.722615  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:12.724262  3284 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.643524  7205 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:12.735343  7033 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:12.739111  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:12.700464  6732 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:12.726334  6755 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:12.528584  7133 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:12.705121  7121 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:12.738420  3249 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:12.724869  6983 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:12.751681  7165 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:12.751860  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:12.788762  3283 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
W20260709 13:17:12.752627  7192 log.cc:927] Time spent T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
W20260709 13:17:12.753716  7200 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:17:12.757187  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:12.681747  7000 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:17:12.729384  3209 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:17:12.682816  6835 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:17:12.806787  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 122136us
I20260709 13:17:12.761018  3207 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:12.751168  7132 consensus_meta.cc:287] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.875s	user 0.010s	sys 0.003s
I20260709 13:17:12.694005  7093 consensus_queue.cc:1059] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 13:17:12.816999  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 89806.1us
I20260709 13:17:12.549957  7183 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.788663  7104 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.804216  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:12.804234  3209 pending_rounds.cc:85] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 6
I20260709 13:17:12.789724  7034 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:12.820114  3209 pending_rounds.cc:107] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:17:12.748831  7205 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.810045  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:12.748296  7181 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 13:17:12.815755  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 109214us
I20260709 13:17:12.819197  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:12.808154  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:12.797047  3284 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:12.820425  3209 raft_consensus.cc:2889] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:12.807802  7151 consensus_meta.cc:287] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.783s	user 0.009s	sys 0.004s
I20260709 13:17:12.826579  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:12.751924  7197 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 13:17:12.759176  6755 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:12.822522  7102 consensus_meta.cc:287] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.721s	user 0.008s	sys 0.006s
I20260709 13:17:12.816851  6404 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:12.821450  7034 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.790982  7121 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:12.739254  7188 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:12.848065  3276 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.830935  6732 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:12.857381  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:12.858951  7204 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:12.876207  7011 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.861140  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:12.879933  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:12.861716  7212 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:12.862534  6755 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:12.863741  7161 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:12.866791  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:12.850059  7187 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:12.885273  3128 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.823870  7104 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:12.885775  7189 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:12.887537  7205 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:12.888299  7208 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:12.869459  3283 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.873811  6732 raft_consensus.cc:697] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:12.875150  3280 raft_consensus.cc:2410] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:17:12.876991  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:12.878165  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:12.912775  3837 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:12.856909  7087 raft_consensus.cc:3055] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:12.917475  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:12.918138  7087 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:12.919010  7087 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:12.919970  6888 consensus_meta.cc:287] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.000s
I20260709 13:17:12.880973  7003 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.924151  6732 consensus_queue.cc:237] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.829252  7165 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:12.955266  7188 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:12.957374  7121 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:12.959342  7200 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:17:12.960954  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 484) took 1032 ms. Trace:
I20260709 13:17:12.961474  3135 rpcz_store.cc:276] 0709 13:17:11.928626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.928760 (+   134us) service_pool.cc:224] Handling call
0709 13:17:11.929206 (+   446us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:12.188879 (+259673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:12.188911 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:12.214441 (+ 25530us) log.cc:844] Serialized 52 byte log entry
0709 13:17:12.451030 (+236589us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:12.481577 (+ 30547us) log.cc:844] Serialized 14 byte log entry
0709 13:17:12.482017 (+   440us) log.cc:844] Serialized 14 byte log entry
0709 13:17:12.487724 (+  5707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.487837 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:12.960699 (+472862us) raft_consensus.cc:1685] finished
0709 13:17:12.960729 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:12.960888 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7157,"prepare.queue_time_us":30289,"prepare.run_wall_time_us":4577,"raft.queue_time_us":64333,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":39019,"spinlock_wait_cycles":12419840,"thread_start_us":398521,"threads_started":2,"wal-append.queue_time_us":311043}
I20260709 13:17:12.966676  7183 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:12.888422  7104 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:12.848755  7102 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.972555  7102 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:12.832257  7151 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:12.974445  3130 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:12.975605  7151 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:12.850512  7034 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:12.982223  7142 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.312s	user 0.006s	sys 0.000s
I20260709 13:17:12.987358  7208 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:12.987999  7208 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:12.989997  7111 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:17:12.991830  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:12.992515  3136 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:12.996886  7208 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:12.890774  3282 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:12.859954  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:12.892338  3806 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:12.872839  3276 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:12.915131  3128 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:12.819314  7185 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:17:12.920341  7087 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.932528  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:12.964975  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:12.937161  7203 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.938171  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:12.938778  6835 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:12.939201  7090 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:12.820441  7132 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:12.946307  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.011507  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 108780us
I20260709 13:17:13.012265  3251 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:12.949210  3283 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
W20260709 13:17:13.004902  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 112647us
W20260709 13:17:12.928488  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 109373us
I20260709 13:17:13.005159  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:13.013902  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:13.007426  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 147572us
I20260709 13:17:13.014467  3128 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:13.014789  3283 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
W20260709 13:17:13.009169  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 71097.3us
I20260709 13:17:13.007987  3281 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:13.014004  3806 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:13.008612  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:13.015771  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:13.016429  3136 raft_consensus.cc:2410] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:17:12.920399  6888 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:13.016944  3101 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:13.018365  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:13.020514  3101 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:13.019340  3806 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:13.024521  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:13.013918  3250 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:13.024085  3207 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:13.028632  7002 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:13.029215  7002 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.029606  7002 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:13.033987  3806 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:13.039338  3135 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:13.042354  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:13.044960  3135 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:13.046639  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:13.006505  6491 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.047286  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:13.018679  7111 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.024055  7197 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:13.025000  7183 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:13.054922  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:13.055807  3250 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:13.055924  3283 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:13.072216  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:13.074083  3282 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:13.037384  7147 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.077764  3101 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:13.079370  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:13.044458  7104 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.081941  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:13.084499  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:13.048128  7003 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:13.076714  3250 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:13.086997  3135 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:13.089838  7132 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:13.090950  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 94522.8us
I20260709 13:17:13.091038  3128 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:13.051697  7208 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:13.095033  7208 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:13.095453  7208 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.096238  7228 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:13.096822  7228 raft_consensus.cc:697] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:13.098234  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:13.093816  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:13.092551  3101 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:13.099110  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:13.099592  7093 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:13.019299  7090 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:13.097736  7228 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:13.100339  7197 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:13.100765  7197 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:13.101140  7197 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.101924  7090 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:13.057530  6983 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:13.082465  7110 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.109135  3250 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:13.092339  7217 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:13.051937  7218 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:13.118848  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 422) took 1097 ms. Trace:
I20260709 13:17:13.075460  6835 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:17:13.082852  6958 consensus_meta.cc:287] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.005s
I20260709 13:17:13.049973  7151 consensus_queue.cc:1059] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:17:13.139412  3250 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:13.113642  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:13.017266  7203 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:13.142095  3134 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:13.142771  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:13.125828  3279 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:13.119632  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:13.125583  3276 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:13.114992  3211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 2808) took 1112 ms. Trace:
I20260709 13:17:13.075029  7219 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.123600  3283 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:13.109395  6732 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:13.091137  7188 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.138533  3202 rpcz_store.cc:276] 0709 13:17:12.021768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.438213 (+416445us) service_pool.cc:224] Handling call
0709 13:17:13.116432 (+678219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:13.116643 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.116671 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:13.116716 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:13.116758 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.116980 (+   222us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.118673 (+  1693us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54003746d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:13.118774 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558876544}
I20260709 13:17:13.116752  7182 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:13.151084  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:13.151664  3202 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:13.141983  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 108121us
I20260709 13:17:13.144994  3211 rpcz_store.cc:276] 0709 13:17:12.002718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.153014 (+150296us) service_pool.cc:224] Handling call
0709 13:17:13.114797 (+961783us) spinlock_profiling.cc:243] Waited 67.2 ms on lock 0x7b54003746d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:13.114928 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154480512}
I20260709 13:17:13.125573  7002 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:13.147799  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:13.105779  7121 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:13.148834  3250 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:13.109122  7011 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:13.122761  7220 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:13.116554  7210 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:13.153330  3277 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.146165  7187 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:13.165199  7003 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.165490  7187 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.143630  7102 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:13.165961  7187 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.170828  7208 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:13.155977  3281 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:13.155757  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:13.173954  3283 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:13.144649  6935 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.138679  7218 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:13.157043  3207 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 7: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:13.154749  6732 raft_consensus.cc:697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:13.150393  7190 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:13.158708  6888 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:13.158952  7002 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:13.159162  3128 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:13.156908  7121 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.160991  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:13.145125  7217 raft_consensus.cc:697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:13.174587  3281 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:17:13.184650  3204 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:13.143096  7034 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:13.159410  7222 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:17:13.189383  6732 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:13.190837  6638 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:13.191293  6638 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.193456  3285 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:13.173133  7210 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.185403  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:13.187386  7221 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:17:13.173188  7220 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.187347  7217 consensus_queue.cc:237] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:13.178726  7102 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:17:13.187920  7138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.007s	user 0.005s	sys 0.008s
I20260709 13:17:13.185679  7121 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.181702  7218 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.199267  7220 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.215809  3202 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:13.197427  7210 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.182591  6935 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:13.219174  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:13.209139  7138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.005s	sys 0.008s
I20260709 13:17:13.222437  3128 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:13.239394  3279 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:13.243062  7210 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:13.243887  7121 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:13.206686  7102 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:13.240496  7208 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:13.247184  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:13.259617  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:13.250511  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:13.282316  3128 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:13.282605  3210 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.249549  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:17:13.254366  3134 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1663) took 1917 ms (client timeout 2242 ms). Trace:
I20260709 13:17:13.280114  6638 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:13.283617  3134 rpcz_store.cc:269] 0709 13:17:11.328506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.369828 (+ 41322us) service_pool.cc:224] Handling call
0709 13:17:13.245758 (+1875930us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400076054. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:13.245896 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3976007552}
I20260709 13:17:13.285534  6638 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:13.254736  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 488) took 1193 ms. Trace:
I20260709 13:17:13.285421  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:13.257912  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:13.205426  7187 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:13.291451  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:13.286271  3129 rpcz_store.cc:276] 0709 13:17:12.061430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.130854 (+ 69424us) service_pool.cc:224] Handling call
0709 13:17:12.131183 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:12.170620 (+ 39437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:12.170657 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:12.183496 (+ 12839us) log.cc:844] Serialized 26 byte log entry
0709 13:17:12.461701 (+278205us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:12.461747 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.470297 (+  8550us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.242867 (+772570us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b2400148418. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b8f889c4 00007fb3b8f86acb 00007fb3b9141dc9 00007fb3b9141a55 00007fb3b9140fb0 00007fb3bbdb7488 00007fb3bbdb7be8 00007fb3bbd8f398 00007fb3bbd8a76a 00007fb3bbd89bb6
0709 13:17:13.246016 (+  3149us) raft_consensus.cc:1685] finished
0709 13:17:13.246032 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.254640 (+  8608us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26897,"raft.queue_time_us":28560,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":16002,"spinlock_wait_cycles":28632960,"thread_start_us":240728,"threads_started":1,"wal-append.queue_time_us":466890}
I20260709 13:17:13.291426  7179 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:13.309917  3135 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:13.310281  3285 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:13.312238  3250 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:13.278810  7034 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:13.315783  3250 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:13.317384  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:13.252470  6983 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:13.318069  3127 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.293124  7203 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:13.328150  3128 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:17:13.330261  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:13.256510  7153 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:17:13.308385  7179 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:13.353649  7179 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.335455  3279 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:17:13.345435  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:13.355049  3279 pending_rounds.cc:85] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 8
I20260709 13:17:13.355326  3279 pending_rounds.cc:107] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:17:13.355468  3128 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 13: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:13.355556  3279 raft_consensus.cc:2889] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:13.349821  7233 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:17:13.350466  7187 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:13.353039  7102 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:13.320354  7190 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.362466  3210 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:13.320609  7208 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:13.364904  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:13.357681  7180 consensus_meta.cc:287] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.859s	user 0.013s	sys 0.000s
I20260709 13:17:13.364141  3100 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:13.368700  7157 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:13.368829  3117 tablet_service.cc:1558] Processing DeleteTablet for tablet 772d700b048349bf9547efac6befb60d with delete_type TABLET_DATA_TOMBSTONED (TS fc48eecc27554cb58b15193cd442b1d3 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40280
I20260709 13:17:13.369401  7157 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:13.372521  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:13.317340  7177 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
W20260709 13:17:13.364308  7223 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 13:17:13.380679  3250 leader_election.cc:336] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.690s (SENT)
I20260709 13:17:13.387166  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:13.387557  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1422) took 1168 ms. Trace:
I20260709 13:17:13.388001  3135 rpcz_store.cc:276] 0709 13:17:12.219053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.095023 (+875970us) service_pool.cc:224] Handling call
0709 13:17:13.095290 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:13.314091 (+218801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.387253 (+ 73162us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54000e15d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:13.387489 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492004224}
I20260709 13:17:13.381691  3127 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:13.384379  7117 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.326144  6983 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:13.364106  7208 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:13.391978  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:13.371834  7102 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:13.394825  3250 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:13.392009  7190 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:13.414374  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:13.414750  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:13.415622  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:13.394270  7208 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.374193  7180 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:13.402143  7187 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:13.424539  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:13.427670  3128 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.408571  7102 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:13.484581  3277 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
W20260709 13:17:13.483747  7223 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:17:13.488973  3280 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:13.496532  3128 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:13.498623  6983 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:13.501412  7102 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:13.503023  7220 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:13.504170  3283 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:13.505302  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:13.506676  3128 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:13.508157  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:13.508946  3128 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 13: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:13.509672  3177 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:13.513790  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:13.514478  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:13.515270  3128 raft_consensus.cc:2410] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:17:13.390554  7157 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:13.516695  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:13.490227  7121 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:13.519346  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:13.610360  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 157970us
I20260709 13:17:13.853490  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:13.972536  3128 raft_consensus.cc:2368] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12.
I20260709 13:17:13.519836  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:13.975735  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:13.976518  3128 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.702641  6955 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:13.978037  6955 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:13.924219  7241 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:13.674943  7218 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:13.983222  3135 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:13.776495  7187 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.984089  7187 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:13.987054  7187 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:13.785910  3250 leader_election.cc:336] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.095s (SENT)
I20260709 13:17:14.025303  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:13.663832  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.597491  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:14.026597  3842 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:14.026701  3128 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:14.001248  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:14.003696  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:13.507557  6983 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:13.982036  7241 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:13.578648  7180 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:13.583966  7197 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:13.745878  7147 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:14.017194  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:14.018009  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:14.033812  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:13.601832  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1408) took 1014 ms. Trace:
I20260709 13:17:13.597115  7242 tablet_replica.cc:333] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
W20260709 13:17:14.029889  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 244047us
W20260709 13:17:14.002238  7175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.019s	sys 0.009s
I20260709 13:17:13.520004  6916 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:14.038141  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:14.038976  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:14.047124  3209 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.046980  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:13.956153  7220 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:14.042920  3102 connection.cc:256] RPC call timeout handler was delayed by -1.2870176110000102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:17:14.049682  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:14.034545  3278 rpcz_store.cc:276] 0709 13:17:12.587848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.881917 (+294069us) service_pool.cc:224] Handling call
0709 13:17:12.882224 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:12.882573 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:12.882604 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:12.883094 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:17:13.005945 (+122851us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:13.022728 (+ 16783us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.046162 (+ 23434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.046268 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.232244 (+185976us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b18004350a0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:13.520088 (+287844us) raft_consensus.cc:1685] finished
0709 13:17:13.601231 (+ 81143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.601684 (+   453us) inbound_call.cc:177] Queueing success response
0709 13:17:14.020005 (+418321us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b18004350a0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b9102557 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
Metrics: {"mutex_wait_us":17615,"prepare.queue_time_us":17357,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":25798,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":18981,"spinlock_wait_cycles":12409984,"thread_start_us":122342,"threads_started":1,"wal-append.queue_time_us":204850}
I20260709 13:17:14.055001  3210 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:14.052759  6916 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:14.060423  6916 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:14.048722  7175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.019s	sys 0.009s
I20260709 13:17:14.035280  7187 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.043529  7217 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:14.070452  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:14.028134  6983 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:14.075518  3209 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
W20260709 13:17:14.076304  3203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.007s	sys 0.019s
W20260709 13:17:14.077546  3203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.008s	sys 0.019s
I20260709 13:17:14.070545  6916 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.072861  6955 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:14.082194  3211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.011s	sys 0.019s
W20260709 13:17:14.085180  3211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.011s	sys 0.020s
I20260709 13:17:14.072973  7153 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:14.088056  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:14.045364  7147 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:14.090154  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 573) took 1215 ms. Trace:
I20260709 13:17:14.074815  7217 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:14.089437  6916 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:14.081665  6890 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:14.097959  3278 rpcz_store.cc:276] 0709 13:17:12.875099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.076037 (+1200938us) service_pool.cc:224] Handling call
0709 13:17:14.089773 (+ 13736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.089948 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:14.089963 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:14.089991 (+    28us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:14.090009 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.090042 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.090111 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:14.080569  7160 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:14.094960  7117 consensus_meta.cc:287] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.000s
I20260709 13:17:14.105890  7197 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:14.107820  3133 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:17:14.111996  6958 raft_consensus.cc:3055] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:14.112361  6916 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:14.112440  6958 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:14.114526  6958 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:14.115561  6958 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.112411  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 574) took 1237 ms. Trace:
I20260709 13:17:14.116214  3278 rpcz_store.cc:276] 0709 13:17:12.875394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.104770 (+1229376us) service_pool.cc:224] Handling call
0709 13:17:14.111441 (+  6671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.111625 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:14.111651 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:14.111695 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:14.111729 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.111781 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.112356 (+   575us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:14.109930  7179 consensus_meta.cc:287] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.756s	user 0.010s	sys 0.005s
I20260709 13:17:14.109686  7217 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:14.095342  7153 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:14.113603  7218 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:14.107009  7160 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:14.126983  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1424) took 1210 ms. Trace:
I20260709 13:17:14.128345  3278 rpcz_store.cc:276] 0709 13:17:12.914633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.117439 (+1202806us) service_pool.cc:224] Handling call
0709 13:17:14.124116 (+  6677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.124313 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:14.124336 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:14.124373 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:14.124407 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.124458 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.124575 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:14.148240  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.147495  7241 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:14.121328  7179 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:14.175853  7147 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:14.177330  7133 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:14.178090  7160 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:14.173967  7247 log.cc:927] Time spent T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:17:14.173697  6935 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:14.191321  6983 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:14.204972  7094 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:14.212291  7242 raft_consensus.cc:2243] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:14.215997  7208 consensus_meta.cc:287] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.794s	user 0.010s	sys 0.003s
I20260709 13:17:14.230199  7208 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:14.217347  7153 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:14.327406  7250 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.102s	user 0.009s	sys 0.000s
I20260709 13:17:14.349526  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1687) took 1181 ms. Trace:
I20260709 13:17:14.350013  3128 rpcz_store.cc:276] 0709 13:17:13.168063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.027518 (+859455us) service_pool.cc:224] Handling call
0709 13:17:14.027881 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:14.148846 (+120965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:14.148875 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:14.149401 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:17:14.197042 (+ 47641us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:14.198922 (+  1880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.199088 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.349240 (+150152us) raft_consensus.cc:1685] finished
0709 13:17:14.349262 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.349453 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2920,"raft.queue_time_us":60804,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":7986,"thread_start_us":164773,"threads_started":2,"wal-append.queue_time_us":65160}
I20260709 13:17:14.353724  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:14.357693  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:14.363221  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:14.363940  3128 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:14.364775  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:14.366446  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:14.368038  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:14.370685  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:14.370733  7207 log.cc:927] Time spent T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 1.544s	user 0.009s	sys 0.009s
I20260709 13:17:14.370922  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:14.371603  3134 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.372812  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:14.373703  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:14.373940  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:14.376442  3250 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:14.377339  7102 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:14.377929  7240 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.866s	user 0.003s	sys 0.011s
I20260709 13:17:14.378125  7102 raft_consensus.cc:697] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:14.378515  7210 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:14.379284  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2843) took 1131 ms. Trace:
I20260709 13:17:14.379436  7102 consensus_queue.cc:237] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:14.380232  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:14.382711  3133 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1678) took 2326 ms (client timeout 2095 ms). Trace:
W20260709 13:17:14.383185  3133 rpcz_store.cc:269] 0709 13:17:12.055828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.060447 (+  4619us) service_pool.cc:224] Handling call
0709 13:17:14.382452 (+2322005us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54000690d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:14.382590 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4705669888}
W20260709 13:17:14.385250  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.379760  3202 rpcz_store.cc:276] 0709 13:17:13.247440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.251234 (+  3794us) service_pool.cc:224] Handling call
0709 13:17:13.251961 (+   727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.257898 (+  5937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.257927 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:13.258385 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:17:13.364013 (+105628us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:13.364052 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.364116 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.343497 (+979381us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:14.379005 (+ 35508us) raft_consensus.cc:1685] finished
0709 13:17:14.379028 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.379226 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5000,"raft.queue_time_us":5513,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":21925,"spinlock_wait_cycles":9513344,"thread_start_us":55688,"threads_started":1,"wal-append.queue_time_us":127092}
I20260709 13:17:14.392375  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:14.393957  3134 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
W20260709 13:17:14.394083  3130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1673) took 2339 ms (client timeout 1690 ms). Trace:
I20260709 13:17:14.356021  7242 raft_consensus.cc:2272] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:14.354434  7179 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:14.397706  3136 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:14.395125  3130 rpcz_store.cc:269] 0709 13:17:12.054203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.057208 (+  3005us) service_pool.cc:224] Handling call
0709 13:17:14.393841 (+2336633us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b5400075654. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:14.394015 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2106916608}
I20260709 13:17:14.395351  3250 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:14.406775  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:14.418095  3250 leader_election.cc:400] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12.
I20260709 13:17:14.418486  3250 leader_election.cc:403] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:14.420274  7180 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:14.420584  7256 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:17:14.421259  7220 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:14.422171  7257 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:17:14.419513  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:14.397670  7000 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:14.433467  7220 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12.
I20260709 13:17:14.435513  3130 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:14.399462  7160 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:14.437929  7160 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:14.440186  7160 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:14.433372  7180 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:14.436966  3130 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:14.414546  7187 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:14.444002  3250 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:14.445998  7208 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:14.470211  3127 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:14.471196  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 496) took 1159 ms. Trace:
I20260709 13:17:14.471673  3127 rpcz_store.cc:276] 0709 13:17:13.312242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.375862 (+1063620us) service_pool.cc:224] Handling call
0709 13:17:14.469408 (+ 93546us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b5800002798. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:17:14.469707 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.470842 (+  1135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.471107 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67943168}
W20260709 13:17:14.473600  7260 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:17:14.474437  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1414) took 2322 ms. Trace:
I20260709 13:17:14.474963  3136 rpcz_store.cc:276] 0709 13:17:12.152003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.038128 (+886125us) service_pool.cc:224] Handling call
0709 13:17:14.394772 (+1356644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.406029 (+ 11257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.474123 (+ 68094us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400075650. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:14.474356 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3119039872}
I20260709 13:17:14.478652  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1427) took 1345 ms. Trace:
I20260709 13:17:14.479295  3278 rpcz_store.cc:276] 0709 13:17:13.133184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.138158 (+1004974us) service_pool.cc:224] Handling call
0709 13:17:14.138594 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:14.138999 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:14.139038 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:14.139813 (+   775us) log.cc:844] Serialized 26 byte log entry
0709 13:17:14.219378 (+ 79565us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:14.219435 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.219525 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.478370 (+258845us) raft_consensus.cc:1685] finished
0709 13:17:14.478398 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.478573 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2191,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3741,"thread_start_us":79037,"threads_started":1,"wal-append.queue_time_us":187923}
I20260709 13:17:14.485123  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1694) took 1307 ms. Trace:
I20260709 13:17:14.485281  7095 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:14.485636  3131 rpcz_store.cc:276] 0709 13:17:13.178243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.029998 (+851755us) service_pool.cc:224] Handling call
0709 13:17:14.044092 (+ 14094us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:14.149515 (+105423us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:14.235958 (+ 86443us) log.cc:844] Serialized 14 byte log entry
0709 13:17:14.415156 (+179198us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:14.415577 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:17:14.415701 (+   124us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:14.415736 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.415799 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.484865 (+ 69066us) raft_consensus.cc:1685] finished
0709 13:17:14.484887 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.485035 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":725,"prepare.queue_time_us":191272,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":58173,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":21918,"thread_start_us":249450,"threads_started":3,"wal-append.queue_time_us":154360}
I20260709 13:17:14.488288  3130 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:17:14.494282  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:14.496094  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2845) took 1127 ms. Trace:
I20260709 13:17:14.496523  3210 rpcz_store.cc:276] 0709 13:17:13.369070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.369300 (+   230us) service_pool.cc:224] Handling call
0709 13:17:13.369966 (+   666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.055464 (+685498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.495701 (+440237us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54001d6854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:14.496030 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1574999296}
I20260709 13:17:14.461485  7220 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:14.500788  3832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 807) took 1599 ms. Trace:
I20260709 13:17:14.501348  3832 rpcz_store.cc:276] 0709 13:17:12.892960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.893146 (+   186us) service_pool.cc:224] Handling call
0709 13:17:14.490729 (+1597583us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b5800003c98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:17:14.490995 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.491300 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:14.491341 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:14.491643 (+   302us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:14.491719 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.491833 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.492109 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4107136}
I20260709 13:17:14.506460  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52014 (request call id 564) took 1854 ms. Trace:
I20260709 13:17:14.506963  3277 rpcz_store.cc:276] 0709 13:17:12.652216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.803939 (+151723us) service_pool.cc:224] Handling call
0709 13:17:14.506228 (+1702289us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b540005ffd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:14.506365 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766886784}
I20260709 13:17:14.511824  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1422) took 1659 ms. Trace:
I20260709 13:17:14.512315  3280 rpcz_store.cc:276] 0709 13:17:12.852271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.321271 (+469000us) service_pool.cc:224] Handling call
0709 13:17:13.356870 (+ 35599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:13.497193 (+140323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.511429 (+1014236us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400435dd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:14.511662 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298604800}
I20260709 13:17:14.517356  3133 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:17:14.543147  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 497) took 1136 ms. Trace:
I20260709 13:17:14.543632  3133 rpcz_store.cc:276] 0709 13:17:13.407306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.384147 (+976841us) service_pool.cc:224] Handling call
0709 13:17:14.516467 (+132320us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b5800002798. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:17:14.516984 (+   517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:14.542778 (+ 25794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.543074 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48500480}
I20260709 13:17:14.519434  3134 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:14.546411  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:14.521049  3130 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:14.524422  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.534077  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:14.550711  3202 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:14.541642  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:14.553895  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 55134.1us
I20260709 13:17:14.555648  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:14.560052  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:14.579857  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:14.572568  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:14.566248  3133 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:14.506454  3131 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:14.578912  7180 raft_consensus.cc:697] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:14.563534  7220 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:14.566946  7163 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.572264  7190 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.582154  7000 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.597852  7185 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.585773  7187 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:14.583338  6921 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:14.610747  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:14.618687  3805 leader_election.cc:336] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.503s (SENT)
I20260709 13:17:14.584992  7242 ts_tablet_manager.cc:1916] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:14.619622  3805 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:14.621016  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:14.627861  3176 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:14.628466  3805 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:14.635592  7095 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:14.614972  7000 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:14.645613  7265 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:17:14.646011  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1681) took 1481 ms. Trace:
I20260709 13:17:14.646449  3135 rpcz_store.cc:276] 0709 13:17:13.164411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.401256 (+236845us) service_pool.cc:224] Handling call
0709 13:17:14.645763 (+1244507us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b540036a6d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:14.645942 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1306175360}
I20260709 13:17:14.646905  7000 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:14.647523  7000 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:14.648000  7000 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:14.648355  6983 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:14.627950  7133 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:14.649559  7133 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:14.650157  7133 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.650279  6890 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:14.650888  6890 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.610335  7163 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:14.654924  3207 raft_consensus.cc:2393] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:14.655391  7187 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:14.612109  7190 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:14.639565  7253 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.629608  6921 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:14.661500  7220 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:14.665674  7147 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:14.617480  7259 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:14.666275  7147 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:14.666635  7259 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:14.657253  3133 raft_consensus.cc:1240] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:14.667682  6888 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:14.669431  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1695) took 1484 ms. Trace:
I20260709 13:17:14.671265  3132 rpcz_store.cc:276] 0709 13:17:13.184743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.374976 (+1190233us) service_pool.cc:224] Handling call
0709 13:17:14.375274 (+   298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:14.385566 (+ 10292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:14.385596 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:14.415584 (+ 29988us) log.cc:844] Serialized 52 byte log entry
0709 13:17:14.525513 (+109929us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:14.573092 (+ 47579us) log.cc:844] Serialized 14 byte log entry
0709 13:17:14.660662 (+ 87570us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b1800327be0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b907cc0a 00007fb3c27bc219 00007fb3b9104a40 00007fb3b90ff4e4 00007fb3b90ff455 00007fb3bc1e7060 00007fb3bc1f9716 00007fb3bc20a287 00007fb3bc20a208
0709 13:17:14.661083 (+   421us) log.cc:844] Serialized 14 byte log entry
0709 13:17:14.669004 (+  7921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.669099 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.669219 (+   120us) raft_consensus.cc:1685] finished
0709 13:17:14.669235 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.669372 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9396,"prepare.queue_time_us":60422,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":2384,"raft.queue_time_us":90018,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":252,"spinlock_wait_cycles":5252480,"thread_start_us":91796,"threads_started":1,"wal-append.queue_time_us":155032}
I20260709 13:17:14.682292  7147 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:14.692046  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.698678  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 498) took 1279 ms. Trace:
I20260709 13:17:14.700839  3129 rpcz_store.cc:276] 0709 13:17:13.419471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.388028 (+968557us) service_pool.cc:224] Handling call
0709 13:17:14.477744 (+ 89716us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b5800002798. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:17:14.478067 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.478360 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:14.478741 (+   381us) log.cc:844] Serialized 14 byte log entry
0709 13:17:14.698177 (+219436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:14.698279 (+   102us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:14.698342 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.698439 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.698599 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97447,"prepare.queue_time_us":8527,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"spinlock_wait_cycles":47286144,"thread_start_us":121425,"threads_started":1,"wal-append.queue_time_us":179827}
I20260709 13:17:14.704715  6921 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:14.705641  7190 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:14.706646  7163 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:14.704720  7210 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:17:14.710253  7210 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:14.710620  7210 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:14.711500  7210 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:14.712716  7210 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:14.713491  7133 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:14.718859  7133 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:14.720047  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:14.721169  7160 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:14.721764  7160 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:14.722869  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:14.727958  3281 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:14.734485  3135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56db43db40f644309c6db08523b1b033"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:14.735303  3135 raft_consensus.cc:606] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:14.738843  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:14.741536  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:14.752200  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.753762  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:14.754951  3277 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.761752  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:14.762861  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:14.766659  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:14.767554  3278 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:14.737964  7095 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:14.775635  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 566) took 2122 ms. Trace:
I20260709 13:17:14.776207  3276 rpcz_store.cc:276] 0709 13:17:12.652822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.150644 (+497822us) service_pool.cc:224] Handling call
0709 13:17:13.162077 (+ 11433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:13.172380 (+ 10303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.172411 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:13.172453 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:13.172490 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.775360 (+1602870us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b54002f94d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:14.775415 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.775555 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23182592}
I20260709 13:17:14.749958  7268 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:14.800805  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:14.803849  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:14.810124  3276 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:14.812836  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:14.814917  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:14.768664  6909 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:14.820242  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1418) took 1991 ms. Trace:
I20260709 13:17:14.820772  3285 rpcz_store.cc:276] 0709 13:17:12.828873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.202295 (+373422us) service_pool.cc:224] Handling call
0709 13:17:13.202534 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:13.314290 (+111756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.819951 (+1505661us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54001775d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:14.820169 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247317888}
I20260709 13:17:14.822328  7000 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:14.818113  7087 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:14.818264  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1414) took 2163 ms. Trace:
I20260709 13:17:14.818682  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:14.831666  3278 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.831822  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:14.819248  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:14.833698  3282 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.736100  7180 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:14.830544  3283 rpcz_store.cc:276] 0709 13:17:12.673564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.186230 (+512666us) service_pool.cc:224] Handling call
0709 13:17:13.203103 (+ 16873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:13.504562 (+301459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.818051 (+1313489us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54001e00d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:14.818206 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691952896}
I20260709 13:17:14.822420  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:14.838992  3285 raft_consensus.cc:2410] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:17:14.773307  7095 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.816893  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:14.816958  3250 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:14.829649  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:14.829111  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:14.824317  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:14.840121  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:14.877676  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:14.895970  3276 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:14.897799  3135 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:14.897137  3134 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:14.856455  3277 raft_consensus.cc:2410] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 13:17:14.906273  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 89397.8us
I20260709 13:17:14.903728  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 572) took 2029 ms. Trace:
I20260709 13:17:14.904428  3837 raft_consensus.cc:2393] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 7: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:14.910621  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:14.911325  6890 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:14.881812  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:14.916882  3836 raft_consensus.cc:2393] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 13: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
W20260709 13:17:14.918484  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 304251us
I20260709 13:17:14.907482  3279 rpcz_store.cc:276] 0709 13:17:12.874736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.366369 (+491633us) service_pool.cc:224] Handling call
0709 13:17:13.388440 (+ 22071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:13.388589 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:13.388848 (+   259us) log.cc:844] Serialized 14 byte log entry
0709 13:17:14.521834 (+1132986us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b18002f96e0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f23a 00007fb3bc1f9a2a
0709 13:17:14.903257 (+381423us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:14.903329 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:14.903399 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.903486 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.903654 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":133,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3608,"spinlock_wait_cycles":3236736,"thread_start_us":381161,"threads_started":1}
I20260709 13:17:14.919556  3249 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:14.927210  3249 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:14.927807  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:14.928442  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 300644us
I20260709 13:17:14.932657  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2833) took 1924 ms. Trace:
I20260709 13:17:14.933363  3208 rpcz_store.cc:276] 0709 13:17:13.008079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.008205 (+   126us) service_pool.cc:224] Handling call
0709 13:17:13.037591 (+ 29386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.049302 (+ 11711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.049327 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:13.049814 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:17:14.514656 (+1464842us) spinlock_profiling.cc:243] Waited 6.55 ms on lock 0x7b18004701a0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:17:14.719103 (+204447us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:14.719144 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.719218 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.918264 (+199046us) raft_consensus.cc:1685] finished
0709 13:17:14.918286 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.932570 (+ 14284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":417,"raft.queue_time_us":13665,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":21988,"spinlock_wait_cycles":15068544,"thread_start_us":204260,"threads_started":1,"wal-append.queue_time_us":1748177}
I20260709 13:17:14.935683  3283 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:14.932530  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:14.844405  7095 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.845327  7177 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:14.892436  7185 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:14.844588  7197 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:14.982513  7197 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:14.840684  7087 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:14.985875  7087 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:14.989333  3278 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:14.949101  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:14.815030  7268 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:14.940646  7261 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:17:14.976106  3282 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:14.947284  7163 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:17:14.941659  7259 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:14.979254  6909 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:14.979748  3285 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:17:15.011024  7259 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:14.926928  7218 consensus_queue.cc:1059] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:17:14.980824  7253 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:15.014422  7253 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:15.014524  3206 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:15.014834  7253 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:15.015708  7253 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.017014  7210 raft_consensus.cc:3055] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:15.017789  7210 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:15.018791  7210 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.020464  3280 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:14.942122  7133 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:17:14.982010  7185 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:14.981637  7177 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.000012  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.025596  3202 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:14.968235  7002 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:15.003211  3208 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:15.009428  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:15.009536  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:15.044337  3211 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.001691  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:15.046262  3842 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:17:15.030161  7177 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:15.037910  6890 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:15.039062  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:15.019923  6921 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.045939  7121 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:15.046876  3276 raft_consensus.cc:2376] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13. Re-sending same reply.
I20260709 13:17:14.967705  6983 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:17:15.057324  3277 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:15.060496  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:15.029229  3283 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:15.053005  7160 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:15.063668  7002 raft_consensus.cc:697] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:17:15.095106  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 404023us
I20260709 13:17:15.091169  3836 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:15.063373  7228 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:15.109736  3276 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:17:15.093896  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 465463us
I20260709 13:17:15.115191  7095 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.116887  7268 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:15.104837  3211 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
W20260709 13:17:15.175509  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 333799us
I20260709 13:17:15.105320  7121 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.104563  6921 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.119143  7228 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.186839  3211 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:15.188467  7228 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:15.173553  7274 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:15.177484  7095 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:15.195331  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.198022  3211 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:15.203544  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 294280us
W20260709 13:17:15.201668  7102 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.004s	sys 0.014s
I20260709 13:17:15.210860  7100 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.226161  3177 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:15.190059  6983 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:15.227623  3177 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:15.234476  3130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:15.235378  3130 raft_consensus.cc:606] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:15.235888  3130 raft_consensus.cc:614] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:15.236220  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1697) took 2030 ms. Trace:
W20260709 13:17:15.211223  7102 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.005s	sys 0.014s
W20260709 13:17:15.238443  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 343158us
I20260709 13:17:15.225483  6958 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.248911  3101 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:15.231349  7160 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:15.185424  7002 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:15.251024  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 304632us
W20260709 13:17:15.253654  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.236969  7133 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:15.229466  7100 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.198686  7180 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.237165  7163 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.199204  7274 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.230221  7284 consensus_queue.cc:1059] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:17:15.204628  7281 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 13:17:15.245826  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 318651us
I20260709 13:17:15.237427  6983 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.255926  7160 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:15.260453  7133 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:15.256006  6958 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.253049  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:15.281440  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:15.281776  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 52603.2us
W20260709 13:17:15.281625  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 167607us
I20260709 13:17:15.255612  3128 rpcz_store.cc:276] 0709 13:17:13.205967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.375532 (+1169565us) service_pool.cc:224] Handling call
0709 13:17:14.405094 (+ 29562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:14.406251 (+  1157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:14.406286 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:14.415163 (+  8877us) log.cc:844] Serialized 26 byte log entry
0709 13:17:14.583436 (+168273us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:14.943892 (+360456us) log.cc:844] Serialized 14 byte log entry
0709 13:17:15.235835 (+291943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.235918 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:15.235959 (+    41us) raft_consensus.cc:1685] finished
0709 13:17:15.235974 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:15.236137 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80786,"prepare.queue_time_us":73321,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":55592,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":27957,"thread_start_us":715071,"threads_started":3,"wal-append.queue_time_us":216235}
I20260709 13:17:15.288998  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:15.292521  3249 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:15.274277  7160 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.277678  7133 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.266554  7163 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.285820  7187 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:15.265894  7180 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.302505  7284 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:15.297309  7281 raft_consensus.cc:3055] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:15.296653  7293 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:15.334313  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:15.338065  3249 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:15.297737  7289 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:15.341773  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 60399.6us
W20260709 13:17:15.367486  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 254729us
I20260709 13:17:15.368865  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:15.334619  7284 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:17:15.373782  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 159239us
I20260709 13:17:15.308295  7297 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:15.375944  3249 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:15.378880  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 88248.5us
I20260709 13:17:15.336685  7273 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.333024  7281 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:15.376289  7087 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:15.373571  7185 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:15.367692  7196 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:15.317625  7187 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.397125  6909 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:17:15.449257  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.452662  7274 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:15.449286  7284 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.457724  7284 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:15.458612  7288 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 13:17:15.457860  7294 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:17:15.457106  7287 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:17:15.461314  7281 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:15.463439  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:15.454799  7283 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260709 13:17:15.495146  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 110984us
W20260709 13:17:15.501906  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 253088us
I20260709 13:17:15.502851  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:15.396270  7273 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.464931  7100 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:15.513754  6983 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:15.564065  7299 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:17:15.565413  7163 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:15.569391  7180 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:15.465731  7311 consensus_queue.cc:1059] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:17:15.571029  7305 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:15.571867  7305 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.571532  7147 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:15.572376  7305 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.559384  7281 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.575213  7160 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.578866  7286 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.582486  7160 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:15.582886  7273 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:15.586779  7305 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:15.588573  7293 raft_consensus.cc:3055] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:15.589221  7293 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:15.590075  7293 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.591270  7293 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:15.603271  7100 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.605762  6958 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:15.510776  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 226644us
W20260709 13:17:15.545219  7295 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:17:15.545441  7187 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:15.614187  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 238293us
I20260709 13:17:15.604264  7100 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.634850  3249 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:15.559118  7218 raft_consensus.cc:993] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:17:15.637619  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:15.640038  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:15.641180  3833 raft_consensus.cc:2410] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:17:15.663226  3285 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:15.664691  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:15.665460  3280 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:17:15.640256  7102 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:15.666857  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:15.667750  3281 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:15.669943  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:15.670221  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 119860us
I20260709 13:17:15.580900  7286 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.670259  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:15.672930  3285 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:17:15.675572  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:15.676031  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:15.673755  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:15.676203  3279 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.676978  3277 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:15.676427  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:15.678148  3278 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:15.678720  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 294470us
I20260709 13:17:15.657509  7273 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:15.686996  7273 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.659529  7290 raft_consensus.cc:1081] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:17:15.682188  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:15.692232  3833 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:15.692420  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 246645us
I20260709 13:17:15.657341  7033 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:15.681209  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 178432us
I20260709 13:17:15.686302  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:15.675547  7102 raft_consensus.cc:697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:15.697515  7318 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:15.682926  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:15.697753  3842 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:15.690796  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:15.698896  3836 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:15.697767  7286 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:15.695509  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:15.689684  7273 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:15.704999  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:15.706207  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:15.706512  3279 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:15.706945  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:15.708102  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:15.709121  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:15.709434  7242 ts_tablet_manager.cc:1929] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
W20260709 13:17:15.709792  7280 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.505s	user 0.004s	sys 0.013s
I20260709 13:17:15.709765  3277 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.709971  7242 log.cc:1199] T 772d700b048349bf9547efac6befb60d P fc48eecc27554cb58b15193cd442b1d3: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-0-root/wals/772d700b048349bf9547efac6befb60d
I20260709 13:17:15.713874  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:15.716202  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:15.718706  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:15.723834  3278 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
W20260709 13:17:15.727772  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.722313  3100 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:15.697825  7033 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.710213  7100 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:15.730055  3836 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:15.735016  3277 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:15.737977  7326 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:15.738986  7242 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40280 (request call id 0) took 2424 ms. Trace:
I20260709 13:17:15.739483  3101 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:15.738976  7321 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.739758  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:15.740787  7321 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.740281  7242 rpcz_store.cc:276] 0709 13:17:13.356695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.368531 (+ 11836us) service_pool.cc:224] Handling call
0709 13:17:13.585757 (+217226us) ts_tablet_manager.cc:1151] Deleting tablet 772d700b048349bf9547efac6befb60d
0709 13:17:13.585895 (+   138us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:17:14.982118 (+1396223us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:15.709269 (+727151us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:15.738896 (+ 29627us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106792,"tablet-delete.queue_time_us":150261,"thread_start_us":29905,"threads_started":1}
I20260709 13:17:15.740689  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:15.743249  7321 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:15.740420  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:15.744895  3836 raft_consensus.cc:2410] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:17:15.745131  7321 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:15.746323  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:15.746456  7293 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:15.746559  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:15.747056  7326 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:15.729801  3806 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:15.748639  7326 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:15.748976  7293 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:15.748039  7321 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:15.718600  7318 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:15.751111  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:15.753958  7293 raft_consensus.cc:3055] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:15.754446  7293 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:15.754194  7321 raft_consensus.cc:697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:15.755393  7121 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:15.755359  7293 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.757321  7293 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:15.759534  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:15.755571  7321 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.761319  7091 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:15.698153  7102 consensus_queue.cc:237] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.762184  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:15.763576  3101 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:15.729056  7312 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:15.764992  7324 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:15.767546  3806 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:15.778450  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.770470  3251 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:15.779721  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.780325  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:17:15.774224  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.782755  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.783572  3211 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:15.783617  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.782706  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.784521  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.784965  3202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56db43db40f644309c6db08523b1b033"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:17:15.785494  3202 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:15.785857  3202 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.777545  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.788132  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:15.772693  7312 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.789686  7312 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.789808  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:15.790336  7315 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:15.790894  7315 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.790994  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.791441  7315 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:15.792356  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.793702  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.794389  3134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:15.794986  3209 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:15.795202  3134 raft_consensus.cc:606] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:15.795964  3134 raft_consensus.cc:614] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:15.796859  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:15.793658  7324 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:15.799685  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.800347  3209 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 7.
I20260709 13:17:15.801730  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.799604  7324 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.803349  7324 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.803900  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.805974  3206 raft_consensus.cc:3055] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:15.806277  3206 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:15.806964  3206 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.807883  3206 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.810034  7197 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:15.811230  3207 raft_consensus.cc:3055] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:15.811602  3207 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:15.776916  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:15.767539  6890 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:15.773593  7259 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.824096  3209 raft_consensus.cc:3055] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:15.771641  7286 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:15.829094  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:15.774513  7163 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:15.840669  7163 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.775487  7297 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:15.845372  7297 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.829192  3209 raft_consensus.cc:740] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:15.785637  7210 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.786916  7290 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:15.786623  7180 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:15.831063  7311 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:15.847317  7311 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:15.847594  7297 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:15.847729  7311 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.829125  6909 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:17:15.849383  6909 consensus_queue.cc:1243] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer 0930e3e7657c43bcaaa5b0778f3e08cf log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:17:15.850389  7324 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.853843  3209 consensus_queue.cc:260] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.835479  6921 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:15.821770  7284 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:17:15.836364  7286 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:15.856355  7286 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:15.856109  7311 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.826356  7253 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:15.859421  7324 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:15.859685  7311 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:15.856950  3202 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.822292  7187 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:15.814123  7322 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:17:15.772874  7309 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:15.861984  3209 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.820035  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:15.839682  7292 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:15.863296  7163 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:15.823992  3204 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:15.864794  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.865537  3204 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 6.
I20260709 13:17:15.842355  3134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:15.866209  7286 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.854213  7033 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:15.863162  7292 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:15.774381  6983 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.867022  3134 raft_consensus.cc:606] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
W20260709 13:17:15.867799  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47857.5us
I20260709 13:17:15.842727  3249 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:15.868258  7311 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:15.870491  3202 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:15.907907  7311 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:15.908486  3835 pending_rounds.cc:85] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 11
I20260709 13:17:15.908838  3835 pending_rounds.cc:107] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:17:15.909148  3835 raft_consensus.cc:2889] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:15.909505  7210 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:15.908917  7311 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.910007  7210 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.910893  6983 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.912192  7210 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:15.826522  7305 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:15.916654  7290 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:15.917635  7033 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:15.917485  7290 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.917907  3202 raft_consensus.cc:3055] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:15.918337  3202 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:15.919090  7286 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:15.919087  3202 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.786473  7121 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:15.876051  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:15.878063  7180 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:15.830902  7259 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:15.884061  7133 consensus_meta.cc:287] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.004s
I20260709 13:17:15.824724  6890 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.898192  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:15.940407  3278 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.898380  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:15.914556  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 71932.2us
W20260709 13:17:15.922546  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.920233  3202 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.937742  3206 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:17:15.944124  3206 pending_rounds.cc:85] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 4
I20260709 13:17:15.944492  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:15.944545  3206 pending_rounds.cc:107] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:17:15.945335  3206 raft_consensus.cc:2889] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:15.948454  3840 raft_consensus.cc:2393] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 8: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:15.951617  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:15.952332  3134 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.953752  3129 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:15.956089  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:15.919852  7290 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:15.899431  7269 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:15.901978  7185 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:15.953843  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:15.958402  3132 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
W20260709 13:17:15.963665  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:15.946980  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 578138us
I20260709 13:17:15.975425  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:15.967366  3249 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:15.947880  3209 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:15.947162  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.978338  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.979113  3206 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:15.980154  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:15.981508  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:15.981766  7187 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:15.982326  3209 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.981400  7033 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:17:15.989192  7269 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.990864  3209 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:17:15.991456  7269 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:15.914592  6983 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:15.916847  7305 raft_consensus.cc:697] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:15.947539  7180 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:15.966531  7179 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:16.001108  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:16.034029  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.995471  7268 consensus_queue.cc:1059] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:17:15.996007  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.001983  3100 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:15.951146  6890 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.021263  3127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:16.044721  3127 raft_consensus.cc:606] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:16.045097  3127 raft_consensus.cc:614] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:15.963969  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:16.003710  3202 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:17:16.036549  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:16.045965  3202 pending_rounds.cc:85] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 3
I20260709 13:17:16.038645  3278 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:17:16.040680  3206 raft_consensus.cc:2393] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 8: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:16.041201  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:16.041966  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2850) took 1111 ms. Trace:
I20260709 13:17:16.046252  3202 pending_rounds.cc:107] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:17:16.047366  3202 raft_consensus.cc:2889] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.047856  3202 pending_rounds.cc:107] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:17:16.048131  3202 raft_consensus.cc:2889] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:16.050181  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.050028  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:16.046298  3832 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.949748  7121 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.061239  7259 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:16.044170  6983 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:17:16.082779  3203 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:16.066329  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.085721  3209 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
W20260709 13:17:16.086108  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.070000  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:16.074599  3134 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:16.075258  7002 raft_consensus.cc:2764] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:17:16.043999  7091 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.038342  7326 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.047765  7100 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:16.078186  7287 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:16.022579  7163 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:15.952483  7133 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:16.107014  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.077726  3833 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:16.110011  3134 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:16.076932  7306 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:16.006129  7185 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:16.113368  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.076699  7318 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:16.099548  7268 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:17:16.039198  7274 consensus_queue.cc:1059] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:17:16.046198  7179 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.134287  3205 raft_consensus.cc:1813] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Handling vote request from an unknown peer fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:16.135037  3205 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 8: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:16.116531  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:16.129267  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.081247  7160 consensus_queue.cc:1059] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:16.136175  3209 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:17:16.138758  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:16.139639  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.108269  7100 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:16.059103  7330 consensus_queue.cc:1059] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:17:16.103992  7259 consensus_queue.cc:1059] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:17:16.127468  7297 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:16.172380  7185 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:16.172572  7121 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:16.174381  7179 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:16.175663  6890 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:16.176893  7273 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:16.177583  7274 consensus_queue.cc:1243] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer fc48eecc27554cb58b15193cd442b1d3 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:16.178113  7274 raft_consensus.cc:3055] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:16.178442  7274 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:16.179646  7273 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:16.179699  7274 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.180516  3282 raft_consensus.cc:2368] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14.
I20260709 13:17:16.182696  3203 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 12: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:16.183897  3207 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.185276  7297 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:16.186231  7297 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.187511  7297 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.188925  7312 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:16.190635  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 56342.5us
I20260709 13:17:16.191501  7312 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:16.138988  7313 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:17:16.193990  7313 raft_consensus.cc:3055] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:16.194581  7313 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:16.196346  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.196616  3204 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:16.184881  3207 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.202248  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:16.203127  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.205474  7163 raft_consensus.cc:3055] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:16.205931  7163 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:16.206753  7259 raft_consensus.cc:3055] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:16.207051  7163 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.194283  7309 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:17:16.207198  7259 raft_consensus.cc:740] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:16.150687  6835 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:16.210052  7259 consensus_queue.cc:260] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:16.211108  6835 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:16.212989  7331 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:17:16.205860  3205 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 9: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:16.212703  7163 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.133515  7318 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:16.215518  7318 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:16.217170  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:16.219863  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:16.216917  6835 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:16.109304  7326 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.107968  7091 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.145427  7100 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.196338  7313 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:16.237098  3127 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:16.238207  7326 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:16.239246  7292 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:16.240509  7180 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:16.243110  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:16.245185  3133 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:16.220636  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:16.224696  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.203181  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.247637  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:16.224687  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:16.228797  7197 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:16.249406  3133 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:16.049688  3210 rpcz_store.cc:276] 0709 13:17:14.930660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.930783 (+   123us) service_pool.cc:224] Handling call
0709 13:17:14.931123 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.931375 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:15.202090 (+270715us) log.cc:844] Serialized 14 byte log entry
0709 13:17:16.024796 (+822706us) log.cc:844] Serialized 14 byte log entry
0709 13:17:16.041444 (+ 16648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.041544 (+   100us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:16.041626 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.041722 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.041890 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":515560,"prepare.queue_time_us":309693,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":1403,"raft.queue_time_us":476238,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":80,"thread_start_us":641394,"threads_started":3,"wal-append.queue_time_us":206633}
I20260709 13:17:16.132941  7306 raft_consensus.cc:697] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:16.180954  7274 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.175690  7133 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:16.250624  3176 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:16.252552  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:16.243921  3128 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:17:16.264679  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:16.264848  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:16.265630  3128 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 8.
I20260709 13:17:16.266438  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:16.255638  3131 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:16.264987  3205 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:16.255271  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:16.256295  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 287643us
I20260709 13:17:16.267441  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:16.268784  3136 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:16.270556  3277 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:16.271226  3133 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:16.271376  3136 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:17:16.271658  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.273167  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.273761  3280 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
W20260709 13:17:16.272778  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 137532us
I20260709 13:17:16.255111  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:16.275990  3806 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:16.276099  3129 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:16.258069  3210 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:16.255234  7197 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:16.284425  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.285710  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:16.286698  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.287667  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.288276  3280 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:16.293866  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.294883  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.272276  3285 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:16.130842  7305 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.301062  3250 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:16.305845  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.309258  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.309772  3250 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:16.310139  3283 raft_consensus.cc:2410] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:16.233484  7253 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:17:16.281267  7033 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:16.316066  3278 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:16.293578  7197 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:16.319137  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 175123us
I20260709 13:17:16.299182  7281 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:16.308851  7133 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:16.308548  6909 raft_consensus.cc:2764] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:16.348104  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.349742  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.351385  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:16.352937  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.353668  3278 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:17:16.317050  7208 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:16.261646  7315 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:16.316346  7033 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.364393  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.367329  3207 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:16.322269  7180 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:16.347977  7160 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:16.379627  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.383379  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:16.387146  3101 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:16.318594  7000 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:17:16.389928  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:16.394652  3833 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.390990  3284 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:16.393292  7091 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:16.395829  3101 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:16.398877  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:16.369694  7033 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.391682  3806 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:16.401187  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:16.411628  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:16.413717  3101 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:16.415907  3101 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:16.353878  7328 consensus_queue.cc:1059] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:17:16.410034  7091 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:16.400888  7290 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:16.412577  3833 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
W20260709 13:17:16.423560  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 173005us
I20260709 13:17:16.425102  3101 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:16.438469  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 128779us
I20260709 13:17:16.391494  7160 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:16.436929  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:16.413182  7210 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:16.419814  7318 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:16.444898  3250 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:16.420095  6835 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:16.446986  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:16.445272  3832 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:16.448390  3835 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:16.449481  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:16.450774  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:17:16.463336  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.431766  7340 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:16.448529  7292 consensus_queue.cc:1059] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:17:16.373353  7306 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:16.561257  7208 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:16.561539  7292 raft_consensus.cc:3055] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:16.561839  7208 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:16.562172  7292 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:16.562808  7315 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:16.432467  7314 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:16.442490  7160 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.447470  7318 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.443578  7281 raft_consensus.cc:697] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:16.582263  7281 consensus_queue.cc:237] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:16.450938  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:16.448635  7133 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:16.585685  7133 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:16.585881  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 135018us
I20260709 13:17:16.586175  7133 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:16.586841  3251 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:16.587574  7311 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:16.587236  7133 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.505558  6909 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:16.534813  7299 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:17:16.592846  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:16.523801  7286 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:16.447172  7273 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
W20260709 13:17:16.540591  7345 log.cc:927] Time spent T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:17:16.547053  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 96346.9us
I20260709 13:17:16.541703  7312 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:17:16.614434  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:16.615936  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:16.585141  7102 raft_consensus.cc:3055] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:16.544042  7339 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:17:16.550243  7340 raft_consensus.cc:697] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:16.523192  7210 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.543928  6890 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:16.636395  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:16.553551  7346 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:16.563066  7292 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.444108  7335 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 13:17:16.579746  6983 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:16.657528  6983 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.659688  6983 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:16.449590  6835 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.660362  6835 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.662395  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:16.617655  7102 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:16.665743  7102 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.666723  7102 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:16.667387  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.670076  6835 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.672567  6835 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:16.674907  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.589865  3833 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:16.587296  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:17:16.595330  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 145925us
W20260709 13:17:16.676920  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 89693.1us
I20260709 13:17:16.677348  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.597510  6909 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:16.681396  6909 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.683640  7100 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.684782  3132 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:16.434535  7290 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.685348  7290 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:16.567925  7208 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:16.591527  7318 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.622402  3250 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:16.691365  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 69059.3us
I20260709 13:17:16.691514  7091 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:16.691972  7091 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:16.692325  7091 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.692476  3250 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:16.692749  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:16.693444  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:16.694087  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:16.694279  3127 raft_consensus.cc:2393] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:16.695501  3134 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:17:16.695709  3127 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:16.696121  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:16.617468  7315 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:16.696723  3133 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:16.697861  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:16.627183  7269 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:16.699880  7269 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.700429  7269 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.696758  3129 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:16.702754  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:16.639595  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.703423  3209 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.703685  3206 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:16.704524  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.640487  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:16.614917  7337 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:17:16.705272  3205 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.652159  7340 consensus_queue.cc:237] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:16.706318  7349 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:16.710337  3207 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:16.712414  7297 consensus_meta.cc:287] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 13:17:16.654561  7292 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.589237  7000 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:16.702937  3130 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:16.635087  7350 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:17:16.653620  3177 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:16.651033  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.734119  3250 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:16.723295  3202 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:16.723234  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:16.735116  3211 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:16.735195  3206 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:16.724079  3805 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:16.642736  7210 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.740902  3130 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:16.727731  3209 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:16.731343  3136 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:16.744033  3805 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:16.739001  7346 raft_consensus.cc:697] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:16.745707  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.767202  3128 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:16.749300  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:16.726799  7325 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.778214  3211 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:16.752467  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:16.729900  7187 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:16.773304  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:16.790297  3136 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:16.712263  7197 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:16.777742  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:16.737548  7268 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:17:16.796522  7268 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:16.801606  7346 consensus_queue.cc:237] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.734707  7342 consensus_queue.cc:1059] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:17:16.805243  7355 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:16.733394  7002 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:16.791164  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:16.750960  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 97391.8us
I20260709 13:17:16.770064  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:16.807199  3127 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:16.810779  3205 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:16.792249  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:16.818368  6983 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:16.818825  6983 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:16.819240  6983 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.813630  7269 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:16.819001  3205 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:16.805423  7342 raft_consensus.cc:3055] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:16.819514  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.775373  7348 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.777029  7297 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:16.826164  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:16.788574  7320 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:16.771886  7276 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:16.848030  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.830407  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:16.856231  3136 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:16.847440  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.843767  3204 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:17:16.856323  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.858291  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.859735  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.860834  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:16.861738  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.862022  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.863251  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.863744  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:16.864754  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.862831  3280 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:16.787256  6835 consensus_queue.cc:1059] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:17:16.806061  7002 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.879518  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:16.789654  7301 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:16.873293  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.874778  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:16.827395  7342 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:17:16.930696  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 210180us
I20260709 13:17:16.789819  7325 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:16.921748  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 187728us
I20260709 13:17:16.922935  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:16.823086  7360 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:16.918696  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 174726us
I20260709 13:17:16.982673  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1435) took 1321 ms. Trace:
I20260709 13:17:17.058519  7197 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:17.026429  7358 log.cc:927] Time spent T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:17:17.098645  3282 rpcz_store.cc:276] 0709 13:17:15.660928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.666622 (+  5694us) service_pool.cc:224] Handling call
0709 13:17:16.934263 (+1267641us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b5400038754. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:16.982597 (+ 48334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1176340864}
W20260709 13:17:16.934427  7274 consensus_meta.cc:287] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.669s	user 0.014s	sys 0.004s
I20260709 13:17:16.988692  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:16.832048  7348 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:17.053985  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 59489.4us
I20260709 13:17:16.978983  7269 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:16.913865  7002 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.948169  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:17.010197  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:17.114547  3202 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 7.
I20260709 13:17:16.854740  7276 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.064246  7330 raft_consensus.cc:3055] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:16.822186  7355 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.056442  7273 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:16.831676  7335 consensus_queue.cc:1059] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:17:16.862885  7320 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:17.059202  7100 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:16.989408  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 56888.7us
I20260709 13:17:16.931646  7342 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:17.062019  7033 consensus_meta.cc:287] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.001s
I20260709 13:17:16.983680  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:16.923681  7336 log.cc:927] Time spent T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
I20260709 13:17:17.099975  7350 consensus_queue.cc:1059] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:17:17.095845  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 231423us
I20260709 13:17:17.117641  7330 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:17.099112  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:17.056958  7325 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:17.106843  3277 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
W20260709 13:17:17.111632  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 303976us
I20260709 13:17:17.065551  7290 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.103055  6921 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.116888  3211 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:17:17.118253  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:17.139576  7297 raft_consensus.cc:697] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:17.104754  7309 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.141054  3203 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:17:17.181756  3203 pending_rounds.cc:85] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 6
W20260709 13:17:17.114673  7133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.001s	sys 0.041s
I20260709 13:17:17.060410  7210 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:17.176899  3176 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:17.145306  7320 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:17.162640  7100 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.182055  3203 pending_rounds.cc:107] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:17:17.125411  7364 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:17:17.177235  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 78244.1us
I20260709 13:17:17.195887  3805 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:17.193778  3203 raft_consensus.cc:2889] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:17.142256  7000 raft_consensus.cc:697] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:17.193874  3132 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:17.183154  6909 consensus_meta.cc:287] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
I20260709 13:17:17.213264  6909 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:17.213886  7324 consensus_queue.cc:1059] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:17.214898  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 515) took 1264 ms. Trace:
I20260709 13:17:17.215487  7095 raft_consensus.cc:3055] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:17.215583  6909 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:17.183743  6921 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.215986  7095 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:17:17.216187  7163 consensus_meta.cc:287] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.002s	user 0.011s	sys 0.003s
I20260709 13:17:17.177626  7368 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:17.217304  7368 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:17.215258  3135 rpcz_store.cc:276] 0709 13:17:15.950145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.950780 (+   635us) service_pool.cc:224] Handling call
0709 13:17:15.951101 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:15.996988 (+ 45887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:15.997024 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:16.010266 (+ 13242us) log.cc:844] Serialized 52 byte log entry
0709 13:17:16.356459 (+346193us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:16.445672 (+ 89213us) log.cc:844] Serialized 14 byte log entry
0709 13:17:16.459476 (+ 13804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.459591 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.214664 (+755073us) raft_consensus.cc:1685] finished
0709 13:17:17.214687 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.214838 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57950,"prepare.queue_time_us":192662,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":21639,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":54996,"thread_start_us":368238,"threads_started":2,"wal-append.queue_time_us":379212}
I20260709 13:17:17.217728  7368 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.201267  7177 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.218672  6888 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.219220  6888 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.219579  7095 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:17.220856  7095 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.199234  7000 consensus_queue.cc:237] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:17.182137  7335 consensus_queue.cc:1059] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:17:17.188220  7309 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.225752  6921 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:17.185562  7133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.001s	sys 0.041s
I20260709 13:17:17.227466  3805 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:17.229693  7284 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:17.159861  7033 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.234500  7187 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:17.235468  3280 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:17.236260  7033 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:17.236629  7177 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:17.205188  7364 consensus_queue.cc:1243] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:17:17.205605  7370 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:17:17.209290  7091 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:17.142779  6835 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.107645  7360 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:17.237377  7160 consensus_meta.cc:287] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.000s
I20260709 13:17:17.240127  7100 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:17.241391  7318 consensus_meta.cc:287] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.004s
I20260709 13:17:17.241756  3805 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:17.242820  3276 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:17:17.243289  3842 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:17.244033  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:17.236276  7313 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:17.245810  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.247267  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 70458.5us
I20260709 13:17:17.203011  7355 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:17.204739  7348 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:17.181768  7342 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:17.261341  7347 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.002s	sys 0.019s
I20260709 13:17:17.287954  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:17.283823  7160 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:17.227481  7309 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:17.255136  7274 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:17.335695  3133 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:17.362509  3208 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
W20260709 13:17:17.275310  7292 consensus_meta.cc:287] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.000s
W20260709 13:17:17.369606  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 81742.9us
I20260709 13:17:17.273059  7284 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:17.424467  3284 raft_consensus.cc:2410] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:17:17.399175  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.426493  7284 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:17.428629  7284 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:17.428866  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:17:17.362092  7347 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.002s	sys 0.025s
W20260709 13:17:17.436672  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 259986us
I20260709 13:17:17.360399  7366 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.275502  7269 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.161s
W20260709 13:17:17.440105  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 315867us
I20260709 13:17:17.237229  7330 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:17.399241  6983 consensus_meta.cc:287] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.001s
I20260709 13:17:17.392818  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:17.456885  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 64151.6us
I20260709 13:17:17.397869  7335 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:17.430719  7370 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:17:17.469244  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 325551us
I20260709 13:17:17.398180  7274 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:17.460608  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 350684us
I20260709 13:17:17.436335  7160 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:17.464607  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:17.453138  3100 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:17.451416  7208 consensus_meta.cc:287] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.765s	user 0.009s	sys 0.003s
I20260709 13:17:17.294267  7177 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:17.459662  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:17.487370  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:17.490674  3135 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:17.492290  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:17.294209  7318 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.459702  7309 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:17.437949  6835 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:17.524072  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 59540.2us
I20260709 13:17:17.461294  6983 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.496366  7330 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.467818  7187 consensus_queue.cc:1059] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:17:17.575187  3131 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:17.455120  7366 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.397298  7297 consensus_queue.cc:237] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:17.543768  7370 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:17.513624  6888 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:17.544063  7335 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.545001  7276 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:17.583400  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:17.603456  7091 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:17.498653  7208 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.593050  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:17.636152  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 183118us
I20260709 13:17:17.637624  3210 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.593817  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:17.576701  7350 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:17.576393  7160 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:17.596575  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:17.644415  3206 pending_rounds.cc:85] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 5
I20260709 13:17:17.644761  3206 pending_rounds.cc:107] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:17:17.645041  3206 raft_consensus.cc:2889] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:17.573439  7293 consensus_queue.cc:1059] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:17:17.581769  7382 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:17.621380  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:17.577994  7305 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:17:17.604732  7309 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.627914  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:17.632331  3132 raft_consensus.cc:2393] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:17:17.576982  7102 consensus_meta.cc:287] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.908s	user 0.018s	sys 0.001s
W20260709 13:17:17.631091  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 132827us
W20260709 13:17:17.634603  7381 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:17:17.633241  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:17.638258  3100 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:17.623392  7253 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:17.635154  7399 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:17.648869  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:17.666762  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:17.627350  7360 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:17.617345  7355 consensus_queue.cc:1059] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:17:17.593959  7274 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:17.668043  7378 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:17:17.628559  7180 raft_consensus.cc:3055] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:17.658620  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:17.735987  3282 raft_consensus.cc:2368] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8.
I20260709 13:17:17.659013  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:17.649770  7100 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:17.647498  7379 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.073s	user 0.001s	sys 0.001s
W20260709 13:17:17.742487  7390 log.cc:927] Time spent T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:17:17.744423  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:17.745101  3285 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
W20260709 13:17:17.745756  7391 log.cc:927] Time spent T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:17:17.745986  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:17.746833  3285 raft_consensus.cc:2393] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:17:17.747084  7380 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:17:17.747611  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:17.748620  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:17.654050  7160 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:17.701777  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 68603.7us
I20260709 13:17:17.661502  7309 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.669071  3100 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:17.653472  7382 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:17.671989  3204 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:17.656517  3279 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:17.658331  7350 raft_consensus.cc:697] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:17.757977  7350 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:17.759028  7397 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:17:17.762550  7197 raft_consensus.cc:3055] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:17.763195  7197 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:17.763557  7398 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.764137  7197 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.767535  7197 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.662673  7383 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:17.769613  7382 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.736964  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:17.770745  3132 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:17.770277  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 101285us
I20260709 13:17:17.741238  3283 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:17.661540  3210 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:17.676162  7253 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:17.754725  3176 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:17.766196  7259 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:17.731179  7276 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.732607  3209 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:17.730243  7293 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:17.805364  7293 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.730028  7335 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:17.764201  7398 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:17.810396  7360 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.811245  7399 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:17.810995  7360 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:17.811784  7399 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.769954  7383 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:17.812738  7313 consensus_meta.cc:287] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.002s
I20260709 13:17:17.772905  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:17.772800  7100 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.777503  3134 raft_consensus.cc:3055] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:17.823277  3134 raft_consensus.cc:740] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:17:17.825721  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 53375us
I20260709 13:17:17.827090  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:17.783552  7359 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.804s	user 0.006s	sys 0.011s
I20260709 13:17:17.668955  7368 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:17.785820  6983 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:17.789917  7208 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:17.735491  7180 raft_consensus.cc:740] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:17.791980  7253 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:17.793810  7002 consensus_meta.cc:287] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.000s
I20260709 13:17:17.793658  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:17.770375  7363 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:17.795754  7276 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:17.798158  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 315008us
I20260709 13:17:17.800526  3132 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:17.852617  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:17.854734  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:17.856194  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:17.772794  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:17.814673  7383 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:17.817737  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2646) took 1542 ms. Trace:
W20260709 13:17:17.831913  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 77235.6us
I20260709 13:17:17.832315  3100 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:17.856946  3132 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:17.824159  3134 consensus_queue.cc:260] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:17.818842  7320 consensus_meta.cc:287] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 13:17:17.859166  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:17.822947  7318 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:17.859688  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:17.857764  3278 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:17.863341  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:17.864333  3833 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:17.864445  3836 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:17.857548  3281 rpcz_store.cc:276] 0709 13:17:16.281892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.282085 (+   193us) service_pool.cc:224] Handling call
0709 13:17:16.282404 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.296080 (+ 13676us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:17.024255 (+728175us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b18002a1a20. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b90ff455 00007fb3bfbe73c7 00007fb3bc1f99a7 00007fb3bc2090bf 00007fb3bc209038
0709 13:17:17.261996 (+237741us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.601506 (+339510us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:17.605894 (+  4388us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.606072 (+   178us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:17.611690 (+  5618us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.629744 (+ 18054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.635910 (+  6166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.817285 (+181375us) raft_consensus.cc:1685] finished
0709 13:17:17.817321 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.817647 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50977,"prepare.queue_time_us":244690,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":2129,"raft.queue_time_us":30224,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":28171,"spinlock_wait_cycles":5003136,"thread_start_us":473221,"threads_started":2,"wal-append.queue_time_us":360620}
I20260709 13:17:17.842334  7305 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:17.866415  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:17.834182  6890 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:17.873306  3211 raft_consensus.cc:2410] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:17.881587  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:17.882601  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:17.882444  3280 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:17.874117  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:17.874593  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:17.876034  3837 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:17.877055  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.884299  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:17.878960  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:17.886785  3132 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:17.865271  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:17.884074  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:17.865458  3210 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:17.889110  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:17.888720  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:17.889701  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:17.890465  3176 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:17.888468  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:17.891434  3176 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:17.891148  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:17.893317  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:17.894358  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:17.895766  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:17.899679  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:17.849870  7363 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:17.900290  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:17.907011  3285 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:17.903151  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:17.904323  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:17.907816  3132 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:17.870342  7402 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:17.908743  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:17.876124  6983 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.918769  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:17.924830  3278 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:17.901690  7335 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:17.938716  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:17.939806  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:17.930058  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:17.894430  7253 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:17.931937  3282 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:17.905931  6835 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:17.895260  7330 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:17.921422  7402 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.894593  7318 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.895839  7355 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:17.901507  7197 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:17.859782  7002 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.906193  7259 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:17.899942  7305 raft_consensus.cc:697] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:17.940371  3204 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:17.941684  3132 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.926312  7273 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:17.872141  7320 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:17.967553  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:17.955782  3023 maintenance_manager.cc:419] P 2d86a7fbede6469c844c1637c8ddd791: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033342
I20260709 13:17:17.928562  7160 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:17.923228  7342 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:17.935077  6890 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.911725  7392 consensus_queue.cc:1059] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:17:17.955782  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:17.941620  7335 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:17.926383  7362 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:17:17.970865  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:17.952826  7402 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.981313  3277 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:17.961524  7197 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:17.923761  7180 consensus_queue.cc:260] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:17.989164  7313 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.996399  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:17.993718  7392 raft_consensus.cc:3055] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:17.998857  7368 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:17.972180  7348 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:17.958884  7318 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:17.980595  7388 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:18.007149  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:18.008224  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.020998  3132 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:17.974309  7403 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:17.986536  7208 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:17.997130  7335 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:17.972286  7273 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.026743  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:17.996430  7322 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.029587  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.000473  7160 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:18.035714  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:17.961114  7363 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.036644  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:18.007911  7392 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:17:18.044361  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.045645  3204 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:18.046123  7133 raft_consensus.cc:3055] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:18.046506  7133 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:18.047366  7133 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.048555  7133 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:17.996587  6890 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.025698  7348 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.030958  7346 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:17.996781  7342 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.061285  3204 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:18.036957  7180 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.011462  7197 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:17.996546  7401 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.209s
I20260709 13:17:18.039737  7355 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:18.026139  7388 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.054602  7253 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:18.010929  7313 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.066495  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:18.042225  7276 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:18.043354  7387 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:18.044049  7322 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.079483  7368 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:17:18.081324  7386 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.085242  7411 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:18.086213  7405 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 13:17:18.087044  7406 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:17:18.087863  7412 log.cc:927] Time spent T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:18.033993  7208 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:18.090330  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.068712  7404 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:17:18.097234  3204 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.063967  7346 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:18.100450  3127 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:18.031534  7305 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.077958  7160 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.107858  7253 raft_consensus.cc:697] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:18.110611  7407 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:17:18.111407  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 521) took 1814 ms. Trace:
I20260709 13:17:18.115185  3136 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:18.121747  3128 rpcz_store.cc:276] 0709 13:17:16.296531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.297313 (+   782us) service_pool.cc:224] Handling call
0709 13:17:16.297620 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.767761 (+470141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.111143 (+1343382us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54000e24d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:18.111342 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044072832}
I20260709 13:17:18.123586  3128 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:18.100010  7228 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:18.105453  7411 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:18.139506  3127 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:18.156404  3204 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
W20260709 13:17:18.124945  7408 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:17:18.147569  7253 consensus_queue.cc:237] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.158654  7297 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:18.100837  7392 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.161512  7318 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.121250  7346 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:18.119750  7313 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.163333  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:18.140414  7411 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:18.126709  7002 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:18.136409  7320 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.144933  7403 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.166545  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:18.182199  6890 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:18.185158  7340 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:18.185746  7340 raft_consensus.cc:697] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:18.186672  7340 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.187742  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 446) took 1359 ms. Trace:
I20260709 13:17:18.188144  3208 rpcz_store.cc:276] 0709 13:17:16.828172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.828380 (+   208us) service_pool.cc:224] Handling call
0709 13:17:18.187536 (+1359156us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b5400195d54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:18.187676 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992536832}
I20260709 13:17:18.189702  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1439) took 1342 ms. Trace:
I20260709 13:17:18.190131  3284 rpcz_store.cc:276] 0709 13:17:16.846897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.847077 (+   180us) service_pool.cc:224] Handling call
0709 13:17:18.189479 (+1342402us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b540022ef54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:18.189637 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304285056}
I20260709 13:17:18.125537  7160 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:18.174243  7413 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:17:18.202049  3100 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:18.202205  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:18.204188  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.140925  7228 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:18.208196  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.209261  7388 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:18.104352  7386 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.180231  7392 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.217108  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:18.221101  3838 raft_consensus.cc:2410] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:18.174682  7297 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.214030  7325 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:18.218307  7259 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.231514  3209 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:18.217736  6890 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:18.236686  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.231096  7325 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.204870  7403 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.231477  7355 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:18.233626  7348 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.235116  7208 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:18.239612  7273 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:18.253244  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:18.238838  7259 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.256108  3209 raft_consensus.cc:2410] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:17:18.248952  7325 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:18.241611  6890 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.267043  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:18.267767  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.269654  7228 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:18.274284  7419 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:17:18.262365  6983 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:18.260905  7305 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:17:18.277856  7305 consensus_queue.cc:1243] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:18.267707  3209 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:18.280397  3209 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:18.281759  7342 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.282954  7403 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:18.274246  7382 consensus_meta.cc:287] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.005s
I20260709 13:17:18.268869  7160 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.254191  7355 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.278469  6890 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.264793  7322 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.298552  7297 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.271412  7259 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:18.290557  7355 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.290840  7309 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.306288  7386 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:18.283589  7382 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.319159  7382 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:18.319989  7290 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.320950  7309 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.306699  7335 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.330940  7335 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.331676  3210 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:18.323065  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1440) took 1475 ms. Trace:
I20260709 13:17:18.333302  3283 rpcz_store.cc:276] 0709 13:17:16.847275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.847652 (+   377us) service_pool.cc:224] Handling call
0709 13:17:18.322827 (+1475175us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b540022e554. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:18.322982 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1722073856}
I20260709 13:17:18.325596  7100 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:18.337055  3176 leader_election.cc:400] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8.
I20260709 13:17:18.337463  3176 leader_election.cc:403] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:17:18.339016  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:18.341653  7421 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:17:18.342072  7309 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 7. Current term is 8.
I20260709 13:17:18.344300  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:18.345927  3176 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:18.346498  7284 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.347059  7284 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.349108  7398 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:18.353298  7301 consensus_queue.cc:1059] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:18.354692  7301 raft_consensus.cc:3055] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:18.355293  7301 raft_consensus.cc:740] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:18.356065  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:18.356858  3202 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:18.358131  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:18.359180  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:18.359925  3202 raft_consensus.cc:2368] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9.
I20260709 13:17:18.360594  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:18.361781  7297 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:18.363862  3204 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:18.365651  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:18.366695  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:18.367488  3204 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:18.369709  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:18.361246  7309 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:18.373642  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:18.372177  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:18.375626  3202 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:18.376991  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:18.351289  7355 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:18.381335  7309 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:18.382897  7133 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:18.383266  7402 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.399124  7133 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:18.399971  7402 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.400148  7133 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.386435  7355 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.404951  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1454) took 1659 ms. Trace:
I20260709 13:17:18.405879  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1449) took 1546 ms. Trace:
I20260709 13:17:18.406272  3279 rpcz_store.cc:276] 0709 13:17:16.859583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.862735 (+  3152us) service_pool.cc:224] Handling call
0709 13:17:18.405715 (+1542980us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54002f8fd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:18.405813 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289836288}
I20260709 13:17:18.405728  7411 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.393875  7284 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.416421  3204 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:18.405373  3130 rpcz_store.cc:276] 0709 13:17:16.745989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.747031 (+  1042us) service_pool.cc:224] Handling call
0709 13:17:16.747513 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.932884 (+185371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.932931 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.987334 (+ 54403us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.191376 (+204042us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:17.191436 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.404527 (+1213091us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b54000e2ed4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:18.404580 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.404627 (+    47us) raft_consensus.cc:1685] finished
0709 13:17:18.404640 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.404886 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3606,"raft.queue_time_us":5668,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":28188,"spinlock_wait_cycles":86890240,"thread_start_us":235135,"threads_started":2,"wal-append.queue_time_us":348032}
I20260709 13:17:18.419451  7373 raft_consensus.cc:993] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:17:18.356387  7301 consensus_queue.cc:260] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.429167  7286 raft_consensus.cc:1081] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:17:18.429674  7301 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.421203  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:18.421463  3207 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 445) took 1602 ms (client timeout 2068 ms). Trace:
W20260709 13:17:18.431394  3207 rpcz_store.cc:269] 0709 13:17:16.819008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.819198 (+   190us) service_pool.cc:224] Handling call
0709 13:17:18.421277 (+1602079us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400194e54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:18.421409 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2949927680}
I20260709 13:17:18.385347  7340 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:17:18.390543  7346 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.435454  7309 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:18.437103  7346 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.437415  3204 raft_consensus.cc:2393] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:18.440001  3838 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:18.443454  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:18.444331  3837 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:18.443617  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:18.445664  3842 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:18.403769  7355 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:18.448448  3203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2892) took 1632 ms. Trace:
I20260709 13:17:18.448464  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 524) took 1730 ms. Trace:
I20260709 13:17:18.448860  3203 rpcz_store.cc:276] 0709 13:17:16.816148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.816936 (+   788us) service_pool.cc:224] Handling call
0709 13:17:16.817339 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.197452 (+380113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.448210 (+1250758us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b540019e454. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:18.448385 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743146240}
I20260709 13:17:18.449038  3133 rpcz_store.cc:276] 0709 13:17:16.718057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.718835 (+   778us) service_pool.cc:224] Handling call
0709 13:17:16.719131 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.363508 (+644377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.448261 (+1084753us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b5400415fd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:18.448407 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1417443072}
I20260709 13:17:18.449666  3204 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:18.450273  3102 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:18.451188  3102 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:18.451656  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.453998  3207 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:17:18.442835  7427 log.cc:927] Time spent T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.174s	user 0.000s	sys 0.004s
I20260709 13:17:18.460079  7411 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.463665  3204 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:18.456434  7401 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:18.455341  7286 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:18.452204  7373 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:17:18.476904  7399 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:18.477910  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 486581us
I20260709 13:17:18.485997  3207 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:18.471114  7401 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.490747  7401 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:18.493963  3207 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:17:18.494946  3207 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:18.495873  3207 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.501187  3202 pending_rounds.cc:85] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 5
I20260709 13:17:18.502435  3202 pending_rounds.cc:107] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:17:18.503032  3202 raft_consensus.cc:2889] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:18.497627  7268 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:17:18.505986  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1452) took 1632 ms. Trace:
I20260709 13:17:18.506372  3276 rpcz_store.cc:276] 0709 13:17:16.873763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.873883 (+   120us) service_pool.cc:224] Handling call
0709 13:17:16.874202 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.289830 (+415628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.505740 (+1215910us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54003f2ad4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:18.505932 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":847148416}
I20260709 13:17:18.479385  7286 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:18.510241  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.512835  7369 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.513446  7293 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.516057  7033 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:18.516144  7389 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:18.471094  7325 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.520834  3207 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.522083  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:18.510457  7366 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.522608  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:18.522855  3836 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:18.523231  3833 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:18.510921  7286 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:18.525027  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:18.525386  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:18.525905  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:18.525873  3249 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:18.516609  7033 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.517324  7185 consensus_queue.cc:1059] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:17:18.528843  7269 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.558444  3281 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:18.560820  3207 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.516733  7389 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.527499  7365 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:18.524974  7410 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:18.558099  7364 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:18.571244  3100 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:18.563265  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:18.563616  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:18.564718  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:18.565157  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:18.573516  3276 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:18.563794  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:18.574083  3284 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:17:18.570026  3176 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.882s (SENT) [suppressed 11 similar messages]
I20260709 13:17:18.566270  3251 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:18.578418  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:18.584640  3249 leader_election.cc:400] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9.
I20260709 13:17:18.585114  3249 leader_election.cc:403] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:18.586205  3249 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:18.588357  3833 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:18.569535  7197 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:18.628398  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:18.628531  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:18.630692  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:18.560701  7281 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.567744  7002 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.638360  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 48384.2us
I20260709 13:17:18.631798  3838 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:18.582581  7366 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 13:17:18.640651  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 74448us
W20260709 13:17:18.648036  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 61909.9us
I20260709 13:17:18.583760  7387 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:18.649223  3249 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:18.652253  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:18.513443  7369 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.656075  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:18.632299  7364 raft_consensus.cc:697] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:18.577672  7268 consensus_queue.cc:1059] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:17:18.630494  7350 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:18.647547  6909 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.656448  7387 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.667778  3177 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:18.647643  7180 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.661571  7322 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:18.661860  7292 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:18.632432  7293 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:17:18.655177  7002 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.570490  7269 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.657030  7185 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:18.662384  7208 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:18.757546  7208 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:18.665041  7415 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:18.678946  7322 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:18.732334  7435 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:17:18.680950  7411 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:18.810143  7411 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:18.678838  7292 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.810669  7411 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.811192  7352 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:18.677861  7387 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:18.648667  7281 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.673456  7350 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.806594  7002 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:18.807026  7355 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.807367  7325 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.679215  7180 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.780032  7322 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:18.812443  7292 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:18.808535  7033 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:18.679227  7416 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.126s
I20260709 13:17:18.810247  7269 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:18.610028  7365 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.642217  7410 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.755960  7373 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:18.727909  7356 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.176s
I20260709 13:17:18.812353  7415 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:17:18.839891  7434 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.268s	user 0.000s	sys 0.002s
I20260709 13:17:18.757611  7364 consensus_queue.cc:237] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.843525  7415 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:18.847625  7438 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:17:18.851722  7389 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:18.858917  7411 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.860080  7410 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:18.858917  7401 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.863149  7401 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:18.864218  7411 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:18.867113  7415 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.870049  7415 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:18.680876  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:18.935627  3207 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:18.763448  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.758085  7185 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:18.927289  7365 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:18.811774  7352 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.911129  7208 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:18.959587  7350 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:18.960772  7369 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:18.932664  7281 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:18.971742  7185 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.000284  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:19.006258  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1466) took 1360 ms. Trace:
I20260709 13:17:19.006870  3285 rpcz_store.cc:276] 0709 13:17:17.645215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.748509 (+103294us) service_pool.cc:224] Handling call
0709 13:17:17.748768 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.907375 (+158607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.005554 (+1098179us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54002968d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:19.005951 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323450240}
I20260709 13:17:19.010915  3835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 761) took 1545 ms. Trace:
W20260709 13:17:19.011896  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 441768us
W20260709 13:17:19.015386  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.017797  3203 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:19.011471  3835 rpcz_store.cc:276] 0709 13:17:17.465664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.465829 (+   165us) service_pool.cc:224] Handling call
0709 13:17:17.466157 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.573496 (+107339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.573543 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:17.573604 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:17.573649 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.009928 (+1436279us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400000d54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:19.010243 (+   315us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.010717 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246181248}
I20260709 13:17:19.029068  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:19.030130  3841 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.045476  7388 raft_consensus.cc:3055] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:19.046155  7388 raft_consensus.cc:740] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:19.048703  7352 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:19.085067  7314 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.085994  7314 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:18.842610  7373 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.089751  3841 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:19.111655  3207 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:19.069012  7322 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.118897  3842 raft_consensus.cc:2393] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
W20260709 13:17:19.124344  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.121289  7355 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:19.134649  3134 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.137617  3206 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:19.159669  3285 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:19.162663  7163 raft_consensus.cc:3055] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:19.163318  7163 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:19.155819  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 429513us
I20260709 13:17:19.176672  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2898) took 1314 ms. Trace:
I20260709 13:17:19.177196  3210 rpcz_store.cc:276] 0709 13:17:17.862097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.893054 (+ 30957us) service_pool.cc:224] Handling call
0709 13:17:17.893533 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.332126 (+438593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.176130 (+844004us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400247054. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:19.176458 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007112064}
I20260709 13:17:19.178802  7373 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:19.181778  7180 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:19.190696  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.194072  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:19.195165  7388 consensus_queue.cc:260] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.197944  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:19.198843  3133 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:19.206753  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:19.209209  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:19.209626  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:19.210202  3284 raft_consensus.cc:2393] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:19.210531  3281 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.213882  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:19.219570  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:19.196988  7388 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.917039  3020 catalog_manager.cc:5028] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): tablet 772d700b048349bf9547efac6befb60d (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
W20260709 13:17:19.222458  3020 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 3.308e+06us
I20260709 13:17:19.223992  7102 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:19.232139  3210 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:19.233608  3100 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:19.233922  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:19.235735  7400 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:19.236578  7400 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:19.238341  7400 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.246497  3030 catalog_manager.cc:5697] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 7 to 10, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 10 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:19.249821  6909 consensus_meta.cc:287] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.572s	user 0.017s	sys 0.000s
I20260709 13:17:19.249182  3030 catalog_manager.cc:5697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 9 to 10, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 10 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:19.250380  6909 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9.
W20260709 13:17:19.252156  7286 consensus_meta.cc:287] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.720s	user 0.014s	sys 0.010s
I20260709 13:17:19.251322  3030 catalog_manager.cc:5697] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 9 to 10, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 10 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:19.252655  7286 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.255656  7286 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:19.164562  7163 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.256780  7401 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:19.257336  7163 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.257997  7401 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:19.258414  7401 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:19.260025  7401 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.272811  7352 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:19.270920  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45309.3us
I20260709 13:17:19.278183  3134 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:19.300614  3177 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:19.301321  3281 raft_consensus.cc:2410] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:17:19.302909  3805 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:19.303714  7411 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:19.304332  7411 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:19.305262  7355 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.305958  7355 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.308240  7355 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:19.309463  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:19.310217  3205 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.273517  7352 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.320359  7411 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.290452  6909 consensus_queue.cc:1059] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:17:19.322425  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 144667us
I20260709 13:17:19.325987  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:19.327368  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:19.298369  3134 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1458) took 2545 ms (client timeout 1882 ms). Trace:
W20260709 13:17:19.329701  3134 rpcz_store.cc:269] 0709 13:17:16.749126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.752109 (+  2983us) service_pool.cc:224] Handling call
0709 13:17:17.777366 (+1025257us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b540040b3a0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc166dc0 00007fb3bc1f2e18 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:19.094617 (+1317251us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b580014f3d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc14b0aa 00007fb3bc1cd447 00007fb3bc1e5fe7 00007fb3bc1e77de 00007fb3bc1f327c 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c
0709 13:17:19.294530 (+199913us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3207798016}
I20260709 13:17:19.328284  7401 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.335191  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:19.336016  3129 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:19.336979  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:19.338092  3129 raft_consensus.cc:2393] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:19.339948  7286 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:19.340871  3133 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:17:19.341570  7322 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:19.342826  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:19.245059  7387 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.322489  7314 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:19.354321  7373 consensus_queue.cc:1059] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:19.354535  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:19.356163  7373 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:19.356381  3206 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 8: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:19.356688  7373 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:17:19.345054  7292 consensus_meta.cc:287] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.004s
W20260709 13:17:19.358213  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.316758  7352 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:19.352070  3205 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
W20260709 13:17:19.365916  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 71434.9us
I20260709 13:17:19.354679  6921 raft_consensus.cc:3055] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:19.347772  7387 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:19.350594  7197 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.375722  6921 raft_consensus.cc:740] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:17:19.393465  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 90839.3us
I20260709 13:17:19.394371  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:19.394554  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:19.396458  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 55061.6us
W20260709 13:17:19.398900  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 118846us
W20260709 13:17:19.399515  7306 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 13:17:19.399647  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.400481  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:19.401701  3285 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:19.402679  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:19.403288  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:19.403470  3206 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.404242  3136 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:19.404515  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:19.405695  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:19.409905  3204 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:19.399720  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:19.411604  3129 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:19.413971  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:19.414731  7197 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:19.413321  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.414819  3284 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:19.418322  3250 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:19.420660  7355 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.421175  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:19.421653  7355 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.422851  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:19.423535  7346 consensus_queue.cc:1059] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:19.424244  7416 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:19.424566  7346 raft_consensus.cc:3055] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:19.425196  7416 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:19.376642  7292 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.425719  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:19.426504  3276 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:19.427084  7387 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.427322  7373 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.427788  7387 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.424562  7301 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:19.429414  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.429705  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1446) took 2738 ms. Trace:
I20260709 13:17:19.430164  7387 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:19.430101  3131 rpcz_store.cc:276] 0709 13:17:16.690718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.696560 (+  5842us) service_pool.cc:224] Handling call
0709 13:17:16.696914 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.617892 (+920978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.388511 (+1770619us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b5400075154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:19.429499 (+ 40988us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2019406720}
I20260709 13:17:19.431818  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:19.427802  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:19.432876  3283 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:19.432905  7387 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:19.434348  7197 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:19.426671  3277 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:17:19.436213  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 111959us
I20260709 13:17:19.389735  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:19.428854  7373 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.353739  7185 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.459532  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:19.436142  7346 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:19.464680  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:19.463043  7416 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:19.507999  7179 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:19.446807  7286 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:19.524272  3210 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:19.508131  7312 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:19.468060  7355 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:19.529304  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:19.511354  7416 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.550577  7305 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.551556  7305 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.553300  7392 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:19.553977  7392 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:19.554489  7392 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.556840  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2921) took 1079 ms. Trace:
I20260709 13:17:19.557523  3202 rpcz_store.cc:276] 0709 13:17:18.477529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.500412 (+ 22883us) service_pool.cc:224] Handling call
0709 13:17:18.500895 (+   483us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:18.504050 (+  3155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.504084 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:19.225020 (+720936us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b2c00136548. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:17:19.225940 (+   920us) log.cc:844] Serialized 52 byte log entry
0709 13:17:19.451975 (+226035us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:19.452029 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.456945 (+  4916us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.556000 (+ 99055us) raft_consensus.cc:1685] finished
0709 13:17:19.556032 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.556521 (+   489us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"spinlock_wait_cycles":6732416,"thread_start_us":225548,"threads_started":1,"wal-append.queue_time_us":327306}
I20260709 13:17:19.563361  7366 raft_consensus.cc:3055] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:19.563984  7366 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:19.565014  7362 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:19.565795  7362 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.568372  7362 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:19.570425  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:19.573233  7286 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.575611  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2914) took 1374 ms. Trace:
I20260709 13:17:19.578526  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:19.576081  3209 rpcz_store.cc:276] 0709 13:17:18.200980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.281235 (+ 80255us) service_pool.cc:224] Handling call
0709 13:17:18.301488 (+ 20253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.301953 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.301988 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.302652 (+   664us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.975109 (+672457us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b180047da60. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:17:19.080680 (+105571us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:19.088339 (+  7659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.109154 (+ 20815us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.572501 (+463347us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b180047da60. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:19.575267 (+  2766us) raft_consensus.cc:1685] finished
0709 13:17:19.575286 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.575429 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9316,"raft.queue_time_us":108,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4246,"spinlock_wait_cycles":26556032,"thread_start_us":14488,"threads_started":1,"wal-append.queue_time_us":746561}
I20260709 13:17:19.584641  7356 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:19.585676  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:19.588629  3284 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.592012  7273 raft_consensus.cc:3055] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:19.592643  7273 raft_consensus.cc:740] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:19.593925  7273 consensus_queue.cc:260] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.595000  7284 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:19.596845  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 165207us
I20260709 13:17:19.597515  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:19.601291  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:19.604554  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.616516  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 43995us
W20260709 13:17:19.617390  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.618628  3284 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:19.626638  3133 raft_consensus.cc:2393] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:17:19.626876  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 232433us
I20260709 13:17:19.628059  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:19.628136  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:19.629834  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:19.626878  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:19.633383  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:19.633611  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:19.634310  3284 raft_consensus.cc:2376] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12. Re-sending same reply.
I20260709 13:17:19.634534  3282 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:19.635780  3284 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:19.636237  7305 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:19.633702  3135 raft_consensus.cc:2368] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 11. Current term is 12.
I20260709 13:17:19.618549  7286 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:19.629067  3131 raft_consensus.cc:2393] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:19.644460  3206 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:19.603829  7416 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:19.650279  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 197194us
W20260709 13:17:19.653944  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.596099  7179 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.652544  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:19.661820  7352 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:19.662695  7352 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.664788  7352 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:19.648659  7322 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.678459  6921 consensus_queue.cc:260] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.656759  7284 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.680361  6921 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.682178  7284 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:19.682349  3203 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:19.683223  7185 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:19.683895  3209 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:19.679204  7322 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.624498  7312 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.685271  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:19.686219  3202 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:19.686328  7322 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:19.686601  7312 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:19.687273  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:19.688084  7274 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.160s
I20260709 13:17:19.688659  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:19.688977  7274 raft_consensus.cc:3055] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:19.689421  7274 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:19.689882  3204 raft_consensus.cc:2393] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:19.690546  7274 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.692121  7274 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:19.692898  7133 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:19.667790  3284 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:19.694098  7133 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.672266  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:19.695446  3207 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:19.695730  7179 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:19.696645  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.697314  3837 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.698271  7133 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:19.700341  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:19.706279  3030 catalog_manager.cc:5697] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 7 to 10, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 10 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:19.701352  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:19.674153  7346 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.713168  3285 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:19.675011  7363 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:19.675326  7454 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:17:19.540544  7387 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.672410  7297 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.708371  3030 catalog_manager.cc:5697] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:19.716711  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 57674.5us
I20260709 13:17:19.720122  3282 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
W20260709 13:17:19.735986  7450 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.446s	user 0.004s	sys 0.004s
I20260709 13:17:19.741523  7133 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:19.742118  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 97831.7us
I20260709 13:17:19.743515  7133 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:19.745438  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:19.745301  7133 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:19.768414  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:19.769260  7297 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.769538  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:19.770393  3135 raft_consensus.cc:3055] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:19.770783  3135 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:19.771720  7297 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:19.736145  7387 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:19.746987  7388 consensus_meta.cc:287] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.003s
I20260709 13:17:19.748601  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:19.755326  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:19.758912  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:19.752477  3136 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:19.761759  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:19.773934  3129 raft_consensus.cc:2410] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:19.774427  3130 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:19.713824  7346 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.790164  3840 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.782261  3837 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:19.787124  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:19.793032  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 66424.3us
I20260709 13:17:19.797544  3835 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 7.
I20260709 13:17:19.815842  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:19.795151  3135 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.619201  7366 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.829499  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:19.832657  3207 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:19.836572  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:19.837672  3129 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:17:19.849566  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 53828.7us
I20260709 13:17:19.857944  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:19.857566  3210 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:19.862687  3177 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:19.864867  3278 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:19.865744  7268 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.866003  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:19.866477  7268 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.867154  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:19.870222  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:19.870535  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:19.873153  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:19.876170  3100 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:19.883145  3102 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:19.885434  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:19.881027  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 233402us
I20260709 13:17:19.891781  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:19.875159  7163 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:19.893039  7309 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:17:19.893656  7163 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.894282  7163 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.874542  7355 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.897683  7355 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.861967  7388 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.883400  7463 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:19.839035  7392 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:19.901830  3136 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:19.916040  3206 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:19.917104  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:19.917375  7335 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:19.917779  3136 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:19.918206  7305 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:19.918843  7305 raft_consensus.cc:697] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:19.919271  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:19.892971  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.911485  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:19.922232  3284 raft_consensus.cc:2393] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:19.862486  7133 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:19.891573  3838 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:19.890542  3134 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:19.913630  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:19.909238  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:19.914032  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:19.928828  3281 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.914625  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:19.920081  3136 raft_consensus.cc:2376] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8. Re-sending same reply.
I20260709 13:17:19.826388  7301 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 13:17:19.931568  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 303725us
I20260709 13:17:19.931491  3285 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
W20260709 13:17:19.935971  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 52907us
I20260709 13:17:19.901830  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:19.886652  7400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.011s	sys 0.008s
I20260709 13:17:19.938719  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:19.944556  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:19.944902  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:19.948079  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:19.948727  3283 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 11: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:19.951050  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:19.951233  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:19.952085  3284 raft_consensus.cc:2368] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14.
I20260709 13:17:19.907311  7463 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:19.917910  7335 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:19.955773  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:19.915817  7392 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:19.961337  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:19.901017  7355 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:19.945215  7400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.012s	sys 0.008s
I20260709 13:17:19.959954  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:19.960371  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:19.957676  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.962185  3285 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 11: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:19.963778  3284 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:19.965742  3210 raft_consensus.cc:2410] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:19.944545  7179 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:19.902472  7388 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:19.970150  3206 raft_consensus.cc:2410] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:19.966506  3134 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:19.965487  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:19.973506  3135 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.969421  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:19.975153  3837 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:19.948302  7466 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:19.953126  7312 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:19.962635  7463 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.981122  3805 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:19.965521  7297 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:19.965055  7335 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.995631  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:20.001921  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.003021  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:20.003650  3805 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:20.005577  7352 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:20.006475  7352 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:20.006853  7352 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:20.007285  7352 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.009994  3206 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:20.018426  3282 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:20.019611  7388 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:19.920112  7305 consensus_queue.cc:237] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.004032  3277 raft_consensus.cc:2393] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:17:20.030306  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 121331us
I20260709 13:17:20.033245  3283 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.951340  7133 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:20.048862  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 108782us
I20260709 13:17:20.031306  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:20.056962  3837 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:20.063591  3841 raft_consensus.cc:1240] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:20.067466  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:20.070911  3281 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:20.072746  3277 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:20.075961  3207 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:20.073348  3284 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:20.088081  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:20.076577  7268 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:20.089011  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:20.066468  7312 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.097254  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:20.098624  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:20.099928  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:20.100483  3284 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
W20260709 13:17:20.109148  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 183621us
I20260709 13:17:20.110088  3101 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:20.108078  7163 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.111624  3101 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:20.112377  7163 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:20.114632  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.117825  3805 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:20.118769  7355 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:20.119566  7355 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.115046  7463 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.123665  7463 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:20.126408  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1734) took 2519 ms. Trace:
I20260709 13:17:20.126937  3132 rpcz_store.cc:276] 0709 13:17:17.606838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.053522 (+446684us) service_pool.cc:224] Handling call
0709 13:17:18.053882 (+   360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:18.054245 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.054277 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:18.054693 (+   416us) log.cc:844] Serialized 52 byte log entry
0709 13:17:19.587893 (+1533200us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b18003b5d80. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:17:19.963998 (+376105us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:19.964034 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.967116 (+  3082us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.125828 (+158712us) raft_consensus.cc:1685] finished
0709 13:17:20.125856 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.126181 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7226,"spinlock_wait_cycles":3994496,"thread_start_us":339054,"threads_started":1,"wal-append.queue_time_us":2028324}
W20260709 13:17:20.129315  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 98086.2us
I20260709 13:17:20.129611  7297 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:20.130138  7297 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:20.130528  7297 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:20.135679  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:20.136368  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.096537  7312 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:20.139806  3283 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:20.153355  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:20.153836  7468 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:20.154685  7281 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:20.155917  7309 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:20.156526  7309 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.154625  7468 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.157174  7163 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:20.158754  7309 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:20.158754  7468 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:20.161028  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:20.154531  3838 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:17:20.163741  7468 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:20.164140  7468 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.164507  7468 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.167563  7464 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:20.168279  7464 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:20.171231  7459 log.cc:927] Time spent T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:17:20.178954  7340 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:20.179643  7388 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.182152  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:20.182786  7388 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.183307  7386 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:20.183724  7386 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:20.184072  7386 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:20.184940  7388 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:20.189416  7468 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.181061  7382 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:20.181181  7268 consensus_queue.cc:1059] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:20.129386  7411 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.193418  7091 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:20.194109  3249 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:20.180486  7360 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:20.214301  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:20.215261  3283 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:20.148254  7286 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:20.160905  7292 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:20.228060  3249 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:20.059964  7466 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:20.235534  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 124080us
I20260709 13:17:20.211771  7180 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.236985  6921 raft_consensus.cc:2764] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:17:20.231525  7366 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.232064  7363 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:20.205498  7185 consensus_queue.cc:1059] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:17:20.256995  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:20.207484  7411 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.209004  7386 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.242902  7133 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:20.260171  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 194216us
I20260709 13:17:20.263908  3249 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:20.255834  7416 consensus_meta.cc:287] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.549s	user 0.013s	sys 0.000s
I20260709 13:17:20.251770  7363 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:20.248477  7180 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.286841  3805 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:20.264894  7481 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:20.290825  3102 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:20.292402  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 52258.2us
I20260709 13:17:20.278414  7363 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:20.295717  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45779.8us
I20260709 13:17:20.294178  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 615) took 1639 ms. Trace:
I20260709 13:17:20.302809  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:20.297555  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:20.304728  3210 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:20.298332  3206 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:20.306145  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:20.308454  3202 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:20.285435  7133 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.284312  7355 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:20.294935  7274 consensus_meta.cc:287] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.602s	user 0.005s	sys 0.009s
W20260709 13:17:20.313328  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 181226us
I20260709 13:17:20.323344  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:20.318511  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:20.299823  3280 rpcz_store.cc:276] 0709 13:17:18.565704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.568154 (+  2450us) service_pool.cc:224] Handling call
0709 13:17:18.568503 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.747944 (+179441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.747978 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.758370 (+ 10392us) log.cc:844] Serialized 26 byte log entry
0709 13:17:19.068708 (+310338us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:19.069058 (+   350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.172710 (+1103652us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54001784d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:20.172760 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.172900 (+   140us) raft_consensus.cc:1685] finished
0709 13:17:20.172919 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.205371 (+ 32452us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":636,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":10674,"spinlock_wait_cycles":411582848,"thread_start_us":121181,"threads_started":1,"wal-append.queue_time_us":205343}
I20260709 13:17:20.278628  7416 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.325027  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:20.310109  7305 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:20.321455  7281 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:17:20.328191  7468 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:20.346042  7468 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:20.326203  7355 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:17:20.346604  7468 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.347021  7468 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:20.310837  7392 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:20.347697  7474 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:17:20.348726  7268 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:20.349342  7268 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.350205  7416 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:20.334030  7274 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:20.350983  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:20.351195  7274 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.351481  7268 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:20.351641  7274 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:20.351882  7481 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:20.351750  3281 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:20.328465  7466 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:20.333381  3205 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:20.328572  7360 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:20.353892  7360 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.354278  7360 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:20.354418  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:20.355358  3205 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:20.356477  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:20.339610  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:20.357208  7352 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.339442  7356 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:20.340212  3211 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:20.359457  7352 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:20.360109  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:20.328269  7479 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:17:20.361470  3211 raft_consensus.cc:2410] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:20.356739  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:20.271083  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:20.364494  3840 consensus_meta.cc:287] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.003s
I20260709 13:17:20.364902  3840 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:20.367803  3135 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:20.369962  3102 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:20.377897  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 56821.4us
I20260709 13:17:20.326112  6921 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:20.301169  7091 consensus_queue.cc:1059] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:17:20.384740  3203 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:17:20.387869  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.385520  6921 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.389381  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:20.389561  6921 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:20.389401  7384 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:20.393711  7416 consensus_queue.cc:1059] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:20.394521  7386 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:20.394820  7383 raft_consensus.cc:3055] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:20.395210  7383 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:17:20.396287  7346 consensus_meta.cc:287] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.003s
I20260709 13:17:20.396180  7383 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.397514  7383 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.402230  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:20.403393  7481 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:20.404628  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47973.7us
I20260709 13:17:20.405519  3101 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:20.335578  7305 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:20.430181  7478 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:17:20.413056  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1487) took 1043 ms. Trace:
I20260709 13:17:20.431027  3130 rpcz_store.cc:276] 0709 13:17:19.370092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.373257 (+  3165us) service_pool.cc:224] Handling call
0709 13:17:20.412762 (+1039505us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54003b79d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:20.412983 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667642624}
I20260709 13:17:20.327205  7133 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.409271  7268 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:17:20.432219  7273 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:20.433938  7133 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:20.413741  6921 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.436501  6921 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:20.416888  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:20.437626  7464 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:20.413539  7363 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.438041  3280 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.440168  7411 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:20.441411  7091 raft_consensus.cc:3055] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:20.441979  7091 raft_consensus.cc:740] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:20.442407  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:20.443189  3840 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:20.442970  7091 consensus_queue.cc:260] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.443452  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:20.444643  7091 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:20.445307  7384 raft_consensus.cc:697] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:20.445447  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:20.419376  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:20.444722  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:20.422044  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.387813  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:20.425417  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:17:20.429867  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 102442us
W20260709 13:17:20.471664  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 83913.7us
I20260709 13:17:20.438285  7392 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:20.472492  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:20.482470  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 179747us
W20260709 13:17:20.428216  7485 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:20.468025  3842 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:20.502519  3202 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:20.429491  7305 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:20.501992  3030 catalog_manager.cc:5697] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:20.512125  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:20.439668  7363 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:20.517551  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.519415  3833 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:20.489475  7268 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:20.525635  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 98233.8us
W20260709 13:17:20.525755  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 120369us
I20260709 13:17:20.526357  3177 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:20.535116  3101 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:20.422853  7274 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.526684  7268 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.538282  7268 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:20.539711  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.420102  7335 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.409035  7360 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.542930  7360 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:20.544631  3206 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:20.511797  7286 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:20.483708  6921 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:17:20.549338  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:20.548134  3840 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:20.551100  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:20.551740  3280 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:20.554646  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:20.555071  3207 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:17:20.556231  3203 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:20.524778  7411 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:20.565506  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:20.566293  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 93883.5us
I20260709 13:17:20.568459  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:20.564273  3177 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:20.569530  3211 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:20.547112  7387 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.575479  7463 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.576529  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:20.577515  7286 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:20.577858  3101 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:20.579005  7373 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:20.579392  7373 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:20.579768  7373 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.582082  3101 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:20.582993  6835 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:20.583418  6835 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.583738  6835 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:20.586733  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:20.590588  7335 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:20.591553  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:20.593181  7411 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.632756  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:20.633427  3841 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:20.633517  7411 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:20.631628  3202 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.594868  7274 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:20.595175  7388 raft_consensus.cc:3055] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:20.600503  3030 catalog_manager.cc:5697] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:20.637320  7388 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:20.604029  3837 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:20.638770  7388 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.639320  3030 catalog_manager.cc:5697] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 5 to 6, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 6 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:20.605654  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:20.606618  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:20.607800  3832 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:20.615061  7486 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:17:20.615895  7384 consensus_queue.cc:237] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.617347  7297 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.620414  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:20.650408  3840 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:20.622723  7180 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:20.623530  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:20.659471  3204 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:20.567529  7466 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.561764  7355 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:20.647225  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 78867.6us
I20260709 13:17:20.641569  3842 raft_consensus.cc:2368] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12.
I20260709 13:17:20.641579  3836 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:17:20.643522  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 69480.1us
W20260709 13:17:20.648972  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 77552.8us
W20260709 13:17:20.667160  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.658490  7314 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:20.641064  3030 catalog_manager.cc:5697] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 5 to 11, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 11 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:20.657910  3131 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:20.587062  7470 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:20.688658  3209 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:20.642975  3833 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:20.640141  7388 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:20.687598  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 123398us
I20260709 13:17:20.694135  7293 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.694700  7293 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.698594  3030 catalog_manager.cc:5697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:20.700696  3030 catalog_manager.cc:5697] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:20.696946  7293 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:20.703806  3030 catalog_manager.cc:5697] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 3 to 8, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 8 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:20.705446  3030 catalog_manager.cc:5697] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 1 to 8. New cstate: current_term: 8 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:20.706991  3030 catalog_manager.cc:5697] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 8 to 10, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 10 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:20.708623  3030 catalog_manager.cc:5697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 7 to 8, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 8 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:20.711817  3285 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:20.712782  3030 catalog_manager.cc:5697] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:17:20.715478  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:20.717010  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.723361  3838 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 7. Current term is 9. Ops: []
W20260709 13:17:20.723308  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 141659us
I20260709 13:17:20.671000  7355 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.728186  3177 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:20.731256  3202 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:20.731483  3210 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:20.733260  3030 catalog_manager.cc:5697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 7 to 8, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 8 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:20.733989  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:20.739108  3211 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:20.743734  3030 catalog_manager.cc:5697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 3 to 7, term changed from 3 to 7, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New cstate: current_term: 7 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:20.639664  7468 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.749667  3177 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:20.648466  7387 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.718225  7486 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:20.765553  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:20.674224  7363 consensus_queue.cc:1059] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:17:20.726595  7470 raft_consensus.cc:697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:20.738916  7355 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.790787  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:20.799858  3251 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:20.768394  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:20.806802  3207 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:20.746992  7463 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:20.691773  7180 consensus_queue.cc:1059] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:17:20.811146  3834 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:20.749068  7274 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:20.821532  7274 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:20.823566  7274 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:20.829632  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:20.830403  3833 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:20.831171  7463 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.831614  7463 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:20.789667  7356 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:20.833861  7274 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:20.811410  7495 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:17:20.837808  7297 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:20.838428  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 91667.7us
W20260709 13:17:20.821606  3033 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38226 (request call id 252) took 29756 ms (client timeout 15000 ms). Trace:
I20260709 13:17:20.748303  7273 consensus_queue.cc:1059] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:17:20.837054  7274 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:20.839212  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:20.849236  7091 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.849857  7091 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.854578  6835 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.857664  6835 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:20.858647  7468 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:20.822247  3030 catalog_manager.cc:5697] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 5 to 8, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 8 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:20.861058  3177 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
W20260709 13:17:20.866096  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 141268us
I20260709 13:17:20.868484  3204 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:20.866704  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:20.869443  7486 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:20.751048  7268 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.880394  6835 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:20.882249  7268 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:20.883149  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:17:20.884262  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 84570.2us
I20260709 13:17:20.885303  7356 raft_consensus.cc:697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:20.885591  7382 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.886322  7382 consensus_queue.cc:1059] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:20.877840  3249 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:20.878572  7363 consensus_queue.cc:1059] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:20.879966  7273 raft_consensus.cc:3055] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:20.880076  7360 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.886348  3251 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:20.888867  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:20.891278  3211 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:20.892254  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:20.890615  3249 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:20.886374  7356 consensus_queue.cc:237] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:20.921551  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 82447.5us
W20260709 13:17:20.926672  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.874215  7292 raft_consensus.cc:3055] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:20.839828  7470 consensus_queue.cc:237] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.929701  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:20.934194  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.887252  7180 raft_consensus.cc:3055] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:20.940126  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:20.887355  7411 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:20.890440  6921 raft_consensus.cc:3055] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:20.933027  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.907562  7273 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:20.949115  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:20.951323  3210 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 14: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:20.948899  7411 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.952951  7411 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.954195  7373 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.954891  7463 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.956449  7373 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:20.922720  7305 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.957306  6909 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:20.920714  7360 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.959385  7305 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:20.963778  7297 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.921113  7383 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:20.964515  7383 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.964461  7297 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.965135  7383 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.965231  7490 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.965917  7490 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.928977  7163 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:20.967240  7163 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:20.967533  7382 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:20.968056  7382 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:20.968463  7382 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:20.946660  7180 raft_consensus.cc:740] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:20.940281  7486 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:20.969834  7180 consensus_queue.cc:260] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:20.970599  7486 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.973591  7091 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:20.839197  3033 rpcz_store.cc:269] 0709 13:16:50.888210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.893312 (+  5102us) service_pool.cc:224] Handling call
0709 13:17:20.644577 (+29751265us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:13.089441 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:13.090137 (+   696us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:13.090185 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:17:13.090202 (+    17us) tablet.cc:662] Decoding operations
0709 13:17:13.114104 (+ 23902us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:13.114216 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:13.114244 (+    28us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:17:13.115419 (+  1175us) tablet.cc:701] Row locks acquired
0709 13:17:13.115471 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:17:13.115680 (+   209us) write_op.cc:270] Start()
0709 13:17:13.115844 (+   164us) write_op.cc:276] Timestamp: P: 1783603033115596 usec, L: 0
0709 13:17:13.115862 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:17:13.157238 (+ 41376us) log.cc:844] Serialized 5539 byte log entry
0709 13:17:14.099508 (+942270us) op_driver.cc:464] REPLICATION: finished
0709 13:17:14.341268 (+241760us) write_op.cc:301] APPLY: starting
0709 13:17:14.341391 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:14.341765 (+   374us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:14.341917 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:14.362025 (+ 20108us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:14.362461 (+   436us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:17:14.362531 (+    70us) write_op.cc:312] APPLY: finished
0709 13:17:14.365600 (+  3069us) log.cc:844] Serialized 101 byte log entry
0709 13:17:14.366433 (+   833us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:14.366608 (+   175us) write_op.cc:454] Released schema lock
0709 13:17:14.366674 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:14.367103 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:14.367134 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":642849,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":228901,"apply.run_cpu_time_us":4970,"apply.run_wall_time_us":25846,"num_ops":14,"prepare.queue_time_us":158012,"prepare.run_cpu_time_us":30215,"prepare.run_wall_time_us":224234,"raft.queue_time_us":657689,"raft.run_cpu_time_us":40091,"raft.run_wall_time_us":145637,"replication_time_us":967335,"thread_start_us":631243,"threads_started":4,"wal-append.queue_time_us":201566,"wal-append.run_cpu_time_us":42851,"wal-append.run_wall_time_us":2002767}]]}
I20260709 13:17:20.980263  7268 raft_consensus.cc:3055] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:20.980741  7268 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:20.941183  7363 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:20.981734  7363 raft_consensus.cc:697] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:20.982095  7268 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:20.983091  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:20.982897  7363 consensus_queue.cc:237] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:20.998492  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 112236us
I20260709 13:17:20.999496  3251 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:20.933697  7480 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:21.006575  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 64718.4us
I20260709 13:17:20.934547  7292 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:20.956884  7463 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:20.942178  6835 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:21.022888  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:21.030171  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:21.020268  7480 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:21.038900  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:20.949681  6921 raft_consensus.cc:740] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:21.039772  3131 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:21.043376  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:21.044183  3211 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:21.005789  7268 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:21.047075  3806 leader_election.cc:336] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.517s (SENT)
W20260709 13:17:21.065016  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 194132us
I20260709 13:17:21.065339  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:21.066171  3132 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:21.077570  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:21.082590  3133 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:21.082765  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:21.090178  3131 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:21.092165  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:21.018041  7373 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:17:21.098779  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:21.099409  3128 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:21.051929  7480 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:21.102074  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:21.105177  3134 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:21.099736  3806 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:21.098395  7477 log.cc:927] Time spent T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:17:21.114534  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 48771.9us
I20260709 13:17:20.968478  7163 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:21.098969  7387 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:21.122983  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 114489us
I20260709 13:17:21.124935  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:21.111608  7481 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:21.136584  3133 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:21.114403  7392 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:21.120597  7360 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:21.154891  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.161337  3134 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
W20260709 13:17:21.139696  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 198287us
W20260709 13:17:21.151643  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 104621us
I20260709 13:17:21.180969  3249 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:21.151957  6909 raft_consensus.cc:697] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:17:21.201503  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 51306.1us
I20260709 13:17:21.109855  7292 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:21.209826  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:21.210539  3130 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.153959  7481 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:21.127202  7490 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:21.135115  6921 consensus_queue.cc:260] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:21.134179  7273 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:21.228467  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 229034us
I20260709 13:17:21.211090  7373 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:17:21.229040  7292 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:21.259014  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 78895.2us
I20260709 13:17:21.224409  7297 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:21.243767  3130 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:21.278215  3100 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:21.283422  3130 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:21.286857  3132 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:21.288020  3128 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:21.266621  6921 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:21.268621  6909 consensus_queue.cc:237] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:21.303676  7502 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:17:21.307358  7497 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 13:17:21.313398  7503 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 13:17:21.314757  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 108804us
I20260709 13:17:21.316308  3101 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:21.320292  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:21.322052  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:21.336395  3211 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:21.325779  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:21.333341  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:21.322180  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:21.339875  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.321523  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:21.322582  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 178520us
I20260709 13:17:21.286500  7392 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.334100  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:21.353830  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 75732.9us
I20260709 13:17:21.292887  7273 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:21.361662  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:21.326287  7180 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:21.321040  7463 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:21.359695  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:21.290593  7512 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:21.368558  7388 consensus_meta.cc:287] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.004s
W20260709 13:17:21.388047  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 207206us
I20260709 13:17:21.369084  6835 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:21.392146  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.393054  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:21.409914  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.412773  3202 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:21.383749  7366 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:21.428295  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:21.431483  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:21.432680  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:21.433117  3202 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:21.433331  3282 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:21.433588  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:21.434327  3281 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 10: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:21.434651  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:21.435165  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:21.436384  7373 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:21.436674  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:21.439023  7366 raft_consensus.cc:697] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:21.440119  7366 consensus_queue.cc:237] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:21.440861  7133 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:21.441733  7507 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:21.442391  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:21.443341  7509 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:17:21.443657  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:21.354624  7481 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:21.461450  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 145360us
I20260709 13:17:21.464089  3136 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:17:21.464197  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:21.464977  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:21.465583  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:21.465641  3128 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
W20260709 13:17:21.475589  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.360658  7392 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:21.478719  7392 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:21.487979  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:21.488873  3129 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:21.390324  7463 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:21.490576  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:21.491235  7463 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:21.493552  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:21.409443  6835 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.494313  3130 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:21.494560  6835 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:21.499930  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:21.500772  3832 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 11: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:21.353339  7411 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:21.503717  3129 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:21.504801  3205 raft_consensus.cc:2393] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 10: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:17:21.506244  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 172215us
W20260709 13:17:21.421226  7355 consensus_meta.cc:287] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.007s
I20260709 13:17:21.507068  7355 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:21.516018  3203 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:21.441018  7388 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:21.518764  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:21.542104  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 311062us
I20260709 13:17:21.543514  3832 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:21.442341  7507 raft_consensus.cc:697] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:21.552109  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:21.555254  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.555783  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:21.556576  3834 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.567554  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:21.568696  3284 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:21.572976  3285 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:21.582492  3279 raft_consensus.cc:2410] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:17:21.583604  7268 consensus_meta.cc:287] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.002s
I20260709 13:17:21.590036  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:21.590926  3285 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:21.592648  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:21.550230  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:21.598502  3838 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:21.608675  3250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.013s	sys 0.022s
W20260709 13:17:21.609225  3250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.013s	sys 0.022s
I20260709 13:17:21.610473  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:21.616470  3282 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:21.448935  7383 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:21.544129  7355 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:21.624562  3834 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
W20260709 13:17:21.653673  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 53455.5us
I20260709 13:17:21.657279  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:21.658432  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 46121.4us
I20260709 13:17:21.664242  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:21.595073  7411 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:21.725901  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 46275us
I20260709 13:17:21.726289  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:21.727383  3135 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:21.658593  7463 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:21.731151  7463 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:21.731525  7463 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:21.744683  3285 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
W20260709 13:17:21.769739  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 217727us
I20260709 13:17:21.775018  3177 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
W20260709 13:17:21.720817  7363 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.009s	sys 0.003s
I20260709 13:17:21.796483  3283 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:21.612581  7512 consensus_queue.cc:1059] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.149s
I20260709 13:17:21.600116  7388 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:21.807716  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:21.888746  3135 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
W20260709 13:17:21.818545  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.779517  7514 log.cc:927] Time spent T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:17:21.798180  7513 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:21.671769  7508 consensus_queue.cc:1059] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.143s
W20260709 13:17:21.887660  3806 leader_election.cc:336] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.508s (SENT)
I20260709 13:17:21.787982  7309 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:17:21.827339  7163 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.828941  3176 leader_election.cc:400] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14.
I20260709 13:17:21.902809  3176 leader_election.cc:403] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:17:21.842664  6909 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.887550  7512 consensus_queue.cc:1243] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer 0930e3e7657c43bcaaa5b0778f3e08cf log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:17:21.845744  7363 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.009s	sys 0.003s
I20260709 13:17:21.899585  3806 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:21.909185  7340 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:21.905555  6909 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:21.911890  6835 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:21.878240  7507 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:21.917444  7163 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:21.920042  7163 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:21.921779  7519 log.cc:927] Time spent T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:17:21.926553  7480 consensus_meta.cc:287] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.817s	user 0.015s	sys 0.000s
I20260709 13:17:21.934669  3838 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:21.927704  7480 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:21.937000  3177 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:21.940896  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:21.947062  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:21.947669  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:21.953691  3130 raft_consensus.cc:2368] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13.
W20260709 13:17:21.947847  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 176174us
I20260709 13:17:21.955111  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:21.960301  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:21.964758  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:21.965252  3281 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:21.966151  3127 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:21.968446  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:21.969439  3838 raft_consensus.cc:2368] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12.
W20260709 13:17:21.969647  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.975651  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 365260us
I20260709 13:17:21.937949  7513 raft_consensus.cc:697] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:21.948554  7382 consensus_meta.cc:287] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.980s	user 0.011s	sys 0.015s
I20260709 13:17:21.945640  7360 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14.
W20260709 13:17:21.981163  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.959806  7335 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:21.983995  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:21.985042  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:21.986109  3832 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:21.963889  7163 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:21.987334  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.971110  7521 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:21.983143  7512 raft_consensus.cc:3055] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:17:21.990001  3250 leader_election.cc:336] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.644s (SENT)
I20260709 13:17:21.984669  7309 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:17:22.014390  7528 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 13:17:22.015431  7535 log.cc:927] Time spent T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:22.017302  7480 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:22.025519  7541 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.183s	user 0.000s	sys 0.003s
I20260709 13:17:22.025290  7521 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:22.030771  7513 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:22.033412  7383 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:22.036250  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1516) took 1002 ms. Trace:
I20260709 13:17:22.037462  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.038631  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1508) took 1011 ms. Trace:
W20260709 13:17:22.039399  7529 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:17:22.039906  3128 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:22.086581  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.073990  3127 rpcz_store.cc:276] 0709 13:17:21.027247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.040364 (+ 13117us) service_pool.cc:224] Handling call
0709 13:17:22.038448 (+998084us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b54000e29d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:22.038571 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2008134912}
I20260709 13:17:22.087396  3128 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:22.040495  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:22.042521  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47115.9us
I20260709 13:17:22.049340  7512 raft_consensus.cc:740] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:22.049503  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:22.059698  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.089753  3135 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:22.060484  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.066206  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:21.995338  7273 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.984414  7382 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:22.070565  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.093474  3131 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:22.054746  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:22.067204  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:22.053053  3211 consensus_meta.cc:287] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.706s	user 0.009s	sys 0.005s
I20260709 13:17:22.054735  7387 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.097981  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.095137  3211 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:22.097051  3136 raft_consensus.cc:2368] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14.
W20260709 13:17:22.097337  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 126931us
I20260709 13:17:22.073966  3133 rpcz_store.cc:276] 0709 13:17:21.034183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.149847 (+115664us) service_pool.cc:224] Handling call
0709 13:17:21.192824 (+ 42977us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.217734 (+ 24910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.217784 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.218911 (+  1127us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.618074 (+399163us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:21.843649 (+225575us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.867742 (+ 24093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.867830 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.036044 (+168214us) raft_consensus.cc:1685] finished
0709 13:17:22.036066 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.036192 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34988,"prepare.queue_time_us":298856,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":28,"raft.queue_time_us":42630,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":16986,"thread_start_us":495320,"threads_started":2,"wal-append.queue_time_us":729753}
I20260709 13:17:22.115151  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.116312  3136 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:22.101729  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.118191  3130 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:22.137064  3132 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:22.141649  3277 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
W20260709 13:17:22.151022  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 161051us
W20260709 13:17:22.152393  3250 leader_election.cc:336] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.775s (SENT)
I20260709 13:17:22.112777  7383 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:22.147300  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.154330  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.155090  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.155988  3132 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
W20260709 13:17:22.157686  7551 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:17:22.099638  7463 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.163744  7463 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:22.164709  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 76531.4us
I20260709 13:17:22.165320  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.166514  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:22.167527  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:22.143590  7305 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.099772  7273 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.192592  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.101401  7387 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:22.152294  6835 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:22.196327  3136 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:22.196372  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:22.197471  3127 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:22.201922  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:22.203945  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:17:22.194187  6921 consensus_meta.cc:287] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.842s	user 0.013s	sys 0.004s
I20260709 13:17:22.205297  3176 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:22.192260  7490 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:22.208621  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 56244.8us
W20260709 13:17:22.209770  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.189020  7305 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.210986  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.212451  7305 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:22.217603  7549 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:17:22.223819  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.224870  3132 raft_consensus.cc:2368] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13.
I20260709 13:17:22.231508  7557 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:22.232160  7557 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:22.235611  7557 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:22.236599  3250 leader_election.cc:336] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.648s (SENT)
I20260709 13:17:22.200017  7309 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:17:22.230309  7490 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:22.196031  7133 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:17:22.237746  7382 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:22.205660  7360 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:22.203768  7524 raft_consensus.cc:3055] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:22.261981  3250 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:22.208127  7163 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:22.263749  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.291206  3133 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:22.291316  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.281199  3834 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:22.286689  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.226791  7335 raft_consensus.cc:697] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:22.169838  7512 consensus_queue.cc:260] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:22.297459  6921 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.301576  7555 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.303773  6921 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.304271  7555 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.305999  6921 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:22.298131  7490 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.306496  7555 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:22.298159  7180 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:22.297459  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.266376  7388 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:22.288643  7524 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:22.308355  7524 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:22.301486  7513 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:22.301582  7163 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:22.309491  7524 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.309619  7513 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:22.302402  7355 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:22.310149  7387 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:22.310458  7355 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.311550  7273 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:22.312515  7355 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:22.312721  7521 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:22.313254  3251 leader_election.cc:400] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12.
I20260709 13:17:22.325265  3251 leader_election.cc:403] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:22.307533  3127 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:17:22.302448  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 65902us
I20260709 13:17:22.315493  3832 raft_consensus.cc:1217] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Deduplicated request from leader. Original: 6.8->[8.9-11.10]   Dedup: 8.9->[11.10-11.10]
I20260709 13:17:22.317483  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:22.318557  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.328011  3833 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:22.328320  3136 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:22.323607  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:22.329664  3838 raft_consensus.cc:2368] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10.
I20260709 13:17:22.330180  3832 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: [8.9-11.10]
W20260709 13:17:22.332176  3250 leader_election.cc:336] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.793s (SENT)
I20260709 13:17:22.332756  3251 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:22.345594  3251 leader_election.cc:400] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10.
I20260709 13:17:22.346171  3251 leader_election.cc:403] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:17:22.310144  7513 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.347023  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:22.347134  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.353384  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:22.349025  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:22.359407  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 154145us
I20260709 13:17:22.327976  6909 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:22.367530  7335 consensus_queue.cc:237] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:22.348884  7366 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:17:22.374661  7388 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.349324  7273 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:22.375622  7388 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.349160  7309 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:22.347477  7521 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12.
I20260709 13:17:22.377156  7309 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:22.310177  7163 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.380064  7309 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:22.368091  7554 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:22.382576  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.399116  3127 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:22.384183  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.384436  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.385416  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.385851  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.400074  3136 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
W20260709 13:17:22.393610  3250 leader_election.cc:336] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.586s (SENT)
I20260709 13:17:22.402809  3133 raft_consensus.cc:2368] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13.
I20260709 13:17:22.386080  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.386586  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.387324  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.390093  3129 raft_consensus.cc:3055] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:22.373219  7268 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:22.404309  3129 raft_consensus.cc:740] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:22.412743  3131 raft_consensus.cc:2410] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:22.418273  3128 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:22.421346  3129 consensus_queue.cc:260] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.356133  7383 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.424160  3276 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
W20260709 13:17:22.437733  3250 leader_election.cc:336] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.019s (SENT)
I20260709 13:17:22.385942  7513 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:22.439692  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.444900  3131 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:22.396777  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:22.443924  3250 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:22.380095  7388 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:22.447399  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 50689.6us
I20260709 13:17:22.466679  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.472046  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.470101  3284 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:22.474148  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.474457  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.475046  3133 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:22.475495  3132 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
W20260709 13:17:22.476703  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.476765  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.479633  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.478201  3127 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
W20260709 13:17:22.481519  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 380986us
I20260709 13:17:22.484572  3277 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:22.489719  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.490664  3131 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:22.491830  3134 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:17:22.492265  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.492528  3129 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.494129  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.494760  3133 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
W20260709 13:17:22.495340  3204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.008s	sys 0.017s
I20260709 13:17:22.465543  7561 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:22.496794  3281 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:22.497483  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.498183  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.502931  3136 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:22.488039  7388 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:22.499785  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 62106.9us
I20260709 13:17:22.500382  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.512447  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:22.513712  3250 leader_election.cc:336] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.177s (SENT)
I20260709 13:17:22.517058  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.519388  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:22.523217  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.524005  3277 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:22.526257  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.494081  7273 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.491281  7268 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.537220  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:22.528374  3208 raft_consensus.cc:2410] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:22.529173  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:22.529434  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:22.539445  3250 leader_election.cc:336] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.690s (SENT)
I20260709 13:17:22.539597  3210 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:22.530720  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.540781  3131 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
W20260709 13:17:22.532351  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 253748us
I20260709 13:17:22.535733  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1502) took 1097 ms. Trace:
I20260709 13:17:22.498942  3806 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:22.542457  3276 rpcz_store.cc:276] 0709 13:17:21.431032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.431190 (+   158us) service_pool.cc:224] Handling call
0709 13:17:22.527949 (+1096759us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b5400077454. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:22.528094 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1783553408}
I20260709 13:17:22.547248  3279 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 10: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:22.548506  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.551163  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:22.554551  3250 leader_election.cc:336] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.766s (SENT)
I20260709 13:17:22.560258  3250 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:22.565899  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 67067.1us
I20260709 13:17:22.567123  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:22.567075  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.568131  3209 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:22.516351  7561 raft_consensus.cc:697] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:22.571152  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:22.574888  3209 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:22.583377  3210 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:22.574235  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.586133  3131 raft_consensus.cc:2410] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:17:22.597013  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.599663  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.601529  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.602733  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:22.603487  3210 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:22.605715  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.604905  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:22.618465  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:22.619601  3279 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:22.620043  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:22.623759  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:22.625819  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 71410.9us
I20260709 13:17:22.522622  7388 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.632161  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:22.632570  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:22.634289  3280 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.637449  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.638607  3278 raft_consensus.cc:2410] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:22.601642  7292 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:22.640515  7360 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.633036  7490 raft_consensus.cc:2764] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:22.633402  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:22.646798  7360 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:22.647476  7360 raft_consensus.cc:697] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:22.649523  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.650586  3276 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:22.651146  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.650624  3277 raft_consensus.cc:2410] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:22.652313  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.648598  7360 consensus_queue.cc:237] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.654780  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.657604  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:22.592590  7560 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.545994  7273 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.709751  3210 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:22.657553  3277 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:22.677737  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:22.712173  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.713495  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:22.659613  3250 leader_election.cc:336] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.115s (SENT)
I20260709 13:17:22.714629  3250 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:22.601884  7554 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:22.692441  3280 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:22.709604  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.716172  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:22.718931  3276 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:22.719573  3278 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:17:22.734937  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.735642  7133 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:22.736814  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:22.741892  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.687145  7560 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.714051  7513 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:22.711251  7464 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:22.751631  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 174157us
I20260709 13:17:22.755698  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.757913  3135 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:22.758294  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.747496  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:22.758958  3279 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:22.761729  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.762351  3281 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:22.763322  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:22.763895  3278 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.745975  7163 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:22.765640  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:22.766408  3101 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:22.728355  7554 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:22.749557  7561 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.785218  7554 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:22.752736  7560 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.788349  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.789738  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.790804  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.791729  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.792272  3130 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:22.793378  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:22.794028  3280 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.746299  7292 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:22.774188  3806 leader_election.cc:336] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.753s (SENT)
I20260709 13:17:22.709645  7568 consensus_queue.cc:1059] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:17:22.799264  7568 raft_consensus.cc:3055] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:22.799787  7568 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:22.805677  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.806181  3278 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:22.806937  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.808316  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.800863  7568 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:22.810597  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 44313.9us
W20260709 13:17:22.810752  3806 leader_election.cc:336] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.095s (SENT)
I20260709 13:17:22.811134  7568 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.811269  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:22.812055  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:22.813301  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:22.813665  7558 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:17:22.807559  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:22.814689  3136 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.808578  3280 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
W20260709 13:17:22.816331  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 156741us
W20260709 13:17:22.817170  3250 leader_election.cc:336] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.156s (SENT)
I20260709 13:17:22.826710  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:22.827766  3278 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:22.828038  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.816236  7305 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.830091  7553 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:22.833473  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:22.834138  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:22.841003  3280 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:22.849182  3135 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:22.760474  7464 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.902812  3132 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 18: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:22.814579  7163 raft_consensus.cc:697] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:22.872215  3128 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:22.822464  7314 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:22.845404  3136 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:22.928236  3278 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:17:22.880955  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 151578us
I20260709 13:17:22.897432  3208 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
W20260709 13:17:22.904366  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 87163.5us
W20260709 13:17:22.929850  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.900331  7481 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:22.900913  7133 raft_consensus.cc:697] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:22.923126  3130 raft_consensus.cc:3055] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:17:22.931648  3250 leader_election.cc:336] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.184s (SENT)
I20260709 13:17:22.918955  7388 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:22.933163  3135 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:22.934094  3130 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:22.932956  3176 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:22.896055  7558 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:17:22.923429  3280 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:22.939769  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:22.942494  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:22.944646  3130 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.948167  7133 consensus_queue.cc:237] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:22.949656  7273 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:22.950697  7571 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:17:22.951725  7570 log.cc:927] Time spent T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:17:22.957594  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:17:22.956478  3250 leader_election.cc:336] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.758s (SENT)
I20260709 13:17:22.969357  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:22.956679  3204 raft_consensus.cc:2393] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 9: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:22.956261  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:22.971692  3211 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:17:22.962436  3833 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:17:22.978540  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:22.979413  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:22.973949  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 160744us
I20260709 13:17:22.981400  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:22.983181  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.981618  3101 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:22.936344  7464 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:22.987727  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.994465  3250 leader_election.cc:336] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.062s (SENT)
W20260709 13:17:22.998649  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.998961  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:23.000188  3249 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:23.010224  3102 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:23.015172  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.019987  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:23.021154  3211 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:23.025214  3208 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:23.027294  3249 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:23.031890  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 202369us
I20260709 13:17:22.970329  6835 consensus_queue.cc:1059] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:17:22.988545  7305 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:23.047228  7574 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:17:23.014426  7507 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.008633  7180 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.014294  7585 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.016222  7464 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:23.059125  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:23.030311  7388 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:23.048864  7480 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:23.049813  7314 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:23.062920  7572 log.cc:927] Time spent T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
W20260709 13:17:23.129642  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 94937.2us
I20260709 13:17:23.084882  6835 raft_consensus.cc:3055] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:23.137164  3128 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:23.139040  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:23.102972  7464 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:23.028761  7163 consensus_queue.cc:237] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:23.112715  7314 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.053483  7588 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:17:23.146157  3132 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:23.146281  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:23.102161  7524 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:23.082962  7507 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:23.151680  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:23.152622  3127 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:23.113029  7388 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.155344  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:23.158493  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.149405  7586 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:23.182229  7586 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.161784  7305 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:23.182806  7586 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:23.183115  7305 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:23.184059  3127 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:23.185417  7305 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:23.180271  3128 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
W20260709 13:17:23.186733  7383 consensus_meta.cc:287] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.742s	user 0.013s	sys 0.000s
I20260709 13:17:23.187249  7383 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10.
I20260709 13:17:23.154093  7314 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:23.191346  7581 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.270s	user 0.002s	sys 0.000s
W20260709 13:17:23.169940  7575 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:17:23.162050  7480 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:23.193938  7480 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:23.196374  7480 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:23.197746  7578 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:17:23.198745  7314 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:23.200951  7576 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:17:23.202438  7314 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:23.209287  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 146367us
I20260709 13:17:23.211512  3250 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:23.216063  3285 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:23.216710  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:23.137452  6835 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:23.180948  7524 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:23.255640  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 237859us
I20260709 13:17:23.167869  7560 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:23.252691  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:23.222013  7363 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:23.214761  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:23.289011  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 74346.2us
W20260709 13:17:23.281447  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 136336us
I20260709 13:17:23.284721  7411 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:23.295910  7411 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:23.298043  7587 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:17:23.298874  7411 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:23.289606  7568 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:23.300567  7568 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:23.310400  7507 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:23.221558  7527 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:17:23.315733  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:23.316617  3842 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:23.220722  7569 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:17:23.315790  7464 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:23.320269  7560 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:23.265964  7268 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.321600  7268 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:23.324695  7268 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:23.329248  7577 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
I20260709 13:17:23.334363  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:23.336935  7340 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.339363  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:23.344622  7585 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:23.288691  7592 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.347481  7592 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:23.350445  7592 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:23.340993  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:23.354892  3133 raft_consensus.cc:2368] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13.
I20260709 13:17:23.219890  7388 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:23.274046  7524 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:23.366677  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 307805us
W20260709 13:17:23.360621  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 68978.1us
W20260709 13:17:23.361444  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 52509us
W20260709 13:17:23.359253  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 73501.3us
W20260709 13:17:23.356861  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 44996.7us
I20260709 13:17:23.379333  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:23.380656  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:23.386351  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:23.374861  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:23.380057  3838 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:23.354123  7593 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:23.363276  7557 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:23.400328  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.400710  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:23.406064  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:23.406742  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:23.408788  3209 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:23.387301  7305 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:23.438611  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:23.399616  7594 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:23.366755  6835 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:23.410624  7335 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:17:23.411010  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:23.366693  7507 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:17:23.444696  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:23.438421  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:23.315682  7568 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:23.455687  3277 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:23.458779  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 431552us
W20260709 13:17:23.458199  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 47275.7us
I20260709 13:17:23.459882  3250 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:23.460074  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:23.462221  7163 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:23.463076  7163 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:23.463670  7163 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.471109  3805 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:23.450397  7305 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:23.467326  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:23.440861  7585 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:23.449039  7594 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.455466  7314 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.456991  7593 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.485849  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:23.472220  7363 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:23.483781  3249 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:23.457427  7133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.003s	sys 0.020s
I20260709 13:17:23.489563  3134 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:17:23.480690  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 499168us
I20260709 13:17:23.504331  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:23.505478  3285 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:23.477185  7527 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:23.528990  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:23.482137  6835 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.458817  7586 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:23.540917  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:23.546906  3209 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:23.480708  7594 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.582151  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:23.574651  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:23.547315  3284 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:23.589514  3133 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:23.586088  3282 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:23.450873  3136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:23.587663  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:23.585242  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 114270us
I20260709 13:17:23.586671  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:23.584977  3100 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:23.532143  7133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.003s	sys 0.021s
I20260709 13:17:23.595449  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:23.596343  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 146376us
I20260709 13:17:23.526917  6909 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:23.592161  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:23.609485  3280 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:17:23.592443  3805 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.085s (SENT) [suppressed 44 similar messages]
I20260709 13:17:23.609525  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:23.642700  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.487061  7314 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:23.611760  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:23.551275  7591 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:23.684320  3806 leader_election.cc:336] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.847s (SENT)
I20260709 13:17:23.684468  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:23.567658  7559 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:23.686969  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 77557.4us
I20260709 13:17:23.529469  7180 consensus_queue.cc:1059] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:17:23.559376  7360 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:23.706764  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:23.749907  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 113903us
W20260709 13:17:23.750759  3806 leader_election.cc:336] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.906s (SENT)
I20260709 13:17:23.689781  3284 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:23.752110  3280 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:23.599481  7388 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:23.753110  7600 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.754213  3280 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:23.489183  7593 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:23.614436  7464 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:23.747213  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 135529us
I20260709 13:17:23.706146  7582 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:23.756431  3136 raft_consensus.cc:606] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:23.744571  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 262727us
I20260709 13:17:23.771262  3136 raft_consensus.cc:614] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:23.772142  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:17:23.751554  3806 leader_election.cc:336] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.662s (SENT)
I20260709 13:17:23.757872  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:23.773821  3806 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:23.763594  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 264464us
I20260709 13:17:23.710903  7559 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:23.702667  6909 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:23.604043  7335 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 13:17:23.770404  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:23.775317  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:23.772249  3280 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:17:23.704116  7387 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.657528  7568 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:17:23.780108  3250 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:23.747006  7557 raft_consensus.cc:697] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:23.748586  7560 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:23.792860  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:23.795576  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:23.793936  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 86163.3us
I20260709 13:17:23.796725  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:23.776677  7360 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:23.773571  7582 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.745415  7569 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:17:23.831524  3805 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:23.778867  7559 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:23.787106  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:23.847688  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 60717.9us
I20260709 13:17:23.848755  3101 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:23.792572  7527 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:23.795286  7600 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:23.850131  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:23.790488  7464 raft_consensus.cc:697] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:23.796132  7388 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:23.868862  3129 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:23.869998  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:23.858193  3208 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
W20260709 13:17:23.872651  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 58591.2us
I20260709 13:17:23.873808  3250 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:23.842770  7582 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.833386  7180 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:23.886696  3250 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:23.892125  3250 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:23.861159  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:23.891189  3207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 1900) took 1294 ms. Trace:
I20260709 13:17:23.766104  7591 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:23.857756  7384 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:23.852236  7527 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:23.901204  3207 rpcz_store.cc:276] 0709 13:17:22.576059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.576235 (+   176us) service_pool.cc:224] Handling call
0709 13:17:23.869811 (+1293576us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b5800102f98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:17:23.870870 (+  1059us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6536960}
I20260709 13:17:23.870308  7305 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:23.834614  7604 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:17:23.912091  7388 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:17:23.919034  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 57996us
I20260709 13:17:23.920562  7481 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.923856  7612 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:23.924786  7606 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:23.925212  7596 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.399s	user 0.001s	sys 0.000s
I20260709 13:17:23.953231  3209 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:24.033764  7463 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:24.034397  7463 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:24.037274  7601 log.cc:927] Time spent T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
I20260709 13:17:23.925527  7598 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:24.037873  7598 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:24.038270  7598 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:23.900285  7292 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:23.887063  7490 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:17:24.039885  7591 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:23.920329  7564 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 1.066s	user 0.000s	sys 0.005s
I20260709 13:17:24.031713  7464 consensus_queue.cc:237] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:24.042794  7612 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:24.043839  3209 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:24.043462  7612 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:23.978761  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:17:24.031427  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 198793us
I20260709 13:17:23.918550  7527 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.883268  6909 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:24.046605  3277 consensus_meta.cc:287] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.007s
W20260709 13:17:24.056015  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 77382.3us
I20260709 13:17:24.046834  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:24.062000  3101 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:24.065435  3277 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:24.068982  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:24.036938  7463 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:24.070794  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2967) took 1496 ms. Trace:
I20260709 13:17:24.071417  3205 rpcz_store.cc:276] 0709 13:17:22.573982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.574128 (+   146us) service_pool.cc:224] Handling call
0709 13:17:24.070143 (+1496015us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b5800102f98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caeee 0000000000375939 00007fb3c113e1e0 00007fb3c12070c4 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:17:24.070314 (+   171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.070489 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.070520 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.070557 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:24.070586 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.070639 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.070738 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9365760}
I20260709 13:17:24.082197  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:24.060111  7586 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:24.066164  7585 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:23.952270  7557 consensus_queue.cc:237] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:24.063916  7292 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:24.030107  7388 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:24.070996  7314 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:24.078814  7606 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.081684  7305 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.075466  7556 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:17:24.107191  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.091147  7490 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:24.092583  7384 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:24.104167  7603 log.cc:927] Time spent T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 13:17:24.100244  7600 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:24.116647  7556 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:24.119204  7605 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260709 13:17:24.101393  7481 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:24.106700  7602 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.329s	user 0.001s	sys 0.001s
I20260709 13:17:24.115921  7593 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:24.121109  7360 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:24.102516  7292 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:24.144405  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 82539.1us
I20260709 13:17:24.116792  7617 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:24.150539  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:24.108759  7305 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.157032  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:24.147434  7623 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:17:24.158190  3129 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.161985  3101 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:24.164101  3101 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:24.109385  7606 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:24.135136  7585 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:17:24.138103  7490 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:17:24.131265  7586 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:17:24.167315  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:24.172434  3128 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:24.132612  7600 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:24.174171  7609 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
W20260709 13:17:24.174746  7619 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:17:24.175554  7611 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
W20260709 13:17:24.177218  7613 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
W20260709 13:17:24.178325  7163 consensus_meta.cc:287] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.714s	user 0.012s	sys 0.000s
I20260709 13:17:24.178735  7163 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:24.179792  7599 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:17:24.179935  3206 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.181408  7305 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:24.189568  3805 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:24.189863  7163 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:24.190850  3206 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:24.191044  7633 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:24.191567  7633 raft_consensus.cc:697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:24.160025  7363 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:24.175359  7631 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:24.159328  7384 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:24.164230  7360 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.194710  3135 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:24.194793  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:24.134814  7632 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:17:24.195473  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:24.214681  3129 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:24.216271  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:24.170336  3101 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:17:24.217780  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47520.2us
I20260709 13:17:24.218504  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:17:24.175401  7616 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:24.223941  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:24.226171  3101 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:24.226109  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:24.210158  7627 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:17:24.194090  7617 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:24.192482  7633 consensus_queue.cc:237] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:24.220266  7624 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:17:24.210985  7521 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:24.256212  7631 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:24.256174  7629 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:17:24.258093  7388 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:24.258078  7292 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:24.258924  7384 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:24.261247  7305 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:24.261917  7568 raft_consensus.cc:476] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 13:17:24.265677  3250 leader_election.cc:400] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13.
W20260709 13:17:24.268025  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.230155  7464 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:24.230415  7591 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:17:24.225605  7309 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:24.249547  7480 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:24.253605  7612 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:24.221360  7360 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.269316  7631 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:24.248525  7335 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:17:24.303400  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:24.285035  7595 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:24.306070  7637 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:24.305827  7595 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.307178  7481 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:24.273495  7273 consensus_queue.cc:1059] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:17:24.304200  3134 raft_consensus.cc:2376] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10. Re-sending same reply.
I20260709 13:17:24.255663  7598 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.272773  7521 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.292001  7464 raft_consensus.cc:697] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:24.294701  7617 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.307659  7481 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.302793  7631 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.302372  7480 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:24.322474  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:24.331002  7600 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:24.331540  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:24.341708  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:24.342444  7598 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:24.343175  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:24.344381  7360 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:24.344537  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:24.345278  3836 raft_consensus.cc:2368] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12.
I20260709 13:17:24.348937  7480 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.318528  7626 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.189s
I20260709 13:17:24.367707  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:24.367897  7091 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:24.375918  7600 consensus_queue.cc:1059] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:24.377140  7600 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:17:24.356782  6835 consensus_meta.cc:287] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.792s	user 0.012s	sys 0.000s
W20260709 13:17:24.383373  7594 consensus_meta.cc:287] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.777s	user 0.009s	sys 0.005s
I20260709 13:17:24.382994  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:24.386754  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:24.328874  7634 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:24.388104  3127 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
W20260709 13:17:24.381533  7559 consensus_meta.cc:287] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.005s
W20260709 13:17:24.387205  7560 consensus_meta.cc:287] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.002s
I20260709 13:17:24.396733  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:24.395829  3177 leader_election.cc:400] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12.
I20260709 13:17:24.398116  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:24.400660  3127 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:24.400674  3177 leader_election.cc:403] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:24.382593  7598 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:24.378958  7556 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:24.387655  7360 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.389233  7553 raft_consensus.cc:3055] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:24.401916  7559 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:24.399124  7464 consensus_queue.cc:237] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.415508  3130 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.422315  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:24.424130  7180 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:24.424319  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:24.425428  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:24.426923  3279 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:24.428057  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:24.428645  3281 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 8.
I20260709 13:17:24.428920  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:24.405272  7486 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12.
I20260709 13:17:24.424723  7180 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:24.430158  7642 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:17:24.431901  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:24.320574  7617 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.440644  3806 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:24.446413  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:24.446687  7614 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:24.447299  7614 raft_consensus.cc:697] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:24.447597  7133 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.447834  7292 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.448292  7292 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:24.450753  7556 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:24.450914  7292 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:24.451349  7556 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:24.453600  7512 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:24.436344  7360 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:24.406939  7560 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:24.464452  3130 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:17:24.467149  3130 pending_rounds.cc:85] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 7
I20260709 13:17:24.469959  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:24.470613  3133 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:24.388993  7594 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.471458  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:24.432018  7553 raft_consensus.cc:740] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:24.476461  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:24.476920  3131 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:24.437803  7591 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:24.477555  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:24.446727  7383 raft_consensus.cc:3055] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:24.500711  3133 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:24.503327  3249 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:24.498965  3281 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:24.467523  3130 pending_rounds.cc:107] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:17:24.504122  3130 raft_consensus.cc:2889] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:24.448151  7133 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.504908  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1809) took 1739 ms. Trace:
I20260709 13:17:24.509472  3130 rpcz_store.cc:276] 0709 13:17:22.765685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.922617 (+156932us) service_pool.cc:224] Handling call
0709 13:17:22.922967 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.613720 (+690753us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b58006884d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc14b0aa 00007fb3bc1cd447 00007fb3bc1e5fe7 00007fb3bc1e77de 00007fb3bc1f1b49 00007fb3bc1f2416 00007fb3bc1eed8f 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4
0709 13:17:24.415335 (+801615us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b58006881d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc14b0aa 00007fb3bc1cd447 00007fb3bc1e5fe7 00007fb3bc1e77de 00007fb3bc1f1b49 00007fb3bc1f2416 00007fb3bc1eed8f 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4
0709 13:17:24.504652 (+ 89317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.504856 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354859648}
I20260709 13:17:24.410375  7598 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.506953  3249 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:24.457566  7180 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:24.504132  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:24.477708  7588 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.523065  3127 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:24.477787  7292 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.498733  7521 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:24.533830  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:24.534495  3281 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:24.502355  7383 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:17:24.526628  7524 consensus_meta.cc:287] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.137s	user 0.012s	sys 0.002s
I20260709 13:17:24.540990  7639 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.537873  7507 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:17:24.505719  7591 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.546099  3203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 2980) took 1162 ms. Trace:
I20260709 13:17:24.550653  3203 rpcz_store.cc:276] 0709 13:17:23.383869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.391178 (+  7309us) service_pool.cc:224] Handling call
0709 13:17:24.544686 (+1153508us) spinlock_profiling.cc:243] Waited 901 us on lock 0x7b5800102f98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:17:24.544899 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.545097 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.545712 (+   615us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.545774 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:24.545822 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.545899 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.546027 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2072960}
I20260709 13:17:24.547760  3842 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:24.527117  7556 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:24.532187  7180 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:24.564059  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:24.556015  3805 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:24.531301  7268 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:24.570807  3101 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:24.573123  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:24.575644  3101 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:24.540724  7553 consensus_queue.cc:260] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:24.589250  7383 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.622805  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:24.590263  7643 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:17:24.590394  7355 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:24.567137  7180 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.537389  7292 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:24.686134  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45090us
I20260709 13:17:24.531013  7588 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:24.552896  7524 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.568526  7268 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:24.571853  7464 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:24.558182  7639 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.595440  7592 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:24.588620  7622 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:24.448189  7614 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:24.578354  7612 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:24.574779  7335 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:24.617659  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 44671.8us
I20260709 13:17:24.618366  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:24.618458  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 53329.2us
I20260709 13:17:24.619736  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:24.620298  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:24.621378  3251 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:24.627389  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:24.635326  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:24.635921  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:24.636369  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:24.637989  3209 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:24.623611  3836 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
W20260709 13:17:24.670625  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.687390  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:24.617062  7569 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:24.690831  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:24.685667  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:24.622501  7208 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:24.638526  7527 consensus_meta.cc:287] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.004s
I20260709 13:17:24.777789  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:24.778775  3276 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:24.779814  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:24.780462  3276 raft_consensus.cc:2368] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12.
I20260709 13:17:24.622402  7363 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:24.711732  3833 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:24.713780  3202 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:24.786044  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:24.729451  7659 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:17:24.729926  7292 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:24.730296  7598 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:24.685422  7383 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:24.730927  7647 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:17:24.686509  7180 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:24.743196  3131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:24.867969  3131 raft_consensus.cc:606] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:24.746837  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:24.747484  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:24.764065  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 144404us
W20260709 13:17:24.767597  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 146304us
I20260709 13:17:24.895691  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:24.896173  3251 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:24.766973  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:24.769608  3277 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:24.771579  7664 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.781641  3207 raft_consensus.cc:2410] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:24.781814  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:24.784052  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:24.679363  7582 consensus_meta.cc:287] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.779s	user 0.014s	sys 0.000s
I20260709 13:17:24.739427  7553 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:24.687302  7629 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:17:24.800740  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:24.739995  7612 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:24.814071  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:24.781883  7569 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:24.837729  7654 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 13:17:24.838649  7648 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:17:24.841382  7594 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:24.793365  7591 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:24.791853  7622 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:24.801219  7617 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:24.790107  7527 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:24.791338  7335 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:24.793569  7360 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:24.798355  7521 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:24.785599  7384 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:24.861756  7645 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:24.863387  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:24.864853  7481 consensus_meta.cc:287] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.540s	user 0.005s	sys 0.005s
I20260709 13:17:24.866024  7588 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:24.741041  7464 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:24.867003  7631 consensus_meta.cc:287] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.003s
I20260709 13:17:24.830947  7268 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:24.810842  7592 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:24.867362  7562 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:24.900693  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 133827us
W20260709 13:17:24.901670  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 154315us
I20260709 13:17:24.911667  7582 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.910014  7512 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:24.914111  3101 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:24.909202  7355 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:24.915304  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:24.916391  3284 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.918063  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:24.919164  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:25.024844  3833 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:24.918941  7612 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.028499  7630 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:25.029170  7663 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:25.029923  7663 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:24.939553  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:25.033404  3208 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.941838  3249 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:17:24.945442  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.988672  3282 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
W20260709 13:17:24.989687  3250 leader_election.cc:336] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.047s (SENT)
W20260709 13:17:25.039467  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 49835.5us
I20260709 13:17:25.044417  7527 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:25.047194  7622 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:24.999533  7645 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.012349  7592 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.052359  7592 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:24.929796  7634 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:24.932744  7507 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.902731  3132 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:25.006013  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:24.914685  7664 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:24.993113  7659 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:17:24.951498  7521 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.951901  7384 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:25.090816  7384 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.068783  7507 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.091362  7582 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.064993  7639 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:25.060377  7634 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.988858  7556 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:25.066162  7335 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:25.092937  7556 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.093751  7180 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.095326  7556 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:24.994292  7594 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:25.096427  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.096326  7594 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.026387  3205 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:25.014904  7562 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.012221  7512 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.056237  7630 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:25.059799  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 53875.6us
I20260709 13:17:25.159646  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:25.000078  7464 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.005833  7631 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:24.999648  7481 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.007329  7569 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.078801  3832 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:25.161640  3176 leader_election.cc:400] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12.
I20260709 13:17:25.163199  7512 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:25.071587  7559 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.088816  7355 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.075598  7665 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:17:25.187374  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 180419us
I20260709 13:17:25.190011  3284 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:25.098887  7521 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:25.208818  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 294767us
I20260709 13:17:25.092991  7507 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:25.103955  7363 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:25.181437  7383 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:25.214883  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 273088us
W20260709 13:17:25.241931  3806 leader_election.cc:336] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.111s (SENT)
I20260709 13:17:25.219383  3210 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:25.228047  3208 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:25.244354  3208 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:25.228420  3101 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:25.201017  7360 raft_consensus.cc:2764] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:25.234580  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:25.240619  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:25.209282  7629 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:25.209853  7622 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:25.349756  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:25.215729  7569 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.224001  7617 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:25.351701  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:25.226879  7591 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.141s
W20260709 13:17:25.362071  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 133676us
I20260709 13:17:25.348670  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:25.441025  3207 raft_consensus.cc:2376] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12. Re-sending same reply.
I20260709 13:17:25.450537  7464 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.451978  7664 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.352190  7662 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.420961  7383 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.362771  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:25.473800  3208 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:25.247242  7363 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.476893  7630 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:25.480319  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.378705  7635 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:25.481778  3284 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:17:25.485519  3284 pending_rounds.cc:85] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 7
I20260709 13:17:25.485975  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:25.486215  3284 pending_rounds.cc:107] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:17:25.486666  3205 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.486739  3284 raft_consensus.cc:2889] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:25.493468  7626 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.494122  7626 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.484983  7635 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.503517  7635 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.448663  7622 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.507963  3208 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:25.471488  7180 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:25.252489  7665 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.510296  3206 raft_consensus.cc:1240] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:25.503791  7676 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.318s	user 0.004s	sys 0.000s
I20260709 13:17:25.519580  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:25.449067  7629 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.471999  7383 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.526472  3133 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 18: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:25.514153  7594 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.516796  7091 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:25.532092  7481 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.519922  7612 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.556658  7091 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:25.557232  7631 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.462994  7662 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:25.599211  7670 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.418s	user 0.002s	sys 0.000s
I20260709 13:17:25.599503  7580 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:25.600118  7580 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:25.602068  7673 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.438s	user 0.002s	sys 0.000s
I20260709 13:17:25.602422  7580 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.607362  7091 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.569361  7683 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:25.608021  3277 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:25.625809  3205 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:17:25.626578  7629 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:25.627363  7622 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:25.628355  7689 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:17:25.619781  7683 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:25.630846  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.631186  7683 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:25.588775  7634 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.639740  7662 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.641613  7612 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:25.632748  7626 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:25.642802  7665 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:25.643666  7645 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.646474  7634 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.654064  7383 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:25.658331  3131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56db43db40f644309c6db08523b1b033"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:25.659314  3131 raft_consensus.cc:606] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:25.659837  3131 raft_consensus.cc:614] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:25.660688  7512 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.661885  3282 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:17:25.663722  7512 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:25.659916  7635 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.667438  7635 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.672791  7635 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:25.673449  7635 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.681826  3131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c414d51e428042c596cb410c48956c63"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:25.682545  3131 raft_consensus.cc:606] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:25.682893  3131 raft_consensus.cc:614] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:25.684573  7524 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:25.687150  3131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:25.687800  3131 raft_consensus.cc:606] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:25.688189  3131 raft_consensus.cc:614] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:25.688604  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 567) took 1246 ms. Trace:
I20260709 13:17:25.678544  7363 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:25.689018  3130 rpcz_store.cc:276] 0709 13:17:24.442246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.678463 (+236217us) service_pool.cc:224] Handling call
0709 13:17:24.685838 (+  7375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.938420 (+252582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.938452 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:24.979026 (+ 40574us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.349463 (+370437us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:25.349524 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.688180 (+338656us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5400415fd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:25.688234 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.688289 (+    55us) raft_consensus.cc:1685] finished
0709 13:17:25.688304 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.688539 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23209,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":78,"spinlock_wait_cycles":36808576,"thread_start_us":276602,"threads_started":2,"wal-append.queue_time_us":458969}
I20260709 13:17:25.689477  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:25.656735  7634 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:25.680227  7553 consensus_meta.cc:287] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.767s	user 0.008s	sys 0.005s
I20260709 13:17:25.680691  7091 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.698478  7634 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.698839  7635 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.716236  7595 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.721653  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:25.754936  7521 consensus_meta.cc:287] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.514s	user 0.016s	sys 0.004s
W20260709 13:17:25.758322  7675 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.570s	user 0.002s	sys 0.000s
I20260709 13:17:25.773531  7593 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:25.775468  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2723) took 1303 ms. Trace:
I20260709 13:17:25.782703  7634 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.784397  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1550) took 1018 ms. Trace:
I20260709 13:17:25.784806  3128 rpcz_store.cc:276] 0709 13:17:24.765539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.900707 (+135168us) service_pool.cc:224] Handling call
0709 13:17:24.901015 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.918071 (+ 17056us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:24.930997 (+ 12926us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.188683 (+257686us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.203319 (+ 14636us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.211830 (+  8511us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:25.211875 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.211944 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.757688 (+545744us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:25.784095 (+ 26407us) raft_consensus.cc:1685] finished
0709 13:17:25.784208 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.784333 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12524,"prepare.queue_time_us":12656,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":36876,"raft.queue_time_us":21650,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":66782720,"thread_start_us":200331,"threads_started":1,"wal-append.queue_time_us":249816}
I20260709 13:17:25.786453  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1543) took 1025 ms. Trace:
I20260709 13:17:25.786942  3282 rpcz_store.cc:276] 0709 13:17:24.761518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.038354 (+276836us) service_pool.cc:224] Handling call
0709 13:17:25.038724 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.662235 (+623511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.786112 (+123877us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b540022d654. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:25.786366 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1432540544}
I20260709 13:17:25.789690  7606 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:25.792580  7384 consensus_meta.cc:287] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.011s
I20260709 13:17:25.762337  7521 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.775938  3279 rpcz_store.cc:276] 0709 13:17:24.471891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.472147 (+   256us) service_pool.cc:224] Handling call
0709 13:17:24.472603 (+   456us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:24.474476 (+  1873us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:24.579156 (+104680us) log.cc:844] Serialized 14 byte log entry
0709 13:17:24.735396 (+156240us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:24.740299 (+  4903us) log.cc:844] Serialized 52 byte log entry
0709 13:17:24.740440 (+   141us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:24.742700 (+  2260us) log.cc:844] Serialized 14 byte log entry
0709 13:17:24.743433 (+   733us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.065040 (+321607us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b18000de6a0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:25.727332 (+662292us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b18000de6a0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b90ff455 00007fb3bc1e7060 00007fb3bc1f9716 00007fb3bc20a287 00007fb3bc20a208
0709 13:17:25.772981 (+ 45649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.773221 (+   240us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.773267 (+    46us) raft_consensus.cc:1685] finished
0709 13:17:25.773284 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.775399 (+  2115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70121,"prepare.queue_time_us":202096,"prepare.run_cpu_time_us":145,"prepare.run_wall_time_us":1449,"raft.queue_time_us":48578,"raft.run_cpu_time_us":479,"raft.run_wall_time_us":21671,"spinlock_wait_cycles":123693184,"thread_start_us":150794,"threads_started":3,"wal-append.queue_time_us":92267,"wal-append.run_cpu_time_us":4319,"wal-append.run_wall_time_us":1004315}
I20260709 13:17:25.816857  3833 raft_consensus.cc:3055] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:25.822299  3833 raft_consensus.cc:740] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:25.806470  7589 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.806819  7580 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:25.826280  7580 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.806659  7560 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:25.802997  7384 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.829624  7560 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.831868  7560 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.805531  7656 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.836162  7133 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.820135  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:25.837626  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:25.839006  7521 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:25.839432  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:25.840375  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.841171  3832 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:25.843921  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:25.845374  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1541) took 1085 ms. Trace:
I20260709 13:17:25.845206  6835 consensus_queue.cc:1059] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:25.846689  6835 raft_consensus.cc:3055] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:25.845781  3276 rpcz_store.cc:276] 0709 13:17:24.760596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.904691 (+144095us) service_pool.cc:224] Handling call
0709 13:17:24.905011 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.911630 (+  6619us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:24.919157 (+  7527us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.073824 (+154667us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b180037f120. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b907cc0a 00007fb3c27bc219 00007fb3b9104a40 00007fb3b90ff4e4 00007fb3b90ff455 00007fb3bc1e7060 00007fb3bc1f9716 00007fb3bc20a287 00007fb3bc20a208
0709 13:17:25.073978 (+   154us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.074569 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.074705 (+   136us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:25.074751 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.074868 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.841284 (+766416us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b180037f120. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:25.845182 (+  3898us) raft_consensus.cc:1685] finished
0709 13:17:25.845202 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.845318 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63292,"prepare.queue_time_us":17501,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":119446,"raft.run_cpu_time_us":402,"raft.run_wall_time_us":68419,"spinlock_wait_cycles":56835712,"thread_start_us":46614,"threads_started":1,"wal-append.queue_time_us":67882}
I20260709 13:17:25.847154  6835 raft_consensus.cc:740] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:25.848656  6835 consensus_queue.cc:260] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.850263  6835 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.836977  7645 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:17:25.852566  7645 raft_consensus.cc:3055] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:25.853540  7589 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.856668  7589 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:25.858877  3836 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:25.833122  7656 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.861157  7656 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:25.861263  7562 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:25.861680  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:25.863255  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:25.863900  3133 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.864535  3130 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:25.865258  7681 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.697s	user 0.004s	sys 0.000s
I20260709 13:17:25.852941  7645 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:25.866565  7384 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.866743  7617 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:25.867213  7617 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:25.867156  7645 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.823541  3833 consensus_queue.cc:260] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.869896  3833 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:25.867268  3132 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:25.875542  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:25.876228  3842 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:17:25.876979  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:25.877687  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:25.878266  7656 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:25.878428  3130 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:25.878907  7656 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:25.881654  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 160092us
I20260709 13:17:25.882625  3250 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:25.882959  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1913) took 1249 ms. Trace:
I20260709 13:17:25.883448  3210 rpcz_store.cc:276] 0709 13:17:24.633998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.635022 (+  1024us) service_pool.cc:224] Handling call
0709 13:17:24.690198 (+ 55176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.243261 (+553063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.882630 (+639369us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b5400153bd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:25.882894 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216360704}
I20260709 13:17:25.884434  3250 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:25.883019  7656 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:25.885694  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:25.887297  7606 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:25.828851  7580 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:25.868803  7645 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.884799  3133 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:25.895502  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:25.896699  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:25.896821  3250 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:25.897313  3136 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:25.893776  3102 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:25.897783  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:25.899102  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:25.899675  3136 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:25.901197  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:25.905838  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1538) took 1161 ms. Trace:
I20260709 13:17:25.906843  3833 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:17:25.909580  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:25.909961  3833 pending_rounds.cc:85] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 7
I20260709 13:17:25.910442  3833 pending_rounds.cc:107] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:17:25.910799  3833 raft_consensus.cc:2889] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:25.913954  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:25.915625  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:25.908587  3806 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:25.906404  3283 rpcz_store.cc:276] 0709 13:17:24.744764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.744906 (+   142us) service_pool.cc:224] Handling call
0709 13:17:24.776531 (+ 31625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.989193 (+212662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.989222 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:24.989688 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.168317 (+178629us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:25.168357 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.168422 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.864634 (+696212us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:25.895404 (+ 30770us) raft_consensus.cc:1685] finished
0709 13:17:25.895434 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.905735 (+ 10301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21210,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":31137,"spinlock_wait_cycles":48788736,"thread_start_us":339127,"threads_started":2,"wal-append.queue_time_us":153443}
I20260709 13:17:25.924026  7568 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.936087  7639 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:25.936213  7568 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.936611  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:25.936715  7363 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:25.937265  3127 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.937299  7363 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:25.937969  7363 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.938472  7568 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:25.940527  7589 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:25.941105  7589 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:25.924486  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:25.923444  7682 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:25.923760  7366 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:25.942625  7682 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:25.943090  7366 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.943188  7682 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.943378  7589 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:25.943593  7366 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:25.936651  7639 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:25.945513  7580 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:25.945588  7639 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:25.946935  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:25.941870  7593 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:25.946914  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:25.949041  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:25.931557  3133 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:25.967052  3128 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:25.955549  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:25.951985  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:25.953217  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 133200us
I20260709 13:17:25.967782  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:25.968479  3249 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:25.968796  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:25.946094  7580 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.982226  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:25.982095  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:25.986071  3279 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.986274  3282 raft_consensus.cc:2410] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:17:25.977861  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 65615us
I20260709 13:17:25.969847  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:25.933326  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:25.987540  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:25.988061  7632 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:25.988204  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:25.970144  7273 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:25.991842  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:25.969826  7180 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:25.992851  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:25.997784  7383 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:25.940702  7524 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:17:26.003916  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:26.004398  3102 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:25.997433  7682 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:26.007068  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:25.932349  3130 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:26.034333  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:26.011626  3127 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:26.016340  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:26.016429  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:26.035792  3210 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:26.029686  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.033001  3136 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:26.036579  3207 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:25.970732  7335 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:26.039665  7656 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:26.030843  7273 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:25.967185  7683 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:25.986940  7593 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.984187  7355 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:26.041594  3136 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:26.044548  7384 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:26.016218  7180 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.031037  7569 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:25.987105  7580 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.045045  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:26.041011  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:26.031363  6835 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:26.051662  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:26.097141  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 56146.6us
I20260709 13:17:26.097595  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:26.052186  3127 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:26.098063  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:26.047912  7561 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:17:25.984543  7464 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:17:26.055122  7273 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:26.055716  7683 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:26.056686  7593 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.046082  7383 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:26.052871  7682 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:26.062224  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:26.121317  7366 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:26.122125  7669 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.675s	user 0.002s	sys 0.000s
W20260709 13:17:26.122622  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 60503.4us
I20260709 13:17:26.063751  3806 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:26.069056  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.125247  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:26.125800  3835 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:17:26.072312  7687 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.622s	user 0.002s	sys 0.000s
W20260709 13:17:26.073578  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 291289us
I20260709 13:17:26.080117  7180 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.080514  7569 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.080837  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:26.082955  3128 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:26.146124  3283 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:26.146541  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:26.147012  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:25.970196  7568 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.104960  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:25.970278  7521 consensus_queue.cc:1059] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.104s
I20260709 13:17:26.016404  7665 consensus_queue.cc:1059] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:17:26.107240  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:26.111339  7629 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:26.124953  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:26.106473  6835 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:26.128196  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 64556.2us
I20260709 13:17:26.075452  7384 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.145983  7682 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:26.129838  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:26.130029  3250 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:26.134117  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:26.075486  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:26.141472  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:26.096910  7355 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:26.048871  7584 consensus_queue.cc:1059] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 13:17:26.225764  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 95830.1us
I20260709 13:17:26.226775  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:26.097544  7634 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:26.147255  3128 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:17:26.093276  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.147678  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:26.164635  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:26.165503  3281 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.166205  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:26.169425  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:26.173564  7639 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:26.177383  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:26.179427  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:26.181413  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1551) took 1415 ms. Trace:
I20260709 13:17:26.183434  3277 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
W20260709 13:17:26.186722  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 79555.1us
I20260709 13:17:26.106757  7690 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:26.075034  7656 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:26.194761  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:26.196496  3805 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:26.245682  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 49607.2us
I20260709 13:17:26.246670  3805 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:26.248380  3805 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:26.133668  7366 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:26.129232  3130 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 19. Ops: []
I20260709 13:17:26.250629  3128 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:17:26.163265  7569 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:26.144956  7557 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:26.216411  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:26.218528  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.218760  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:26.223578  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:26.216756  3834 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.193739  7629 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.194285  7632 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:26.236545  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:26.209492  7384 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.243271  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:26.235918  3129 rpcz_store.cc:276] 0709 13:17:24.765779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.925341 (+159562us) service_pool.cc:224] Handling call
0709 13:17:24.925629 (+   288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:25.100274 (+174645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.100305 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:25.100849 (+   544us) log.cc:844] Serialized 52 byte log entry
0709 13:17:25.359851 (+259002us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:25.359890 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.359962 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:26.071568 (+711606us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:26.180909 (+109341us) raft_consensus.cc:1685] finished
0709 13:17:26.180949 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.181331 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9758,"raft.queue_time_us":27233,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5539,"spinlock_wait_cycles":27216640,"thread_start_us":311637,"threads_started":2,"wal-append.queue_time_us":260556}
I20260709 13:17:26.218106  7388 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:26.244544  7614 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:26.252164  7521 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:26.271382  3030 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55102 (request call id 137) took 14669 ms (client timeout 15000 ms). Trace:
I20260709 13:17:26.240572  7682 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:26.228806  7562 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:26.189110  7568 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:26.251065  7612 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:26.277460  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:26.259445  7690 raft_consensus.cc:697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:26.280145  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:26.292063  3834 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:26.259377  7561 raft_consensus.cc:3055] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:26.263451  7559 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:26.264012  7629 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:26.295535  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:26.319463  3101 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:26.267107  7615 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:26.249001  7617 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:26.333992  6835 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:26.336109  7617 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:26.336895  7592 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:26.246551  7634 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:26.339511  7634 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:26.319847  3133 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:26.341353  3133 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:26.344740  3132 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:26.233012  7355 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:26.255465  7665 consensus_queue.cc:1059] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:17:26.321522  3022 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.521s	user 0.058s	sys 0.051s
I20260709 13:17:26.285046  7133 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:26.287698  3030 rpcz_store.cc:269] 0709 13:17:11.591552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.614489 (+ 22937us) service_pool.cc:224] Handling call
0709 13:17:12.421919 (+807430us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b5400270010. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90cb0b2 00007fb3c2044a89 00007fb3c1fdcda6 00007fb3c1fae088 00007fb3c20ac37e 00007fb3c056d2a4 00007fb3c056d232 00007fb3c056d161 00007fb3c056d0dc
0709 13:17:26.255789 (+13833870us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:21.740287 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:21.741360 (+  1073us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:21.741422 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:17:21.741448 (+    26us) tablet.cc:662] Decoding operations
0709 13:17:21.913233 (+171785us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:21.913342 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:21.913371 (+    29us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:17:21.914854 (+  1483us) tablet.cc:701] Row locks acquired
0709 13:17:21.914926 (+    72us) write_op.cc:260] PREPARE: finished
0709 13:17:21.915106 (+   180us) write_op.cc:270] Start()
0709 13:17:21.915233 (+   127us) write_op.cc:276] Timestamp: P: 1783603041915039 usec, L: 0
0709 13:17:21.915291 (+    58us) op_driver.cc:348] REPLICATION: starting
0709 13:17:21.916188 (+   897us) log.cc:844] Serialized 7436 byte log entry
0709 13:17:22.562228 (+646040us) op_driver.cc:464] REPLICATION: finished
0709 13:17:22.772796 (+210568us) write_op.cc:301] APPLY: starting
0709 13:17:22.773115 (+   319us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:22.780277 (+  7162us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:22.780597 (+   320us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:23.147067 (+366470us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:23.324297 (+177230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=38
0709 13:17:23.324397 (+   100us) write_op.cc:312] APPLY: finished
0709 13:17:23.324911 (+   514us) log.cc:844] Serialized 132 byte log entry
0709 13:17:23.325144 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:23.325371 (+   227us) write_op.cc:454] Released schema lock
0709 13:17:23.325453 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:23.325947 (+   494us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:23.325982 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2041588,"reported_tablets":28,"spinlock_wait_cycles":31197056,"child_traces":[["op",{"apply.queue_time_us":209923,"apply.run_cpu_time_us":10357,"apply.run_wall_time_us":553245,"num_ops":19,"prepare.queue_time_us":434075,"prepare.run_cpu_time_us":9271,"prepare.run_wall_time_us":234146,"raft.queue_time_us":330547,"raft.run_cpu_time_us":12886,"raft.run_wall_time_us":190067,"replication_time_us":646756,"thread_start_us":787986,"threads_started":4,"wal-append.queue_time_us":178186,"wal-append.run_cpu_time_us":54422,"wal-append.run_wall_time_us":2227750}]]}
I20260709 13:17:26.266929  7645 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:17:26.326040  7639 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:26.277393  7632 raft_consensus.cc:697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:26.310981  7559 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:26.323436  7682 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.281838  7521 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:26.303758  7561 raft_consensus.cc:740] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:26.250944  7383 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:26.285424  7614 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:26.330217  3117 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e1a4d71ef0f4287999b5ee60fe02740 with delete_type TABLET_DATA_TOMBSTONED (TS fc48eecc27554cb58b15193cd442b1d3 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:40280
I20260709 13:17:26.541530  3836 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:26.333244  7464 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:26.334084  7683 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:26.324121  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:26.543496  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 219415us
W20260709 13:17:26.336907  7680 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 1.141s	user 0.000s	sys 0.005s
I20260709 13:17:26.275591  7363 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:26.326946  7690 consensus_queue.cc:237] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:26.276701  7388 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:26.562253  7388 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:26.562698  7614 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:26.563081  3283 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:26.311196  3281 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:26.564337  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:26.301407  7562 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:26.413311  7559 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.566479  7562 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:26.350674  7615 raft_consensus.cc:697] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:26.567612  7615 consensus_queue.cc:237] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:26.401036  7133 raft_consensus.cc:697] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:26.569438  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:26.570047  7133 consensus_queue.cc:237] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:26.571053  7561 consensus_queue.cc:260] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:26.571753  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:26.572623  7561 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.430601  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:26.309310  7584 consensus_queue.cc:1059] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:17:26.332441  3279 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:26.575073  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:26.575412  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:26.575699  3279 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:26.576159  7698 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:17:26.576412  7617 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:26.576951  7617 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:26.559792  7363 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:26.576294  7180 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:26.508576  7521 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.583117  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:26.548144  3835 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:17:26.578042  7617 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:26.593062  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:26.599566  3205 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
W20260709 13:17:26.592758  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 417473us
I20260709 13:17:26.556514  7464 raft_consensus.cc:2764] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:26.604092  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:26.604708  3210 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.545054  7622 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:26.605038  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:26.606046  3209 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:26.610059  3281 raft_consensus.cc:2368] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13.
I20260709 13:17:26.610579  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 663) took 1431 ms. Trace:
I20260709 13:17:26.611050  3135 raft_consensus.cc:1240] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:26.555199  7588 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:26.612139  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 568) took 1114 ms. Trace:
W20260709 13:17:26.612643  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 368194us
I20260709 13:17:26.741326  7363 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:26.611243  3285 rpcz_store.cc:276] 0709 13:17:25.179455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.603823 (+424368us) service_pool.cc:224] Handling call
0709 13:17:25.604172 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.631862 (+ 27690us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:25.695888 (+ 64026us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.888239 (+192351us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.888299 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:25.888354 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.610254 (+721900us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b54001e8f54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:26.610322 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.610501 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142168,"prepare.queue_time_us":80590,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":147973,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":63137152,"thread_start_us":106498,"threads_started":2,"wal-append.queue_time_us":74983}
I20260709 13:17:26.612738  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 662) took 1445 ms. Trace:
W20260709 13:17:26.658931  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.745187  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:26.746254  3285 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 11: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:26.747359  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:26.749243  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:26.750660  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:26.751350  3285 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:26.752373  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:26.753687  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:26.754834  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:26.755667  3285 raft_consensus.cc:2393] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:26.737834  3135 rpcz_store.cc:276] 0709 13:17:25.499463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.500170 (+   707us) service_pool.cc:224] Handling call
0709 13:17:25.500537 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.610890 (+1110353us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b5400103ea0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc166dc0 00007fb3bc1f11c0 00007fb3bc1f2231 00007fb3bc1eed8f 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c
0709 13:17:26.611532 (+   642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.612071 (+   539us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2444160}
I20260709 13:17:26.766494  3279 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:26.756512  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:26.772284  3285 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:26.796299  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:26.797523  3209 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:26.816520  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:26.817472  3285 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:26.818552  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:26.819171  3285 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:26.822574  3128 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.037s	sys 0.045s
W20260709 13:17:26.823077  3128 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.037s	sys 0.045s
W20260709 13:17:26.826606  3248 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.021s	sys 0.042s
W20260709 13:17:26.827243  3248 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.021s	sys 0.042s
W20260709 13:17:26.829049  3806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.028s	sys 0.056s
W20260709 13:17:26.829988  3806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.028s	sys 0.056s
W20260709 13:17:26.832712  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 576017us
I20260709 13:17:26.760017  7645 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.506881  7682 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:26.775496  7569 consensus_meta.cc:287] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.509s	user 0.004s	sys 0.004s
W20260709 13:17:26.854336  3131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.011s	sys 0.008s
W20260709 13:17:26.940521  3131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.011s	sys 0.009s
I20260709 13:17:26.857389  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:26.735210  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:26.950935  3249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.041s	sys 0.079s
W20260709 13:17:26.951586  3249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.041s	sys 0.079s
I20260709 13:17:26.941877  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 574) took 1047 ms. Trace:
I20260709 13:17:26.961999  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:26.962491  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:26.960604  3210 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:26.973733  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:26.976405  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:26.977666  3205 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 13: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:17:26.974031  3177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.000s	sys 0.023s
W20260709 13:17:26.979096  3177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.000s	sys 0.023s
I20260709 13:17:26.736919  7622 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:26.844859  7363 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:26.981333  3133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.012s	sys 0.011s
W20260709 13:17:26.957252  7580 consensus_meta.cc:287] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.845s	user 0.008s	sys 0.004s
I20260709 13:17:26.961951  7208 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:26.994990  3174 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.020s	sys 0.037s
W20260709 13:17:26.996146  3174 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.020s	sys 0.038s
I20260709 13:17:26.736424  7632 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:26.984540  6835 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.956478  7569 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:26.774989  7588 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:26.970012  7463 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.004s	sys 0.017s
I20260709 13:17:26.988606  3285 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:26.950709  7645 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:26.992420  7656 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:27.010836  7355 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.008s	sys 0.010s
W20260709 13:17:27.023156  7557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.005s	sys 0.010s
I20260709 13:17:26.992506  7580 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:27.100366  7463 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.005s	sys 0.017s
I20260709 13:17:27.131973  7720 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:27.123983  7355 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.009s	sys 0.010s
I20260709 13:17:27.069495  7568 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:27.001505  7208 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:27.009820  7363 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:27.135527  7557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.005s	sys 0.011s
W20260709 13:17:27.160444  7133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.015s	sys 0.019s
I20260709 13:17:27.161247  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:27.166983  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.120210  7690 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:27.118582  7562 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:27.029456  6835 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:27.243068  3127 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.010s	sys 0.014s
W20260709 13:17:27.243839  3129 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.006s	sys 0.016s
W20260709 13:17:27.255661  3129 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.007s	sys 0.016s
W20260709 13:17:27.244153  3832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.007s	sys 0.015s
I20260709 13:17:27.256773  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52014 (request call id 668) took 1089 ms. Trace:
W20260709 13:17:27.256973  3832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.009s	sys 0.017s
I20260709 13:17:27.257591  3285 rpcz_store.cc:276] 0709 13:17:26.167555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.121140 (+953585us) service_pool.cc:224] Handling call
0709 13:17:27.256674 (+135534us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:27.015472  7677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.009s	sys 0.015s
W20260709 13:17:26.981945  3133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.013s	sys 0.011s
W20260709 13:17:26.979732  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 685618us
I20260709 13:17:27.252223  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1841) took 1191 ms. Trace:
W20260709 13:17:27.255218  3127 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.010s	sys 0.014s
W20260709 13:17:27.183686  7702 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.755s	user 0.002s	sys 0.000s
I20260709 13:17:27.271893  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:27.278440  3285 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:27.250947  7133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.015s	sys 0.019s
I20260709 13:17:27.231966  7557 raft_consensus.cc:697] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:17:27.264205  7677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.009s	sys 0.016s
I20260709 13:17:27.304278  3208 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:27.278792  7562 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.307817  7562 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:27.287616  7180 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:27.184612  7720 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:27.269829  7690 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:27.287202  7721 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:27.326844  7706 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.377s	user 0.000s	sys 0.001s
W20260709 13:17:27.345695  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 383511us
W20260709 13:17:27.358078  3251 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.007s	sys 0.020s
I20260709 13:17:27.357916  3249 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:27.359367  3249 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:27.361410  3251 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.007s	sys 0.020s
W20260709 13:17:27.362223  3176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.059s	user 0.005s	sys 0.023s
W20260709 13:17:27.363682  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:27.339110  7705 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.363s	user 0.001s	sys 0.001s
I20260709 13:17:27.338060  7677 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.366132  3249 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:27.365742  3285 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
W20260709 13:17:27.361765  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 625446us
I20260709 13:17:27.379313  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2743) took 1331 ms. Trace:
I20260709 13:17:27.380638  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2730) took 1432 ms. Trace:
I20260709 13:17:27.380987  7715 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:27.381284  7710 log.cc:927] Time spent T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:17:27.336035  7682 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:27.383587  7682 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:27.384629  7682 consensus_queue.cc:1059] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:27.375458  7180 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:27.381119  3276 rpcz_store.cc:276] 0709 13:17:25.948340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.950435 (+  2095us) service_pool.cc:224] Handling call
0709 13:17:25.950806 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.951239 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.951278 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.985320 (+ 34042us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.210651 (+225331us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:26.210710 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.210805 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.380369 (+1169564us) raft_consensus.cc:1685] finished
0709 13:17:27.380401 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.380565 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2691,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":15740,"thread_start_us":221617,"threads_started":1,"wal-append.queue_time_us":321314}
I20260709 13:17:27.386966  7180 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.386790  3249 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:27.388374  7180 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:27.389918  3249 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:27.390519  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1574) took 1067 ms. Trace:
I20260709 13:17:27.390702  7715 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:27.390940  3133 rpcz_store.cc:276] 0709 13:17:26.323485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.342175 (+ 18690us) service_pool.cc:224] Handling call
0709 13:17:26.342576 (+   401us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:26.343203 (+   627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.343252 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:26.344047 (+   795us) log.cc:844] Serialized 52 byte log entry
0709 13:17:27.264748 (+920701us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:27.264810 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.264923 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.390273 (+125350us) raft_consensus.cc:1685] finished
0709 13:17:27.390296 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.390457 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5888,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":42907,"thread_start_us":920225,"threads_started":1,"wal-append.queue_time_us":944250}
I20260709 13:17:27.393560  7727 tablet_replica.cc:333] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:17:27.393358  3249 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:27.394250  7718 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:17:27.394515  7569 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:27.381392  7712 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:17:27.395915  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:27.394863  3249 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:27.397795  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.398419  3204 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:27.398804  3101 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:27.398352  3249 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:27.386783  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:27.395771  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:27.392071  7682 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:27.402892  3133 raft_consensus.cc:2393] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:27.404412  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2748) took 1238 ms. Trace:
I20260709 13:17:27.404893  3276 rpcz_store.cc:276] 0709 13:17:26.166162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.386534 (+1220372us) service_pool.cc:224] Handling call
0709 13:17:27.404328 (+ 17794us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.403553  3249 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:27.406809  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.407284  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:27.379817  3285 rpcz_store.cc:276] 0709 13:17:26.048444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.271299 (+1222855us) service_pool.cc:224] Handling call
0709 13:17:27.379229 (+107930us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.399631  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:27.363065  7562 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:27.380029  7568 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:27.393386  7734 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:17:27.410547  7730 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:27.409474  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:27.410724  7562 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:27.411305  3285 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:27.411872  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52014 (request call id 672) took 1243 ms. Trace:
I20260709 13:17:27.412289  3285 rpcz_store.cc:276] 0709 13:17:26.168624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.409156 (+1240532us) service_pool.cc:224] Handling call
0709 13:17:27.411799 (+  2643us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.412598  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:27.413993  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1559) took 1186 ms. Trace:
I20260709 13:17:27.414876  3276 rpcz_store.cc:276] 0709 13:17:26.227467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.412269 (+1184802us) service_pool.cc:224] Handling call
0709 13:17:27.413921 (+  1652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.376657  7719 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.417917  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2736) took 1461 ms. Trace:
I20260709 13:17:27.411059  7730 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:27.419567  3285 rpcz_store.cc:276] 0709 13:17:25.956866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.417126 (+1460260us) service_pool.cc:224] Handling call
0709 13:17:27.417448 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.417611 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.417634 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.417672 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:27.417703 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.417754 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.417864 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.418579  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2738) took 1461 ms. Trace:
I20260709 13:17:27.421972  3276 rpcz_store.cc:276] 0709 13:17:25.957505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.417564 (+1460059us) service_pool.cc:224] Handling call
0709 13:17:27.417883 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.418168 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.418225 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.418278 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:27.418329 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.418400 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.418520 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.362474  7721 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.394253  7208 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:27.420462  7730 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.397893  7622 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:27.412729  7464 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:27.417191  7717 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:27.411329  7562 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.458782  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:27.362568  3176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.005s	sys 0.023s
I20260709 13:17:27.418074  7588 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:27.418213  7645 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:27.410712  7568 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:27.425768  7634 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:27.441628  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:27.395197  7677 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:26.747264  3284 rpcz_store.cc:276] 0709 13:17:25.167346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.506744 (+339398us) service_pool.cc:224] Handling call
0709 13:17:25.507000 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.532143 (+ 25143us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:25.570168 (+ 38025us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.614738 (+ 44570us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.774427 (+159689us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b18003a30c0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:25.856080 (+ 81653us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b18003a30c0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b907cc0a 00007fb3c27bc219 00007fb3b9104a40 00007fb3b90ff4e4 00007fb3b90ff455 00007fb3bc1e7060 00007fb3bc1f9716 00007fb3bc20a287 00007fb3bc20a208
0709 13:17:25.856273 (+   193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.856326 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:25.856368 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.612439 (+756071us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b54003ba6d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:26.612509 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.612665 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":236619,"prepare.queue_time_us":39741,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":88,"raft.queue_time_us":243048,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":181,"spinlock_wait_cycles":83686016,"thread_start_us":42787,"threads_started":1,"wal-append.queue_time_us":108503,"wal-append.run_cpu_time_us":1908,"wal-append.run_wall_time_us":1056929}
I20260709 13:17:27.478173  3284 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:27.478960  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1549) took 1467 ms. Trace:
I20260709 13:17:27.479346  3284 rpcz_store.cc:276] 0709 13:17:26.012043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.477223 (+1465180us) service_pool.cc:224] Handling call
0709 13:17:27.477864 (+   641us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:27.478677 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.478905 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.422758  7682 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:27.393306  7557 consensus_queue.cc:237] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.468582  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2740) took 1463 ms. Trace:
I20260709 13:17:27.473819  3210 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:27.459481  7208 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:27.486166  7208 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:27.486618  7208 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:27.486835  7383 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:27.487223  7383 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:27.488124  7383 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:27.489759  7678 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 2.292s	user 0.012s	sys 0.024s
W20260709 13:17:27.491144  7593 consensus_meta.cc:287] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.371s	user 0.010s	sys 0.003s
I20260709 13:17:27.491604  7588 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.492195  7588 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.493129  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1533) took 2750 ms. Trace:
W20260709 13:17:27.493991  3132 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 579) took 1417 ms (client timeout 1791 ms). Trace:
W20260709 13:17:27.494526  3132 rpcz_store.cc:269] 0709 13:17:26.076514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.133653 (+ 57139us) service_pool.cc:224] Handling call
0709 13:17:27.493693 (+1360040us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54003db654. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:27.493801 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262482176}
I20260709 13:17:27.493510  3278 rpcz_store.cc:276] 0709 13:17:24.742804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.782065 (+ 39261us) service_pool.cc:224] Handling call
0709 13:17:24.867740 (+ 85675us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.868101 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.868128 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:24.891455 (+ 23327us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.208446 (+316991us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:25.329640 (+121194us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.387555 (+ 57915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.387637 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.489143 (+2101506us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:27.492760 (+  3617us) raft_consensus.cc:1685] finished
0709 13:17:27.492870 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.493022 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62746,"prepare.queue_time_us":121809,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":80428,"raft.run_cpu_time_us":786,"raft.run_wall_time_us":26363,"spinlock_wait_cycles":25337216,"thread_start_us":283414,"threads_started":1,"wal-append.queue_time_us":280881}
I20260709 13:17:27.495280  7588 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:27.495661  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:27.491577  7593 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:27.496991  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:27.497807  3132 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:27.498695  7593 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:27.499867  7383 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:27.500226  7521 consensus_meta.cc:287] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.896s	user 0.010s	sys 0.000s
I20260709 13:17:27.503038  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.504256  3207 raft_consensus.cc:2410] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:17:27.505931  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1824) took 1597 ms. Trace:
I20260709 13:17:27.506296  3130 rpcz_store.cc:276] 0709 13:17:25.908960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.035596 (+126636us) service_pool.cc:224] Handling call
0709 13:17:26.051623 (+ 16027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.250896 (+199273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.505708 (+1254812us) spinlock_profiling.cc:243] Waited 77.4 ms on lock 0x7b540032f0d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:27.505872 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178049920}
I20260709 13:17:27.508394  7208 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:27.520650  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.529853  7690 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:27.459673  7464 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:27.459252  7714 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:27.537586  7714 raft_consensus.cc:697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:27.538734  7714 consensus_queue.cc:237] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.425990  7719 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.539029  3022 maintenance_manager.cc:643] P 2d86a7fbede6469c844c1637c8ddd791: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.528s	user 0.270s	sys 0.132s Metrics: {"bytes_written":30171,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":197993,"dirs.run_cpu_time_us":554,"dirs.run_wall_time_us":33888,"drs_written":1,"lbm_read_time_us":475,"lbm_reads_lt_1ms":4,"lbm_write_time_us":225232,"lbm_writes_10-100_ms":9,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"spinlock_wait_cycles":20036352,"thread_start_us":385832,"threads_started":2,"update_count":19,"wal-append.queue_time_us":463288,"wal-append.run_cpu_time_us":708,"wal-append.run_wall_time_us":1067520}
I20260709 13:17:27.549348  7727 raft_consensus.cc:2243] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:27.550238  7727 pending_rounds.cc:70] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: Trying to abort 2 pending ops.
I20260709 13:17:27.550483  7719 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:27.550544  7727 pending_rounds.cc:77] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: Aborting op as it isn't in flight: id { term: 5 index: 5 } timestamp: 7305637871667404800 op_type: NO_OP noop_request { }
I20260709 13:17:27.456709  7580 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:27.551149  7727 raft_consensus.cc:2889] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:27.551343  3023 maintenance_manager.cc:419] P 2d86a7fbede6469c844c1637c8ddd791: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9144 bytes on disk
I20260709 13:17:27.551618  7727 pending_rounds.cc:77] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: Aborting op as it isn't in flight: id { term: 3 index: 4 } timestamp: 7305637819467063296 op_type: NO_OP noop_request { }
I20260709 13:17:27.552264  7727 raft_consensus.cc:2889] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:27.552695  7727 raft_consensus.cc:2272] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:27.552757  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.553790  3835 raft_consensus.cc:2393] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:27.554733  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:27.555649  7273 raft_consensus.cc:3055] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:27.556067  7273 raft_consensus.cc:740] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:27.556118  7727 ts_tablet_manager.cc:1916] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:17:27.551461  3281 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1556) took 1402 ms (client timeout 1774 ms). Trace:
I20260709 13:17:27.483731  3276 rpcz_store.cc:276] 0709 13:17:26.003888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.464033 (+1460145us) service_pool.cc:224] Handling call
0709 13:17:27.464514 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.466537 (+  2023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.466582 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.466648 (+    66us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:27.466700 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.466766 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.466927 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:27.515419  7722 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:27.516599  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.567979  3206 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:27.518719  3202 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:27.515486  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:27.522830  7208 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:27.527096  7720 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:27.558503  3281 rpcz_store.cc:269] 0709 13:17:26.148627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.564036 (+415409us) service_pool.cc:224] Handling call
0709 13:17:27.551255 (+987219us) spinlock_profiling.cc:243] Waited 45 ms on lock 0x7b5400037354. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:27.551404 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103440768}
I20260709 13:17:27.460628  7562 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.589605  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.485111  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:27.518523  7721 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:27.578680  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.597884  3838 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:27.584075  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2751) took 1417 ms. Trace:
I20260709 13:17:27.598959  3281 rpcz_store.cc:276] 0709 13:17:26.167023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.582996 (+1415973us) service_pool.cc:224] Handling call
0709 13:17:27.583262 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.583432 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.583458 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.583498 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:27.583537 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.583587 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.584011 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.601557  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2752) took 1434 ms. Trace:
I20260709 13:17:27.602144  3281 rpcz_store.cc:276] 0709 13:17:26.167277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.600219 (+1432942us) service_pool.cc:224] Handling call
0709 13:17:27.600632 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.600904 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.600943 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.601003 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:27.601060 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.601324 (+   264us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.601479 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.592428  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:27.593943  3022 maintenance_manager.cc:643] P 2d86a7fbede6469c844c1637c8ddd791: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.038s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":382,"lbm_reads_lt_1ms":4}
I20260709 13:17:27.595769  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.597059  3207 raft_consensus.cc:2368] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14.
I20260709 13:17:27.605628  3836 raft_consensus.cc:1813] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Handling vote request from an unknown peer fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:27.606295  3836 raft_consensus.cc:2368] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9.
I20260709 13:17:27.484177  7682 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.608592  3102 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:27.566723  7634 raft_consensus.cc:697] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:17:27.585548  7629 consensus_meta.cc:287] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.255s	user 0.011s	sys 0.002s
I20260709 13:17:27.615245  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.619377  3836 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:27.626061  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.611959  7682 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:27.630198  7568 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:27.632483  7735 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:27.633060  7735 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:27.633342  7715 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:27.634052  7634 consensus_queue.cc:237] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:27.634137  7735 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.612501  6835 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:27.595571  7690 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:27.637450  7690 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.640329  7690 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:27.642884  7682 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.645020  7682 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:27.582175  7663 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:27.657568  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.650826  3832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 826) took 1365 ms. Trace:
I20260709 13:17:27.661502  3836 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:17:27.671988  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.672761  3838 raft_consensus.cc:2393] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:27.658895  3832 rpcz_store.cc:276] 0709 13:17:26.285146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.285732 (+   586us) service_pool.cc:224] Handling call
0709 13:17:26.318271 (+ 32539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.318647 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.318676 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.319738 (+  1062us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.258036 (+938298us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:27.258104 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.258202 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.650551 (+392349us) raft_consensus.cc:1685] finished
0709 13:17:27.650580 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.650747 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14643,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":937819,"threads_started":1,"wal-append.queue_time_us":1100772}
I20260709 13:17:27.500798  7521 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.677134  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:27.664156  7464 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:27.689677  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 286180us
I20260709 13:17:27.581928  7273 consensus_queue.cc:260] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.628249  7629 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:27.676723  7384 consensus_meta.cc:287] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 1.399s	user 0.014s	sys 0.001s
W20260709 13:17:27.693079  3277 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2734) took 1738 ms (client timeout 1876 ms). Trace:
I20260709 13:17:27.696885  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.700955  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:27.698570  3277 rpcz_store.cc:269] 0709 13:17:25.955138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.955269 (+   131us) service_pool.cc:224] Handling call
0709 13:17:27.692817 (+1737548us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400319054. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:27.693019 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495603968}
I20260709 13:17:27.702726  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:27.701753  3206 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.704564  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:27.705992  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 307230us
I20260709 13:17:27.706918  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.707836  3806 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:27.713500  3250 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:27.714324  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.707499  3202 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
W20260709 13:17:27.697780  7559 consensus_meta.cc:287] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 1.129s	user 0.009s	sys 0.005s
I20260709 13:17:27.667621  7663 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.715997  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.720690  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.725483  3209 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:27.719908  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:27.729297  3250 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:27.743304  3206 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:27.749728  3204 raft_consensus.cc:2393] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:27.756214  3133 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:27.757344  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:27.718358  7612 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:27.715713  7464 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:27.760210  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:27.765321  3806 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:27.751219  7561 consensus_meta.cc:287] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.159s	user 0.011s	sys 0.004s
I20260709 13:17:27.777562  3205 raft_consensus.cc:2410] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:27.769332  7656 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:27.778653  7656 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.721041  7524 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:27.760572  3206 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:17:27.779937  3206 pending_rounds.cc:85] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 6
I20260709 13:17:27.780339  3206 pending_rounds.cc:107] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:17:27.780617  3206 raft_consensus.cc:2889] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:27.782351  7629 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:27.783869  7677 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:27.788162  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:27.752059  7273 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:27.769956  7612 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:27.789327  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.789712  7612 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.790207  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.791007  3206 raft_consensus.cc:2410] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:27.794893  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:27.796200  3132 raft_consensus.cc:2410] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:27.795804  7464 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.799731  7464 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:27.800362  7738 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:17:27.708108  7384 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.803611  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.804468  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.807087  3135 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:27.748327  7559 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.808449  7521 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:27.265331  3128 rpcz_store.cc:276] 0709 13:17:26.061101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.251500 (+190399us) service_pool.cc:224] Handling call
0709 13:17:26.251780 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.252005 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:26.823498 (+571493us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.251729 (+428231us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.251807 (+    78us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:27.251881 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.251972 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.252147 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":272898,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":2613,"raft.queue_time_us":73614,"thread_start_us":923081,"threads_started":2}
I20260709 13:17:27.840193  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.752403  7739 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:27.841531  7559 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:27.841874  3835 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:26.953425  3131 rpcz_store.cc:276] 0709 13:17:25.894195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.895917 (+  1722us) service_pool.cc:224] Handling call
0709 13:17:25.899574 (+  3657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.899884 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:26.222973 (+323089us) log.cc:844] Serialized 14 byte log entry
0709 13:17:26.941441 (+718468us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.941517 (+    76us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:26.941586 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.941681 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.941819 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64189,"prepare.queue_time_us":408133,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":9703,"raft.queue_time_us":10005,"thread_start_us":1000787,"threads_started":2}
I20260709 13:17:27.842339  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:27.842963  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:27.843528  3131 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:27.843271  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.843760  3135 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:27.752676  7715 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:27.845104  7715 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:27.845314  3832 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:27.845520  7715 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.748610  7682 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:27.847860  7682 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:27.849655  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.850013  7682 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:27.850944  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.852208  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:27.815960  3134 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1812) took 3520 ms (client timeout 1558 ms). Trace:
W20260709 13:17:27.854488  3134 rpcz_store.cc:269] 0709 13:17:24.295267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.314319 (+ 19052us) service_pool.cc:224] Handling call
0709 13:17:27.815672 (+3501353us) spinlock_profiling.cc:243] Waited 3.49 s on lock 0x7b54000e15d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:27.815868 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8024342784}
I20260709 13:17:27.818451  3102 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:27.819345  3101 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:27.833675  3136 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:27.858336  7591 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:27.860004  7612 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.861311  7629 consensus_queue.cc:1059] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:27.862772  7561 raft_consensus.cc:3055] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:27.863168  7561 raft_consensus.cc:740] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:27.863463  7512 raft_consensus.cc:3055] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:27.864178  7512 raft_consensus.cc:740] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:27.864015  7561 consensus_queue.cc:260] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.865552  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.841909  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:27.867573  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:27.867645  3283 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1563) took 1609 ms (client timeout 1506 ms). Trace:
I20260709 13:17:27.868032  3203 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:17:27.868126  3283 rpcz_store.cc:269] 0709 13:17:26.258260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.277185 (+ 18925us) service_pool.cc:224] Handling call
0709 13:17:27.867461 (+1590276us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b540042c554. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:27.867569 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601048448}
I20260709 13:17:27.869544  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:27.870102  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:27.870278  3283 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:27.841030  3208 raft_consensus.cc:2410] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:27.841037  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:27.834852  7384 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:27.835865  7663 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:27.839566  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.849774  7656 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:27.877987  3177 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:27.869637  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1572) took 1560 ms. Trace:
I20260709 13:17:27.874128  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:27.874894  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.881779  3834 raft_consensus.cc:2410] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:17:27.875721  3836 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:27.882205  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:27.876330  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.883097  3283 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:27.884328  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:27.877177  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1571) took 1583 ms. Trace:
I20260709 13:17:27.825891  3133 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:27.878345  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.885179  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.886348  3127 rpcz_store.cc:276] 0709 13:17:26.293603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.296306 (+  2703us) service_pool.cc:224] Handling call
0709 13:17:26.296726 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.297031 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:27.269695 (+972664us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.876799 (+607104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.876860 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:27.876909 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.876976 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.877122 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11367,"prepare.queue_time_us":249208,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":9668,"raft.queue_time_us":17808,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":1526220,"threads_started":3,"wal-append.queue_time_us":455128}
I20260709 13:17:27.885989  3207 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:27.888418  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.885057  3283 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:17:27.880785  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:27.889376  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 70120.2us
I20260709 13:17:27.889575  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:27.889938  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 71626.6us
I20260709 13:17:27.889994  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:27.878993  7363 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:27.891413  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:27.892593  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:27.892360  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.893234  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.893756  3202 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:27.892350  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.894085  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:27.890874  3101 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:27.895246  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.895440  3207 raft_consensus.cc:2368] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14.
I20260709 13:17:27.891479  3283 raft_consensus.cc:2393] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 10: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:27.897034  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:27.898082  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.898919  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:27.899257  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.899669  3283 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:27.900441  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:27.910840  3102 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:27.913293  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:27.913885  3208 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.885867  7464 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:27.914800  7730 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:27.919404  7730 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:27.922255  7612 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:27.923055  7464 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:27.925755  7464 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:27.908618  7690 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.930295  7744 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:27.930640  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 52735.2us
I20260709 13:17:27.930821  7744 raft_consensus.cc:697] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:27.931190  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:27.931911  3206 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:27.931818  7744 consensus_queue.cc:237] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:27.932727  7737 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:27.933317  7737 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.933710  7737 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:27.935667  7690 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:27.936079  7690 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:27.936480  7690 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:27.900621  7720 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:27.901237  7656 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.938593  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1849) took 1191 ms. Trace:
I20260709 13:17:27.938896  7268 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:27.938956  3130 rpcz_store.cc:276] 0709 13:17:26.747007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.507116 (+760109us) service_pool.cc:224] Handling call
0709 13:17:27.507468 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:27.507806 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.507833 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:27.508365 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.756848 (+248483us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:27.756888 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.756957 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.938371 (+181414us) raft_consensus.cc:1685] finished
0709 13:17:27.938392 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.938530 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11816,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":84,"thread_start_us":248101,"threads_started":1,"wal-append.queue_time_us":384398}
I20260709 13:17:27.942482  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1845) took 1196 ms. Trace:
I20260709 13:17:27.952879  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2739) took 1983 ms. Trace:
I20260709 13:17:27.953233  3133 rpcz_store.cc:276] 0709 13:17:26.746010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.464238 (+718228us) service_pool.cc:224] Handling call
0709 13:17:27.942265 (+478027us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540036a1d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:27.942415 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345023872}
I20260709 13:17:27.953357  3285 rpcz_store.cc:276] 0709 13:17:25.969440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.420910 (+1451470us) service_pool.cc:224] Handling call
0709 13:17:27.421230 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.421453 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:27.692004 (+270551us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.952534 (+260530us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.952584 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:27.952635 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.952694 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.952810 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":476606,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"thread_start_us":525173,"threads_started":2}
I20260709 13:17:27.954728  3208 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:27.900306  7480 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:27.961145  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.957746  3251 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:27.924722  7561 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:27.963855  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 198628us
I20260709 13:17:27.905849  7719 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:27.962247  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 65308.9us
I20260709 13:17:27.967860  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:27.961848  3832 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:27.969937  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:27.970244  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.971542  3837 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:27.891000  3210 raft_consensus.cc:2410] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:17:27.998154  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.993201  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 671) took 1824 ms. Trace:
I20260709 13:17:27.999243  3176 leader_election.cc:400] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13.
I20260709 13:17:27.997789  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:28.000361  3176 leader_election.cc:403] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:27.999833  3283 rpcz_store.cc:276] 0709 13:17:26.168329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.990846 (+1822517us) service_pool.cc:224] Handling call
0709 13:17:27.991760 (+   914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.992004 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.992035 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.992799 (+   764us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:27.992870 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.992953 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.993119 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.010102  7582 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:28.011466  7355 raft_consensus.cc:3055] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:28.011979  7355 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:27.880771  3129 rpcz_store.cc:276] 0709 13:17:26.309685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.327298 (+ 17613us) service_pool.cc:224] Handling call
0709 13:17:26.327589 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.327778 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:27.263622 (+935844us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.869310 (+605688us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.869363 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:27.869414 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.869479 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.869582 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87714,"prepare.queue_time_us":246771,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":50,"raft.queue_time_us":42493,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":1445640,"threads_started":3,"wal-append.queue_time_us":455218}
I20260709 13:17:28.013170  7355 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.017513  3281 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:28.018275  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:28.018879  3841 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:28.020079  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:28.020195  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:27.956547  7747 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:27.963954  7384 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:27.977450  7480 raft_consensus.cc:697] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:28.062374  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:28.032624  3251 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:28.067811  3251 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:17:28.068653  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.035362  3283 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:28.070283  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 674) took 1901 ms. Trace:
I20260709 13:17:28.070693  3283 rpcz_store.cc:276] 0709 13:17:26.175787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.034565 (+1858778us) service_pool.cc:224] Handling call
0709 13:17:28.034960 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.069919 (+ 34959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.070212 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.025700  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:27.890437  7512 consensus_queue.cc:260] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.076576  7512 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:28.045732  7747 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.024822  7719 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13.
I20260709 13:17:28.000433  7746 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:28.061133  7384 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:28.061465  7665 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:28.081390  3283 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:28.083969  3841 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:28.075397  7656 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:28.126677  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:28.128607  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 676) took 1951 ms. Trace:
I20260709 13:17:28.129755  3283 rpcz_store.cc:276] 0709 13:17:26.176748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.071594 (+1894846us) service_pool.cc:224] Handling call
0709 13:17:28.071982 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.128212 (+ 56230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.128492 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.131577  3283 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:17:28.132305  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1558) took 1911 ms. Trace:
I20260709 13:17:28.132673  3283 rpcz_store.cc:276] 0709 13:17:26.220636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.130791 (+1910155us) service_pool.cc:224] Handling call
0709 13:17:28.131239 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.132024 (+   785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.132243 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.135303  3283 raft_consensus.cc:1240] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:28.136694  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 677) took 1912 ms. Trace:
I20260709 13:17:28.137815  3283 rpcz_store.cc:276] 0709 13:17:26.224673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.134726 (+1910053us) service_pool.cc:224] Handling call
0709 13:17:28.135100 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.136410 (+  1310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.136634 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.138441  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:28.139421  3841 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.140519  3283 raft_consensus.cc:1240] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:28.141906  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 678) took 1917 ms. Trace:
I20260709 13:17:28.142472  3283 rpcz_store.cc:276] 0709 13:17:26.224961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.139798 (+1914837us) service_pool.cc:224] Handling call
0709 13:17:28.140128 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.141155 (+  1027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.141832 (+   677us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:28.145370  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 52305.1us
I20260709 13:17:28.146071  3283 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:17:28.146725  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 236038us
I20260709 13:17:28.147889  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:28.147110  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:28.148654  3833 raft_consensus.cc:2376] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13. Re-sending same reply.
I20260709 13:17:28.149791  3102 leader_election.cc:400] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9.
I20260709 13:17:28.150272  3102 leader_election.cc:403] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:28.127279  7384 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:28.126669  7682 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:28.155594  3251 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:28.134279  7363 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:28.161504  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:28.135078  7746 raft_consensus.cc:697] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:28.161681  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:28.157626  3284 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:28.167163  3833 raft_consensus.cc:2393] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 13: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:28.156356  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1560) took 1924 ms. Trace:
I20260709 13:17:28.167526  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2732) took 2213 ms. Trace:
I20260709 13:17:28.160856  3251 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:28.168630  3282 rpcz_store.cc:276] 0709 13:17:25.948965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.951636 (+  2671us) service_pool.cc:224] Handling call
0709 13:17:28.157215 (+2205579us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b54001775d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:28.162417 (+  5202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41377664}
I20260709 13:17:28.169577  3841 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:28.170030  3282 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:28.170848  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1562) took 1916 ms. Trace:
I20260709 13:17:28.171236  3282 rpcz_store.cc:276] 0709 13:17:26.254083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.169527 (+1915444us) service_pool.cc:224] Handling call
0709 13:17:28.169816 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.170560 (+   744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.170784 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.175238  3251 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:28.168411  3283 rpcz_store.cc:276] 0709 13:17:26.232266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.143978 (+1911712us) service_pool.cc:224] Handling call
0709 13:17:28.145858 (+  1880us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.148980 (+  3122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.156279 (+  7299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.148366  7557 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.150647  7589 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:28.137722  7665 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:28.157745  7562 consensus_meta.cc:287] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.001s
I20260709 13:17:28.157058  7739 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:28.136050  7690 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.150939  7559 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:28.191395  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 276674us
W20260709 13:17:28.177387  3102 raft_consensus.cc:2686] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:17:28.164105  7521 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:28.158246  7757 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:28.181903  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:28.197211  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 279143us
I20260709 13:17:28.198460  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:28.177213  7388 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:28.180583  7738 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:28.194672  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:28.194085  3283 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:28.161372  7645 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:17:28.158205  7715 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.199934  3100 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:28.202620  7757 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.163936  7553 consensus_queue.cc:1059] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:17:28.207086  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:28.208896  3836 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
W20260709 13:17:28.231359  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:28.232558  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.233631  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:28.234724  3101 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:28.234999  7634 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:28.235482  7634 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.235961  7634 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:28.236485  7744 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:28.236912  7744 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:28.237346  7744 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:28.237954  3100 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:28.235850  3101 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:28.183234  7562 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:28.272800  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 126598us
I20260709 13:17:28.183104  7557 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.200119  7521 raft_consensus.cc:697] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:17:28.290252  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 54532.6us
I20260709 13:17:28.195848  7559 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.209760  7388 raft_consensus.cc:697] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:28.293678  3279 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:28.180140  7480 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.263412  7663 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:28.293447  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:28.298913  3278 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:28.210479  7752 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:17:28.290273  7739 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.311988  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:28.277372  7588 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:28.322827  3101 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:28.315505  7758 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:17:28.326432  3836 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:28.313138  7768 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.348261  7768 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.339810  7335 raft_consensus.cc:3055] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:28.349620  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.351013  7559 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:28.351998  7747 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:28.324568  7739 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.353614  7557 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:28.355297  7739 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:28.357105  7562 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:28.293424  7612 consensus_queue.cc:1059] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:17:28.359448  7612 raft_consensus.cc:3055] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:28.359841  7612 raft_consensus.cc:740] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:28.359704  7737 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.361986  7690 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:28.364342  7757 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:28.290402  7746 consensus_queue.cc:237] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.367712  7763 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:28.368160  7763 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.368501  7763 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.340437  7735 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:28.369460  7735 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:28.369814  7735 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.295495  7730 consensus_queue.cc:1059] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:17:28.373769  7730 raft_consensus.cc:3055] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:28.374125  7730 raft_consensus.cc:740] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:28.375051  7715 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:28.312517  7762 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:28.349563  7335 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:28.377676  7335 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.378626  7335 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:28.315228  6835 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:28.329408  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 669) took 2161 ms. Trace:
I20260709 13:17:28.380561  6835 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:28.345564  7760 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:28.345057  7388 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:28.346312  7755 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 13:17:28.347069  7761 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:17:28.347715  7754 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:17:28.381006  6835 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:28.380652  3281 rpcz_store.cc:276] 0709 13:17:26.167813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.603617 (+1435804us) service_pool.cc:224] Handling call
0709 13:17:27.603981 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.018447 (+414466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.329092 (+310645us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b5400039154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:28.329321 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950364416}
W20260709 13:17:28.327116  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 139512us
W20260709 13:17:28.435098  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 112386us
I20260709 13:17:28.432879  3279 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
W20260709 13:17:28.437335  3805 leader_election.cc:336] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.808s (SENT)
W20260709 13:17:28.441684  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.452242  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.441716  3250 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:28.454298  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 214077us
I20260709 13:17:28.455340  3100 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:28.323010  7663 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 13:17:28.374150  7665 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:28.460444  3250 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:28.461588  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:28.462328  3133 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:28.463780  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:28.464042  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:28.465659  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:28.466559  3127 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 9: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:28.467779  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:28.469280  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:28.471252  3128 raft_consensus.cc:1240] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:28.438759  7762 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:28.438150  7713 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.472565  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:28.473904  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:28.476611  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:28.465517  7464 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.466843  7745 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:28.459268  7562 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:28.453028  7588 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:28.375113  7730 consensus_queue.cc:260] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.360913  7612 consensus_queue.cc:260] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.464027  7645 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.434186  7521 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.458164  7752 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:17:28.476994  7663 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:28.477708  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:28.486124  7273 consensus_meta.cc:287] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.697s	user 0.003s	sys 0.007s
I20260709 13:17:28.558583  3282 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:28.492682  3250 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:28.560035  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 67455us
I20260709 13:17:28.561818  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:28.490728  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1554) took 2380 ms. Trace:
I20260709 13:17:28.515789  7768 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:28.518935  7713 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.562852  3276 rpcz_store.cc:276] 0709 13:17:26.110176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.559840 (+1449664us) service_pool.cc:224] Handling call
0709 13:17:27.560159 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:27.581842 (+ 21683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.581874 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:27.627079 (+ 45205us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.896062 (+268983us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:28.164032 (+267970us) log.cc:844] Serialized 14 byte log entry
0709 13:17:28.175829 (+ 11797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.175999 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.490490 (+314491us) raft_consensus.cc:1685] finished
0709 13:17:28.490519 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.490664 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9503,"raft.queue_time_us":6397,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":17123,"spinlock_wait_cycles":12010240,"thread_start_us":409215,"threads_started":2,"wal-append.queue_time_us":500647}
I20260709 13:17:28.520183  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:28.565222  7715 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:28.565693  7715 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:28.566058  7715 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:28.521384  7464 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.567651  3134 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:28.521713  7745 raft_consensus.cc:697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:28.568819  7464 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:28.465770  7739 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:17:28.571952  7273 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:28.570418  7745 consensus_queue.cc:237] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.538849  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:28.577527  3133 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:28.485985  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:28.524132  7562 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.586119  7562 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:28.503933  7727 ts_tablet_manager.cc:1929] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260709 13:17:28.587167  7727 log.cc:1199] T 8e1a4d71ef0f4287999b5ee60fe02740 P fc48eecc27554cb58b15193cd442b1d3: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-0-root/wals/8e1a4d71ef0f4287999b5ee60fe02740
I20260709 13:17:28.526341  7645 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.584830  6835 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.552502  7744 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.523684  7634 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:28.614172  3176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.022s	sys 0.031s
W20260709 13:17:28.630194  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:28.631865  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:28.632710  3176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.022s	sys 0.032s
W20260709 13:17:28.633680  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 634540us
I20260709 13:17:28.634588  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:28.636036  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:17:28.639945  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 184675us
I20260709 13:17:28.647740  3204 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:28.648123  3100 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:28.648901  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.524910  7588 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.644234  7727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40280 (request call id 1) took 2393 ms. Trace:
I20260709 13:17:28.644279  7721 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:28.643927  6835 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:28.651259  3805 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.145s (SENT) [suppressed 27 similar messages]
I20260709 13:17:28.652819  3204 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:28.653939  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.655501  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.665422  3127 raft_consensus.cc:2368] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14.
I20260709 13:17:28.666158  3100 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:28.610303  7553 consensus_queue.cc:1059] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:17:28.555840  7763 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.682648  3100 leader_election.cc:400] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14.
I20260709 13:17:28.639670  7768 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:28.683599  3100 leader_election.cc:403] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:28.672164  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.685398  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:28.689936  3210 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:28.661577  7617 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.613372  7384 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:28.690685  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.666412  7721 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:28.694494  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:28.661940  7690 consensus_queue.cc:1059] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:17:28.697911  7645 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:28.698372  7690 consensus_queue.cc:1243] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer 48080cf0460346769ab046a4f9457aa5 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:28.698961  7690 raft_consensus.cc:3055] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:28.699422  7690 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:28.699975  7634 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:28.700286  7690 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 5, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.665884  7727 rpcz_store.cc:276] 0709 13:17:26.266477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.329950 (+ 63473us) service_pool.cc:224] Handling call
0709 13:17:27.393142 (+1063192us) ts_tablet_manager.cc:1151] Deleting tablet 8e1a4d71ef0f4287999b5ee60fe02740
0709 13:17:27.393252 (+   110us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:17:28.433150 (+1039898us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:28.503776 (+ 70626us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:28.639027 (+135251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154382,"tablet-delete.queue_time_us":829502,"thread_start_us":449254,"threads_started":1}
I20260709 13:17:28.705360  7737 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:28.708779  7735 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.710871  7735 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:28.712642  7744 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:28.701901  7771 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:28.695350  7617 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.702723  7384 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:28.703496  3132 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:28.671085  7762 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:28.670944  7752 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.725499  7617 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:28.725739  7752 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.728039  7752 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:28.715580  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:28.728750  3210 raft_consensus.cc:2376] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12. Re-sending same reply.
I20260709 13:17:28.661765  7629 consensus_queue.cc:1059] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:17:28.739614  7745 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.740402  7629 raft_consensus.cc:3055] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:28.740484  7763 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:28.720548  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:28.695796  7721 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.717938  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.738432  7588 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:28.720214  7738 consensus_meta.cc:287] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.001s
I20260709 13:17:28.733695  7715 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.744158  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.745139  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:28.741142  7629 raft_consensus.cc:740] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:28.718302  7612 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:28.751601  3100 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:28.763070  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 88800.9us
I20260709 13:17:28.773170  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.746603  7738 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:28.750617  7690 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.778353  3202 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:17:28.746806  7762 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:28.812538  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 214919us
I20260709 13:17:28.763139  7764 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:28.814766  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:28.815935  7559 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:28.771705  7771 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:28.831120  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:28.832428  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:28.833150  3202 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:28.834100  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:28.740298  7745 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.847973  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:28.852339  3129 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:17:28.821424  7588 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:28.799172  7335 consensus_queue.cc:1059] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:17:28.781699  7562 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.863499  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.866353  7715 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:28.867023  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.868129  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:28.839668  7629 consensus_queue.cc:260] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:28.872453  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:28.873661  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1935) took 1920 ms. Trace:
I20260709 13:17:28.874082  3209 rpcz_store.cc:276] 0709 13:17:26.952990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.970559 (+ 17569us) service_pool.cc:224] Handling call
0709 13:17:26.970966 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.725877 (+754911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.873437 (+1147560us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b5400246654. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:28.873606 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734584704}
I20260709 13:17:28.875320  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:28.876299  3209 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:28.876473  7745 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:28.878146  7703 log.cc:927] Time spent T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 2.279s	user 0.006s	sys 0.012s
I20260709 13:17:28.879142  7562 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:28.880100  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2729) took 2932 ms. Trace:
I20260709 13:17:28.880524  3280 rpcz_store.cc:276] 0709 13:17:25.948005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.949333 (+  1328us) service_pool.cc:224] Handling call
0709 13:17:25.949719 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.950196 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.950238 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.985563 (+ 35325us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.231435 (+245872us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:26.255821 (+ 24386us) log.cc:844] Serialized 14 byte log entry
0709 13:17:26.256025 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.256094 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.877473 (+2621379us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:28.879685 (+  2212us) raft_consensus.cc:1685] finished
0709 13:17:28.879889 (+   204us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.880036 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27801,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":16526,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":19282,"spinlock_wait_cycles":9671552,"thread_start_us":224864,"threads_started":1,"wal-append.queue_time_us":423875}
I20260709 13:17:28.882467  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:28.884161  7589 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:28.884672  7589 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:28.885480  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1857) took 1117 ms. Trace:
I20260709 13:17:28.885857  3131 rpcz_store.cc:276] 0709 13:17:27.768420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.844138 (+ 75718us) service_pool.cc:224] Handling call
0709 13:17:27.844437 (+   299us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:27.877035 (+ 32598us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.877063 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:27.877640 (+   577us) log.cc:844] Serialized 52 byte log entry
0709 13:17:28.726399 (+848759us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b180002d940. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:17:28.810559 (+ 84160us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:28.810606 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.810715 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.885152 (+ 74437us) raft_consensus.cc:1685] finished
0709 13:17:28.885173 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.885417 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11370,"raft.queue_time_us":32106,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":12415,"spinlock_wait_cycles":8052992,"thread_start_us":83961,"threads_started":1,"wal-append.queue_time_us":993753}
I20260709 13:17:28.890161  7721 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.891300  3207 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:28.891475  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:28.894434  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:28.896198  3207 raft_consensus.cc:2393] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:28.894738  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:28.892346  7721 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:28.897500  3209 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:28.901618  6835 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14.
I20260709 13:17:28.897326  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:28.875325  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.902814  3131 raft_consensus.cc:2410] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:28.838104  7762 raft_consensus.cc:697] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:28.897800  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:28.906342  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.906939  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.909363  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.914462  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1551) took 2901 ms. Trace:
I20260709 13:17:28.915004  3284 rpcz_store.cc:276] 0709 13:17:26.012632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.480284 (+1467652us) service_pool.cc:224] Handling call
0709 13:17:28.157419 (+677135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.173735 (+ 16316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.910627 (+736892us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54001775d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:28.914367 (+  3740us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556372864}
W20260709 13:17:28.918268  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 126499us
I20260709 13:17:28.919708  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.920692  3207 raft_consensus.cc:2393] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 10: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:28.924593  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.925686  3209 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:28.926972  3100 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:28.926957  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:28.928201  3209 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:28.930513  3207 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:28.931387  3209 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:28.934648  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:28.934952  3127 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:28.936311  3131 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:28.938429  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:28.938868  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:28.939505  3276 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.940706  3281 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:28.942138  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:28.942669  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:28.943432  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.944435  3209 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:28.935304  3280 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:28.945982  7775 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:28.948349  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2745) took 2839 ms. Trace:
I20260709 13:17:28.948843  3278 rpcz_store.cc:276] 0709 13:17:26.109156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.495546 (+1386390us) service_pool.cc:224] Handling call
0709 13:17:27.495806 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.306141 (+810335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.948058 (+641917us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b54002968d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:28.948273 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1846476544}
I20260709 13:17:28.951758  7776 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:28.952464  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:28.953394  3283 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:28.953765  3206 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:28.955227  3206 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:17:28.958427  3136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1569) took 2679 ms (client timeout 2399 ms). Trace:
I20260709 13:17:28.952607  7762 consensus_queue.cc:237] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:28.961963  3134 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:28.967229  3210 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:17:28.980430  3134 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:28.982842  7730 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:28.983700  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:28.984287  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 679) took 1261 ms. Trace:
I20260709 13:17:28.984845  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:28.995662  3282 rpcz_store.cc:276] 0709 13:17:27.722702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.172759 (+450057us) service_pool.cc:224] Handling call
0709 13:17:28.173139 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.559104 (+385965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.983968 (+424864us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5400038754. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:28.984208 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885629824}
I20260709 13:17:28.986418  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:28.987097  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:28.987974  3134 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:28.988631  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:28.989208  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 43544.9us
I20260709 13:17:28.989497  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:28.989995  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:28.991703  3276 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:29.000676  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:29.002473  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:29.003121  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:29.003811  3207 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:28.993392  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:28.959045  3136 rpcz_store.cc:269] 0709 13:17:26.279333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.279649 (+   316us) service_pool.cc:224] Handling call
0709 13:17:28.958145 (+2678496us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54000e29d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:28.958331 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3519387520}
I20260709 13:17:28.994494  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:28.994668  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:29.005703  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:29.006714  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:29.007340  3209 raft_consensus.cc:2368] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14.
I20260709 13:17:29.008852  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:29.009768  3840 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:29.015070  3838 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:29.017031  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:29.017823  3134 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:29.018440  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:29.021505  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.023547  3136 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:29.024621  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:29.013226  3249 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:29.014258  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:29.028525  3131 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:29.028788  3127 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:29.030197  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:29.030736  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:29.030932  3842 raft_consensus.cc:2393] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 10: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:29.017230  6835 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:17:29.031456  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 56324.5us
I20260709 13:17:29.032640  6835 raft_consensus.cc:3055] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:29.033094  6835 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:29.013334  7562 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:28.931305  7721 consensus_queue.cc:1059] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:17:29.039808  3249 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:29.041785  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:29.059615  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:29.008621  7776 raft_consensus.cc:697] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:29.012943  7682 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:29.060230  7746 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:29.063158  7720 raft_consensus.cc:3055] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:29.089794  7720 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:29.063548  7273 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:29.091789  7273 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:29.042773  7562 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.092456  7562 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:29.057228  7486 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.066231  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:29.093535  7486 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.094241  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:29.066779  7690 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.095610  7486 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:29.095778  7690 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.097112  7790 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:29.097536  7790 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:29.067134  7774 log.cc:927] Time spent T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.360s	user 0.003s	sys 0.000s
I20260709 13:17:29.097954  7690 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:29.067862  7739 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:29.067791  7561 consensus_queue.cc:1059] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:29.068413  7768 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:29.068686  3020 catalog_manager.cc:5028] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): tablet 8e1a4d71ef0f4287999b5ee60fe02740 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:17:29.028538  7715 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.041371  7388 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:29.069290  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:29.070781  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.071982  3250 leader_election.cc:400] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14.
I20260709 13:17:29.072324  7363 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:29.073551  7615 raft_consensus.cc:3055] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:29.070701  7557 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:17:29.079161  3129 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.080081  3249 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:29.081866  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:29.082484  3127 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:28.998313  7480 consensus_queue.cc:1059] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:17:29.040269  7738 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.098510  7521 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:29.085464  3207 raft_consensus.cc:2410] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:29.145861  7521 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.146636  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:29.147608  3207 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:29.147992  7521 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:29.148509  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:29.096180  7486 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:29.149289  7486 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.149245  7363 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:29.149992  7486 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:29.150655  7355 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.151662  7363 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:29.097900  7790 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:29.154078  7632 raft_consensus.cc:3055] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:29.154456  7632 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:29.155472  7632 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.067353  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:29.156731  7632 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.099897  3251 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:29.157727  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 670) took 2989 ms. Trace:
I20260709 13:17:29.008832  7612 consensus_queue.cc:1059] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:17:29.158191  3277 rpcz_store.cc:276] 0709 13:17:26.168065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.717449 (+1549384us) service_pool.cc:224] Handling call
0709 13:17:27.871538 (+154089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.871719 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.871742 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.871781 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:27.871810 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.871859 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.157555 (+1285696us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540042c550. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:29.157670 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353579264}
I20260709 13:17:29.159054  7612 raft_consensus.cc:3055] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:29.159416  7612 raft_consensus.cc:740] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:29.160265  7612 consensus_queue.cc:260] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:29.161266  7789 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.161861  7789 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.165512  3206 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:29.107785  3834 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:17:29.166630  3279 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 2753) took 2922 ms (client timeout 2329 ms). Trace:
W20260709 13:17:29.167025  3279 rpcz_store.cc:269] 0709 13:17:26.244343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.856854 (+612511us) service_pool.cc:224] Handling call
0709 13:17:29.166445 (+2309591us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54002977d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:29.166558 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3106064256}
I20260709 13:17:29.167790  7612 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.099349  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:29.092378  7273 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:29.110860  6835 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:29.170346  6835 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:29.035899  7717 consensus_queue.cc:1059] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:17:29.039119  7559 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:17:29.121349  3250 leader_election.cc:403] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:17:29.091291  7513 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:29.126199  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 56984.1us
I20260709 13:17:29.036412  7580 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:29.131769  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 51770.3us
I20260709 13:17:29.206156  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:29.118882  7715 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.107967  7180 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:29.135190  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:29.214298  3203 raft_consensus.cc:2393] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:29.125315  7615 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:29.139582  7480 raft_consensus.cc:3055] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:29.142043  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:29.145249  7645 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:29.010696  7785 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:17:29.036594  7630 consensus_queue.cc:1059] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:17:29.259756  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:29.172442  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:29.270977  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:29.271641  3207 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.174840  7388 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:29.175464  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 75634.7us
W20260709 13:17:29.175712  7791 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:17:29.175951  7363 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:29.178725  7713 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:29.253047  7739 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:29.182117  7629 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.183353  7589 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:29.184001  3835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 830) took 1599 ms. Trace:
I20260709 13:17:29.295948  3835 rpcz_store.cc:276] 0709 13:17:27.584927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.585124 (+   197us) service_pool.cc:224] Handling call
0709 13:17:27.585379 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.842268 (+256889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.183746 (+1341478us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54003abbd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:29.183939 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589451648}
I20260709 13:17:29.113649  7617 consensus_queue.cc:1059] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:17:29.186055  7776 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.188894  7744 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:29.252300  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47375.7us
I20260709 13:17:29.264303  3285 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:29.260752  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:29.301821  3276 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:29.267958  3279 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:29.269070  3278 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:29.274034  7751 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.006s	sys 0.015s
I20260709 13:17:29.215771  7721 raft_consensus.cc:3055] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:29.109335  7720 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.253877  7645 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.221637  7480 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:29.266719  7746 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:17:29.215071  7513 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:29.261650  7553 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:17:29.293963  7363 raft_consensus.cc:697] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:29.266891  7682 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:17:29.300006  7656 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.017s	sys 0.015s
I20260709 13:17:29.257825  7521 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:29.305706  7751 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.006s	sys 0.018s
I20260709 13:17:29.287772  7557 consensus_queue.cc:1059] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:17:29.309974  7721 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:29.312616  7645 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:29.314535  7789 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:29.322391  7656 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.017s	sys 0.015s
I20260709 13:17:29.317900  7720 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.316001  7805 raft_consensus.cc:3055] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:29.340754  7805 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:29.342420  7805 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.343768  7805 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.345141  7715 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:29.346097  7589 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:29.347117  7721 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.348408  7721 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.349797  7738 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.316731  7615 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:29.351162  7615 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:29.351576  7769 consensus_queue.cc:1175] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fc48eecc27554cb58b15193cd442b1d3" responder_term: 11 status { last_received { term: 11 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 11 index: 10 } }
I20260709 13:17:29.345002  7790 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.361855  7790 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:29.400585  3031 catalog_manager.cc:5697] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 7 to 10, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 10 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:29.408855  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.409660  3100 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:29.170292  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 71037.9us
I20260709 13:17:29.194974  3129 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:29.431353  3102 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:29.118613  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:29.234568  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.436476  3102 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:17:29.437494  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 318855us
W20260709 13:17:29.439219  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.441722  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.442324  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.443919  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:29.278064  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:29.452234  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:29.209141  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:29.471153  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:29.282857  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:29.190842  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:29.477020  7273 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:29.478775  3210 raft_consensus.cc:2410] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:29.481577  7663 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:29.482828  7663 consensus_queue.cc:1059] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:17:29.208163  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 136333us
I20260709 13:17:29.485643  3278 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:29.491137  7677 consensus_queue.cc:1059] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:29.277724  3251 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:29.291792  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:29.509397  3280 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 11: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:29.261675  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:29.295150  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:29.510509  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:29.511430  3281 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:29.290093  3283 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:29.312858  3836 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:29.254585  7180 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:29.517369  7180 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:29.266664  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:29.518499  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:29.519483  3284 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.462651  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:29.462958  7363 consensus_queue.cc:237] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:29.473867  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:29.484742  7663 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:29.524471  7663 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:29.525051  7663 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:29.526289  3127 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:29.500555  7634 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
W20260709 13:17:29.502861  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.459465  7480 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.540649  7560 raft_consensus.cc:3055] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:29.541455  7560 raft_consensus.cc:740] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:29.543398  7560 consensus_queue.cc:260] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:29.505573  7309 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.506153  7513 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:29.550336  7582 consensus_queue.cc:1059] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:29.553498  7591 consensus_queue.cc:1059] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:29.554137  7773 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.555024  7790 raft_consensus.cc:3055] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:29.555277  7591 raft_consensus.cc:3055] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:29.555614  7790 raft_consensus.cc:740] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:29.555874  7591 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:29.558547  7790 consensus_queue.cc:260] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.561105  7790 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.562762  7480 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:29.566534  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.325393  7557 consensus_queue.cc:1243] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer 48080cf0460346769ab046a4f9457aa5 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:29.529418  7735 raft_consensus.cc:3055] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:29.567531  7735 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:29.569170  7735 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:29.570788  7735 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.492537  7677 consensus_queue.cc:1243] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:29.584836  3202 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:29.432479  3031 catalog_manager.cc:5697] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.606580  3284 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:29.622638  7663 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.623087  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:29.625486  3285 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:17:29.626518  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 88227us
I20260709 13:17:29.628474  7663 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:29.637239  7617 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:29.641394  7180 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:29.631639  7388 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:29.623334  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.648705  7560 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.649850  3250 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:29.666091  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 225232us
I20260709 13:17:29.650700  7682 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
W20260709 13:17:29.683033  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 405230us
W20260709 13:17:29.684413  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.694300  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.698069  7562 consensus_meta.cc:287] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.011s
I20260709 13:17:29.698709  7562 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:29.700476  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 50882.7us
I20260709 13:17:29.704558  7667 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:29.705313  7738 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:29.705431  7667 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:29.678954  3206 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:29.705832  7738 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:29.712776  3277 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:29.715160  3031 catalog_manager.cc:5697] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 7 to 9, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 9 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:29.723497  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:29.724273  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:29.726020  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:29.728972  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:29.730261  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 46021.7us
I20260709 13:17:29.731937  7180 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:29.734988  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:29.735956  3278 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:29.737414  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:29.738517  3285 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:29.744592  7363 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:29.745877  7363 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:29.748793  3132 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:29.748950  7273 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:29.749696  7273 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.751061  7363 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:29.751744  7273 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:29.752869  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:29.753793  3278 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:29.754696  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:29.755997  7752 raft_consensus.cc:3055] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:29.756476  7752 raft_consensus.cc:740] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:29.748806  3249 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:29.757736  7752 consensus_queue.cc:260] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.759491  7752 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:29.759588  3249 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:29.737205  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.759488  3834 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:29.768172  7180 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:29.692572  7751 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:17:29.773905  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:29.663210  7591 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:29.783010  7486 consensus_meta.cc:287] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.013s
W20260709 13:17:29.783741  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.783866  3838 raft_consensus.cc:3055] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:29.784490  3838 raft_consensus.cc:740] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:17:29.784618  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.785274  7588 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:17:29.785527  3838 consensus_queue.cc:260] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:29.786564  3838 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:29.793926  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 111772us
I20260709 13:17:29.793694  7667 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:29.794929  3176 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:29.796989  7720 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:29.797866  3210 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:29.798161  7591 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.783524  7486 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:29.769256  7562 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:29.811414  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 51979.5us
I20260709 13:17:29.808442  7180 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:17:29.812814  3031 catalog_manager.cc:5697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.797909  7720 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:29.822068  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:29.824290  3249 leader_election.cc:400] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14.
I20260709 13:17:29.826129  3278 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:29.826484  3279 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:29.827368  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:29.827549  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:29.828086  3278 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:29.830904  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:29.831559  3282 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:29.831938  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:29.832387  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:29.834427  3280 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:29.835536  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:29.836202  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:29.838306  3283 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:29.839385  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:29.842382  3203 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:17:29.847124  3207 consensus_meta.cc:287] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.531s	user 0.014s	sys 0.003s
I20260709 13:17:29.847723  3207 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:29.848026  7790 consensus_queue.cc:1059] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:29.849403  3208 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:29.849427  7720 raft_consensus.cc:3055] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:29.828783  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:29.820688  3031 catalog_manager.cc:5697] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 7 to 11, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 11 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.828959  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:29.800791  7363 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:29.863585  3278 raft_consensus.cc:2376] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19. Re-sending same reply.
I20260709 13:17:29.891858  3209 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
W20260709 13:17:29.899186  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.862391  7720 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:29.909457  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:29.907055  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:29.912955  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 88929.5us
I20260709 13:17:29.915753  3283 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:29.916770  3282 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:17:29.919152  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.925117  3280 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:29.929373  3211 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:17:29.923080  3031 catalog_manager.cc:5697] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.933291  3277 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:29.931147  3838 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:17:29.937764  3838 pending_rounds.cc:85] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 10
W20260709 13:17:29.943019  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.943578  3278 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:29.938491  3838 pending_rounds.cc:107] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:17:29.951220  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:29.953573  3282 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:17:29.960558  3838 raft_consensus.cc:2889] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:29.973587  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.970871  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:29.969591  3249 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:29.977551  7682 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.978253  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:29.979476  7273 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:29.980382  3249 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:29.981524  7273 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.983045  7715 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:29.983541  3249 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:29.983597  7273 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:29.984948  7273 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:29.987411  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:29.988900  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 99237.7us
W20260709 13:17:29.993515  7615 consensus_meta.cc:287] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.642s	user 0.014s	sys 0.006s
I20260709 13:17:29.996474  3280 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:29.997804  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:29.998570  3277 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:30.003458  7180 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.004035  7180 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:30.006302  7645 consensus_meta.cc:287] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.667s	user 0.006s	sys 0.009s
I20260709 13:17:30.006835  7645 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:30.008244  3280 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:17:29.972561  3031 catalog_manager.cc:5697] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 7 to 8, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 8 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.032065  3279 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:17:30.029959  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:30.037719  3277 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:30.044953  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:30.045845  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:30.006337  7180 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:30.013804  7588 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:17:30.052335  7588 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:30.052762  7588 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:30.054279  7588 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:30.057216  7717 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:17:30.058795  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:30.051589  3285 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:30.061444  7615 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.077944  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:30.082072  3203 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 13: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:30.084966  3838 raft_consensus.cc:2393] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:30.055625  7588 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:30.102792  3100 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:30.108310  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:30.099243  3031 catalog_manager.cc:5697] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.107422  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:30.101693  7180 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.125138  7789 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:17:30.125404  7180 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.127622  7656 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.128182  7180 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:30.128288  7656 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.131608  7486 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:30.108008  7663 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:30.133625  7663 raft_consensus.cc:697] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:30.135171  7663 consensus_queue.cc:237] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.137432  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:30.091584  7615 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:30.140748  7615 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:30.124579  7737 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:30.119706  7561 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 13:17:30.149191  7629 consensus_meta.cc:287] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.848s	user 0.018s	sys 0.005s
I20260709 13:17:30.149659  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:30.150313  3204 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:30.150911  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:30.100054  7751 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 13:17:30.147714  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.123648  7816 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.087s	user 0.003s	sys 0.000s
W20260709 13:17:30.145671  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.163857  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:30.161386  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:30.167304  7561 consensus_queue.cc:1059] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:30.168344  7561 raft_consensus.cc:3055] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:30.168673  3805 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:30.174010  3277 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:30.168748  7561 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:30.181740  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:30.182559  3285 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:30.179207  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:30.187666  3251 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:30.177834  7789 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.189592  7789 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:30.190661  7561 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.192003  7789 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:30.193272  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.195029  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:30.196116  7560 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:30.197697  7739 consensus_meta.cc:287] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.853s	user 0.006s	sys 0.012s
I20260709 13:17:30.197794  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:30.198293  7739 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14.
I20260709 13:17:30.198791  3835 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:30.200067  7739 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:30.205235  7746 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:30.192114  7561 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:30.218128  3281 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:30.176368  7645 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:30.222220  3277 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:30.227298  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.229665  7682 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:30.180322  7615 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:30.233661  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:30.235039  3203 raft_consensus.cc:2410] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:30.236145  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:30.236989  3285 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:30.237965  3207 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:30.238487  3031 catalog_manager.cc:5697] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 2 to 6, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 6 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.240015  3202 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:17:30.240485  3202 pending_rounds.cc:85] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 8
I20260709 13:17:30.240788  3202 pending_rounds.cc:107] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:17:30.241242  3202 raft_consensus.cc:2889] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:30.244057  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:30.245487  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 57950.5us
I20260709 13:17:30.246501  3251 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:30.236161  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:30.248311  3251 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:30.252264  3031 catalog_manager.cc:5697] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 4 to 7, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 7 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:30.256291  7355 consensus_meta.cc:287] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.105s	user 0.007s	sys 0.014s
I20260709 13:17:30.257243  3205 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:30.257766  7582 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.258201  7682 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:30.258383  7582 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:30.260993  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 3051) took 1495 ms. Trace:
I20260709 13:17:30.262059  3202 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:30.262555  3251 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:30.262599  3202 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:30.263741  7667 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:30.264596  7667 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:30.264171  3202 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.266201  3202 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:30.269896  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.272766  7738 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.274463  7738 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:30.277606  7819 log.cc:927] Time spent T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.160s	user 0.001s	sys 0.001s
W20260709 13:17:30.281426  7820 log.cc:927] Time spent T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.153s	user 0.000s	sys 0.002s
I20260709 13:17:30.287122  7582 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:30.290017  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:30.314139  3202 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:30.316444  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:30.319420  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 122690us
I20260709 13:17:30.316794  3031 catalog_manager.cc:5697] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 7 to 8, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 8 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
W20260709 13:17:30.326110  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 150619us
I20260709 13:17:30.329556  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:30.331933  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.332022  3281 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:17:30.332546  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 60853.3us
I20260709 13:17:30.261418  3204 rpcz_store.cc:276] 0709 13:17:28.765812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.767224 (+  1412us) service_pool.cc:224] Handling call
0709 13:17:28.767537 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:30.150716 (+1383179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.260657 (+109941us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540019f854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:30.260918 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3178734464}
W20260709 13:17:30.339932  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.343590  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:30.343705  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:30.326706  7562 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.345038  3805 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:30.328063  3031 catalog_manager.cc:5697] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 3 to 4, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 4 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.350669  6835 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:30.353766  7824 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:17:30.353714  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:30.355825  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:30.350908  7717 consensus_queue.cc:1059] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:17:30.357908  7629 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:30.357401  7486 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:30.352851  7562 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.360729  7562 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:30.362135  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:30.356969  7790 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:30.365651  7790 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.367990  7790 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:30.371259  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 521) took 1258 ms. Trace:
I20260709 13:17:30.371660  3208 rpcz_store.cc:276] 0709 13:17:29.112487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.476193 (+363706us) service_pool.cc:224] Handling call
0709 13:17:29.848799 (+372606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.849911 (+  1112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.371046 (+521135us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54002a71d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:30.371194 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855570304}
I20260709 13:17:30.351365  7752 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:30.374186  7752 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.374704  7752 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:30.375813  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.391623  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 51209us
I20260709 13:17:30.391322  7615 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:30.392885  7486 raft_consensus.cc:697] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:30.390034  6835 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.397174  3031 catalog_manager.cc:5697] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 5 to 6, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 6 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.402175  6835 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:30.400230  7789 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:17:30.404613  7717 raft_consensus.cc:3055] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:30.404899  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:30.405257  7739 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.405826  7739 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:30.405062  7717 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:30.409675  7717 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:30.410948  7717 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.412047  7656 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:30.414144  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.414382  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:30.415030  3838 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:30.415210  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:30.415879  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:30.416558  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:17:30.416092  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.414583  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.402190  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:30.415113  3832 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:30.420347  3205 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 500) took 1728 ms (client timeout 1791 ms). Trace:
I20260709 13:17:30.422478  3806 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:30.420706  7486 consensus_queue.cc:237] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:30.415132  7832 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:17:30.435937  3806 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:30.423969  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:30.423823  7735 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:30.425180  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:30.421005  7562 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:30.420997  3205 rpcz_store.cc:269] 0709 13:17:28.691558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.691689 (+   131us) service_pool.cc:224] Handling call
0709 13:17:30.417260 (+1725571us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400152cd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:30.420136 (+  2876us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3482533248}
I20260709 13:17:30.426860  3249 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:30.420680  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:30.427453  7682 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:17:30.400141  7821 log.cc:927] Time spent T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.258s	user 0.000s	sys 0.004s
W20260709 13:17:30.428556  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 84971.8us
W20260709 13:17:30.429360  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.470106  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.471246  3177 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:30.429997  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:30.408583  7739 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:30.400434  7738 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.430546  3805 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:30.431807  7769 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:30.438500  3128 raft_consensus.cc:2410] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:30.441805  7645 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:30.447067  3133 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:30.404980  7720 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:30.479439  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 77356us
I20260709 13:17:30.459259  7773 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.501258  7683 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:17:30.504264  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:30.469307  7273 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:30.536441  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.509303  3129 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:30.483050  7789 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:30.480345  7738 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.577020  3101 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:17:30.579867  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 71327.5us
I20260709 13:17:30.474087  7582 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:30.577766  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:30.584770  7582 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:30.565028  7667 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:30.505836  7656 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.578058  7789 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.486653  7562 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 13:17:30.610781  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:30.505012  7737 consensus_queue.cc:1059] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.106s
I20260709 13:17:30.612298  3208 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:30.613672  3211 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:30.571023  7790 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 13:17:30.633186  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.614734  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 110602us
I20260709 13:17:30.611156  7789 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.588405  7739 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:17:30.590934  7663 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.596060  7582 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:30.636883  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:30.596407  7746 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.584553  7773 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.626941  7656 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:30.658399  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 169835us
I20260709 13:17:30.648512  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:30.632324  7667 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:30.654806  7828 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:30.676734  7464 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:30.677299  7464 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:30.677703  7464 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.665827  7663 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:30.681155  7768 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:30.681780  7738 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:30.682629  7745 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.683256  7745 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.688505  3136 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:30.681315  7663 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:30.653436  7843 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:30.657820  7645 raft_consensus.cc:697] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:30.711412  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:30.717533  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 287025us
I20260709 13:17:30.714543  7745 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:30.705724  7720 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:30.662366  7746 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:30.729569  3100 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:30.714682  7480 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:30.741163  7735 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:30.753018  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 78834.8us
I20260709 13:17:30.754819  6835 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:30.759737  3805 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:30.761612  7561 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:30.745702  7588 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:30.766846  3834 raft_consensus.cc:2410] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:17:30.770313  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:30.771404  6835 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:30.777216  7847 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:30.775936  7838 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.777917  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:30.778069  7838 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:30.784413  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 138091us
I20260709 13:17:30.764482  7588 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:30.768822  7738 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:30.788015  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.763391  7752 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.766185  7751 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:17:30.798200  3101 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:30.798800  6835 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:30.801347  7838 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:30.786970  7588 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:30.792775  7677 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.792045  7773 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:30.807637  7738 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.819082  7738 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:30.808543  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:30.821835  7773 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:30.822463  7773 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.823112  7773 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:30.812351  7677 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.838104  7789 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:30.840605  7656 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:30.841161  6835 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:30.782101  7645 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:30.849436  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:30.849839  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 95474us
I20260709 13:17:30.851691  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:30.852499  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.852334  3210 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:30.850162  3836 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:30.866824  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:30.867486  3836 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.868120  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:30.868732  3210 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:30.840904  7789 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:30.875869  3203 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:30.867005  3102 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:30.880074  7464 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:30.883617  7464 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:30.862582  7745 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.887501  7745 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.889329  3176 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:30.894310  7745 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:30.894862  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:30.895720  3840 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:30.896466  7656 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:30.897359  7656 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:30.897792  7656 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:30.898094  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:30.899869  3100 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:30.919111  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:30.922587  3836 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:30.923260  7745 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:30.929330  7677 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:30.933504  7588 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:30.934438  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.934528  7752 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:30.935077  7683 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:30.939579  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 148981us
I20260709 13:17:30.877221  7486 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:30.942901  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:30.945150  7683 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:30.947605  7683 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:30.948266  7486 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:30.950661  3209 raft_consensus.cc:2410] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:30.935916  7751 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:30.935722  7745 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:30.959941  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.964159  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 94696.8us
I20260709 13:17:30.965484  3101 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:30.965004  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:30.966503  3209 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:30.956614  7751 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.969559  3249 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:30.959067  7745 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:30.974978  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:31.000574  3206 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:31.002246  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.999835  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 124387us
I20260709 13:17:30.965421  7588 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:31.005288  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 48315us
I20260709 13:17:31.006695  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:31.007623  7772 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:31.008092  7772 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.008453  7772 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.009819  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:31.010641  7768 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:31.011137  7768 raft_consensus.cc:697] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:31.011988  7768 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:30.999727  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:31.016086  7737 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:17:30.955158  7752 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:17:31.025070  3101 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:31.014935  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:31.035768  7720 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:31.036371  7720 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.034920  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:31.038640  7746 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:31.036810  7720 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:31.039552  6835 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:31.040232  6835 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.041285  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:31.042135  6835 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:31.022133  7677 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:31.048187  7677 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:31.048586  7677 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:30.970252  7773 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:31.050172  7588 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:31.050990  7588 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:31.054097  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:31.054881  7588 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:30.969503  7582 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.058775  3211 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:31.059202  7588 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:31.061153  7591 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:31.061570  7591 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.061628  7588 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:31.062038  7591 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:30.974143  7751 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.065968  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:31.068718  7588 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:31.069468  7588 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:31.070415  7588 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.077764  3805 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:31.043051  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:31.078977  7560 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:31.079552  7790 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:31.080327  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 51481.9us
I20260709 13:17:31.081435  3805 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:31.092226  3102 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:31.094002  3177 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:31.112685  3177 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:31.121613  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.080785  7582 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:31.127379  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:31.165833  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.165614  7772 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.167954  7486 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:31.168115  7772 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:30.977273  7738 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:31.096417  7560 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:31.187523  3209 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:17:31.185375  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:31.189198  3207 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:31.102020  7752 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:31.196367  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:31.198787  3133 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:31.128176  7789 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:31.199688  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:31.172679  7738 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.160306  7790 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:31.206671  3207 raft_consensus.cc:1217] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 10.10->[11.11-11.11]   Dedup: 11.11->[]
I20260709 13:17:31.207140  3207 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:17:31.155912  7355 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.209122  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:31.209863  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.210016  3136 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:31.198782  7752 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.249913  3128 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:31.211354  3131 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:31.210599  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:31.259215  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.271972  3277 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:31.214720  7480 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.210886  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.201850  7737 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:31.256011  3805 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:31.252908  7790 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:31.295051  3134 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:31.295780  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.296084  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.295953  7790 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:31.296798  7851 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.297786  3205 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:17:31.250911  7828 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:31.249332  7772 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.299217  7560 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:31.299476  7772 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:31.297510  7851 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:31.302606  7772 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:31.205451  7738 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:31.299628  7591 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.269795  7752 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.327000  3206 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:31.333750  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.334617  3136 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:31.335422  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.336040  3136 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:31.337448  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.337858  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.338162  3127 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:31.339423  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:31.339896  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:31.340309  3284 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
W20260709 13:17:31.340844  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 46045.6us
I20260709 13:17:31.341262  3211 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:31.336805  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.340667  3281 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:31.345338  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:31.346125  3276 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:31.346438  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:31.346572  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:31.347445  3283 raft_consensus.cc:2410] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 12 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:17:31.348233  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:31.348961  3278 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:31.350061  3277 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:31.350059  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:31.351470  3280 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:31.318874  7746 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:31.311053  7772 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:31.352011  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:31.360201  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:31.369230  7355 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:31.369412  7772 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.371620  7772 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:31.296828  7480 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.373955  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:31.380935  3836 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:31.382378  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:31.398252  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:31.400022  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 48086.2us
I20260709 13:17:31.406032  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.409319  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:31.411966  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.412341  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:31.412865  3130 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.415212  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:31.406253  3102 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:31.380966  7838 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:31.381039  7355 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:31.421802  3284 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:31.367226  7746 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.373772  7677 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:31.447198  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 233712us
I20260709 13:17:31.450248  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:31.455730  3280 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:31.408528  7663 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:31.461120  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:31.442072  7868 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:31.468189  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.470140  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:31.484795  3280 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.488129  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:31.489012  7665 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.489411  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:31.489535  7665 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.491263  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:31.491506  7665 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:31.480669  3135 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
W20260709 13:17:31.482999  7860 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:17:31.446724  7838 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:31.484161  7744 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:31.525770  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:31.482216  7865 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:31.483420  7677 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:31.481931  7851 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:31.532681  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 63508.3us
I20260709 13:17:31.534593  3210 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:31.496277  7486 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:31.527552  7744 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.545722  7744 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.547924  3280 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:31.559660  3207 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:31.479121  7663 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.573683  7867 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.594316  7867 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:31.597625  3101 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:31.597754  7867 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:31.578183  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:31.601186  3280 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:31.601537  7677 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:31.602748  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:31.604313  7735 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:31.603765  3280 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:31.604369  3101 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:31.631801  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 182806us
I20260709 13:17:31.633821  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:31.627380  7853 log.cc:927] Time spent T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 13:17:31.485146  7355 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:31.638090  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 231902us
I20260709 13:17:31.638422  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:31.665208  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.549548  7865 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.676894  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:31.632709  7866 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:31.628925  7746 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:31.633922  7464 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:17:31.654273  7859 log.cc:927] Time spent T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.263s	user 0.001s	sys 0.001s
W20260709 13:17:31.679028  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 293503us
I20260709 13:17:31.606987  7486 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.677601  3280 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:31.653831  7591 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:31.638319  7851 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 13:17:31.688005  7720 consensus_meta.cc:287] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.648s	user 0.005s	sys 0.009s
I20260709 13:17:31.691251  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:31.693012  7656 consensus_meta.cc:287] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.795s	user 0.007s	sys 0.006s
I20260709 13:17:31.692849  7746 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:31.746130  7861 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:17:31.778033  7847 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.788519  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1986) took 1028 ms. Trace:
I20260709 13:17:31.739758  7480 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:31.801445  7875 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:17:31.804333  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:31.809262  7870 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:17:31.810412  7663 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:31.811197  7717 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.776580  7656 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:31.745844  7720 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.700608  7871 consensus_queue.cc:1059] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 13:17:31.798359  7847 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:31.816205  7878 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.818544  7486 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:31.777493  7591 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:31.821218  7751 consensus_meta.cc:287] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.756s	user 0.012s	sys 0.000s
I20260709 13:17:31.697568  7864 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:17:31.826983  7738 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:31.827642  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 3103) took 1001 ms. Trace:
I20260709 13:17:31.700470  7790 consensus_queue.cc:1059] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:17:31.828878  3280 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
W20260709 13:17:31.835884  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 157405us
I20260709 13:17:31.837600  3130 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:31.787318  7560 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.889465  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:31.889328  7560 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:31.890128  3280 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:31.890470  7738 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:31.891597  7560 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:31.688992  7866 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:31.896603  7866 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:31.834430  7745 consensus_meta.cc:287] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.003s
W20260709 13:17:31.862641  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 161780us
I20260709 13:17:31.897406  7745 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.864059  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:31.899123  3210 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:31.899969  7745 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:31.900174  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:31.901019  3210 raft_consensus.cc:2393] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 10: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:31.901961  7864 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:31.902387  7864 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:31.902791  7864 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.905817  7790 raft_consensus.cc:3055] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:31.906325  7790 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:31.906526  7855 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.401s	user 0.003s	sys 0.000s
I20260709 13:17:31.907509  7790 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.910478  7847 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:31.910777  7737 raft_consensus.cc:3055] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:31.911156  7737 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:31.912034  7737 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.912556  7720 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:31.912757  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:31.913389  3211 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:31.914672  7656 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:31.872366  7878 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.917919  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:31.866447  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:31.867328  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:31.872362  3129 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
W20260709 13:17:31.857717  7752 consensus_meta.cc:287] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.006s
W20260709 13:17:31.859959  7876 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:17:31.877449  3202 rpcz_store.cc:276] 0709 13:17:30.826591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.827299 (+   708us) service_pool.cc:224] Handling call
0709 13:17:30.851742 (+ 24443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:30.923965 (+ 72223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:30.924011 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:30.953459 (+ 29448us) log.cc:844] Serialized 26 byte log entry
0709 13:17:31.192222 (+238763us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:31.192262 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.192321 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:31.827423 (+635102us) raft_consensus.cc:1685] finished
0709 13:17:31.827446 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.827582 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46720,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":90,"spinlock_wait_cycles":49920,"thread_start_us":226665,"threads_started":1,"wal-append.queue_time_us":359606}
I20260709 13:17:31.792567  3204 rpcz_store.cc:276] 0709 13:17:30.759807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.759953 (+   146us) service_pool.cc:224] Handling call
0709 13:17:30.760374 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:30.767499 (+  7125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:30.767535 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:30.772473 (+  4938us) log.cc:844] Serialized 26 byte log entry
0709 13:17:31.100793 (+328320us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:31.100836 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.100930 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:31.788135 (+687205us) raft_consensus.cc:1685] finished
0709 13:17:31.788187 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.788428 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8870,"raft.queue_time_us":6852,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":5130,"thread_start_us":302342,"threads_started":1,"wal-append.queue_time_us":524396}
I20260709 13:17:31.873766  7751 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.922997  3134 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 13: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:31.919569  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:31.924042  3250 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:31.926928  3211 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:31.930676  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 1985) took 1171 ms. Trace:
W20260709 13:17:31.933897  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 242782us
I20260709 13:17:31.859581  7717 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:31.909034  7790 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:31.887940  7838 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:31.931191  3208 rpcz_store.cc:276] 0709 13:17:30.759513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.759647 (+   134us) service_pool.cc:224] Handling call
0709 13:17:30.771487 (+ 11840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:30.785345 (+ 13858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:30.785372 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:30.804308 (+ 18936us) log.cc:844] Serialized 26 byte log entry
0709 13:17:31.121917 (+317609us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:31.121977 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.122072 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:31.906109 (+784037us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b24001b7748. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b8f889c4 00007fb3b8f86acb 00007fb3b9141dc9 00007fb3b9141a55 00007fb3b914109d 00007fb3bbd7310e 00007fb3bbd8a88c 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221
0709 13:17:31.920464 (+ 14355us) raft_consensus.cc:1685] finished
0709 13:17:31.920486 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.930602 (+ 10116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8949,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":8849,"spinlock_wait_cycles":28479232,"thread_start_us":299779,"threads_started":1,"wal-append.queue_time_us":625250}
I20260709 13:17:31.930753  7682 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:31.953266  7464 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.953830  7464 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.956051  7464 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:31.925813  7737 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.956718  7738 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:31.959522  7717 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:31.965509  3282 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:31.966548  7773 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:31.968544  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:31.875659  7591 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:31.994019  7865 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:31.995813  7591 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:31.969628  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 45658.9us
I20260709 13:17:31.997283  3250 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:31.927130  7752 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:31.999986  7752 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:32.000872  3131 raft_consensus.cc:2393] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:31.917938  7878 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:31.974877  3135 raft_consensus.cc:1240] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:31.974970  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.976068  7656 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:31.985581  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:31.932255  7866 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:17:32.014684  7656 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:31.949906  7745 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.015818  7745 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.002127  3206 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:31.985673  7738 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.001817  7717 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:32.014081  7751 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:31.950685  7739 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:32.018042  3130 raft_consensus.cc:2410] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:17:32.017060  7656 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:32.109032  7717 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:32.070598  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.062937  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.109035  7739 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.110638  7739 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.037357  7738 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:32.005438  3127 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:32.070972  3203 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:17:32.051972  3176 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:32.114601  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:32.085597  3276 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 13:17:32.117401  7773 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:32.118664  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 66838.3us
I20260709 13:17:32.121114  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:32.121157  7739 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:32.054570  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 57353.1us
I20260709 13:17:32.124744  7739 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:32.125236  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:32.127986  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.128567  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.129232  3130 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:32.129478  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.130048  3136 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:32.132558  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:32.133028  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.133397  3136 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:32.133762  3130 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:32.134373  7773 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:32.134859  7773 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.135390  7773 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.142369  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:32.143944  7591 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:32.063496  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 298080us
I20260709 13:17:32.032922  7884 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:32.034327  7889 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:32.035815  7897 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.088451  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 152788us
I20260709 13:17:32.049090  7866 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:32.002599  7856 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:32.144537  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:32.169958  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.177229  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:32.178053  3130 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:32.106423  7745 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:32.144591  7591 raft_consensus.cc:697] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:32.176469  3249 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:32.087218  7871 consensus_queue.cc:1059] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:17:32.188129  3249 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:32.152052  7682 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:32.164845  7884 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.189704  7884 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.190143  3836 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:32.191841  3836 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:32.193811  3836 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:32.187120  3250 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:32.175582  7739 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:32.198493  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:32.200362  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.201292  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:32.203048  3281 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:32.209956  3836 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:32.174063  7898 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.215969  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.215893  7898 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.218509  7898 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:32.188159  7891 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:32.174015  7897 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.219408  7667 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:32.219218  7891 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.176834  7486 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:32.222000  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:32.222590  3835 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:32.210575  3281 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:32.224750  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:32.226548  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.227056  3282 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:32.228274  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.228690  3276 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:17:32.228950  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.230189  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:32.230841  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:32.231604  3836 raft_consensus.cc:2393] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 14: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:32.228925  3210 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:32.231984  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:32.179587  7866 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.241691  7900 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:32.244288  7900 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.244517  7866 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:32.244663  7900 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.236042  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:32.245471  3282 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:32.247468  7864 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.236852  3276 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:32.234467  7896 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.249384  7868 raft_consensus.cc:3055] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:32.225476  7486 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:32.201292  7745 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:32.242343  7717 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:32.249622  7896 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.249874  7868 raft_consensus.cc:740] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:32.257339  7896 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:32.257666  7862 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.907s	user 0.000s	sys 0.004s
I20260709 13:17:32.256894  7868 consensus_queue.cc:260] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.248917  3835 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:32.250432  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.263463  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.263226  7591 consensus_queue.cc:237] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.253710  7890 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:32.264781  7890 raft_consensus.cc:697] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:32.265756  7890 consensus_queue.cc:237] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.254853  3834 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:32.271337  3130 raft_consensus.cc:2410] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:32.221676  7889 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:32.277566  7910 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:32.253917  7355 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:32.278082  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.278815  7355 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.279419  7355 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.278326  7910 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.280598  7910 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:32.281148  7889 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:32.281635  7889 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:32.253300  7768 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 13:17:32.284024  7885 log.cc:927] Time spent T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.467s	user 0.003s	sys 0.000s
I20260709 13:17:32.294989  3203 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:32.289292  3101 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:32.277876  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:32.317265  3133 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.289582  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.312631  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:32.318053  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:32.316277  3282 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:17:32.319252  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.319432  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.318881  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:32.253691  7683 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.286060  7744 consensus_meta.cc:287] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.740s	user 0.011s	sys 0.002s
I20260709 13:17:32.328056  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:32.321945  3282 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:32.330160  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.322710  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 524) took 1210 ms. Trace:
I20260709 13:17:32.331502  3834 raft_consensus.cc:2393] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:32.272425  7486 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:32.317402  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 202671us
I20260709 13:17:32.330933  3205 rpcz_store.cc:276] 0709 13:17:31.112035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.174725 (+ 62690us) service_pool.cc:224] Handling call
0709 13:17:31.195379 (+ 20654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.298248 (+102869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.322355 (+1024107us) spinlock_profiling.cc:243] Waited 95.5 ms on lock 0x7b5400247554. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:32.322627 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219725184}
I20260709 13:17:32.332386  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:32.333169  3838 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:32.324543  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.334301  3128 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
W20260709 13:17:32.335287  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.335602  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.327773  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:32.327162  3249 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:32.285145  7897 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:32.342885  3837 raft_consensus.cc:2393] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 10: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:32.345906  3128 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:32.348217  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.348762  3806 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:32.314746  7838 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.352761  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:32.357792  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:32.323706  7656 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:32.365454  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:32.350191  7891 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:32.380416  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.381304  3130 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:32.361007  7656 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.344929  7683 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.385386  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:32.360582  7897 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:32.382381  7908 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:32.348155  7878 consensus_queue.cc:1059] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:17:32.363994  7892 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.386037  3835 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:32.344748  7744 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.358441  7838 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.377790  7864 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:32.401453  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:32.377513  7894 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:32.407989  7894 raft_consensus.cc:697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:32.408928  7894 consensus_queue.cc:237] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.405934  7789 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:32.410351  7789 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.413487  7789 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:32.384388  7656 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.388607  7897 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:32.422168  7897 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.414791  7892 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.434572  3136 raft_consensus.cc:2368] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11.
I20260709 13:17:32.424515  3276 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:17:32.405237  3834 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:32.433528  7848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.378s	user 0.039s	sys 0.054s
I20260709 13:17:32.436161  3102 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:32.384351  7773 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.449294  3102 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:32.450598  7872 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:32.451458  7464 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:32.447911  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:32.434428  7790 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:32.453652  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 145257us
I20260709 13:17:32.456223  3834 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:32.458317  3133 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
W20260709 13:17:32.443822  7848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.394s	user 0.039s	sys 0.055s
I20260709 13:17:32.463824  3133 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:32.465411  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:32.466480  7656 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.472458  7683 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:32.457132  7790 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:32.475030  7920 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:17:32.468763  7892 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:32.495319  7872 raft_consensus.cc:697] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:32.495780  7464 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:32.499756  3133 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:32.458019  7355 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.502099  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:17:32.509460  7918 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:17:32.517685  7744 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:32.518093  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 1887) took 1412 ms. Trace:
I20260709 13:17:32.518458  3132 rpcz_store.cc:276] 0709 13:17:31.096032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.096164 (+   132us) service_pool.cc:224] Handling call
0709 13:17:31.124744 (+ 28580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:31.162571 (+ 37827us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:31.189068 (+ 26497us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.400577 (+1211509us) spinlock_profiling.cc:243] Waited 45.2 ms on lock 0x7b1800087820. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f23a 00007fb3bc1f9a2a
0709 13:17:32.507690 (+107113us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.508269 (+   579us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:32.508318 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:32.508366 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.508428 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.508528 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":307,"prepare.queue_time_us":29361,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":18695,"spinlock_wait_cycles":114117248,"thread_start_us":106510,"threads_started":2,"wal-append.queue_time_us":1267480}
I20260709 13:17:32.520800  7464 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.521512  7656 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:32.525362  7838 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:32.526365  7486 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.532481  7790 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:32.535590  7355 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:32.545087  7851 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.545784  7851 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.546706  7900 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.536053  7486 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:32.548810  7900 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:32.549393  7851 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:32.549392  3832 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 12: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:32.551870  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:32.552450  3834 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:32.525362  7773 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:32.551601  3177 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:32.556396  3177 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:32.577708  7790 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:32.577886  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:32.578415  7790 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:32.578998  7790 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:32.580674  7355 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:32.581485  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2804) took 1220 ms. Trace:
I20260709 13:17:32.583319  7665 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:32.581929  3284 rpcz_store.cc:276] 0709 13:17:31.360592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.482105 (+121513us) service_pool.cc:224] Handling call
0709 13:17:31.482464 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.482874 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.482911 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:31.491423 (+  8512us) log.cc:844] Serialized 26 byte log entry
0709 13:17:31.662645 (+171222us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:31.686215 (+ 23570us) log.cc:844] Serialized 14 byte log entry
0709 13:17:31.729766 (+ 43551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.729883 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:32.422974 (+693091us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b18003b3500. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:32.579079 (+156105us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b24003966c8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b8f889c4 00007fb3b8f86acb 00007fb3b9141dc9 00007fb3b9141a55 00007fb3b9140fb0 00007fb3bbdb7488 00007fb3bbdb7be8 00007fb3bbd8f398 00007fb3bbd8a76a 00007fb3bbd89bb6
0709 13:17:32.581161 (+  2082us) raft_consensus.cc:1685] finished
0709 13:17:32.581191 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.581376 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8248,"prepare.queue_time_us":26817,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":106159,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":16178,"spinlock_wait_cycles":27027584,"thread_start_us":206362,"threads_started":2,"wal-append.queue_time_us":205913}
I20260709 13:17:32.584050  7665 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:32.585011  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1893) took 1300 ms. Trace:
I20260709 13:17:32.585410  3131 rpcz_store.cc:276] 0709 13:17:31.284770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.295798 (+ 11028us) service_pool.cc:224] Handling call
0709 13:17:32.584769 (+1288971us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54003dbb54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:32.584919 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1618908032}
I20260709 13:17:32.590274  3251 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:32.592172  7867 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:32.592578  7867 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.592960  7867 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.594367  7904 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:32.599270  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.600265  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1608) took 1220 ms. Trace:
I20260709 13:17:32.602265  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.603175  3204 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 16: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:32.600795  3134 rpcz_store.cc:276] 0709 13:17:31.379644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.380141 (+   497us) service_pool.cc:224] Handling call
0709 13:17:32.600004 (+1219863us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b540032ebd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:32.600185 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1186697600}
I20260709 13:17:32.600116  3209 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:32.606437  3209 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:32.611982  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:32.544668  7897 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.616237  3209 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 13: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:32.619719  3250 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:32.624158  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:32.625279  3209 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.626799  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.629177  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.625782  3100 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:32.637558  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 278715us
I20260709 13:17:32.638332  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:32.600559  7908 raft_consensus.cc:697] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:32.624552  7562 raft_consensus.cc:3055] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:32.626766  7682 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.601161  7866 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:17:32.565265  7910 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.642520  3279 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:32.651100  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2795) took 1307 ms. Trace:
I20260709 13:17:32.643483  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:32.644111  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:32.652554  3211 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.653566  7884 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.655660  7884 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:32.624230  7735 consensus_queue.cc:1059] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:17:32.651563  3279 rpcz_store.cc:276] 0709 13:17:31.343297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.343459 (+   162us) service_pool.cc:224] Handling call
0709 13:17:32.639783 (+1296324us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b5800160e98. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:17:32.639998 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.650762 (+ 10764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.651026 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11657600}
W20260709 13:17:32.656767  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 165278us
I20260709 13:17:32.640316  7894 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:17:32.661621  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.642443  7562 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:32.666806  7562 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.667784  7562 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:32.649616  7866 consensus_queue.cc:1243] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer 0930e3e7657c43bcaaa5b0778f3e08cf log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:32.645000  7665 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:32.672616  3249 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:32.676126  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 56497.8us
I20260709 13:17:32.678809  3211 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:32.679991  7877 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:32.680429  7877 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.680812  7877 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.681118  7893 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:17:32.682632  7932 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:32.683624  7932 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.684429  7932 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.661198  7751 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:32.686035  7897 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:32.689688  7868 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.693156  7877 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:32.693619  3129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 1886) took 1603 ms (client timeout 2085 ms). Trace:
W20260709 13:17:32.694000  3129 rpcz_store.cc:269] 0709 13:17:31.090418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.099696 (+  9278us) service_pool.cc:224] Handling call
0709 13:17:32.693455 (+1593759us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b54002a9ed4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:32.693562 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1623090432}
I20260709 13:17:32.695132  3100 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:32.604316  7872 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.697839  7926 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:32.698410  7926 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:32.698685  7873 raft_consensus.cc:3055] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:32.699143  7873 raft_consensus.cc:740] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:32.699602  7865 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:32.699883  7873 consensus_queue.cc:260] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.699383  7926 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.701848  7873 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.702381  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:32.703357  7891 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:32.703730  7891 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:32.704063  7891 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.705744  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.649948  7682 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.707050  7865 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:32.707247  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.707609  7865 raft_consensus.cc:697] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:32.707924  3204 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:32.707617  7682 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:32.708943  7865 consensus_queue.cc:237] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.712312  3100 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:32.713721  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.714450  3206 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:32.715920  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.716440  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:32.717306  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.717058  3204 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:32.718595  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:32.699894  3251 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:32.728035  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:32.728830  3276 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:32.735329  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:32.736119  3284 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.738864  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.740772  7486 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:32.741505  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.742146  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.746486  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.744999  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:32.742879  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.641651  7889 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.747871  3207 raft_consensus.cc:2393] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 10: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:32.749724  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:32.750046  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 70610.3us
I20260709 13:17:32.756399  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:32.753226  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:32.756942  3277 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.759088  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:32.758394  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.759635  3206 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:32.759987  3281 raft_consensus.cc:2368] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17.
I20260709 13:17:32.763718  3100 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:32.765488  3202 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:17:32.766108  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:32.766422  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.721526  7897 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:32.767472  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.746559  3205 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:17:32.768965  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.771111  3840 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:32.764894  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.769477  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:32.776580  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:32.746851  7894 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:32.788980  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.785156  3282 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:32.790132  6835 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:32.791019  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.791887  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:32.725515  7898 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:17:32.791389  7869 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:32.816246  7869 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:32.816670  7869 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.800979  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.802759  3837 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:17:32.808240  7910 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:32.809916  7560 raft_consensus.cc:3055] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:17:32.813773  7939 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:32.796597  7561 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:32.835726  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:32.815423  7888 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:32.774983  7737 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:32.822310  3209 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:32.746999  7878 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:17:32.825678  3280 raft_consensus.cc:2393] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:32.825788  3284 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:32.848330  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.849488  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.826645  3206 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:17:32.705595  7908 consensus_queue.cc:237] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.851205  7682 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:32.851945  7682 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.830787  3806 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:32.789001  7894 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.853973  7894 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.855257  7682 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:32.837162  6835 raft_consensus.cc:697] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:32.856848  6835 consensus_queue.cc:237] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:32.789189  7871 consensus_queue.cc:1059] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:17:32.860004  3835 raft_consensus.cc:1217] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Deduplicated request from leader. Original: 6.8->[8.9-13.11]   Dedup: 8.9->[11.10-13.11]
I20260709 13:17:32.861450  3835 pending_rounds.cc:85] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 9
I20260709 13:17:32.861661  3835 pending_rounds.cc:107] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:17:32.861873  3835 raft_consensus.cc:2889] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:32.789409  7789 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:17:32.836671  3840 raft_consensus.cc:2410] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:17:32.757172  7486 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.845783  3277 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:32.801062  3135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d682925c4b46799576472fe9f97a07"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:32.894755  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:32.895390  3277 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.867156  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:32.828863  7560 raft_consensus.cc:740] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:32.870275  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:32.901794  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.894586  3135 raft_consensus.cc:606] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:32.845623  7888 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.922789  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:32.923020  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:32.923586  3280 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:32.923590  3133 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:17:32.925921  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 58897.1us
I20260709 13:17:32.928754  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.929013  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.929986  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:32.930583  3134 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:17:32.933490  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:32.936038  7486 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:32.860590  7900 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:32.927666  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:32.898669  7893 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:32.944006  3806 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:32.919150  7682 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:32.925101  7939 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:32.953267  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:32.954910  3209 raft_consensus.cc:1240] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:32.956861  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:32.957746  7866 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:32.926465  7888 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:32.938090  7656 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.970608  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:32.939352  7887 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:32.969455  3806 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:32.968659  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:32.972467  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:32.973618  3202 raft_consensus.cc:2376] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11. Re-sending same reply.
I20260709 13:17:32.966784  3101 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:32.982935  3101 leader_election.cc:400] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17.
I20260709 13:17:32.983282  3101 leader_election.cc:403] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:32.965426  7847 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:32.965631  7898 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.006569  3280 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:33.007560  7925 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:17:32.980242  7851 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:33.012666  3134 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:17:33.015040  7790 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.016361  7893 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:32.974407  7866 raft_consensus.cc:697] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:33.006011  3277 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:33.008059  7916 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:32.977496  7887 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:32.990837  7899 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:33.022585  7847 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.977314  7656 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.036330  7925 consensus_queue.cc:1243] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer 48080cf0460346769ab046a4f9457aa5 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:33.020785  7560 consensus_queue.cc:260] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.052978  3211 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:33.056141  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:33.060647  3277 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 13: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:33.061755  7560 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:33.052373  7916 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.039292  7464 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17.
I20260709 13:17:33.038623  7898 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.045399  7893 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.064194  7916 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:33.065203  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:33.066179  7898 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:33.072232  3277 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:33.076766  3277 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:33.079653  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.075124  7932 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.050993  7889 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:33.055840  7847 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:33.037999  7891 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.089972  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:33.113199  3279 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:33.119557  3278 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:33.111155  7940 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:17:33.107357  7867 consensus_meta.cc:287] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.001s
W20260709 13:17:33.126632  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 143852us
I20260709 13:17:33.139688  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:33.146739  3101 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:33.150940  6835 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:33.152608  3101 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:33.102670  7893 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:33.167848  7941 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:17:33.169962  7932 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:33.115334  7916 consensus_queue.cc:1059] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:17:33.170832  7926 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:33.149626  7925 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:33.173477  7947 log.cc:927] Time spent T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:17:33.102054  7866 consensus_queue.cc:237] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.171877  7895 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:33.195066  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:33.143944  7867 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.193826  3277 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:33.210157  3285 raft_consensus.cc:1217] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 10.5->[11.6-15.8]   Dedup: 11.6->[14.7-15.8]
I20260709 13:17:33.213423  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:33.211328  3285 pending_rounds.cc:85] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 6
I20260709 13:17:33.215968  3285 pending_rounds.cc:107] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:17:33.216214  3285 raft_consensus.cc:2889] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:33.174264  7735 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:17:33.219255  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:33.220942  3276 raft_consensus.cc:2368] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13.
I20260709 13:17:33.221349  3131 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:17:33.222240  3130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:33.223047  3130 raft_consensus.cc:606] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:33.223461  3130 raft_consensus.cc:614] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:33.223541  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:33.224161  3840 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.227324  3277 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:33.229179  3806 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:33.216167  7790 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:33.224377  7562 consensus_meta.cc:287] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.553s	user 0.014s	sys 0.000s
I20260709 13:17:33.234519  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:33.237784  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:33.238495  3284 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:33.238417  3133 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.240091  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:33.240571  3136 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.242202  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:33.243024  3127 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 13: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:33.244347  3127 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:33.248098  3278 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:33.249284  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:33.249505  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:33.249568  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:33.250948  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:33.256922  7847 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.259536  7847 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:33.261651  7950 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:17:33.265700  7949 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:17:33.271200  7944 log.cc:927] Time spent T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.420s	user 0.002s	sys 0.000s
I20260709 13:17:33.271376  3136 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:33.234586  7924 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.235131  7868 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:33.265592  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.275450  3133 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:33.275104  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:33.284037  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:33.240984  7887 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:33.284400  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:33.289259  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:33.291210  3280 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:17:33.295852  7887 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:33.278215  7868 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.303424  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:33.286123  7891 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:33.306866  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:33.316661  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 705) took 1029 ms. Trace:
I20260709 13:17:33.301393  7871 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:33.291563  7924 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.295034  7752 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.315289  3280 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:33.317173  3282 rpcz_store.cc:276] 0709 13:17:32.286779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.347127 (+ 60348us) service_pool.cc:224] Handling call
0709 13:17:32.347434 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.790644 (+443210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.316425 (+525781us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b540005ffd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:33.316602 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005948800}
I20260709 13:17:33.309440  7868 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:33.321794  7955 log.cc:927] Time spent T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:17:33.326854  7893 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:33.349567  7945 log.cc:927] Time spent T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.495s	user 0.001s	sys 0.002s
I20260709 13:17:33.350909  7894 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.352111  3134 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:33.353662  7894 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:33.357515  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:33.357997  3834 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.342005  7867 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:33.363019  3282 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:17:33.330336  7752 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.364351  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:33.365803  7916 consensus_queue.cc:1059] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:33.366896  7916 raft_consensus.cc:3055] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:33.367209  7916 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:33.367439  7752 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:33.368124  7916 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.369438  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:33.370436  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:33.340034  7878 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 13:17:33.385468  7873 consensus_meta.cc:287] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.003s
I20260709 13:17:33.386338  3132 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:33.370059  3832 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:33.371057  3834 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:33.387799  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:33.378495  7916 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:33.391656  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:33.394481  3281 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:33.371958  7851 consensus_queue.cc:1059] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:17:33.373529  7869 consensus_meta.cc:287] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.003s
I20260709 13:17:33.376816  7877 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:33.377400  7887 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:33.378474  7888 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.379356  7926 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:33.382047  7924 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:33.400586  3837 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:17:33.404335  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 630023us
I20260709 13:17:33.405762  3277 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:33.406921  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:33.407296  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:33.407994  7892 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:33.408282  7561 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:33.400769  3251 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:33.409294  7561 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.412497  7864 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:33.413235  7789 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:33.413026  7864 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.413784  7789 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.415104  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:33.415405  7864 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:33.415988  7851 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:33.408612  7892 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.420291  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:33.402613  7869 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:33.426962  7953 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:17:33.423491  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:33.420269  7868 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.416842  7486 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.418972  3135 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:33.430697  7486 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.419216  7683 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:33.422418  3128 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:33.432694  7486 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:33.432855  7892 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:33.433549  3281 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:33.434001  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:33.434659  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:33.435415  7887 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:33.435855  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:33.436156  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:33.436439  3210 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:33.437132  7887 raft_consensus.cc:697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:33.437477  7877 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:33.438169  7768 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:33.438383  7887 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.438732  7768 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.439945  7773 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.416786  3805 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:33.440418  7773 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.441184  7851 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:33.442523  7773 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:33.442602  7772 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:33.443123  7772 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:33.428946  7869 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:33.444142  7772 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.417599  7790 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.451996  7790 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.419257  7560 raft_consensus.cc:3055] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:33.454201  7790 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:33.454276  7560 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:33.455297  7683 raft_consensus.cc:697] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:33.455694  7560 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.456435  7683 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.459340  3249 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:33.460569  3249 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:33.461030  7904 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:33.462421  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:33.463588  7893 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:33.464666  3835 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.469936  7772 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:33.471244  7656 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:33.415939  7789 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:33.474781  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:33.475450  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 62360.2us
I20260709 13:17:33.476127  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:33.477134  7890 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:33.477622  7890 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:33.478483  7890 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.483297  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:33.484185  3211 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:33.485505  3132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:33.486091  3132 raft_consensus.cc:606] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:33.490118  3132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:33.490535  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:33.492245  3208 raft_consensus.cc:2368] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13.
I20260709 13:17:33.492735  7868 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:33.495820  3250 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:33.415970  7864 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:33.501690  7867 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:33.502092  7864 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.505000  7656 raft_consensus.cc:993] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 48080cf0460346769ab046a4f9457aa5 to start an election
W20260709 13:17:33.505620  7943 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.470s	user 0.005s	sys 0.000s
I20260709 13:17:33.440724  7768 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:33.505702  7656 raft_consensus.cc:1081] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Signalling peer 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:17:33.529444  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:33.504988  7864 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:33.512535  3101 leader_election.cc:400] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13.
I20260709 13:17:33.517400  3840 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
W20260709 13:17:33.520181  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 59683.5us
I20260709 13:17:33.490693  3132 raft_consensus.cc:606] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:33.557771  3132 raft_consensus.cc:614] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:33.534166  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 51939.7us
I20260709 13:17:33.560776  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:33.507076  7560 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:33.541821  3211 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:33.536079  3210 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:33.579840  3202 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:17:33.569725  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:33.578321  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:33.581979  3206 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.587241  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:33.588187  3208 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:17:33.589520  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:33.585163  3835 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:33.590337  3203 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:33.592523  6835 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:33.593043  6835 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:33.593595  6835 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:33.600311  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:33.551944  7904 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:33.605654  3176 leader_election.cc:400] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11.
I20260709 13:17:33.606097  3176 leader_election.cc:403] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:33.562148  7591 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:33.608192  3281 raft_consensus.cc:1240] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:33.609066  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:33.609766  3284 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:33.625787  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:33.601869  7868 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.631279  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:33.631788  3206 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:33.635754  3203 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:17:33.636581  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:33.637634  3132 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:33.636185  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:33.628619  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:33.571929  7864 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:17:33.641992  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:33.577380  7773 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:17:33.642530  3128 raft_consensus.cc:2368] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13.
I20260709 13:17:33.568372  7893 consensus_queue.cc:1059] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:17:33.646720  3136 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:33.646889  3209 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:33.653806  3249 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:33.653393  3203 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:33.609364  7790 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11.
I20260709 13:17:33.603982  7789 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:33.585697  7961 consensus_queue.cc:1059] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:17:33.649420  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:33.626636  7904 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:33.674175  7904 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.612372  7892 consensus_queue.cc:1059] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:17:33.677333  7892 raft_consensus.cc:3055] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:33.642616  3284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:33906
I20260709 13:17:33.677716  7892 raft_consensus.cc:740] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:33.678164  3284 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:33.678531  3284 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:33.678596  7892 consensus_queue.cc:260] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.680066  7888 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:33.680573  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:33.681833  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:33.682346  7789 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:33.683594  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:33.684332  7789 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:33.685251  7884 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:33.662739  3836 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:17:33.657132  7959 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:33.686820  7959 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.687366  3133 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faebd952bf73433d84a3292167ecd165"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:33.687530  7893 raft_consensus.cc:3055] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:33.688089  7893 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:33.655184  7591 raft_consensus.cc:697] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:33.689194  7893 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.689760  7591 consensus_queue.cc:237] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.690727  3280 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:33.647421  7868 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.695406  7868 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:33.697283  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:33.665920  7790 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:33.657346  7873 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:33.669480  3136 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:17:33.686239  7486 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:33.698246  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.711719  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 46330.3us
I20260709 13:17:33.684852  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:33.702747  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:33.712865  3209 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:33.703732  7464 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:33.723582  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:33.724646  3840 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:33.729452  3211 raft_consensus.cc:1240] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:33.729483  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 44713.8us
W20260709 13:17:33.730996  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 77277.3us
I20260709 13:17:33.733477  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:33.689006  7959 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:33.741775  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:33.742241  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:33.740917  3284 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.744179  3210 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:17:33.744593  3210 pending_rounds.cc:85] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 6
I20260709 13:17:33.744416  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:33.744828  3210 pending_rounds.cc:107] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:17:33.745126  3210 raft_consensus.cc:2889] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:33.745296  3278 raft_consensus.cc:2410] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:17:33.745453  3210 pending_rounds.cc:107] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:17:33.745774  3210 raft_consensus.cc:2889] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:33.743434  7582 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:33.748302  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:33.707578  7873 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.756058  3805 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:33.757236  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:33.758100  3202 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:17:33.761312  3249 leader_election.cc:400] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13.
I20260709 13:17:33.761271  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:33.761790  3249 leader_election.cc:403] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:17:33.762061  3134 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:33.718238  7789 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.774187  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:33.763829  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:33.776667  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:33.777343  3205 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
W20260709 13:17:33.781816  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 146362us
W20260709 13:17:33.785279  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 132770us
I20260709 13:17:33.786203  7464 consensus_queue.cc:1059] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:33.786468  7656 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:33.787439  7464 raft_consensus.cc:3055] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:33.787978  3205 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:33.766434  7898 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:33.788585  7898 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:33.789000  7898 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.763226  7864 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:17:33.784823  3284 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:33.791788  7768 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:33.792121  7864 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:33.794708  3177 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:33.787912  7464 raft_consensus.cc:740] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:33.795975  7864 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:33.797034  7464 consensus_queue.cc:260] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.797695  3177 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:33.798414  7464 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.798941  7864 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:33.801903  3836 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:33.802325  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:33.764667  3805 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:33.806416  7851 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:33.807036  7851 raft_consensus.cc:697] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:33.808139  7851 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.817561  7960 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:33.819159  3100 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:33.821295  7656 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:33.824297  3840 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:17:33.825053  3100 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:33.825881  7864 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:33.748409  7582 consensus_queue.cc:1243] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer fc48eecc27554cb58b15193cd442b1d3 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:33.832711  7737 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:33.836031  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:33.764992  7873 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:33.843569  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:33.855234  3135 raft_consensus.cc:3055] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:33.843884  3132 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:33.747079  7888 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:33.749564  7790 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:33.870345  7790 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:33.871281  7790 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.737931  7838 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:33.845112  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:33.845649  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:33.873638  3211 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:33.845973  3210 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:33.828826  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 64239.8us
W20260709 13:17:33.874387  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 117108us
I20260709 13:17:33.849556  3840 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:17:33.875887  3133 raft_consensus.cc:606] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:33.876277  3133 raft_consensus.cc:614] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:33.855590  3135 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:33.849848  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:33.837270  3806 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:33.784449  7847 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:33.857450  7864 raft_consensus.cc:3055] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:33.869380  7965 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:17:33.873373  7838 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.874797  7889 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13.
I20260709 13:17:33.857221  7960 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:33.852893  6835 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.748297  7964 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 13:17:33.880900  3135 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:33.911020  3135 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:33.889441  3100 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:33.915328  6835 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:33.916587  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 63615.8us
I20260709 13:17:33.882784  7864 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:33.889410  7916 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:33.846668  7789 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.987279  7789 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:33.988458  3207 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:33.988658  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:33.989454  3838 raft_consensus.cc:2393] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 14: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:33.883042  7884 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:33.992128  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:33.944036  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 54690.4us
I20260709 13:17:33.944612  7751 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:33.950755  7916 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:33.957489  7866 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:33.963382  7838 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:33.963153  7898 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:33.966429  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:33.979574  7961 raft_consensus.cc:3055] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:33.982283  7960 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.983503  7890 raft_consensus.cc:3055] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:33.992869  3840 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:33.908512  7869 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:33.883210  7887 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:17:34.000267  3100 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:34.019627  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 144559us
I20260709 13:17:34.009877  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:34.010468  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:34.010602  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:34.011314  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:34.024583  3130 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:17:34.051743  3249 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:34.006031  7961 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:33.999511  7789 consensus_queue.cc:1059] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:17:34.010321  7960 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:34.001490  7560 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:34.011768  7868 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:34.001019  7735 consensus_queue.cc:1059] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:17:34.060760  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:34.058133  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:34.074108  3211 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:34.012583  7890 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:34.025123  7464 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:34.082341  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:34.076923  3135 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:34.005446  7866 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:34.023456  7869 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:34.075176  7974 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:34.120554  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:34.083935  7772 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:34.085459  7464 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.188611  3280 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:34.088428  7877 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:34.184407  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:34.184484  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:34.187355  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:34.198551  3277 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:34.027014  7864 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.192009  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:34.146093  7889 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:34.096562  7562 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:34.194782  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:34.217519  3211 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.207369  3840 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:34.146341  7865 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:34.116102  7888 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:17:34.189530  7974 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:34.232626  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:34.088143  7560 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:34.181718  7968 log.cc:927] Time spent T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:17:34.239948  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:34.098059  7891 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:17:34.188192  7464 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.261451  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:34.181622  7772 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.277931  3284 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:34.232646  7904 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:34.289602  3211 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:34.115681  7916 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.147056  7961 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.240937  7877 raft_consensus.cc:697] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:34.260789  7562 raft_consensus.cc:697] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:34.249130  7865 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.293092  7864 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.198421  7890 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.297358  7884 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.353211  3840 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:34.370472  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.388078  7993 log.cc:927] Time spent T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:17:34.387713  7562 consensus_queue.cc:237] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:34.392544  7772 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:34.393138  7977 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:17:34.394322  7560 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:34.384209  7963 log.cc:927] Time spent T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:34.396304  7990 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:17:34.396891  7976 log.cc:927] Time spent T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 13:17:34.397495  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2828) took 1224 ms. Trace:
W20260709 13:17:34.398216  7982 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:17:34.399300  7979 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260709 13:17:34.401263  7981 log.cc:927] Time spent T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
I20260709 13:17:34.396930  7990 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:34.404597  7978 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.296s	user 0.001s	sys 0.001s
I20260709 13:17:34.397874  3285 rpcz_store.cc:276] 0709 13:17:33.173179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.173555 (+   376us) service_pool.cc:224] Handling call
0709 13:17:33.195187 (+ 21632us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:33.219983 (+ 24796us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:33.346257 (+126274us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.730814 (+384557us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:33.745980 (+ 15166us) log.cc:844] Serialized 52 byte log entry
0709 13:17:33.746141 (+   161us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:33.759978 (+ 13837us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.784067 (+ 24089us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.784307 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.784419 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:34.273518 (+489099us) spinlock_profiling.cc:243] Waited 8.4 ms on lock 0x7b180043cfc0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:34.397270 (+123752us) raft_consensus.cc:1685] finished
0709 13:17:34.397293 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.397434 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91536,"prepare.queue_time_us":676806,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":5325,"raft.queue_time_us":52381,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":16510,"spinlock_wait_cycles":24326272,"thread_start_us":447685,"threads_started":2,"wal-append.queue_time_us":521917}
I20260709 13:17:34.406286  7877 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.414927  7772 consensus_queue.cc:1059] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:34.361198  7884 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.416965  7893 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.426468  7560 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.416730  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:34.427021  7560 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.427676  3836 raft_consensus.cc:2393] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:34.419673  7866 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:34.418128  7951 raft_consensus.cc:3055] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:34.431394  7560 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:34.431962  7951 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:34.433435  7744 raft_consensus.cc:3055] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:34.433115  7951 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.433856  7744 raft_consensus.cc:740] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:34.315717  7904 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.465723  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:34.466491  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:34.469038  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:34.469194  3281 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:34.476266  3281 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:17:34.479871  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:34.464743  7735 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.505548  7735 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.508153  7735 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:34.509472  7744 consensus_queue.cc:260] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:34.514715  7992 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:34.515436  7992 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:34.521963  7992 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:34.527644  7884 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:34.458213  7560 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:34.527720  7865 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:34.528700  7560 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:34.530072  7873 consensus_meta.cc:287] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.650s	user 0.012s	sys 0.000s
I20260709 13:17:34.530490  7873 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:34.531002  7560 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:34.532543  7873 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:34.470799  7951 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:34.539001  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:34.540935  3250 leader_election.cc:400] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13.
I20260709 13:17:34.539914  3838 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:34.468533  7682 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.544555  3251 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:34.544488  3102 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:34.545096  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 78695.1us
I20260709 13:17:34.477743  7888 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.558138  3838 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:34.563382  3250 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:34.553052  7751 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:34.569983  7751 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.570258  8005 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:34.570387  7751 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:34.368856  7974 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:34.571930  8005 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:34.547325  7588 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:34.587076  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:34.559140  7910 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:34.603354  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:34.606851  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:34.603606  7871 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.611815  7871 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.614307  7871 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:34.551505  7464 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.601970  7735 consensus_queue.cc:1059] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:17:34.617753  7735 consensus_queue.cc:1243] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Peer 48080cf0460346769ab046a4f9457aa5 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:34.618719  7904 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:34.620404  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:34.621034  3835 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:34.623067  7910 raft_consensus.cc:697] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:34.552625  7682 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:34.625900  7682 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:34.549120  7960 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:34.628108  7960 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:34.630029  7464 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:34.632418  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:34.561344  7866 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:17:34.633030  3837 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.633445  3835 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:34.624455  7910 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.638473  3285 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:34.562788  7888 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:34.605226  8005 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:34.658768  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2843) took 1063 ms. Trace:
I20260709 13:17:34.659554  3837 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:34.660772  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:34.662281  3131 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:34.661878  3282 rpcz_store.cc:276] 0709 13:17:33.595639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.596254 (+   615us) service_pool.cc:224] Handling call
0709 13:17:33.596685 (+   431us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:33.614434 (+ 17749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.614480 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:33.646739 (+ 32259us) log.cc:844] Serialized 52 byte log entry
0709 13:17:33.881028 (+234289us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:34.201108 (+320080us) log.cc:844] Serialized 14 byte log entry
0709 13:17:34.658257 (+457149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.658445 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:34.658494 (+    49us) raft_consensus.cc:1685] finished
0709 13:17:34.658508 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.658663 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106718,"prepare.queue_time_us":72160,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":183039,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":19029,"thread_start_us":914944,"threads_started":3,"wal-append.queue_time_us":333850}
I20260709 13:17:34.664428  7990 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:34.671361  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:34.672621  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:34.673713  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:34.678819  3210 raft_consensus.cc:2393] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 16: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:34.682865  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:34.687639  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:34.688498  3130 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:34.689308  7888 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:34.673434  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:34.691082  3204 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:34.692088  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:34.693796  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:34.692956  3204 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 13: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:34.696949  3210 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:17:34.700903  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:34.705461  3131 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:34.673069  7751 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.711431  7751 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:34.714432  3135 raft_consensus.cc:1240] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:34.717769  3136 pending_rounds.cc:85] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 6
I20260709 13:17:34.718204  3136 pending_rounds.cc:107] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:17:34.718446  3136 raft_consensus.cc:2889] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:34.719611  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:34.720186  3838 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:34.720899  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:34.698239  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:34.722714  3837 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:34.726846  3249 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:34.728421  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:34.729447  3127 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:34.719509  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:34.733050  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:34.696712  7893 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.658448  7588 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:17:34.712291  8005 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:34.760144  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:34.724059  7561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.008s	sys 0.016s
I20260709 13:17:34.813035  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:34.812222  3131 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:34.741722  3134 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:34.815451  3129 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:17:34.755646  7924 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.822770  3133 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:17:34.830322  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:34.792713  3282 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:34.832419  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:34.835122  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.761358  3285 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:34.759934  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:34.835981  3284 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:34.854357  3838 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:34.760946  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:34.856312  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:34.856626  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:34.862509  3276 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.789405  7683 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:34.867159  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:17:34.854254  7864 consensus_meta.cc:287] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.002s
W20260709 13:17:34.862366  7561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.008s	sys 0.020s
I20260709 13:17:34.756211  7884 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:34.805459  7838 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:17:34.877599  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:34.884289  3133 raft_consensus.cc:2368] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14.
I20260709 13:17:34.756018  7486 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:34.790289  7889 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:17:34.823599  7893 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:34.891404  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:34.893647  3129 raft_consensus.cc:2410] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:17:34.892417  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:34.869926  7683 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:34.903564  3203 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:34.903759  3836 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:17:34.912207  3250 leader_election.cc:400] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14.
I20260709 13:17:34.912622  3250 leader_election.cc:403] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:34.885823  7974 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:34.889705  7486 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.868170  7924 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:34.932767  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:34.886402  7998 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:34.917100  7683 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:34.920210  7974 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:34.942701  7974 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:34.956831  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.957916  8009 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:17:34.933291  8004 consensus_queue.cc:1059] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:17:34.969741  8004 raft_consensus.cc:3055] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:34.970212  8004 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:17:34.959527  8015 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:34.977720  3127 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:17:34.926363  7884 raft_consensus.cc:3055] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:34.930575  7486 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:34.980954  3203 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:34.977676  7998 raft_consensus.cc:697] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:34.997133  7998 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:34.998023  7893 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:34.979863  7884 raft_consensus.cc:740] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:35.017387  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:34.971114  8004 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:35.007407  7773 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:35.035569  7773 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:35.047453  7869 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:35.047765  7773 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:35.049984  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:35.051343  7951 consensus_meta.cc:287] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.001s
I20260709 13:17:35.052980  7924 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:35.053812  8004 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.061352  3128 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:35.068200  7869 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.045231  7884 consensus_queue.cc:260] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:35.069867  7869 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:35.070688  7884 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:35.072257  7869 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:35.080230  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:35.080938  3205 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:35.081048  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:35.081773  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:35.082159  3205 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:35.082741  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.083976  7867 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.084503  7867 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:35.085060  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:35.085675  3203 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:17:35.085741  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:35.086685  3203 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:35.086997  7867 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:35.087160  3208 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:35.089977  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:35.091392  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:35.092459  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:35.095355  7582 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:35.095976  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:35.097645  3203 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:35.096836  8024 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:17:35.101583  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:35.104085  7869 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:35.104313  7893 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:35.106173  7898 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:35.107753  3276 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:35.108300  8008 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14.
W20260709 13:17:35.109535  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.096285  8027 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:35.096649  7582 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:35.096999  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:35.108340  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 3151) took 1361 ms. Trace:
I20260709 13:17:35.110172  3250 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:35.113478  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:35.111918  3209 rpcz_store.cc:276] 0709 13:17:33.746652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.748807 (+  2155us) service_pool.cc:224] Handling call
0709 13:17:33.772038 (+ 23231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.620277 (+848239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.620305 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:34.620346 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:34.620376 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.108097 (+487721us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b540019e954. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:35.108139 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.108282 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1950220032}
I20260709 13:17:35.114588  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:35.118455  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:35.121340  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:35.114032  7656 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:35.122458  7656 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:35.123952  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:35.125415  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:35.125486  3133 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:17:35.126061  3135 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:35.126176  3129 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:35.127102  7752 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.127207  7893 consensus_queue.cc:1059] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:35.127655  7752 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:35.131040  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:35.132261  7974 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:35.133455  7904 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:35.135236  7974 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:35.125458  3130 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:35.145171  7887 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:35.145984  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:35.120393  7773 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:35.136482  7893 raft_consensus.cc:3055] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:35.147328  7893 raft_consensus.cc:740] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:35.147440  7773 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:35.148239  7893 consensus_queue.cc:260] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:35.149447  7893 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:35.120157  8024 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:35.149698  7898 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:35.150643  7932 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:35.153666  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:35.154884  7790 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:35.155670  7932 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:35.156101  7932 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.156462  7932 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.157159  7890 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.156991  7992 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:35.158595  3209 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:17:35.159070  3131 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:35.162979  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:35.164165  7355 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:35.136415  7744 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:35.136691  7752 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:35.133790  7888 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:35.168735  8031 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:17:35.169267  7888 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.172636  7888 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.173357  7992 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:35.177551  3205 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:35.178682  7864 raft_consensus.cc:2764] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:17:35.181576  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:35.182325  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:35.182879  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:35.139351  7961 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:35.183404  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:35.184193  3209 raft_consensus.cc:2393] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 14: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:35.185187  3202 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:17:35.185456  8005 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:35.186055  3208 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:35.124785  7656 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:35.139398  7683 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:35.198204  7683 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:35.108536  7486 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:35.202500  7486 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:35.203460  3132 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:17:35.203256  7888 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:35.204063  3132 pending_rounds.cc:85] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 10
I20260709 13:17:35.204370  3132 pending_rounds.cc:107] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:17:35.204607  3132 raft_consensus.cc:2889] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:35.209928  8028 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.199s	user 0.002s	sys 0.000s
I20260709 13:17:35.211434  3277 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:35.208223  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:35.213848  3208 raft_consensus.cc:2368] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16.
I20260709 13:17:35.207362  3205 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:35.222868  8011 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:35.223518  8011 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:35.226020  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:35.227084  7904 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:35.227671  7904 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:35.229899  7904 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:35.231703  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:35.232409  3835 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:35.234011  3251 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:35.234988  3840 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:35.237138  8011 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:35.238766  3834 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:17:35.238520  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:35.239900  3835 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:35.238454  8008 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:35.240456  7892 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.242945  3251 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:35.244098  8008 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:35.244529  8008 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:35.245023  8008 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:35.246021  7974 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:35.252023  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:35.252254  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:35.252941  3836 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:35.270285  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:35.196904  8013 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 13:17:35.305109  7752 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.326341  3249 leader_election.cc:400] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16.
I20260709 13:17:35.326774  3249 leader_election.cc:403] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:17:35.329145  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.333455  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 76257.2us
I20260709 13:17:35.334556  3837 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 13:17:35.335151  3837 pending_rounds.cc:85] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 11
I20260709 13:17:35.335459  3837 pending_rounds.cc:107] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:17:35.335760  3837 raft_consensus.cc:2889] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:35.336391  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:35.339918  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:35.346500  3806 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:35.348817  3132 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:17:35.352592  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 100417us
I20260709 13:17:35.364626  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:35.377156  3177 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:35.387655  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:35.399971  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:35.401183  3280 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:35.404491  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:35.405570  3280 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:35.341312  7869 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:35.384002  7773 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:35.387748  7560 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:35.387559  7871 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:35.421875  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 95679.3us
I20260709 13:17:35.423578  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:35.422088  8027 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:35.404335  7561 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:35.412884  7486 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.375586  7752 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:35.389552  7964 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:17:35.415524  7888 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:35.425401  7560 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:35.464152  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 124342us
I20260709 13:17:35.464620  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:35.465469  3207 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.468269  3134 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:17:35.468713  3134 pending_rounds.cc:85] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 8
I20260709 13:17:35.469008  3134 pending_rounds.cc:107] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:17:35.469525  3134 raft_consensus.cc:2889] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:35.422688  7869 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:35.431597  7871 raft_consensus.cc:697] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:35.455291  7867 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:35.473879  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.474584  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 77325.1us
W20260709 13:17:35.486347  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.461234  7560 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.463848  7898 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.500288  7869 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:35.455045  7891 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:17:35.453466  7486 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:35.576139  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 244966us
I20260709 13:17:35.577936  7486 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:35.436774  7561 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:35.580505  7561 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:35.472529  7893 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:35.513696  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 135397us
I20260709 13:17:35.515453  3207 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:35.522208  7752 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:35.522990  3206 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:35.523746  7871 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:35.530051  7932 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:35.506312  7898 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:35.547788  3280 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:17:35.550339  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 436586us
I20260709 13:17:35.556890  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:35.560066  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 94859.4us
I20260709 13:17:35.567441  3101 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:35.571676  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:35.583141  3102 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:35.589721  3285 raft_consensus.cc:2368] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 14. Current term is 15.
W20260709 13:17:35.589991  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 123235us
I20260709 13:17:35.595031  3102 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:35.599577  3207 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:35.602192  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:35.602957  3207 raft_consensus.cc:2393] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:35.606756  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:35.607365  3837 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.609294  8004 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:35.610469  7924 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:35.610857  7924 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:35.611243  7924 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.612571  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:35.612905  7960 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.613454  7960 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:35.614316  3100 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:35.615212  3100 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:35.615649  7960 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:35.615993  7899 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:35.616389  7899 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:35.616658  3100 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:35.617389  7894 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:35.617424  7893 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:35.623116  7926 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:35.616817  7899 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:35.618348  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 51027.2us
I20260709 13:17:35.630244  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:35.631049  3132 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:35.632231  3135 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:35.633230  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:35.634375  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:35.636003  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:35.636710  3127 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:35.617223  7960 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:35.637825  7960 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.618820  7959 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:35.638965  7959 raft_consensus.cc:697] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:35.638819  7960 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:35.620052  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:35.623935  7926 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:35.640187  7959 consensus_queue.cc:237] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:35.657595  3276 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:35.644941  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 61576.7us
I20260709 13:17:35.664757  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:35.618892  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:35.663830  3285 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:17:35.664083  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:35.644907  3806 leader_election.cc:400] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 14. Current term is 15.
I20260709 13:17:35.666764  3806 leader_election.cc:403] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:35.665503  3211 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:35.585501  7789 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.662153  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:35.674013  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:35.680145  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 61327.7us
I20260709 13:17:35.684947  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:35.686303  3204 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:17:35.686508  3133 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:35.687085  3204 pending_rounds.cc:85] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 9
I20260709 13:17:35.688897  3204 pending_rounds.cc:107] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:17:35.686360  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:35.689692  3135 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:35.685858  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:35.689026  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:35.690765  3132 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 9: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:35.689255  3204 raft_consensus.cc:2889] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:35.692324  3176 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:35.693259  3100 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:35.707659  3837 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:35.586835  7582 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:17:35.664659  7355 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:35.700951  8036 log.cc:927] Time spent T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:17:35.664278  7838 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.644464  7887 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:35.720345  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:35.733455  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:35.735208  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:35.736120  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 51567.5us
I20260709 13:17:35.701575  7991 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:35.739440  3250 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:35.756179  3101 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:35.767316  3133 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:17:35.670389  8043 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:17:35.700443  7890 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:17:35.721408  7951 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:35.709518  7789 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:35.757714  7910 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:35.761049  7985 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:35.757386  7582 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:35.843200  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 100744us
I20260709 13:17:35.752651  7838 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:35.788817  7951 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.757540  7869 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:17:35.741518  7355 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:35.758998  7847 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:17:35.754374  7991 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.770169  7990 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:35.836097  7892 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:35.876399  8008 consensus_meta.cc:287] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.631s	user 0.014s	sys 0.000s
W20260709 13:17:35.873270  8021 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:17:35.789189  7891 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.107s
W20260709 13:17:35.907243  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 151148us
W20260709 13:17:35.919507  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 142799us
I20260709 13:17:35.874027  7464 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:35.897845  7908 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:35.900892  7951 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.926065  7990 raft_consensus.cc:697] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:35.907773  7991 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.907418  7887 raft_consensus.cc:697] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:35.972452  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:35.936086  7464 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.921983  7892 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:35.960383  7898 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:35.936177  7908 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:35.931761  8008 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:35.980086  7464 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:36.003660  8054 log.cc:927] Time spent T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.240s	user 0.002s	sys 0.000s
I20260709 13:17:36.018613  8024 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.004359  7847 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:36.017413  7908 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:36.066380  3282 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:17:35.990058  8047 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 14. Current term is 15.
W20260709 13:17:36.030794  8046 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:17:36.075347  7987 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:36.149261  8070 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:17:36.090844  7926 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:36.160822  8053 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:17:36.072054  8067 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:36.162588  8045 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:17:36.165120  7355 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:36.162750  8067 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.073988  7887 consensus_queue.cc:237] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:36.175225  8055 log.cc:927] Time spent T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:17:36.175662  7960 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:36.176717  8052 log.cc:927] Time spent T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:17:36.178434  8008 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:36.028882  7990 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:36.156098  8059 log.cc:927] Time spent T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:17:36.071322  8024 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:36.183780  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 446899us
W20260709 13:17:36.168522  7924 consensus_meta.cc:287] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.003s
W20260709 13:17:36.196035  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 503720us
W20260709 13:17:36.155059  8056 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
W20260709 13:17:36.180508  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.219465  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:36.222092  3285 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:36.222385  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:36.232630  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:36.234313  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:36.212549  7899 consensus_meta.cc:287] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.000s
I20260709 13:17:36.251080  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:36.183833  7926 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.262707  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:36.224586  7924 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:36.228494  7838 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:36.159317  7987 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.249267  7752 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:17:36.297489  8024 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:36.298151  7964 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:36.302039  7960 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:36.281792  7838 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:36.284487  7892 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:36.261600  7899 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:36.326896  7899 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:36.327680  7560 consensus_meta.cc:287] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.813s	user 0.015s	sys 0.000s
I20260709 13:17:36.328187  7560 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:36.340155  3806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.006s	sys 0.021s
W20260709 13:17:36.341583  3806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.006s	sys 0.021s
I20260709 13:17:36.320945  7924 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:36.343904  7867 consensus_meta.cc:287] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.856s	user 0.013s	sys 0.000s
W20260709 13:17:36.343390  3249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.005s	sys 0.004s
I20260709 13:17:36.347025  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1656) took 1080 ms. Trace:
W20260709 13:17:36.367480  3249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.006s	sys 0.004s
W20260709 13:17:36.367967  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 614048us
I20260709 13:17:36.367527  3134 rpcz_store.cc:276] 0709 13:17:35.266834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.329064 (+ 62230us) service_pool.cc:224] Handling call
0709 13:17:35.329382 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:35.469995 (+140613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.346682 (+876687us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400074254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:36.346936 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318553984}
I20260709 13:17:36.373167  8042 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:36.373971  8042 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.374401  8042 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:36.377374  8073 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:36.377840  8067 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:36.378394  8073 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:36.380430  7987 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:36.366457  7898 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:36.382489  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1649) took 1175 ms. Trace:
I20260709 13:17:36.382644  7898 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:36.382889  3276 rpcz_store.cc:276] 0709 13:17:35.207324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.207498 (+   174us) service_pool.cc:224] Handling call
0709 13:17:35.210911 (+  3413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:35.665118 (+454207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.382242 (+717124us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b5400318654. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:36.382430 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1026783104}
I20260709 13:17:36.384658  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2875) took 1046 ms. Trace:
I20260709 13:17:36.385047  3278 rpcz_store.cc:276] 0709 13:17:35.337976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.338092 (+   116us) service_pool.cc:224] Handling call
0709 13:17:35.338349 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:35.497668 (+159319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.497715 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:35.497773 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:35.497838 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.384443 (+886605us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400178ed4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:36.384488 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.384601 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359082240}
I20260709 13:17:36.397197  8027 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:36.399485  7867 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16.
I20260709 13:17:36.316596  7838 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.355568  3838 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:36.384872  7898 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:36.415735  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:36.409209  7951 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.418680  3834 raft_consensus.cc:2393] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:36.420442  3133 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:36.421407  7789 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:36.410993  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:36.421888  7951 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:36.422587  3835 raft_consensus.cc:2368] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15.
I20260709 13:17:36.410993  7838 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:36.423996  8073 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:36.427013  7932 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:36.436862  7898 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:36.437603  7898 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:36.350299  3805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.015s	sys 0.061s
I20260709 13:17:36.379247  7926 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:36.440724  3805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.015s	sys 0.061s
W20260709 13:17:36.441491  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 767514us
I20260709 13:17:36.445307  7898 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:36.447171  3033 catalog_manager.cc:5697] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 12 to 19, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 19 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:36.448758  3033 catalog_manager.cc:5697] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.450546  3033 catalog_manager.cc:5697] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 10 to 12, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 12 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:36.359752  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 754879us
I20260709 13:17:36.452068  3033 catalog_manager.cc:5697] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 10 to 12, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 12 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:36.454166  7898 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.454700  7898 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:36.443624  3805 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
W20260709 13:17:36.480075  8058 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.581s	user 0.000s	sys 0.009s
I20260709 13:17:36.456912  7898 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:36.487448  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 62860.1us
W20260709 13:17:36.488340  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 119646us
I20260709 13:17:36.491943  8004 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:36.493531  7486 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:36.509066  7486 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:36.510131  7486 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.511360  7486 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:36.515053  3102 leader_election.cc:400] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15.
I20260709 13:17:36.515436  3102 leader_election.cc:403] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:36.515527  7744 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:17:36.497846  3206 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 2056) took 1815 ms (client timeout 1647 ms). Trace:
I20260709 13:17:36.516957  7656 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:36.517068  3206 rpcz_store.cc:269] 0709 13:17:34.682222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.682551 (+   329us) service_pool.cc:224] Handling call
0709 13:17:36.497647 (+1815096us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b5400153bd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:36.497765 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1930124672}
W20260709 13:17:36.498154  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.498173  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:36.498746  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:36.500545  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:36.525913  3131 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:36.526012  3134 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 8.
I20260709 13:17:36.486153  7464 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.527292  7560 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:36.413657  7908 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.529549  7464 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:36.530480  7908 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:36.503558  7991 consensus_meta.cc:287] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.004s
I20260709 13:17:36.538592  7991 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:36.553157  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45821.7us
I20260709 13:17:36.540941  7991 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:36.575651  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 53946us
I20260709 13:17:36.558409  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:36.579555  3033 catalog_manager.cc:5697] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 9 to 13, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 13 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.559396  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:36.590279  3204 raft_consensus.cc:2393] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 16: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:17:36.602650  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 123829us
I20260709 13:17:36.603415  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:36.604264  3208 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:36.602164  3806 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:36.582387  3033 catalog_manager.cc:5697] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 8 to 12, leader changed from <none> to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 12 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.602334  8073 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:36.628083  8073 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.628466  8073 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:36.557330  7991 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.641686  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:36.641718  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:36.642366  3282 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:36.624061  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:36.644336  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:36.645735  7964 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:36.647037  7991 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:36.644099  3033 catalog_manager.cc:5697] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 7 to 8, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 8 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:36.608680  7847 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:17:36.658502  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:36.660023  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:36.665110  8077 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:36.665910  8077 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:36.666569  8069 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:36.667147  8069 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:36.667624  8069 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.669394  3249 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:36.676030  7869 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:36.649945  7985 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.640077  7656 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15.
I20260709 13:17:36.656776  7888 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.686020  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:36.701547  3278 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:36.705670  7683 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:36.705998  7997 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:36.706226  7683 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:36.706769  7683 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.706630  7997 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.702307  7985 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.688889  7964 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:36.703548  7898 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:36.709070  7997 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:36.700249  7560 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:17:36.756484  3033 catalog_manager.cc:5697] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:17:36.741194  8050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.005s	sys 0.025s
I20260709 13:17:36.764405  3033 catalog_manager.cc:5697] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:36.766968  3033 catalog_manager.cc:5697] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:36.729651  7888 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.749014  7898 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:36.770170  3127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.020s	sys 0.011s
W20260709 13:17:36.806202  3127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.020s	sys 0.011s
I20260709 13:17:36.768663  3033 catalog_manager.cc:5697] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 8 to 9, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 9 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.808681  3033 catalog_manager.cc:5697] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:36.737989  7964 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.761260  8077 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:36.766134  8050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.005s	sys 0.026s
W20260709 13:17:36.832335  3251 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.022s	sys 0.013s
W20260709 13:17:36.832840  3251 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.022s	sys 0.013s
I20260709 13:17:36.765415  7960 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:36.770961  8082 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.757926  8042 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.838851  3033 catalog_manager.cc:5697] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 10 to 12, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 12 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:36.818655  7898 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.851032  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:36.865311  3033 catalog_manager.cc:5697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.874236  3033 catalog_manager.cc:5697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 7 to 9, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 9 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:17:36.877627  3250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.002s	sys 0.018s
I20260709 13:17:36.828991  8064 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:36.867843  7894 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:36.842428  7908 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:36.882833  3205 raft_consensus.cc:2368] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12.
I20260709 13:17:36.840199  7891 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:36.887599  3250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.002s	sys 0.018s
I20260709 13:17:36.874408  7924 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:36.919559  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 689545us
I20260709 13:17:36.927251  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:36.928190  3133 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
W20260709 13:17:36.925050  3177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.000s	sys 0.031s
I20260709 13:17:36.924588  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:36.930123  3177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.000s	sys 0.032s
I20260709 13:17:36.930351  3210 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:36.864266  7960 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.937325  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:36.921229  3136 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.015s	sys 0.004s
I20260709 13:17:36.874671  8078 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:36.941056  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:36.917694  7964 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:36.926347  7990 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.013s	sys 0.016s
I20260709 13:17:36.944095  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:36.945278  3176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.008s	sys 0.027s
I20260709 13:17:36.947363  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:36.953161  3176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.008s	sys 0.027s
I20260709 13:17:36.868942  8082 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:36.952266  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:36.939277  3136 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.016s	sys 0.004s
I20260709 13:17:36.933287  7991 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:36.960851  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:36.954164  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 719886us
I20260709 13:17:36.919725  8064 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:36.956727  7990 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.013s	sys 0.016s
W20260709 13:17:36.940836  7887 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.005s	sys 0.014s
I20260709 13:17:36.924333  7891 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.945454  7847 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.925419  7908 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.986215  3283 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:17:36.977246  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:36.956583  7964 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:37.027441  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:36.936205  7924 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:36.962235  8083 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:36.960675  8077 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:37.050293  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:36.975188  8024 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.015s	sys 0.018s
W20260709 13:17:36.969766  7887 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.005s	sys 0.015s
I20260709 13:17:37.044653  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:37.054623  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 89074.4us
I20260709 13:17:37.055042  3117 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e1a4d71ef0f4287999b5ee60fe02740 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:40280
W20260709 13:17:37.032470  7866 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.006s	sys 0.020s
W20260709 13:17:37.069871  3031 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38218 (request call id 243) took 37794 ms (client timeout 15000 ms). Trace:
I20260709 13:17:37.075445  8004 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:37.077064  7974 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:37.077546  7888 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:37.079000  7582 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:37.079803  7908 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:37.082851  7960 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:36.988457  7991 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:37.032783  8055 log.cc:927] Time spent T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:17:37.037972  7985 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:36.960103  8078 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:37.134106  8078 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:37.046813  7964 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:36.972695  7959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.002s	sys 0.018s
W20260709 13:17:37.134898  7959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.003s	sys 0.019s
W20260709 13:17:37.111198  8024 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.016s	sys 0.018s
I20260709 13:17:37.136019  7964 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:37.136215  8024 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:37.123085  8004 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.138087  8024 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:37.138725  8024 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.139596  8004 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:37.111615  8073 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:37.142019  8073 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:37.115084  3031 rpcz_store.cc:269] 0709 13:16:59.275882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.281700 (+  5818us) service_pool.cc:224] Handling call
0709 13:16:59.311023 (+ 29323us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54000a87d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc159090 00007fb3bc1f7f3a 00007fb3c1fae1cc 00007fb3c20ac37e 00007fb3c056d2a4 00007fb3c056d232 00007fb3c056d161 00007fb3c056d0dc 00007fb3c056c392 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:37.069724 (+37758701us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:30.803318 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:30.814137 (+ 10819us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:30.814192 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:17:30.814233 (+    41us) tablet.cc:662] Decoding operations
0709 13:17:30.816678 (+  2445us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:30.817028 (+   350us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:30.829727 (+ 12699us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:17:31.046225 (+216498us) tablet.cc:701] Row locks acquired
0709 13:17:31.046271 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:17:31.046465 (+   194us) write_op.cc:270] Start()
0709 13:17:31.046620 (+   155us) write_op.cc:276] Timestamp: P: 1783603051046396 usec, L: 0
0709 13:17:31.046658 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:17:31.047407 (+   749us) log.cc:844] Serialized 5154 byte log entry
0709 13:17:32.263264 (+1215857us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3b90e50ac 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b
0709 13:17:32.740986 (+477722us) op_driver.cc:464] REPLICATION: finished
0709 13:17:32.848485 (+107499us) write_op.cc:301] APPLY: starting
0709 13:17:32.848608 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:33.270893 (+422285us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:33.270942 (+    49us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:33.420422 (+149480us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b180024ee60. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3bbd974bc 00007fb3b90e548b 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bfc25ef0 00007fb3bfc26489 00007fb3bfc2871a
0709 13:17:33.476347 (+ 55925us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:33.476842 (+   495us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:17:33.476929 (+    87us) write_op.cc:312] APPLY: finished
0709 13:17:33.496174 (+ 19245us) log.cc:844] Serialized 121 byte log entry
0709 13:17:33.504136 (+  7962us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:33.504298 (+   162us) write_op.cc:454] Released schema lock
0709 13:17:33.504417 (+   119us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:33.601399 (+ 96982us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:33.604469 (+  3070us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":479355,"reported_tablets":50,"spinlock_wait_cycles":24838528,"child_traces":[["op",{"apply.queue_time_us":107093,"apply.run_cpu_time_us":31476,"apply.run_wall_time_us":704203,"cfile_cache_hit":50,"cfile_cache_hit_bytes":52350,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6221,"cfile_init":2,"lbm_read_time_us":7273,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":10,"num_ops":13,"prepare.queue_time_us":306328,"prepare.run_cpu_time_us":101918,"prepare.run_wall_time_us":1690581,"raft.queue_time_us":197913,"raft.run_cpu_time_us":23061,"raft.run_wall_time_us":679985,"replication_time_us":1694147,"spinlock_wait_cycles":149499520,"thread_start_us":1782019,"threads_started":4,"wal-append.queue_time_us":1437861,"wal-append.run_cpu_time_us":24135,"wal-append.run_wall_time_us":2019398}]]}
I20260709 13:17:37.144009  8024 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:37.148452  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1660) took 1463 ms. Trace:
I20260709 13:17:37.148504  7991 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:37.150008  7924 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:37.151263  7991 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:37.148872  3127 rpcz_store.cc:276] 0709 13:17:35.684924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.685039 (+   115us) service_pool.cc:224] Handling call
0709 13:17:35.685369 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.685728 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:35.742832 (+ 57104us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.806757 (+1063925us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.820346 (+ 13589us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.820523 (+   177us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:36.820571 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.820664 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:37.148239 (+327575us) raft_consensus.cc:1685] finished
0709 13:17:37.148267 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.148392 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11179,"prepare.queue_time_us":56015,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":9103,"raft.queue_time_us":2719,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":22572,"thread_start_us":869787,"threads_started":1,"wal-append.queue_time_us":1204549}
I20260709 13:17:37.111429  8077 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.153721  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:37.155360  8077 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:37.116521  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:37.157152  8061 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:37.157824  8061 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.161051  8061 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:37.161489  8077 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.161844  7582 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:37.162125  8077 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:37.162784  7582 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.131548  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:37.164613  3209 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.091465  7847 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:37.167538  7847 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:37.170189  7891 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:37.113095  8047 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.015s	sys 0.021s
I20260709 13:17:37.091933  8083 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.069929  8042 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:37.116890  7866 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.007s	sys 0.020s
I20260709 13:17:37.126689  7888 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:37.186679  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:37.187429  3132 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:37.187071  7888 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.125159  7974 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.188215  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:37.155318  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:37.189841  3127 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:37.189908  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:37.190609  3135 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:36.969496  7838 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:37.191125  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:37.176786  3128 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.003s	sys 0.036s
I20260709 13:17:37.174693  3131 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:37.181239  3209 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:17:37.195437  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:36.966514  7486 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:37.177556  3211 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:37.185881  8064 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:37.173966  8086 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:37.196317  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:37.189155  7888 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:37.161571  8082 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:37.197569  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:37.198292  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:37.198786  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:37.220134  3211 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:37.199123  3131 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:17:37.225258  3806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.006s	sys 0.022s
W20260709 13:17:37.225575  3806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.006s	sys 0.022s
W20260709 13:17:37.225819  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 623699us
W20260709 13:17:37.226485  3835 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.019s	sys 0.016s
W20260709 13:17:37.226795  3835 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.019s	sys 0.016s
W20260709 13:17:37.199806  3128 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.003s	sys 0.036s
W20260709 13:17:37.178572  8069 consensus_meta.cc:287] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.003s
I20260709 13:17:37.213642  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:37.160742  7898 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:37.219264  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:37.237051  3806 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:37.189314  8083 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.241603  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:37.201092  7871 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.016s	sys 0.033s
I20260709 13:17:37.246007  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1663) took 1016 ms. Trace:
I20260709 13:17:37.251619  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:37.214578  7464 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:37.176654  8047 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.015s	sys 0.022s
W20260709 13:17:37.253536  7871 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.017s	sys 0.033s
I20260709 13:17:37.256465  7974 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:37.221712  8086 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:37.247201  8061 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:17:37.259856  7683 consensus_meta.cc:287] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.003s
W20260709 13:17:37.262768  3838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.000s	sys 0.047s
I20260709 13:17:37.268771  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:37.293023  3838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.000s	sys 0.047s
I20260709 13:17:37.252578  3177 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:37.262852  7960 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.201104  7838 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:37.297422  3203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.018s	sys 0.047s
W20260709 13:17:37.298735  3203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.018s	sys 0.047s
W20260709 13:17:37.300875  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 48408us
I20260709 13:17:37.219754  7486 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:37.279242  7561 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.008s	user 0.031s	sys 0.047s
I20260709 13:17:37.248198  8069 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.286834  7847 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:37.274464  7959 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:37.319525  3805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.010s	sys 0.014s
W20260709 13:17:37.322566  3805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.010s	sys 0.014s
W20260709 13:17:37.322871  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 719005us
I20260709 13:17:37.275784  7464 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:37.300585  7871 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:37.347213  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:37.349913  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:37.351241  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:37.352210  3284 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:37.355005  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:37.356889  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:37.357807  3281 raft_consensus.cc:2368] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15.
I20260709 13:17:37.359387  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:37.309012  7561 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.031s	sys 0.047s
I20260709 13:17:37.310810  7847 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:37.362046  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 58780.3us
I20260709 13:17:37.354090  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:37.299655  7683 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.295521  8061 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:37.300320  7960 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.369758  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:37.318631  8089 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:37.397660  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:37.345115  7888 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.491731  7888 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:37.387200  8088 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:37.387147  3284 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:37.493779  8088 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.495188  7888 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:37.408046  3100 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:37.361214  7871 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:37.496189  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 88260.1us
I20260709 13:17:37.367415  7893 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.480304  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:37.345067  7974 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:37.410830  7899 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.004s	sys 0.059s
I20260709 13:17:37.416410  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:37.322096  7959 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.522593  3127 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:37.524420  3281 raft_consensus.cc:2410] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:17:37.407923  8095 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:17:37.368594  7847 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:37.335994  7891 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:37.386773  7869 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:37.553650  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:37.386938  8077 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:37.552536  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:37.554415  3836 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:37.554455  3276 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:37.549101  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:37.532053  7744 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:37.555845  3127 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:37.557977  3284 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
W20260709 13:17:37.541541  7899 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.005s	sys 0.059s
W20260709 13:17:37.586300  8099 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:17:37.590888  7871 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:37.592106  7871 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:37.595620  7964 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:37.596063  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:37.596174  7964 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.597319  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:37.597435  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:37.599668  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:37.600442  3202 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
W20260709 13:17:37.570163  8093 log.cc:927] Time spent T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:17:37.573351  7744 raft_consensus.cc:697] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:37.541375  7893 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.613449  8086 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:37.615187  8088 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:37.592731  7871 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:37.545835  7974 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.618172  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:37.624316  3279 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.567436  7869 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.609292  7898 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:37.561045  7891 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:37.248951  3128 rpcz_store.cc:276] 0709 13:17:36.229451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.229633 (+   182us) service_pool.cc:224] Handling call
0709 13:17:36.229992 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.230234 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:36.253235 (+ 23001us) log.cc:844] Serialized 14 byte log entry
0709 13:17:37.245570 (+992335us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:37.245641 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:37.245710 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.245797 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.245936 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9572,"prepare.queue_time_us":44024,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":14600,"thread_start_us":973814,"threads_started":1}
W20260709 13:17:37.647842  3136 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.020s	sys 0.014s
W20260709 13:17:37.648366  3136 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.020s	sys 0.014s
I20260709 13:17:37.652499  3835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 910) took 1134 ms. Trace:
W20260709 13:17:37.654103  3208 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.015s	user 0.023s	sys 0.020s
W20260709 13:17:37.654749  3208 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.023s	sys 0.020s
I20260709 13:17:37.653878  3835 rpcz_store.cc:276] 0709 13:17:36.506904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.507053 (+   149us) service_pool.cc:224] Handling call
0709 13:17:36.507386 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.507664 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:37.227109 (+719445us) log.cc:844] Serialized 14 byte log entry
0709 13:17:37.641057 (+413948us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:37.641135 (+    78us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:37.641182 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.641248 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.641380 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1085459,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":92,"raft.queue_time_us":6701,"thread_start_us":1121630,"threads_started":2}
I20260709 13:17:37.668370  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:37.670738  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1664) took 1430 ms. Trace:
I20260709 13:17:37.672816  3279 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:17:37.657434  7838 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:37.663147  8069 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:37.786062  3033 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.016s	sys 0.058s
W20260709 13:17:37.949244  3033 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.024s	sys 0.063s
W20260709 13:17:37.829907  3838 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.010s	sys 0.043s
W20260709 13:17:37.957331  3838 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.018s	sys 0.045s
W20260709 13:17:37.824788  3204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.191s	user 0.017s	sys 0.033s
W20260709 13:17:37.961329  3204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.328s	user 0.027s	sys 0.034s
W20260709 13:17:37.898278  3249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.010s	sys 0.032s
W20260709 13:17:37.873425  3176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.013s	sys 0.031s
W20260709 13:17:38.013383  3176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.016s	sys 0.033s
I20260709 13:17:37.916514  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:37.901551  7887 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:37.920678  7974 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:37.923252  7869 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:37.924156  7683 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:37.928050  3281 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:37.929188  7871 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:37.930159  7486 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:37.931761  7893 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:37.932405  7964 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:37.673653  3136 rpcz_store.cc:276] 0709 13:17:36.240531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.240689 (+   158us) service_pool.cc:224] Handling call
0709 13:17:36.241043 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.241283 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:36.959749 (+718466us) log.cc:844] Serialized 14 byte log entry
0709 13:17:37.669273 (+709524us) log.cc:844] Serialized 14 byte log entry
0709 13:17:37.670323 (+  1050us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:37.670385 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:37.670492 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.670563 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.670683 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40322,"prepare.queue_time_us":41706,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":19949,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":2105,"spinlock_wait_cycles":9514240,"thread_start_us":1375298,"threads_started":2}
W20260709 13:17:37.810034  8047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.015s	sys 0.033s
I20260709 13:17:37.889055  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:38.048588  3279 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:37.942037  3127 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
W20260709 13:17:37.898803  8097 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.280s	user 0.000s	sys 0.006s
W20260709 13:17:37.827713  8098 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.128s	user 0.004s	sys 0.000s
I20260709 13:17:37.946751  3177 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:37.675498  7744 consensus_queue.cc:237] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:38.018059  7561 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:17:38.016211  3249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.015s	sys 0.040s
I20260709 13:17:38.018208  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:38.033876  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 117396us
I20260709 13:17:38.041342  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:38.047499  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:38.018596  8083 consensus_meta.cc:287] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.756s	user 0.012s	sys 0.007s
I20260709 13:17:38.050406  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:38.075201  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:38.050940  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:37.903122  3117 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.007s	sys 0.034s
W20260709 13:17:38.078377  3117 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.007s	sys 0.040s
W20260709 13:17:38.059578  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 112892us
W20260709 13:17:38.048230  8047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.016s	sys 0.036s
I20260709 13:17:38.072695  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:38.078976  3249 leader_election.cc:400] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12.
I20260709 13:17:38.079319  3249 leader_election.cc:403] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:38.073802  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:38.079711  3250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.012s	sys 0.073s
I20260709 13:17:38.069129  3284 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
W20260709 13:17:38.080125  3250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.012s	sys 0.073s
I20260709 13:17:38.019301  8073 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:38.082398  3206 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.523s	user 0.023s	sys 0.080s
W20260709 13:17:38.082801  3206 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.523s	user 0.023s	sys 0.080s
I20260709 13:17:38.084972  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:38.081856  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:38.080406  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 956800us
I20260709 13:17:38.049057  7951 raft_consensus.cc:2764] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:17:38.051399  7871 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:38.068311  7964 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:38.096186  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:38.089757  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:38.090188  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:38.024789  7887 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:38.101068  8042 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:38.101553  8042 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.101935  8042 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.048810  8089 consensus_queue.cc:1059] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 13:17:38.104830  8105 log.cc:927] Time spent T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 13:17:38.105710  8096 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:38.069371  7486 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:38.106909  3838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 911) took 1556 ms. Trace:
I20260709 13:17:38.107285  3838 rpcz_store.cc:276] 0709 13:17:36.550812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.550984 (+   172us) service_pool.cc:224] Handling call
0709 13:17:36.551446 (+   462us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:36.606091 (+ 54645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.606124 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:36.606706 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 13:17:37.293576 (+686870us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:37.957745 (+664169us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.005306 (+ 47561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.005445 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.106678 (+101233us) raft_consensus.cc:1685] finished
0709 13:17:38.106700 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.106846 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59056,"prepare.queue_time_us":300183,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":110599,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":14845,"thread_start_us":1317490,"threads_started":2,"wal-append.queue_time_us":1037973}
I20260709 13:17:38.077008  7561 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:38.173671  7561 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:38.088824  7683 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:38.108462  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:38.169899  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 70513.3us
I20260709 13:17:38.178068  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:38.178411  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 68908.9us
I20260709 13:17:38.075882  8091 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:38.181044  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 72657us
I20260709 13:17:38.182953  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:38.087967  8061 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:38.187590  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:38.081300  7893 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:38.190414  3806 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:38.186193  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:38.063020  8090 consensus_queue.cc:1059] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
W20260709 13:17:38.228765  3134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.006s	sys 0.073s
W20260709 13:17:38.230420  3134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.006s	sys 0.073s
W20260709 13:17:38.231954  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 44547.9us
I20260709 13:17:38.197782  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:38.198896  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:38.108052  8086 consensus_queue.cc:1059] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
W20260709 13:17:38.238873  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 56470.2us
I20260709 13:17:38.245644  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:38.247081  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:38.247236  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:38.092201  7974 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:38.195632  7582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.041s	sys 0.065s
I20260709 13:17:38.107918  7964 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:38.239351  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1665) took 1994 ms. Trace:
I20260709 13:17:38.249571  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:38.248184  3284 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:38.127517  7898 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:38.088357  8073 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:38.249420  3130 rpcz_store.cc:276] 0709 13:17:36.244725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.245282 (+   557us) service_pool.cc:224] Handling call
0709 13:17:36.250781 (+  5499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.251225 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.251265 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.251873 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.765495 (+513622us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:36.765538 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.765667 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.239149 (+1473482us) raft_consensus.cc:1685] finished
0709 13:17:38.239170 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.239295 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":898,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":12989,"thread_start_us":483463,"threads_started":1,"wal-append.queue_time_us":1766039}
I20260709 13:17:38.191756  8047 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:38.231094  8105 log.cc:927] Time spent T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:17:38.261425  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 71104.6us
I20260709 13:17:38.262038  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:38.270028  3207 raft_consensus.cc:2368] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 14. Current term is 15.
W20260709 13:17:38.249034  7582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.041s	sys 0.065s
I20260709 13:17:38.263411  3281 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:38.244951  7899 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:38.182353  7486 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:38.280795  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:38.291078  3211 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
W20260709 13:17:38.263048  3251 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.68:40703 timed out after 1.782s (SENT) [suppressed 6 similar messages]
I20260709 13:17:38.293466  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:38.294225  3211 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:38.081941  8083 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:38.248656  7893 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:38.287686  3282 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.014s	sys 0.052s
I20260709 13:17:38.253137  7964 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:38.245420  8088 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:38.252913  7974 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.260708  7838 raft_consensus.cc:3055] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:38.273578  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:38.299964  3282 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.014s	sys 0.052s
I20260709 13:17:38.299149  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:38.195386  8091 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:38.306320  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:38.107483  7871 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:38.272010  8067 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:38.271394  8107 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:38.279305  7656 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:38.281471  8090 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:38.271930  7560 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:38.284718  8086 raft_consensus.cc:3055] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:38.285939  7899 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.343808  7889 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:38.358430  8116 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40280 (request call id 2) took 1304 ms. Trace:
W20260709 13:17:38.388186  3840 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.077s	sys 0.122s
W20260709 13:17:38.408440  3840 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.077s	sys 0.122s
I20260709 13:17:38.302570  7582 raft_consensus.cc:3055] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:38.414853  3101 leader_election.cc:400] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15.
I20260709 13:17:38.309976  7974 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.421325  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:38.422597  3278 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 14. Current term is 15. Ops: [12.11-14.12]
I20260709 13:17:38.310214  7838 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:38.440052  3805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.021s	sys 0.070s
W20260709 13:17:38.442879  3805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.021s	sys 0.070s
I20260709 13:17:38.351046  7561 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:38.452035  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:38.462222  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:38.344468  8088 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:38.422160  7899 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:38.382740  7656 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:38.437924  7582 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:38.487656  8091 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:38.460726  7588 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:38.456585  7898 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:38.489204  8100 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.408s	user 0.000s	sys 0.001s
W20260709 13:17:38.490103  8121 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:17:38.490706  8088 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:38.491056  8112 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:17:38.499105  3210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.453s	user 0.047s	sys 0.092s
W20260709 13:17:38.594305  3210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.548s	user 0.047s	sys 0.092s
I20260709 13:17:38.595360  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 3182) took 1628 ms. Trace:
I20260709 13:17:38.507375  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1672) took 1377 ms. Trace:
I20260709 13:17:38.389396  8067 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:38.403537  8086 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:38.405826  8090 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:38.448108  7560 raft_consensus.cc:697] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:38.461346  8047 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:38.406675  8107 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:38.441104  7889 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:38.585882  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:38.458840  7561 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:38.655058  7561 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:38.597074  3134 rpcz_store.cc:276] 0709 13:17:37.129978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.200729 (+ 70751us) service_pool.cc:224] Handling call
0709 13:17:37.201017 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:37.216272 (+ 15255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:37.216302 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:37.230796 (+ 14494us) log.cc:844] Serialized 26 byte log entry
0709 13:17:38.231509 (+1000713us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:38.231551 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.231616 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.507155 (+275539us) raft_consensus.cc:1685] finished
0709 13:17:38.507174 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.507310 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22612,"raft.queue_time_us":17343,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":20593,"thread_start_us":981251,"threads_started":1,"wal-append.queue_time_us":1255651}
I20260709 13:17:38.595707  3210 rpcz_store.cc:276] 0709 13:17:36.966949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.967087 (+   138us) service_pool.cc:224] Handling call
0709 13:17:36.989499 (+ 22412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.989740 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:37.045671 (+ 55931us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.594892 (+1549221us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.595034 (+   142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.595074 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:38.595115 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.595191 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.595301 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58265,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"thread_start_us":1548695,"threads_started":1}
I20260709 13:17:38.592557  7683 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12.
I20260709 13:17:38.604424  8082 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:38.590932  7898 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:38.663771  7898 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:38.520089  7838 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:38.665764  7838 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.666646  3283 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:38.667840  8107 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:38.597532  7887 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:38.670418  7871 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:38.671113  8117 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.752s	user 0.000s	sys 0.006s
W20260709 13:17:38.671988  8042 consensus_meta.cc:287] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.570s	user 0.013s	sys 0.000s
I20260709 13:17:38.675107  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:38.676468  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:38.649825  3834 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:38.672530  8042 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:38.677881  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:38.679466  8042 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:38.651553  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:38.589421  8114 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:38.685516  8114 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:38.688673  8114 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:38.690115  8109 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.406s	user 0.001s	sys 0.000s
I20260709 13:17:38.696810  7891 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:38.697665  8086 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:38.699510  8086 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.699643  7964 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:38.715536  7964 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:38.717366  7464 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:38.722159  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2893) took 1358 ms. Trace:
I20260709 13:17:38.648936  8047 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:38.722620  3282 rpcz_store.cc:276] 0709 13:17:37.363280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.363388 (+   108us) service_pool.cc:224] Handling call
0709 13:17:37.363678 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:37.387341 (+ 23663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:37.387371 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:37.409357 (+ 21986us) log.cc:844] Serialized 26 byte log entry
0709 13:17:38.343574 (+934217us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:38.343642 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.343982 (+   340us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.721607 (+377625us) raft_consensus.cc:1685] finished
0709 13:17:38.721758 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.722051 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23197,"raft.queue_time_us":23360,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":22151,"thread_start_us":933451,"threads_started":1,"wal-append.queue_time_us":1182602}
W20260709 13:17:38.723654  8106 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.791s	user 0.006s	sys 0.001s
I20260709 13:17:38.727268  3840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 923) took 1162 ms. Trace:
I20260709 13:17:38.728580  8067 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:38.727770  3840 rpcz_store.cc:276] 0709 13:17:37.565139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.565426 (+   287us) service_pool.cc:224] Handling call
0709 13:17:37.565840 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:37.566127 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:37.566164 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:37.566749 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:17:38.409036 (+842287us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:38.409113 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.409260 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.726978 (+317718us) raft_consensus.cc:1685] finished
0709 13:17:38.727010 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.727191 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":832291,"threads_started":1,"wal-append.queue_time_us":1013568}
I20260709 13:17:38.731168  8090 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:38.736025  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 726) took 1389 ms. Trace:
I20260709 13:17:38.736460  3278 rpcz_store.cc:276] 0709 13:17:37.346479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.346596 (+   117us) service_pool.cc:224] Handling call
0709 13:17:37.346935 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:38.423155 (+1076220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.735731 (+312576us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400038254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:38.735963 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473142016}
I20260709 13:17:38.739063  7656 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:38.419613  8116 rpcz_store.cc:276] 0709 13:17:37.054399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.054687 (+   288us) service_pool.cc:224] Handling call
0709 13:17:38.357982 (+1303295us) ts_tablet_manager.cc:1151] Deleting tablet 8e1a4d71ef0f4287999b5ee60fe02740
0709 13:17:38.358082 (+   100us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:17:38.358348 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1235659,"thread_start_us":922106,"threads_started":1}
I20260709 13:17:38.741281  7582 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:38.745862  7959 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:38.747380  7893 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:38.675257  7960 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:38.722481  8108 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.792s	user 0.000s	sys 0.007s
W20260709 13:17:38.763584  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.724756  8047 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:38.650547  8073 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:38.781854  3100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.000s	sys 0.046s
W20260709 13:17:38.782330  3100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.000s	sys 0.046s
I20260709 13:17:38.756572  7871 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:38.786716  3177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.014s	sys 0.036s
W20260709 13:17:38.787117  3177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.014s	sys 0.036s
W20260709 13:17:38.789047  3835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.010s	sys 0.038s
W20260709 13:17:38.790429  3835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.011s	sys 0.038s
I20260709 13:17:38.775221  7486 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:38.792255  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:38.807893  3206 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.012s	sys 0.042s
I20260709 13:17:38.781194  8090 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:38.809190  3204 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.008s	sys 0.016s
I20260709 13:17:38.815255  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:38.823647  3204 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.008s	sys 0.016s
I20260709 13:17:38.817934  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:38.824208  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:38.827277  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:38.827939  3207 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:38.832167  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:38.833163  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:38.824960  3202 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:38.839097  3210 raft_consensus.cc:2410] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 13:17:38.839121  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 50018.9us
I20260709 13:17:38.791169  7960 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:38.822170  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:17:38.798544  8024 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.026s	sys 0.022s
W20260709 13:17:38.820370  3206 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.012s	sys 0.042s
I20260709 13:17:38.798629  7656 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:38.840183  3250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.022s	sys 0.029s
W20260709 13:17:38.911788  3250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.024s	sys 0.037s
W20260709 13:17:38.912748  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 819213us
W20260709 13:17:38.840332  3176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.009s	sys 0.050s
W20260709 13:17:38.913769  3176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.009s	sys 0.050s
I20260709 13:17:38.880482  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2101) took 2245 ms. Trace:
W20260709 13:17:38.914460  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 873172us
I20260709 13:17:38.841220  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:38.912294  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2089) took 2355 ms. Trace:
I20260709 13:17:38.914939  3208 rpcz_store.cc:276] 0709 13:17:36.634681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.634953 (+   272us) service_pool.cc:224] Handling call
0709 13:17:36.635617 (+   664us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.636603 (+   986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.636653 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.638719 (+  2066us) log.cc:844] Serialized 26 byte log entry
0709 13:17:37.655224 (+1016505us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:37.655272 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.655348 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.721762 (+1066414us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:38.842310 (+120548us) raft_consensus.cc:1685] finished
0709 13:17:38.842343 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.880378 (+ 38035us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1595,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":242,"spinlock_wait_cycles":60777856,"thread_start_us":1015800,"threads_started":1,"wal-append.queue_time_us":1037400}
W20260709 13:17:38.870314  3251 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.022s	sys 0.065s
W20260709 13:17:38.917304  3251 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.023s	sys 0.067s
W20260709 13:17:38.917645  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 654579us
I20260709 13:17:38.916658  3206 rpcz_store.cc:276] 0709 13:17:36.557394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.557656 (+   262us) service_pool.cc:224] Handling call
0709 13:17:36.557991 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.559083 (+  1092us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:36.559399 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.910482 (+2351083us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.910557 (+    75us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:38.910613 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.912087 (+  1474us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.912229 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":156,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":44287,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":8085,"thread_start_us":2350633,"threads_started":2,"wal-append.queue_time_us":1962873}
I20260709 13:17:38.784072  7560 consensus_queue.cc:237] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:38.923997  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:38.922209  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 470521us
I20260709 13:17:38.871057  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2098) took 2240 ms. Trace:
I20260709 13:17:38.920727  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:38.791209  7871 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:38.923684  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 458703us
W20260709 13:17:38.949905  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 59241.1us
I20260709 13:17:38.926214  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:38.953610  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:38.951607  3806 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:38.958144  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:38.910166  8024 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.034s	sys 0.026s
I20260709 13:17:38.891040  7744 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:38.949051  8114 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.981014  7744 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:38.981534  8114 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:38.983117  7744 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:38.983532  8114 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:38.983608  8073 consensus_queue.cc:1059] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:38.984769  8073 raft_consensus.cc:3055] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:38.985140  8073 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:38.985975  8073 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:38.986929  7847 consensus_meta.cc:287] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 1.420s	user 0.008s	sys 0.005s
I20260709 13:17:38.987161  8073 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.971189  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:38.949818  3204 rpcz_store.cc:276] 0709 13:17:36.599808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.599927 (+   119us) service_pool.cc:224] Handling call
0709 13:17:36.626693 (+ 26766us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:36.632443 (+  5750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.632477 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:36.633102 (+   625us) log.cc:844] Serialized 52 byte log entry
0709 13:17:38.004394 (+1371292us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:38.824068 (+819674us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.839766 (+ 15698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.839844 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.839885 (+    41us) raft_consensus.cc:1685] finished
0709 13:17:38.839902 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.840023 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20161,"prepare.queue_time_us":295027,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":33586,"raft.queue_time_us":20709,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":29266,"thread_start_us":2098066,"threads_started":2,"wal-append.queue_time_us":1654818}
W20260709 13:17:38.988168  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 67541.7us
I20260709 13:17:38.994761  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:38.995761  3130 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:38.999071  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:38.840190  7964 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:38.810007  7486 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:38.969954  3101 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:39.004933  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:38.970927  3248 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.011s	sys 0.040s
W20260709 13:17:39.005601  3248 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.011s	sys 0.040s
I20260709 13:17:38.971268  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:38.918439  7960 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:38.975982  8111 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:17:38.980048  7871 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:38.980274  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:38.957239  7959 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:38.821750  7735 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.030s	sys 0.024s
I20260709 13:17:39.002400  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:39.022727  3249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.017s	sys 0.015s
I20260709 13:17:38.912034  7889 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:39.023052  3249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.017s	sys 0.015s
W20260709 13:17:39.023314  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 669015us
I20260709 13:17:38.956101  7683 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.005976  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:39.006368  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.007190  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:39.034042  8114 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:39.034761  8114 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.037575  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:39.039155  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:39.040716  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:39.041545  3210 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:39.043315  3203 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 14. Current term is 15. Ops: [12.11-14.12]
I20260709 13:17:39.009289  3131 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:39.046209  8127 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.046892  8127 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:39.009380  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:38.870860  8083 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:39.012398  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:39.050513  3128 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:39.013769  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:39.013893  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 91315.1us
I20260709 13:17:39.014590  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:39.051745  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.016678  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:39.052760  3129 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:39.052906  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:38.923604  7893 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:17:38.814956  8089 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:39.054327  3204 raft_consensus.cc:2410] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:17:39.054076  8089 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:39.026535  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.988270  8107 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:38.988008  8077 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:39.004521  8103 log.cc:927] Time spent T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.388s	user 0.001s	sys 0.000s
I20260709 13:17:39.051694  3135 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:39.060729  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:39.063359  3249 leader_election.cc:400] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 14. Current term is 15.
W20260709 13:17:39.022400  7735 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.031s	sys 0.025s
I20260709 13:17:39.065634  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:39.083105  3202 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:39.083037  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 130276us
I20260709 13:17:39.011543  8132 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:38.842157  8090 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:38.923010  7656 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:38.987371  7847 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:39.072497  3249 leader_election.cc:403] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:17:39.073717  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 103895us
I20260709 13:17:39.082348  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:39.138109  3204 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 12: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:17:39.138953  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 117098us
I20260709 13:17:39.141491  3251 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:17:39.139401  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 87571.1us
I20260709 13:17:39.139559  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:39.010514  7964 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.143467  3203 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.016976  7486 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:39.104442  8111 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:17:39.161002  3832 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:39.143895  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 59921.9us
I20260709 13:17:39.148412  3835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 928) took 1111 ms. Trace:
W20260709 13:17:39.144585  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 81433.4us
W20260709 13:17:39.137297  7974 consensus_meta.cc:287] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.682s	user 0.012s	sys 0.001s
I20260709 13:17:39.162343  3835 rpcz_store.cc:276] 0709 13:17:38.037278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.037783 (+   505us) service_pool.cc:224] Handling call
0709 13:17:38.038444 (+   661us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.038733 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.038762 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:38.047362 (+  8600us) log.cc:844] Serialized 26 byte log entry
0709 13:17:38.792022 (+744660us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:38.792061 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.792131 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.148166 (+356035us) raft_consensus.cc:1685] finished
0709 13:17:39.148196 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.148330 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":702561,"threads_started":1,"wal-append.queue_time_us":883426}
I20260709 13:17:39.162657  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:39.171572  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:39.144963  8105 log.cc:927] Time spent T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.076s	user 0.000s	sys 0.009s
I20260709 13:17:39.029150  7959 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:39.162688  3100 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:39.172278  3208 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:17:39.165814  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:39.178355  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.179833  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.180236  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.180660  3281 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:39.180675  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.182055  3285 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:17:39.182168  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.181348  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.180776  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.183481  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:39.184057  3282 raft_consensus.cc:2410] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:17:39.183889  3202 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:17:39.060935  7683 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.185709  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.179185  3278 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:39.103317  8107 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:39.147500  7869 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:39.147662  8082 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:39.147282  8114 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:39.190389  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:39.159781  7889 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 14. Current term is 15.
I20260709 13:17:39.210414  7964 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:39.213186  7683 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:39.214164  8088 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:39.227272  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:39.161163  7871 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:39.245751  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:39.247920  8137 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:39.234879  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:39.225409  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:39.254194  3211 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:39.205437  3203 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
W20260709 13:17:39.271390  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 126858us
I20260709 13:17:39.202889  7560 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:39.272624  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:39.273564  3251 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:17:39.217679  8143 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:17:39.272202  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 81883.9us
I20260709 13:17:39.295979  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:39.287400  3204 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:39.191165  8138 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:39.291067  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 147945us
W20260709 13:17:39.294829  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 69542us
I20260709 13:17:39.301110  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:39.230244  8082 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:39.207263  7869 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:39.203415  8127 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:39.301146  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:39.302266  3250 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:39.306380  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:39.187934  7974 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.253466  8088 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:39.290468  7889 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:39.286665  8137 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:39.290411  7560 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:39.346118  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:39.346874  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:39.349781  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:39.350632  3208 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:39.312422  8082 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:39.351467  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:39.311532  7656 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:39.313089  8128 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:39.287978  7871 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:39.332741  7683 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:39.347132  8137 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.327072  8126 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:39.334153  8088 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.328935  8147 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:39.333869  8157 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:39.350839  7560 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:39.335263  7889 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:39.392668  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.393702  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.401492  3281 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:39.398866  7964 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:39.404243  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.374970  8089 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:39.404934  3281 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:39.413908  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.405638  7889 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:39.387377  7960 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:39.389043  7866 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.408484  7893 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:39.439662  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:39.441023  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 248661us
I20260709 13:17:39.445173  3100 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:39.418052  8157 raft_consensus.cc:697] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:17:39.446354  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 130732us
W20260709 13:17:39.447981  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 127844us
I20260709 13:17:39.456598  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:39.373874  8107 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:39.445793  7486 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:39.434824  7866 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.459609  8163 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:39.453976  8164 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:39.483722  8114 consensus_queue.cc:1059] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:39.469107  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.471218  7871 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:39.472004  7847 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:39.472445  7959 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:39.473333  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.477531  7960 consensus_queue.cc:1059] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:39.479516  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 149444us
I20260709 13:17:39.480194  3101 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:39.480389  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.434512  8090 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:39.483984  8164 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:39.496551  8164 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:39.496508  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:39.498517  7997 raft_consensus.cc:3055] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:39.499354  7997 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:17:39.471625  8086 consensus_meta.cc:287] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.772s	user 0.007s	sys 0.004s
I20260709 13:17:39.500552  8157 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:39.488838  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:39.506202  7847 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:39.506844  7847 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:39.507719  7974 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:39.491168  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:39.510035  3206 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:39.494441  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:39.511456  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:39.513037  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.450176  7893 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.520469  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:39.521126  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:39.523475  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:39.524508  3832 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:39.524714  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:39.525476  3840 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 9: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:39.511260  8067 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:39.550834  3135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:39.551928  3135 raft_consensus.cc:606] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:39.553104  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.553498  8114 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:39.554033  8114 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:39.550582  3102 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:39.556104  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:39.518349  7894 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:39.560444  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.520473  7960 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:39.562655  3176 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:39.526373  8166 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:39.571497  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:39.573503  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 53129.1us
I20260709 13:17:39.500499  7997 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.574002  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:39.575222  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 301387us
I20260709 13:17:39.558573  8114 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:39.579583  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.526520  8164 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.587054  3285 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:39.596832  8157 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:39.600131  8160 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:17:39.599985  8157 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:39.602357  8157 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:39.607049  7893 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:39.607697  7582 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:39.611788  8091 raft_consensus.cc:3055] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:39.612221  8091 raft_consensus.cc:740] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:39.573160  8090 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:39.577064  7464 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:39.577070  8163 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:39.620494  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:39.625346  3278 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:39.587950  7847 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:39.621052  7464 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:39.569657  7894 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.576875  8024 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:17:39.617864  8128 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:39.631908  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.628458  7464 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:39.654196  3278 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
W20260709 13:17:39.650601  8073 consensus_meta.cc:287] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.001s
I20260709 13:17:39.648149  7997 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.663223  7866 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:39.664355  7894 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:39.666010  8173 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.085s	user 0.002s	sys 0.000s
I20260709 13:17:39.654685  8128 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:39.668193  8128 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:39.671048  7899 consensus_meta.cc:287] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 1.149s	user 0.009s	sys 0.006s
I20260709 13:17:39.671485  7899 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:39.673658  7899 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:39.628758  8090 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:39.666051  3842 raft_consensus.cc:2410] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:17:39.656500  8042 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:39.682039  8042 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.684273  8042 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:39.653048  7889 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.696929  8164 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:39.698159  8067 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:39.699115  7869 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.701388  8088 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.701733  7869 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:39.704411  8088 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:39.695292  7889 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:39.690586  8137 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.714257  8091 consensus_queue.cc:260] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:39.802034  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 227930us
I20260709 13:17:39.802815  8091 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:39.804003  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:39.773015  3276 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:39.780735  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.783142  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:39.786092  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:39.788515  7560 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:39.718953  8137 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:39.807536  3280 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:17:39.839356  8082 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.841547  8137 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:39.845304  3836 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:39.845611  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:39.846022  8137 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:39.846621  8137 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:39.845220  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 241616us
I20260709 13:17:39.819285  8126 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:39.849998  8126 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:39.853287  8077 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:39.853869  8077 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:39.854583  8077 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:39.881490  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 77812.6us
I20260709 13:17:39.884380  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:39.885116  8082 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:39.891320  7560 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:39.882875  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 267403us
I20260709 13:17:39.906064  8126 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:39.910379  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.921200  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:39.925932  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:39.940156  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:39.932621  8126 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:39.918872  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 57206.1us
I20260709 13:17:39.889379  8114 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:39.942261  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:39.951359  8126 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:39.958624  8126 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:39.966914  7898 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.967693  7898 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:39.969570  8073 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:17:39.986572  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 57163.8us
I20260709 13:17:39.993330  7486 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:39.994081  7486 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:39.994585  7486 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:40.015169  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:40.016212  3278 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.020208  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1678) took 1027 ms. Trace:
I20260709 13:17:40.020711  3134 rpcz_store.cc:276] 0709 13:17:38.993021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.993210 (+   189us) service_pool.cc:224] Handling call
0709 13:17:38.993562 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.067269 (+ 73707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.067315 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.067865 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:17:39.888122 (+820257us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b18002f6da0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3bbd974bc 00007fb3b90e548b 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1
0709 13:17:39.888584 (+   462us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:39.955558 (+ 66974us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.981780 (+ 26222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.003434 (+ 21654us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.003469 (+    35us) raft_consensus.cc:1685] finished
0709 13:17:40.019643 (+ 16174us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.019920 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65371,"raft.queue_time_us":85133,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":75981,"spinlock_wait_cycles":8674688,"thread_start_us":134744,"threads_started":2,"wal-append.queue_time_us":320365}
I20260709 13:17:40.026075  7898 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:40.038452  3278 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:17:40.047075  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:40.049547  7464 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:40.049998  8077 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:40.059870  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.062080  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.062397  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.065449  8114 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:40.067487  7893 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:40.068611  7893 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:40.073002  3100 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:40.073369  7893 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:40.075177  7588 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:40.076083  7588 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:40.083127  7588 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.087632  3134 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:40.089939  7464 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:40.097313  8137 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:40.100056  8137 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:40.100761  3133 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:40.016141  3251 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:17:40.102054  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 86366.9us
I20260709 13:17:40.109136  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:40.122823  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:40.126557  3208 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:40.129778  7683 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:40.137436  7871 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:40.137492  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 586838us
I20260709 13:17:40.139262  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:40.136858  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:40.120368  8126 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:40.151583  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:40.155413  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:40.153280  7898 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:40.159663  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:40.144987  8077 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:40.179929  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:40.158987  8137 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:40.157750  7898 raft_consensus.cc:697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:40.186481  7898 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:40.189330  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:40.190460  7869 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:40.197513  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:40.199862  3209 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:40.200186  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:40.202360  8126 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:40.201893  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:40.203996  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:40.204226  3206 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:40.209214  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:40.217538  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:40.216051  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.219655  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:40.224335  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.227373  3206 raft_consensus.cc:2410] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:17:40.233271  3209 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:40.239295  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:40.250303  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 203574us
I20260709 13:17:40.251557  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:40.253341  3278 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:17:40.253423  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:40.248962  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:40.254956  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:40.255897  3282 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:40.259824  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:40.219985  7486 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:40.266928  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:40.271899  3278 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:40.266935  8073 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.275103  8073 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:40.279623  8181 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:40.283823  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:40.284847  3205 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:40.286693  3840 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:40.288722  3208 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 13: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:40.291342  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.280455  8181 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:40.298125  3206 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:40.300277  3129 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:17:40.301564  3276 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:40.306217  3133 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:17:40.308804  8181 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:40.309517  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:40.310375  3282 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:40.296344  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:40.311653  3203 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:17:40.313614  3020 catalog_manager.cc:5028] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): tablet 8e1a4d71ef0f4287999b5ee60fe02740 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:17:40.303001  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:40.317160  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 88349.9us
I20260709 13:17:40.317693  3805 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:40.319669  7889 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.325276  3204 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:40.326048  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:40.335530  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.337483  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:40.338176  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:40.343129  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:40.287258  3030 catalog_manager.cc:5697] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 10 to 11, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 11 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:40.342725  3100 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:40.341219  3283 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:40.345551  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.328699  8137 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:40.341223  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:40.339661  7871 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:40.347831  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:40.360162  3133 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 18: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:40.340518  8181 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.349684  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:40.372139  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 51094.1us
I20260709 13:17:40.376148  8165 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:40.375285  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.346515  8073 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:40.382858  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 93018.3us
I20260709 13:17:40.384289  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:40.386796  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:40.389521  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.390319  3129 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:40.391120  8164 raft_consensus.cc:993] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:17:40.391703  8164 raft_consensus.cc:1081] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:17:40.394619  8126 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:40.395511  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:40.395283  8126 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:40.381462  8181 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:40.381450  8165 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:40.365934  7889 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:40.406056  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.407194  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:40.408360  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.399405  3030 catalog_manager.cc:5697] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 10 to 12, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 12 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:40.428380  7889 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:40.427515  3030 catalog_manager.cc:5697] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 7 to 8, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 8 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:40.409427  7486 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:40.437034  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:40.431589  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:40.435916  3030 catalog_manager.cc:5697] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 6 to 14. New cstate: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.443181  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:40.442867  3030 catalog_manager.cc:5697] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 9 to 12, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 12 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.446439  3129 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:40.446903  7898 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:40.447283  7898 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:40.447682  7898 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:40.445839  3030 catalog_manager.cc:5697] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.444856  3033 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55102 (request call id 138) took 9776 ms. Trace:
I20260709 13:17:40.465039  3209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:17:40.470983  3209 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:40.471361  3209 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:40.413712  3133 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:40.475760  8107 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:40.472311  3133 raft_consensus.cc:606] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:40.484234  3030 catalog_manager.cc:5697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 8 to 9, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 9 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:40.490711  3030 catalog_manager.cc:5697] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 8 to 12, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 12 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:40.495613  8165 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:40.506670  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:40.507437  3210 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:40.510186  7683 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:40.510615  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:40.512756  7683 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:40.492168  3030 catalog_manager.cc:5697] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 8 to 11, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 11 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:40.524545  3805 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:40.525596  3203 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:40.528543  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.528532  7908 consensus_queue.cc:1059] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:17:40.529512  3135 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:40.528561  8126 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:40.537245  8077 raft_consensus.cc:2764] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:40.537850  8181 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:40.538002  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:40.538558  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.538656  3210 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:40.539204  8126 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.539716  8126 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:40.542107  8126 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:40.542913  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:40.544302  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:40.554375  8164 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:40.554968  8164 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.553689  3030 catalog_manager.cc:5697] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:40.555823  3210 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:40.557255  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:40.558756  8183 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:40.566190  8126 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:40.566895  8126 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:40.567334  8177 raft_consensus.cc:3055] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:40.567893  8177 raft_consensus.cc:740] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:40.570607  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:40.572630  8126 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:40.556020  3030 catalog_manager.cc:5697] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 3 to 12, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 12 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:40.513115  7891 consensus_queue.cc:1059] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:17:40.576601  7891 raft_consensus.cc:3055] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:40.577190  7891 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:40.544310  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:40.580075  3284 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:40.574470  3030 catalog_manager.cc:5697] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:40.555371  8164 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.589622  3209 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:40.598392  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 70421.8us
I20260709 13:17:40.606412  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:40.591338  7588 consensus_meta.cc:287] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.005s
I20260709 13:17:40.608131  8073 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:40.610147  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.613161  3135 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:40.614194  3209 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:40.610147  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 125610us
I20260709 13:17:40.611523  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.626699  3278 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:40.630554  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.618239  7683 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:40.649135  3278 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:40.591775  8177 consensus_queue.cc:260] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:40.651062  3280 pending_rounds.cc:85] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 8
I20260709 13:17:40.616497  7588 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:40.654220  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 255689us
I20260709 13:17:40.653746  3805 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:40.456321  3033 rpcz_store.cc:276] 0709 13:17:30.676650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.681902 (+  5252us) service_pool.cc:224] Handling call
0709 13:17:40.444617 (+9762715us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:38.310187 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:38.495064 (+184877us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:38.495115 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:17:38.495143 (+    28us) tablet.cc:662] Decoding operations
0709 13:17:38.503801 (+  8658us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:38.509771 (+  5970us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:38.516462 (+  6691us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:17:38.652021 (+135559us) tablet.cc:701] Row locks acquired
0709 13:17:38.652052 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:17:38.652260 (+   208us) write_op.cc:270] Start()
0709 13:17:38.652434 (+   174us) write_op.cc:276] Timestamp: P: 1783603058652197 usec, L: 0
0709 13:17:38.652464 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:17:38.680883 (+ 28419us) log.cc:844] Serialized 5974 byte log entry
0709 13:17:39.440265 (+759382us) op_driver.cc:464] REPLICATION: finished
0709 13:17:39.663512 (+223247us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3b90e50ac 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bfc25ef0
0709 13:17:39.712587 (+ 49075us) write_op.cc:301] APPLY: starting
0709 13:17:39.713116 (+   529us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:39.823525 (+110409us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:39.823784 (+   259us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:40.011179 (+187395us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:40.011709 (+   530us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:17:40.011789 (+    80us) write_op.cc:312] APPLY: finished
0709 13:17:40.012475 (+   686us) log.cc:844] Serialized 139 byte log entry
0709 13:17:40.012783 (+   308us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:40.085199 (+ 72416us) write_op.cc:454] Released schema lock
0709 13:17:40.085294 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:40.085966 (+   672us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:40.085994 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":5288,"mutex_wait_us":1143667,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":271952,"apply.run_cpu_time_us":35937,"apply.run_wall_time_us":373299,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66947,"num_ops":15,"prepare.queue_time_us":1240457,"prepare.run_cpu_time_us":35697,"prepare.run_wall_time_us":732654,"raft.queue_time_us":213544,"raft.run_cpu_time_us":21359,"raft.run_wall_time_us":254124,"replication_time_us":787583,"spinlock_wait_cycles":12662528,"thread_start_us":1685969,"threads_started":4,"wal-append.queue_time_us":534085}]]}
I20260709 13:17:40.621943  7889 consensus_queue.cc:1059] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:17:40.659309  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.652737  3280 pending_rounds.cc:107] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:17:40.665887  3280 raft_consensus.cc:2889] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:40.655238  3130 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:40.674944  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.675779  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:40.676465  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:40.677269  8195 log.cc:927] Time spent T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.146s	user 0.005s	sys 0.000s
I20260709 13:17:40.677706  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.685385  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.686121  8107 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:40.685931  7898 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:40.687245  8107 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:40.687773  8107 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:40.647365  7891 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:40.668143  7683 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:40.693769  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:40.687584  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:40.697999  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.698068  3128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c258b23309c4453b850ba59d3011c806"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:40.701570  3128 raft_consensus.cc:606] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:40.701928  3128 raft_consensus.cc:614] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:40.705608  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.709239  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.710996  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.712013  3127 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:40.696760  7588 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:40.697991  7683 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:40.716917  8177 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:40.717363  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:40.719100  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:40.719807  3278 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.721228  3131 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:40.713008  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.722500  3127 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:40.722764  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.723642  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.646070  7908 consensus_queue.cc:1059] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:17:40.725867  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.726330  7908 raft_consensus.cc:3055] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:40.726531  3132 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:40.726745  7908 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:40.727824  7908 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:40.689054  7898 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:40.733834  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:40.723850  8073 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:40.746541  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.723600  3131 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:40.735199  3030 catalog_manager.cc:5697] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:40.699374  7891 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.806959  3130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:40.825559  3130 raft_consensus.cc:606] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:40.826124  3130 raft_consensus.cc:614] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:40.831248  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:40.837342  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.839180  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:40.778344  8077 raft_consensus.cc:2764] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:40.762241  8073 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:40.778893  7908 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:40.856228  3102 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:17:40.855024  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 121350us
I20260709 13:17:40.862654  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:40.863857  3284 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:40.868151  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:40.869096  8184 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:40.869606  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.870734  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:40.871138  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.872624  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.872802  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:40.881498  3284 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
W20260709 13:17:40.881429  3134 consensus_meta.cc:287] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.006s
I20260709 13:17:40.884569  3134 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9.
I20260709 13:17:40.902294  3128 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:40.854821  8073 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:40.907555  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:40.917119  3127 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:40.919086  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:40.920311  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:40.930243  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:40.936633  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 80495.3us
W20260709 13:17:40.941638  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 73627us
I20260709 13:17:40.944939  3134 raft_consensus.cc:1240] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:40.946208  3282 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:17:40.931885  8181 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:40.947515  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 270792us
W20260709 13:17:40.961551  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.964847  3128 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:40.970120  3136 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:40.982165  3030 catalog_manager.cc:5697] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 6 to 8, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 8 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:40.984625  3278 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:40.987226  7656 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.987785  7656 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:40.988744  3133 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:40.990026  7656 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:40.940145  8077 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:40.985353  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:41.002635  3130 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:17:41.009583  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 343618us
W20260709 13:17:40.999699  7871 consensus_meta.cc:287] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.628s	user 0.017s	sys 0.000s
I20260709 13:17:40.999481  8137 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:41.017772  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 85977us
I20260709 13:17:41.023824  7871 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:41.039152  7893 raft_consensus.cc:3055] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:41.039940  7893 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:41.049198  8126 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:41.050143  8126 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.051981  7893 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:41.057536  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 86025us
I20260709 13:17:41.058786  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:41.062777  8184 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:41.063374  8184 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:41.063773  8184 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:41.073501  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 368734us
I20260709 13:17:41.076743  8082 raft_consensus.cc:993] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:17:41.079267  8082 raft_consensus.cc:1081] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:17:41.077695  3131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:41.081348  3131 raft_consensus.cc:606] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:41.081723  3131 raft_consensus.cc:614] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:41.060606  3101 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:41.068831  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:41.089197  3133 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:41.089753  3030 catalog_manager.cc:5697] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 8 to 12, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 12 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.012992  8077 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.111295  7486 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:41.112823  3030 catalog_manager.cc:5697] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 5 to 9, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 9 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:41.116214  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:41.124864  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 275500us
W20260709 13:17:41.126287  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:41.127614  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.110744  3210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:17:41.129328  3210 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.130296  3210 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.091181  8126 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:41.141197  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 80715.5us
W20260709 13:17:41.143347  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 74609.7us
I20260709 13:17:41.143848  3101 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:41.144362  3176 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:41.111856  8082 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:41.146098  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:41.149502  3204 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 16: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:41.148895  3030 catalog_manager.cc:5697] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:41.154270  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 210354us
W20260709 13:17:41.157454  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.179669  8209 consensus_queue.cc:1059] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:17:41.180732  8209 raft_consensus.cc:3055] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:41.181154  7893 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.165987  7486 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:41.181126  8209 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:41.213996  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:41.213575  8209 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.215319  8209 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:41.260633  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 117221us
I20260709 13:17:41.179096  8188 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:41.261092  3208 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:41.260842  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 116574us
I20260709 13:17:41.276278  7898 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:41.277187  7898 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:41.286203  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 319084us
W20260709 13:17:41.292156  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 93839.8us
I20260709 13:17:41.293661  8077 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:41.294646  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:41.318567  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 55225.1us
I20260709 13:17:41.319595  3101 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:41.320363  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 300019us
I20260709 13:17:41.321476  3249 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:41.328922  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:41.331512  8203 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:17:41.310963  7871 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:17:41.176604  8107 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.321225  8181 consensus_queue.cc:1059] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:17:41.341777  8107 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:41.342103  8181 raft_consensus.cc:3055] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:41.329926  3806 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:41.346180  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:41.325282  8164 consensus_meta.cc:287] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.711s	user 0.016s	sys 0.002s
I20260709 13:17:41.353385  3836 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:41.355468  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:41.327911  8222 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:41.358667  3283 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:41.360344  8206 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:41.360850  8206 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.361281  8206 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:41.362210  3838 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:41.342626  8181 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:41.366863  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:41.367715  8181 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.368975  8181 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:41.371469  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 62305.3us
I20260709 13:17:41.358755  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:41.377015  7898 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:41.347260  7869 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.380240  7869 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.352186  8107 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:41.387665  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:41.389794  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 60957.6us
I20260709 13:17:41.391507  3210 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.394698  3204 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:41.394778  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:41.374881  8188 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:41.391433  8107 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.404531  8107 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:41.407838  3210 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:41.392839  7898 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
W20260709 13:17:41.412142  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.408715  7683 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:41.412931  7486 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.413527  7683 raft_consensus.cc:697] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:41.413704  7486 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.413833  7908 consensus_queue.cc:1059] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:41.414497  7683 consensus_queue.cc:237] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.414954  8217 raft_consensus.cc:3055] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:41.404773  3101 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:41.419319  7486 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:41.419643  8217 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:17:41.419319  7891 consensus_meta.cc:287] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.576s	user 0.014s	sys 0.004s
I20260709 13:17:41.425302  8184 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.427716  8184 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:41.429610  7869 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:41.358281  8164 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.423589  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:41.431731  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:41.431913  8164 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:41.417771  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:41.433916  3836 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:41.434026  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:17:41.435531  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 44470.5us
I20260709 13:17:41.435729  7486 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:41.436295  7486 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:41.437219  7486 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.437096  8206 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.433360  8077 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:41.440124  3177 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:41.441044  8077 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:41.441481  8077 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.441814  8077 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:41.446736  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:41.424984  8217 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.449685  8217 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:41.453493  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:41.366464  8073 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.457607  3832 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:41.458156  3176 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:41.459619  8091 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:41.461410  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:41.452785  8107 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.473230  8220 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:41.475085  8107 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:41.480386  7486 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.475520  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:41.468302  8206 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:41.479589  8077 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.466645  8073 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:41.485245  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 54772.4us
I20260709 13:17:41.482417  8126 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.488545  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:41.502643  3204 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:41.502050  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:41.507277  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 47782.8us
I20260709 13:17:41.508124  3210 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:17:41.506544  8164 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
W20260709 13:17:41.509821  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 105151us
I20260709 13:17:41.511978  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:41.512784  3278 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:41.518002  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 44711.5us
W20260709 13:17:41.523509  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.515275  8184 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:41.551527  3210 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:41.560875  3249 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:41.571166  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:41.563489  8082 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:17:41.565534  8183 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:17:41.574961  8183 raft_consensus.cc:3055] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:41.575387  8183 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:41.576222  8183 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.576848  7656 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:41.577284  7656 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:41.578058  7656 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.578583  8077 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:41.579079  7486 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:41.579505  7656 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.580511  8216 consensus_queue.cc:1059] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:17:41.581634  8216 raft_consensus.cc:3055] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:41.581981  8216 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:41.582144  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:41.582772  3832 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:41.580713  8188 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:41.580552  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:41.561784  8091 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:41.604105  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.567829  8220 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:41.605741  3832 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
I20260709 13:17:41.607113  3177 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
W20260709 13:17:41.621157  3021 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 023c1461b69c46bdb3c42ee16f303ea2 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0930e3e7657c43bcaaa5b0778f3e08cf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:17:41.622285  3021 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 72436.3us
I20260709 13:17:41.623473  8077 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:41.624437  8077 raft_consensus.cc:697] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:41.625619  8077 consensus_queue.cc:237] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.571306  7683 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:41.630332  7683 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:41.631347  7683 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:41.632292  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.635284  3204 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:41.635838  3278 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
W20260709 13:17:41.637952  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 83052.5us
I20260709 13:17:41.641381  8183 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.639623  3806 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:41.640098  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:41.609606  8220 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:41.583168  8216 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.647109  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:41.639654  8184 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:41.653735  8091 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:41.653957  8221 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:41.654218  8091 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:41.654969  8091 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:41.648556  8107 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:41.659301  8107 raft_consensus.cc:697] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:41.671193  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:41.654891  8221 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:17:41.684464  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.684922  8221 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:41.688735  3805 leader_election.cc:336] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.851s (SENT)
I20260709 13:17:41.669775  8184 raft_consensus.cc:697] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:17:41.694805  3805 leader_election.cc:336] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.900s (SENT)
I20260709 13:17:41.660825  8107 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:41.697618  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 117149us
I20260709 13:17:41.698367  3101 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:41.699036  3805 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:41.702829  8181 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:41.702915  8184 consensus_queue.cc:237] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.703879  8181 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:41.706012  8209 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:41.707780  8216 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:41.723531  3805 leader_election.cc:336] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.935s (SENT)
I20260709 13:17:41.725669  3208 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:41.729669  8231 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:41.729821  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 78700.1us
I20260709 13:17:41.730546  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:41.730258  8231 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.731158  3283 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:41.731637  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:41.720319  8232 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:41.724926  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:41.733390  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:41.733304  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.743067  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:41.744431  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:41.746058  3278 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:41.748346  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:41.749464  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:41.734165  8227 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:17:41.737416  7893 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:41.737718  8126 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:41.704873  8181 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.749727  8232 raft_consensus.cc:2764] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:41.750157  8164 consensus_queue.cc:1059] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:17:41.785550  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:41.733044  8231 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:41.787683  8077 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:41.804802  8164 raft_consensus.cc:3055] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:41.805506  8164 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:17:41.808032  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.806793  8164 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.809958  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:41.798220  8077 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:41.820181  8232 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:41.821058  8232 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:41.821230  8206 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:41.821647  8232 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.821916  8206 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.822468  8206 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.760326  8091 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.828017  3208 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:17:41.828415  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 50119.4us
W20260709 13:17:41.820279  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 48804.9us
I20260709 13:17:41.829489  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:41.830313  8126 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:41.831369  7893 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:41.831741  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:41.831983  3250 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:41.832479  8126 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:41.833437  8213 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:41.835520  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:41.820600  8077 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:41.837396  8213 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:41.845391  3204 raft_consensus.cc:1275] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:17:41.846227  8091 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:41.866775  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:41.867192  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:41.868865  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:41.879310  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:41.885270  7891 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.887290  7891 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.897213  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:41.890776  7869 consensus_queue.cc:1059] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:17:41.881919  8164 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.903693  8215 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:41.904560  8215 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.904604  8222 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:41.905756  8222 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.906659  8232 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.904920  8137 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.906971  8215 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:41.908810  8215 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.907729  8137 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:41.909771  8237 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:17:41.911051  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:41.911129  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:41.911477  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:41.913060  8137 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:41.913309  7908 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:41.908744  8222 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:41.914305  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:41.918133  7891 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:41.909921  8215 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.902489  8219 raft_consensus.cc:3055] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:41.921165  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:41.921707  8219 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:41.922583  3210 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:41.924984  3249 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:41.925981  7869 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:41.926424  7869 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.927284  7869 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.926308  7908 consensus_queue.cc:1059] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:41.929391  7893 raft_consensus.cc:3055] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:41.929958  7893 raft_consensus.cc:740] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:41.848872  8220 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.931834  3838 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:41.935302  8217 consensus_queue.cc:1059] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:41.936720  8217 raft_consensus.cc:3055] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:41.937150  8217 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:41.938639  8217 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.931270  7893 consensus_queue.cc:260] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.940392  8217 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:41.941044  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:41.941957  3203 raft_consensus.cc:2393] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:41.943248  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:41.944486  3210 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 10: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:41.945438  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:41.946027  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:41.946260  3205 raft_consensus.cc:2410] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 19 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:17:41.946310  3100 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:41.946851  3204 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:41.948436  3100 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:41.948702  8220 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:41.949173  7656 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:41.949246  8082 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:41.951717  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:41.952558  3133 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:41.894842  3206 raft_consensus.cc:2376] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17. Re-sending same reply.
I20260709 13:17:41.955634  3136 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:41.956043  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:41.957168  3129 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:41.957540  3838 raft_consensus.cc:1240] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:41.959802  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:41.961647  3204 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:41.963352  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:41.962692  3135 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:17:41.965806  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:41.962625  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:41.969357  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:41.969985  3128 raft_consensus.cc:2376] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 9. Re-sending same reply.
I20260709 13:17:41.952239  8082 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:41.970948  8082 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.974184  8188 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.974934  8188 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.977111  8215 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:41.979013  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:41.979923  3135 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:41.982903  8181 consensus_queue.cc:1059] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:41.920893  8232 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:41.984050  8181 raft_consensus.cc:3055] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:41.984632  8181 raft_consensus.cc:740] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:41.985814  8181 consensus_queue.cc:260] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.987295  8181 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:41.988027  8247 log.cc:927] Time spent T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:17:41.924280  8219 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:41.989583  8219 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:41.989987  3204 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:41.980542  8077 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:41.993898  3209 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:41.994930  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:41.994644  8177 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:41.996151  8222 consensus_queue.cc:1059] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:42.013521  8222 raft_consensus.cc:3055] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:42.014684  8222 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:42.014945  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:41.996865  8177 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:42.017773  3805 leader_election.cc:336] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.183s (SENT)
I20260709 13:17:42.018154  3206 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:42.018343  3805 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:42.020006  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:42.020733  8220 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:42.021390  3204 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:17:42.022514  8216 consensus_queue.cc:1059] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:42.022828  8206 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:42.025048  8242 raft_consensus.cc:3055] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:42.025564  8242 raft_consensus.cc:740] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:42.026526  8242 consensus_queue.cc:260] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:42.027529  8242 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:42.029848  3210 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:42.031611  8213 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:42.038287  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:42.003327  8188 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:42.004056  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.041721  3131 raft_consensus.cc:2393] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:42.007449  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.010186  3129 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:42.010875  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.038434  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:42.055881  7869 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:42.058271  8222 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:42.066916  8222 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:42.085821  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:42.087073  3204 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.998323  8077 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:42.112254  3135 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
W20260709 13:17:42.113742  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 95997.2us
I20260709 13:17:42.113236  3127 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:42.114745  3203 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:42.115988  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:42.117658  7869 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:42.117839  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:42.118502  3132 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:42.119361  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.121172  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.122826  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.123279  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:42.123749  3127 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:42.124194  3203 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:42.125792  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:42.126345  3130 raft_consensus.cc:2376] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16. Re-sending same reply.
I20260709 13:17:42.129069  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.129071  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.130158  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.130288  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.130913  3136 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:17:42.122920  8250 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.110s	user 0.000s	sys 0.002s
I20260709 13:17:42.132540  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:42.134243  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.137497  3130 raft_consensus.cc:2410] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:17:42.111905  8206 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:42.138525  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:42.145892  3276 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:42.146983  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:42.148618  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 235974us
I20260709 13:17:42.150660  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:42.150772  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:42.152155  3281 raft_consensus.cc:2368] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13.
I20260709 13:17:42.155099  3285 raft_consensus.cc:2410] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 19 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:17:42.156388  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:42.157591  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:42.160825  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.162259  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:42.162801  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.169026  3251 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:42.169318  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.170426  3134 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:42.128795  8216 consensus_queue.cc:1059] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:17:42.183477  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:42.175274  8188 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:42.186311  8188 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:42.188433  8188 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:42.140811  8220 consensus_queue.cc:1059] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:17:42.194384  7891 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:42.194978  7891 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:42.198526  7893 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.198889  8082 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:42.200131  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.166585  8209 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:17:42.202503  8209 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:42.202840  3129 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:42.203473  8209 consensus_queue.cc:1243] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer fc48eecc27554cb58b15193cd442b1d3 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:17:42.200851  3136 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:42.161192  8107 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.205606  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.205775  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:42.206372  3136 raft_consensus.cc:2376] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13. Re-sending same reply.
I20260709 13:17:42.206836  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.206979  7891 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:42.208834  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:42.165285  7871 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:42.209854  3203 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:42.210834  7656 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:42.203899  3283 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:17:42.211694  3133 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:42.216429  3128 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:42.217622  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:42.218773  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.219122  3134 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
W20260709 13:17:42.220777  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 66222.1us
I20260709 13:17:42.222766  3132 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:42.226568  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:42.160926  8177 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:42.220566  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:42.216238  3249 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:42.229274  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:42.231691  3205 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:42.242813  3204 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:42.252347  3209 raft_consensus.cc:2393] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:42.253585  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:42.257220  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:17:42.260098  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 96001.9us
I20260709 13:17:42.260814  3806 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:42.262881  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:42.266724  3101 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:42.276504  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:42.271733  3249 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:42.278409  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:42.280848  8216 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:42.287295  8188 raft_consensus.cc:3055] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:42.289288  8248 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:42.269300  8244 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:42.276301  8215 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:42.288949  8073 raft_consensus.cc:3055] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:42.294643  3832 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:42.302486  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:42.302178  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:42.261444  8126 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.310281  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:42.331519  3284 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:42.319622  3279 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:42.310763  8188 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:42.322330  8244 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:42.322719  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:42.327605  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:42.328502  8082 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:42.334316  3205 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:17:42.349277  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:42.354001  3202 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:42.341936  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:42.277808  7869 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:42.336644  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:42.342370  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:42.269340  8177 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:42.328742  7908 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:42.370081  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:42.382407  3284 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:42.329998  8206 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:42.396071  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:42.342269  8073 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:42.402014  3279 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.402313  3284 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:42.345991  8248 raft_consensus.cc:697] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:42.407748  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:42.405882  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 121609us
I20260709 13:17:42.346204  8244 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:42.412134  8243 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.332s	user 0.000s	sys 0.005s
I20260709 13:17:42.412282  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:42.415161  8253 raft_consensus.cc:2764] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:17:42.416189  8253 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:42.419190  3205 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:42.423177  8107 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:42.423413  3205 raft_consensus.cc:3055] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:42.424254  3205 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:42.395358  7908 raft_consensus.cc:697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:42.425056  3205 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:42.429731  3205 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.432325  3277 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:42.432484  8248 consensus_queue.cc:237] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:42.373303  8232 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:17:42.437242  8252 consensus_queue.cc:1048] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:17:42.439124  8232 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:42.439483  8232 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:42.440101  8232 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:42.409770  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:42.439975  8188 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:42.446885  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 168287us
I20260709 13:17:42.447611  3101 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:42.445669  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:42.449420  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 196705us
I20260709 13:17:42.346428  8126 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:42.452716  8242 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:42.418448  8253 consensus_queue.cc:1059] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:17:42.463490  8107 raft_consensus.cc:3055] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:42.464406  8107 raft_consensus.cc:740] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:42.403656  8215 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:42.465593  8215 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:42.465517  8107 consensus_queue.cc:260] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:42.467149  8188 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.467293  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:42.478008  8256 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:42.479048  8256 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:42.403975  8177 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:42.484040  3280 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.450930  8082 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:17:42.485512  8177 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:42.487780  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:42.484762  8256 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:42.487020  8126 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:42.484162  3283 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:42.446322  3279 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:42.491006  3211 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:42.487291  3285 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
W20260709 13:17:42.493903  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45221.4us
I20260709 13:17:42.499097  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:42.440956  3205 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:42.512643  3280 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
W20260709 13:17:42.511976  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 232522us
I20260709 13:17:42.504261  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:42.517796  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 131851us
I20260709 13:17:42.523854  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:42.519361  3282 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
W20260709 13:17:42.532629  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.534041  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 273267us
W20260709 13:17:42.535009  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 185801us
I20260709 13:17:42.534878  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:42.454885  8073 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:42.538776  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 88454.5us
I20260709 13:17:42.542822  3250 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:42.426357  7908 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:42.546761  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:42.547906  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:42.548601  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:42.548755  3128 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.549347  3132 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 13: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:42.550311  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:42.546734  3806 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:42.553526  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.554073  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:42.554420  3135 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:42.554767  3130 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.553572  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.556154  3133 raft_consensus.cc:2368] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16.
I20260709 13:17:42.563143  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.564136  3132 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 10: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:42.564834  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:42.571511  3128 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:42.539402  8261 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:42.585040  3130 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:42.590583  3127 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
W20260709 13:17:42.632869  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 79213.4us
I20260709 13:17:42.555689  8183 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:42.641062  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:42.594756  7891 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:42.643960  8232 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:42.539125  8255 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:17:42.555224  8242 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
W20260709 13:17:42.656920  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.672849  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.725607  3130 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:17:42.672962  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 130236us
I20260709 13:17:42.727880  3250 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:42.729249  8232 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:42.728428  7683 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:42.644570  8252 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:42.651785  8073 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.667820  8261 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:42.551059  8220 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:17:42.704550  8181 consensus_meta.cc:287] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.717s	user 0.009s	sys 0.011s
I20260709 13:17:42.704331  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:42.707291  8249 log.cc:927] Time spent T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:17:42.709565  8215 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:42.703166  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:42.762754  8252 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.764045  8107 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:42.753742  7871 raft_consensus.cc:3055] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:42.767220  7871 raft_consensus.cc:740] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:17:42.696818  8259 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:17:42.754338  3132 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
W20260709 13:17:42.755149  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.755225  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:42.742960  7908 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:42.789495  3127 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:42.794015  3134 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:42.802022  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.802623  8232 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:42.803032  8232 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:42.803236  8219 consensus_meta.cc:287] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.813s	user 0.018s	sys 0.000s
I20260709 13:17:42.803434  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:42.804322  3133 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 18: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:42.804804  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:42.805203  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:42.803460  8232 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:42.806087  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:42.815390  8244 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:42.833704  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 79472.9us
I20260709 13:17:42.823403  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:42.830070  3129 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:42.834828  3250 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:42.768795  7871 consensus_queue.cc:260] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:42.838187  3102 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:42.846722  3130 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:42.841032  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:42.784266  8220 raft_consensus.cc:697] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:17:42.865710  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 165037us
I20260709 13:17:42.867147  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:42.763434  8252 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:42.885020  3132 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
W20260709 13:17:42.885727  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 292943us
I20260709 13:17:42.853655  8177 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:42.888980  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:42.890718  3101 leader_election.cc:400] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13.
I20260709 13:17:42.891104  3101 leader_election.cc:403] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:42.893456  3205 raft_consensus.cc:3055] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:42.864773  8164 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:42.894003  3205 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:42.870831  7869 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:42.899832  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:42.907783  3131 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:42.920825  3281 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:17:42.891084  8241 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.007s	sys 0.018s
W20260709 13:17:42.922851  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 81877.5us
W20260709 13:17:42.946936  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47401us
I20260709 13:17:42.910543  8261 raft_consensus.cc:697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:17:42.946312  3021 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 023c1461b69c46bdb3c42ee16f303ea2 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0930e3e7657c43bcaaa5b0778f3e08cf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:42.949203  3205 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:42.953032  3101 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:42.961189  3205 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:42.947288  3250 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:42.902527  8253 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:42.953719  8241 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.007s	sys 0.019s
I20260709 13:17:42.945524  8177 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:42.983428  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 109988us
I20260709 13:17:42.955016  8242 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:42.991181  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:42.956720  8255 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:42.993022  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.992844  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 45666.9us
I20260709 13:17:42.998997  3250 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:42.993193  3176 leader_election.cc:400] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16.
I20260709 13:17:42.991675  8253 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:42.999816  3176 leader_election.cc:403] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:42.967188  8215 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:43.004408  3135 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:42.969403  8077 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.954694  8262 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:17:42.992417  8219 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:43.007256  8222 consensus_meta.cc:287] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.931s	user 0.020s	sys 0.002s
I20260709 13:17:43.034603  3205 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:17:43.036818  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 43815us
I20260709 13:17:43.048604  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:43.012688  7893 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:43.048372  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 49439.1us
I20260709 13:17:43.051436  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:42.999442  8177 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:43.012578  8077 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:43.049448  8219 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:42.994701  8220 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:43.066771  8203 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:43.098990  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 47636.7us
I20260709 13:17:43.081797  8215 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:43.131122  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 82583.1us
I20260709 13:17:43.071712  8222 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:17:43.131969  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:43.089236  8219 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:43.089886  8082 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.141713  8077 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:43.142675  8264 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:17:43.158375  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:43.099841  8276 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16.
I20260709 13:17:43.092491  8279 raft_consensus.cc:2764] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:43.095959  8232 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:43.152004  3129 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:17:43.156780  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 56592.5us
I20260709 13:17:43.176885  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:43.150192  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:43.066383  8261 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:43.188124  3250 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:43.193056  3832 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:17:43.160655  8252 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:43.216619  3832 pending_rounds.cc:85] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 11
I20260709 13:17:43.221675  3832 pending_rounds.cc:107] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:17:43.222399  3832 raft_consensus.cc:2889] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:43.168295  8077 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:43.230814  3134 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:43.138124  8215 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:43.235198  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 47188.8us
I20260709 13:17:43.181186  8164 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.179157  8244 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:43.230538  8267 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.312s	user 0.002s	sys 0.000s
I20260709 13:17:43.260000  8222 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:43.260396  8281 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:17:43.260615  8222 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:43.171063  8082 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:43.265621  8203 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.265558  8222 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:43.266322  8203 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:43.266942  8082 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:43.268448  8203 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:43.271282  7891 consensus_meta.cc:287] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.002s
I20260709 13:17:43.271754  7891 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:43.272516  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:43.272957  3130 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:43.277685  8077 raft_consensus.cc:697] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:43.282567  3805 leader_election.cc:336] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.672s (SENT)
I20260709 13:17:43.283279  8126 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:43.284541  8126 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:43.232512  8276 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:43.168967  8209 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:17:43.282742  8279 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:43.283581  3805 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:43.290124  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.305388  3282 raft_consensus.cc:2393] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:43.283629  8268 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:43.292518  8126 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:43.293188  3276 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:43.253573  8164 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:43.294216  8209 raft_consensus.cc:3055] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:43.279064  8077 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:43.250878  8251 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:43.296432  8273 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:43.298722  8107 consensus_meta.cc:287] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
I20260709 13:17:43.299067  3806 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:43.173285  8188 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.290371  3280 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:43.255299  8253 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:43.308161  8268 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:43.310151  8288 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:43.311156  8283 log.cc:927] Time spent T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:17:43.234042  7871 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.312830  8209 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:43.321338  3132 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:43.329389  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 179283us
I20260709 13:17:43.308439  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.356691  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:17:43.331027  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 48535.2us
I20260709 13:17:43.256282  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:43.191838  7893 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:43.315759  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.354068  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:43.318811  8262 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:43.354068  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:43.348042  8073 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:43.341733  8203 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.359514  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:43.370167  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.352671  8082 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:43.373008  3211 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:43.387221  3280 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:43.307216  8279 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:43.365821  8222 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.362251  8255 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:43.370795  8073 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.396301  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:43.368494  8177 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:43.397854  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:43.342621  8273 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:43.352744  8188 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:43.402616  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 146448us
I20260709 13:17:43.400072  3838 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:43.408764  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.409829  3284 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:43.418512  8291 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:43.415491  3806 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:43.403956  8073 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.376866  8203 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:43.416998  3251 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:43.394755  8082 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:43.370476  8288 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:43.457543  8279 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:43.458230  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 51591.1us
I20260709 13:17:43.428471  8232 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:43.460911  3250 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:43.457314  8268 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:43.440812  8248 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.463569  8248 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:43.466212  8188 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:43.466332  8248 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:43.404702  8222 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:43.468504  8222 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:43.444207  8292 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.443463  8262 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:43.447392  7683 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:43.476764  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 78992.7us
I20260709 13:17:43.405030  8255 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:43.405623  8209 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:43.429525  8221 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:17:43.487984  8284 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:43.488610  8284 raft_consensus.cc:697] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:43.488785  8255 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:43.490573  8082 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:43.491109  8296 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:43.491678  8296 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:43.494117  8296 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:43.494695  8285 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:43.478820  8248 raft_consensus.cc:2764] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:17:43.492221  8271 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.495s	user 0.004s	sys 0.003s
I20260709 13:17:43.496955  8276 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:43.501258  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 108072us
I20260709 13:17:43.503279  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:43.510252  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:43.472627  8262 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.517230  3208 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:43.518083  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:43.520372  3210 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:43.478101  7683 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.522616  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:43.527877  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:43.526571  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:43.568615  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:43.481241  8215 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:43.580024  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:43.582938  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:43.485654  8293 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:43.521694  8262 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:43.585253  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 58804.9us
I20260709 13:17:43.586027  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:43.593465  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:43.593643  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:43.594772  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:43.500504  8252 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:17:43.556097  7683 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:43.597584  3805 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:43.585966  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 56190.5us
I20260709 13:17:43.554158  8082 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:43.598802  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:43.599471  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:43.599581  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:43.608355  3130 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:43.608536  3132 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:43.569644  8276 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:43.469354  8292 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:43.569742  8232 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:43.602828  3129 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:43.580629  8285 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:43.605546  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.607461  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:43.595053  8215 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:43.595882  8296 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:43.583798  8222 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:17:43.644604  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 157240us
I20260709 13:17:43.645635  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:43.602919  8126 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:43.639873  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.641770  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:43.642758  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.623049  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:43.670699  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45508.2us
I20260709 13:17:43.676331  8273 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:43.677675  8242 consensus_meta.cc:287] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.671s	user 0.012s	sys 0.003s
I20260709 13:17:43.688694  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.680007  3285 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
W20260709 13:17:43.690186  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 44674us
I20260709 13:17:43.691159  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:43.692267  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.600102  8279 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:17:43.629300  8285 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:43.683012  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.639287  8244 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:43.791659  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.685070  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.680662  3279 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:43.686808  3127 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.636624  8289 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:43.624305  8268 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:43.624214  8220 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:43.614820  8304 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:43.680292  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 82805.4us
I20260709 13:17:43.646397  7869 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:17:43.700598  8301 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.597050  8293 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:43.691377  8242 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13.
I20260709 13:17:43.702986  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.704428  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.691557  7891 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:43.728713  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:43.732390  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:43.733569  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:43.736006  8209 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:43.737793  8273 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:43.744791  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:43.746848  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:43.646065  8248 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
W20260709 13:17:43.754480  8297 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:17:43.778148  8288 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:43.857919  3207 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:43.841948  8177 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:43.784396  8164 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:43.784922  8284 consensus_queue.cc:237] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:43.621802  8232 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:43.626781  8276 raft_consensus.cc:697] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:43.684824  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.685137  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:43.877177  3283 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:43.821194  3135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1719) took 1019 ms. Trace:
I20260709 13:17:43.644268  8299 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:43.832878  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.792222  8244 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.791917  8285 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:43.850756  3840 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:43.852726  3285 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:43.854874  8126 raft_consensus.cc:697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:43.859017  3842 raft_consensus.cc:2393] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 16: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:43.780289  8292 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:43.834110  8296 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:43.877344  3280 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:43.793395  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:43.877791  3135 rpcz_store.cc:276] 0709 13:17:42.801301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.804931 (+  3630us) service_pool.cc:224] Handling call
0709 13:17:43.820793 (+1015862us) spinlock_profiling.cc:243] Waited 80.3 ms on lock 0x7b54000dd754. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:43.821023 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184653056}
W20260709 13:17:43.884217  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 193115us
I20260709 13:17:43.915881  3250 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:43.852555  8082 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.849928  7891 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:43.888259  3127 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:43.857669  8304 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.847518  8107 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:17:43.857985  8273 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:43.848536  8301 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.022817  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:43.906675  3161 heartbeater.cc:646] Failed to heartbeat to 127.1.250.126:33381 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.1.250.126:33381 timed out after 15.000s (SENT)
I20260709 13:17:44.026062  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:43.909219  8303 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:17:43.909960  8280 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:43.878193  8232 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:43.884701  7889 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.945007  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:43.953691  8276 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:43.893580  8244 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:43.955451  8082 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:43.942859  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 207452us
I20260709 13:17:44.009835  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:44.013638  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 97833us
I20260709 13:17:44.042599  3205 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:44.015204  8177 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:43.904675  8260 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:44.023840  3210 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:43.960676  7891 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:44.013715  7871 consensus_meta.cc:287] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.655s	user 0.013s	sys 0.001s
I20260709 13:17:44.019848  7869 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:44.044976  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:44.017995  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 158649us
I20260709 13:17:44.062068  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.037228  8222 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:44.059825  8177 raft_consensus.cc:697] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:44.041720  7889 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.077894  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.080358  7683 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.085419  3278 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:44.085419  8248 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:44.075860  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:44.074741  8296 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.035046  8280 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.088493  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.088743  8293 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:44.056448  8203 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:44.089748  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.028635  8262 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.097343  8289 raft_consensus.cc:697] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:44.091034  3210 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
W20260709 13:17:44.096356  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.021651  8304 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.121538  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:44.060700  7869 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:44.123687  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 78822.4us
I20260709 13:17:44.108721  8293 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:44.056684  8260 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.135342  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:44.137809  8327 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:44.147523  8327 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.149930  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.153694  7683 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:44.089749  8126 consensus_queue.cc:237] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.158731  8262 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.138013  7908 raft_consensus.cc:2764] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:44.142220  8302 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.143473  7869 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:44.163426  8302 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.106612  8206 consensus_queue.cc:1059] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:17:44.169179  7869 raft_consensus.cc:3055] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:44.169708  7869 raft_consensus.cc:740] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:44.170727  7869 consensus_queue.cc:260] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.172091  7869 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:44.132918  8279 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:44.174901  8279 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 18 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:44.138386  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:44.101564  8222 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.151211  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:44.145965  8311 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:17:44.149960  8177 consensus_queue.cc:237] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:44.202471  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 71436us
I20260709 13:17:44.144994  8289 consensus_queue.cc:237] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.202863  8279 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.203290  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.216398  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:44.217748  3135 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:44.219158  3127 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:44.223841  3129 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:44.145418  8082 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.229213  3128 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:44.226559  3131 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:44.226698  3100 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:44.190183  8299 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:44.233530  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:44.209440  8306 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.282s	user 0.001s	sys 0.001s
I20260709 13:17:44.234658  3135 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:44.235404  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:44.187093  8293 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:44.232849  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:44.206717  8318 log.cc:927] Time spent T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.185s	user 0.002s	sys 0.000s
W20260709 13:17:44.208079  8291 consensus_meta.cc:287] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.789s	user 0.007s	sys 0.002s
I20260709 13:17:44.221546  8209 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:44.237641  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:44.240336  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:44.242651  7656 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:44.243980  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.244572  7889 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:44.230124  8203 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.245398  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:44.280895  3132 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:44.144172  8301 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:44.245464  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:44.250551  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:44.281958  3129 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:44.208005  8302 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:44.263307  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 134989us
I20260709 13:17:44.282828  3131 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:44.268711  8291 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:44.284895  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:44.209223  8327 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.285928  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:44.229465  8262 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.288069  8262 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.289529  8293 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.269455  3136 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:44.201884  8280 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.276784  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.278494  3203 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:44.235553  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:44.298473  3128 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
W20260709 13:17:44.255673  8073 consensus_meta.cc:287] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.808s	user 0.019s	sys 0.000s
I20260709 13:17:44.299111  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.299541  8073 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.300045  3203 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:44.300736  3832 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 11: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:44.285398  3206 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:44.291946  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.301846  3202 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:44.302173  3100 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:44.292496  3127 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:44.308964  8073 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:44.310827  3135 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:44.312819  8222 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.313344  8304 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.295670  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:44.316514  3100 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:44.336478  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:44.337189  3135 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:44.342753  3805 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:44.335565  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:44.338387  8219 consensus_meta.cc:287] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.162s	user 0.015s	sys 0.000s
I20260709 13:17:44.336213  8302 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:44.335407  8299 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:44.334990  8304 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.367553  3136 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:44.355525  8256 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:44.367739  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:44.351528  8222 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:44.368321  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.291970  8203 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.294611  8260 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.370882  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:44.361979  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:44.368932  8177 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:44.367872  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:44.339395  8291 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:44.349470  8073 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:44.349663  8206 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.279374  8209 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.408309  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:44.409068  3133 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:44.408088  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:44.443974  3836 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:44.367183  8219 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.423722  8326 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:44.375978  8302 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.365197  8262 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:44.424446  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:44.375113  8299 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:44.405041  8256 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.406675  8222 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.445477  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:44.464576  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:44.466049  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:44.408586  8304 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.425400  8177 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.425098  8291 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.455696  8288 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:44.461223  8302 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:44.440976  8333 consensus_queue.cc:1059] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:17:44.466671  8222 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:44.466768  8256 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:44.478578  8126 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:44.467092  8299 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:44.474502  8282 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:44.468711  8260 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:44.454578  8206 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.485535  8221 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.486097  8242 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.542788  8330 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.543392  8242 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.543623  8330 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.545635  8242 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.465415  8341 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.546537  8341 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:44.547295  8343 log.cc:927] Time spent T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:44.548787  8341 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:44.534860  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.542335  8221 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:44.550258  8340 log.cc:927] Time spent T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:17:44.551273  8221 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:44.552073  8339 log.cc:927] Time spent T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:17:44.557246  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.560879  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2971) took 1238 ms. Trace:
W20260709 13:17:44.561789  8338 log.cc:927] Time spent T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:17:44.561880  3276 rpcz_store.cc:276] 0709 13:17:43.322999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.323279 (+   280us) service_pool.cc:224] Handling call
0709 13:17:43.324134 (+   855us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:43.324736 (+   602us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:43.350553 (+ 25817us) log.cc:844] Serialized 14 byte log entry
0709 13:17:43.521069 (+170516us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:43.571519 (+ 50450us) log.cc:844] Serialized 52 byte log entry
0709 13:17:43.571691 (+   172us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:43.571736 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.571843 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:44.553810 (+981967us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b18000d5100. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:44.560454 (+  6644us) raft_consensus.cc:1685] finished
0709 13:17:44.560580 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.560776 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6241,"prepare.queue_time_us":29531,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2262,"raft.queue_time_us":50837,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":13523,"spinlock_wait_cycles":7769344,"thread_start_us":145059,"threads_started":1,"wal-append.queue_time_us":216222}
I20260709 13:17:44.508703  8289 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:44.515731  8345 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.569840  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.516145  8126 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:44.580479  8244 consensus_meta.cc:287] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.523s	user 0.022s	sys 0.000s
I20260709 13:17:44.493777  8284 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:17:44.586882  8260 raft_consensus.cc:697] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:44.513037  8326 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:44.553702  7891 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:44.625553  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 254033us
I20260709 13:17:44.588884  8206 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:44.577504  8282 raft_consensus.cc:697] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:44.600195  8126 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:44.677311  8299 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.635736  8326 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.680550  8326 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:44.646540  3836 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
W20260709 13:17:44.649716  8344 log.cc:927] Time spent T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:17:44.650161  8203 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:44.650523  8219 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:44.651613  8177 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:44.652953  8291 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.663343  7891 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:44.663776  8260 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.705354  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.668183  8304 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:44.599542  8345 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:44.672483  8232 consensus_meta.cc:287] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.013s
I20260709 13:17:44.677706  8273 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.640868  8209 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.683395  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.736881  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.678289  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.737805  8345 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:44.738481  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.739583  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:44.685562  7869 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:44.741217  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:44.741919  3280 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:44.741725  8302 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.592456  8289 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.742933  3132 raft_consensus.cc:2368] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12.
I20260709 13:17:44.744553  8289 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:44.627710  8244 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.745590  8304 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:44.693298  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.697918  8252 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.746138  8304 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.746698  8244 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.746477  8252 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.748304  8304 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.748363  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:44.748725  8252 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:44.700796  8261 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.749370  8261 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.749694  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.750741  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:44.751453  8261 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.707600  3177 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:44.711457  3102 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:44.752497  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 44981.4us
I20260709 13:17:44.753437  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:44.754724  3102 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:44.755646  8221 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:44.756037  8221 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.756368  8221 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:44.758077  8082 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:44.758514  8288 raft_consensus.cc:3055] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:44.758904  8288 raft_consensus.cc:740] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:44.759789  8288 consensus_queue.cc:260] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.715705  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.761258  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:44.761559  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:44.761940  3277 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:44.762147  3205 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:44.740789  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.765004  8326 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:44.765569  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.765780  8232 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.718410  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:44.766919  3208 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:44.766211  3209 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:17:44.767352  3841 raft_consensus.cc:2393] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 11: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:44.719458  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:44.767949  8232 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.767995  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.768563  3832 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:44.768667  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.726969  3278 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:44.728886  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:44.718715  8222 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.731068  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:44.731717  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:44.785787  3134 raft_consensus.cc:1275] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:44.786000  3836 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:44.786216  3281 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:44.735304  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:44.787232  3283 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:44.769255  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:44.787988  3209 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:44.751245  3206 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:44.789390  3834 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 13: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:44.789600  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:44.789942  3285 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:44.777321  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:44.781486  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:44.780833  3279 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:44.770344  3128 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:44.791755  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:44.792575  3276 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:44.790503  3205 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:44.794672  3128 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:44.794282  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:44.796947  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:44.797267  3176 leader_election.cc:400] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12.
I20260709 13:17:44.797593  3176 leader_election.cc:403] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:44.799284  3102 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:44.811178  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:44.814318  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:44.769694  8285 consensus_meta.cc:287] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.808s	user 0.007s	sys 0.008s
I20260709 13:17:44.826717  3208 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:44.827591  8222 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.822448  8181 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:44.824244  8285 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.836202  8285 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:44.812448  8252 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:44.819780  8326 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:44.856648  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:44.837023  8272 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.773020  8256 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:44.860644  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:44.859007  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:44.839192  8304 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:44.821835  8324 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:17:44.858259  8252 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:44.894876  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 260543us
I20260709 13:17:44.876351  8304 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.902532  3209 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:17:44.877389  8330 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:44.838415  8126 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:44.924820  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 290789us
I20260709 13:17:44.863694  8291 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:17:44.897215  8252 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:44.880908  8353 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:44.955783  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 115671us
I20260709 13:17:44.921811  8304 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:44.997428  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 44594.4us
I20260709 13:17:44.997632  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:44.999135  3207 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:44.894817  7889 consensus_queue.cc:1059] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:17:44.999496  7908 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:45.003331  8126 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:44.863432  8282 consensus_queue.cc:237] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:44.896668  8232 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:17:44.889955  8272 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.009654  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:45.012074  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:45.012089  3208 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:45.009446  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:45.015897  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 59245.3us
I20260709 13:17:44.942678  8330 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:45.052275  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:44.952256  8353 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.956657  8299 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:44.952399  8206 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:17:45.065356  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 149616us
I20260709 13:17:45.066426  3251 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:17:45.097205  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 98857.4us
W20260709 13:17:45.124503  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 81925.4us
I20260709 13:17:45.021505  7889 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:17:45.058785  8345 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:45.067906  7871 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:45.063467  8353 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.133672  3100 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:45.112772  8206 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.142452  8206 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:45.143131  8206 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:45.150869  8357 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:17:45.153584  7871 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.155886  7871 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:45.158818  8256 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:45.160696  8272 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:45.134380  8345 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:45.128145  8327 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.198037  8327 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:45.200574  8327 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:45.134234  8273 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.201731  8273 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.111959  8248 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:45.063004  8330 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.205339  8248 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:45.206676  8330 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:45.209113  8345 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:45.173631  8252 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:45.174374  8356 log.cc:927] Time spent T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:17:45.210570  8345 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.128276  8107 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
W20260709 13:17:45.171216  8355 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:17:45.180220  3206 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:45.162835  8082 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:45.197158  3021 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 023c1461b69c46bdb3c42ee16f303ea2 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0930e3e7657c43bcaaa5b0778f3e08cf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:45.209679  8221 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.211125  3832 raft_consensus.cc:2368] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17.
I20260709 13:17:45.128537  8222 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:17:45.212447  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 79975.2us
W20260709 13:17:45.212544  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 185901us
I20260709 13:17:45.207847  8248 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:45.241228  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:45.255941  3134 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:17:45.256150  3135 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:45.244668  3128 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:45.213264  8164 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:45.240343  3805 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:45.253257  8222 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.262785  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:45.282765  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:45.283775  3204 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.285467  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:45.287190  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:45.285521  3805 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:45.264897  3209 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:45.288357  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:45.288931  3282 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:45.289181  3279 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:45.268431  3128 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:45.271946  3176 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:45.254127  8107 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:45.291273  8107 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.292245  3276 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:17:45.297255  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:45.297952  3208 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:17:45.300670  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:45.214130  8273 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:45.304914  3280 raft_consensus.cc:1275] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:45.303860  3282 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:45.308511  3284 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:45.269598  8221 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:45.280575  8326 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12.
I20260709 13:17:45.317013  3100 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:45.293962  8330 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:45.323356  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 257000us
I20260709 13:17:45.296607  8073 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:45.296463  7871 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:17:45.304979  8164 raft_consensus.cc:697] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:45.326942  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:45.328075  3251 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:45.315563  8375 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.323246  8324 raft_consensus.cc:2764] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:45.341497  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.355849  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:45.357441  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.361694  3281 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:45.364012  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:45.365844  3210 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:45.352797  3277 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:17:45.361274  3204 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:45.372486  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:45.334968  8330 raft_consensus.cc:697] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:45.374595  8330 consensus_queue.cc:237] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.368763  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.336045  8073 raft_consensus.cc:697] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:45.326049  8284 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:17:45.354883  8221 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:45.355536  8285 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:45.327826  8232 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:17:45.362176  8373 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:45.384490  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.393483  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.393776  3281 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 14: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:45.394125  3285 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
I20260709 13:17:45.330077  8291 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:17:45.329104  8279 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:17:45.390795  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:45.367632  8347 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.408015  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:45.383654  8244 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:45.396991  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.375775  8206 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.395541  8373 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:45.400578  8073 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.389598  8221 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.412532  3280 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:17:45.407630  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.408915  3278 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 14: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:45.367985  8350 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:45.410264  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:45.410475  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.383183  8252 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:45.414013  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:45.404364  8164 consensus_queue.cc:237] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:45.395196  8324 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:45.391642  8361 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:45.362843  8375 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.439145  8379 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.440037  8375 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:45.439857  8379 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:45.443276  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.446651  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.447935  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:45.448568  3280 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:45.450233  3285 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
W20260709 13:17:45.454066  8372 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:17:45.457649  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.466264  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:45.467049  3277 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.471099  3281 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:45.431552  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:45.432750  8273 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:45.433158  8369 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:17:45.436031  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.476953  3279 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:17:45.409403  8285 raft_consensus.cc:697] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:45.477033  8273 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.478492  8285 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.479938  8273 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:45.484539  7871 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:45.485261  7871 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.487962  7871 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:45.490100  8222 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:45.419469  8373 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:45.437386  8361 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:45.532444  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 101000us
I20260709 13:17:45.530539  8327 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.537470  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:45.537799  8327 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:45.437409  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.534844  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:45.422724  8244 raft_consensus.cc:697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:45.499755  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:45.420029  8276 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:45.420765  8221 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:45.547089  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.472672  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.548473  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.539424  8282 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:45.423187  8206 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:45.428527  8350 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.416868  8347 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:45.430105  8324 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:45.429100  8107 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:45.645313  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 110559us
I20260709 13:17:45.798391  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:45.799834  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:45.573028  8279 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:45.568271  8126 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:45.572360  8322 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:45.749902  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 201460us
W20260709 13:17:45.750058  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 241496us
I20260709 13:17:45.541419  8299 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:17:45.554792  8325 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:45.769845  3806 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:45.775413  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 411464us
I20260709 13:17:45.831182  3134 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:45.779424  3280 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:17:45.760862  3277 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
W20260709 13:17:45.754678  8353 consensus_meta.cc:287] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.592s	user 0.017s	sys 0.003s
I20260709 13:17:45.753317  7656 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.800386  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:45.805955  3202 raft_consensus.cc:2393] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:17:45.777208  8304 consensus_meta.cc:287] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.754s	user 0.010s	sys 0.010s
I20260709 13:17:45.775127  8260 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:45.819682  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:45.844249  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:45.821259  3135 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:45.825380  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:45.849433  3101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.015s	sys 0.018s
W20260709 13:17:45.849838  3101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.015s	sys 0.018s
I20260709 13:17:45.834860  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:45.839162  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:45.840736  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 71049us
I20260709 13:17:45.799563  8324 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:45.849388  3203 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:17:45.858779  3202 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:17:45.859277  3250 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:45.856612  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:45.860497  3250 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:45.796958  8209 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:17:45.860780  3207 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:45.866580  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:45.848944  8107 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:45.854763  8268 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.887176  3100 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:45.862713  8260 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:45.850835  7656 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:45.873575  8252 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:45.868120  7893 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:45.872615  8329 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:45.845508  8353 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:45.853099  8304 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:45.872272  8377 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:45.875916  8375 raft_consensus.cc:2764] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:17:45.900134  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:45.902402  3101 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:45.926262  3101 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:45.902673  3834 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:45.819734  3251 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:45.904016  3177 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:45.894896  8326 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.005s	sys 0.027s
W20260709 13:17:45.896329  8345 consensus_meta.cc:287] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.002s
I20260709 13:17:45.892068  8222 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:45.998167  3838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 985) took 1229 ms. Trace:
I20260709 13:17:45.916462  8272 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.928393  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:45.904271  8279 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:45.892601  8268 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:46.004211  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 100421us
I20260709 13:17:45.921439  8361 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:46.029953  3835 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:45.927678  8376 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.927670  8329 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:45.923218  8327 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:45.922236  8374 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:46.063732  8374 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:46.065536  3806 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.770s (SENT) [suppressed 31 similar messages]
I20260709 13:17:46.066087  8374 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:46.066380  8284 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:46.066780  8284 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:46.067612  8284 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.072333  8284 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:45.907588  8252 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:46.087007  8376 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.090157  8353 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:46.092291  8260 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.008976  8232 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:46.024585  3838 rpcz_store.cc:276] 0709 13:17:44.696495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.706499 (+ 10004us) service_pool.cc:224] Handling call
0709 13:17:44.713711 (+  7212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.753505 (+ 39794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.753539 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.754016 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:17:44.952854 (+198838us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:45.042295 (+ 89441us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.062318 (+ 20023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.580417 (+518099us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b1800018fa0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b9102522 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:45.925618 (+345201us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b5400475254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:45.925688 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.925754 (+    66us) raft_consensus.cc:1685] finished
0709 13:17:45.925777 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.925951 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64100,"prepare.queue_time_us":89684,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":31075,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":32937,"spinlock_wait_cycles":127105152,"thread_start_us":196828,"threads_started":1,"wal-append.queue_time_us":394950}
I20260709 13:17:46.049775  8222 raft_consensus.cc:697] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:46.051640  3177 leader_election.cc:400] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17.
W20260709 13:17:46.113432  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 61982.9us
W20260709 13:17:46.053164  8385 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 13:17:46.053999  8389 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:17:46.056209  8386 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:17:46.056604  8350 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:46.057586  8382 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.176s	user 0.002s	sys 0.008s
I20260709 13:17:45.927582  8378 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:45.899112  8244 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:46.097605  8329 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.139433  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:46.043860  7683 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:45.927580  8377 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.045702  8181 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:46.188350  3133 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:46.030789  8348 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.130987  3805 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:46.192023  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 61173.3us
I20260709 13:17:46.192983  3805 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:46.041590  8272 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:46.194710  3276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.016s	sys 0.084s
I20260709 13:17:46.196902  3805 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
W20260709 13:17:46.195204  3276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.016s	sys 0.084s
I20260709 13:17:46.200590  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:46.044322  8279 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.202489  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:46.185161  8304 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:46.184011  8329 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:46.186761  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:46.190642  8206 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:46.190063  8181 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:46.195080  8073 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:46.150342  8333 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:17:46.205132  8350 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.250375  8380 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:46.250432  8268 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:46.229785  8209 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:46.231072  8107 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:46.264974  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1747) took 1022 ms. Trace:
I20260709 13:17:46.245692  8181 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.265564  3127 rpcz_store.cc:276] 0709 13:17:45.242491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.243719 (+  1228us) service_pool.cc:224] Handling call
0709 13:17:45.244200 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.258489 (+ 14289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.258535 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:45.284879 (+ 26344us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.410121 (+125242us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:45.410157 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.410218 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:46.264636 (+854418us) raft_consensus.cc:1685] finished
0709 13:17:46.264667 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.264896 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13759,"raft.queue_time_us":48961,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":8492,"spinlock_wait_cycles":22912,"thread_start_us":81173,"threads_started":1,"wal-append.queue_time_us":530392}
W20260709 13:17:46.270545  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 344365us
I20260709 13:17:46.271310  3101 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:46.272930  3207 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:17:46.203125  8348 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.282541  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:46.254493  7871 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:46.257906  8209 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.290567  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:46.308530  3208 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:17:46.273737  8373 consensus_meta.cc:287] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.706s	user 0.012s	sys 0.001s
I20260709 13:17:46.313478  3285 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:46.309099  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:46.314248  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 248725us
I20260709 13:17:46.265520  8376 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:46.269438  8350 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:46.318853  3285 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:46.286676  8314 raft_consensus.cc:2764] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:17:46.245035  8222 consensus_queue.cc:237] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:46.265254  8107 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:46.331642  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 512017us
I20260709 13:17:46.306218  8209 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.314538  8388 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:46.338904  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 67669.1us
I20260709 13:17:46.324081  8325 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:46.333153  8291 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:46.363247  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 160856us
I20260709 13:17:46.364945  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:46.367803  3251 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:46.327162  8350 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:46.372169  3285 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:46.320674  8373 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:46.373822  8396 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.145s	user 0.001s	sys 0.001s
I20260709 13:17:46.394759  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:46.404196  8107 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:46.404898  8397 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:17:46.404997  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 2988) took 1065 ms. Trace:
I20260709 13:17:46.405136  8107 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:46.405859  8107 raft_consensus.cc:697] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:46.405597  3276 rpcz_store.cc:276] 0709 13:17:45.339952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.340089 (+   137us) service_pool.cc:224] Handling call
0709 13:17:45.340446 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.340766 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.340790 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:45.375895 (+ 35105us) log.cc:844] Serialized 26 byte log entry
0709 13:17:46.197968 (+822073us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:46.198013 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.200558 (+  2545us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:46.404752 (+204194us) raft_consensus.cc:1685] finished
0709 13:17:46.404781 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.404938 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18242,"raft.queue_time_us":1085,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3759,"thread_start_us":789978,"threads_started":1,"wal-append.queue_time_us":948295}
I20260709 13:17:46.406934  8107 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:46.410400  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:46.356083  8325 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.415725  8403 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:46.416879  8325 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:46.385545  8285 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:46.420269  8285 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.420779  8285 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:46.423058  8348 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:46.426261  8395 log.cc:927] Time spent T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:17:46.363970  8291 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.430888  8291 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:46.391588  8252 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:46.386740  8272 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:46.460464  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:46.370277  7871 consensus_queue.cc:1059] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 13:17:46.423085  8402 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:46.416491  8403 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.466871  3101 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:46.477260  8164 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:46.459292  8279 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:46.442328  8377 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:46.488073  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:46.481441  8272 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:46.487447  8324 consensus_meta.cc:287] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.002s
I20260709 13:17:46.495236  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:17:46.499572  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 121242us
I20260709 13:17:46.500651  8222 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:46.501124  8222 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.501518  8222 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.501272  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:46.504083  8221 consensus_meta.cc:287] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.717s	user 0.010s	sys 0.005s
I20260709 13:17:46.504132  8405 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:46.504736  8221 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:46.507017  8221 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:46.509992  8373 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:46.509836  8181 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.511934  8181 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:46.513558  8358 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.514s	user 0.003s	sys 0.012s
I20260709 13:17:46.518034  3806 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:46.502900  8324 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.523422  8324 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:46.524284  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:46.526109  8420 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:46.526991  3206 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:46.528024  8412 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:17:46.528566  8398 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:17:46.530762  8379 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:46.535948  8403 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:46.539254  8329 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.543807  3211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 597) took 2067 ms. Trace:
I20260709 13:17:46.544219  3211 rpcz_store.cc:276] 0709 13:17:44.476375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.476524 (+   149us) service_pool.cc:224] Handling call
0709 13:17:44.485713 (+  9189us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:44.507819 (+ 22106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.507868 (+    49us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:44.573230 (+ 65362us) log.cc:844] Serialized 78 byte log entry
0709 13:17:44.898259 (+325029us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:44.898312 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.898401 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:46.542603 (+1644202us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b24001b7868. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b8f889c4 00007fb3b8f86acb 00007fb3b9141dc9 00007fb3b9141a55 00007fb3b9140fb0 00007fb3bbdb7488 00007fb3bbdb7be8 00007fb3bbd8f398 00007fb3bbd8a76a 00007fb3bbd89bb6
0709 13:17:46.543496 (+   893us) raft_consensus.cc:1685] finished
0709 13:17:46.543515 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.543721 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25604,"raft.queue_time_us":23915,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":19150,"spinlock_wait_cycles":89083648,"thread_start_us":219931,"threads_started":1,"wal-append.queue_time_us":369757}
I20260709 13:17:46.546310  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:46.558589  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:46.547995  3202 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:46.564697  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45403.6us
I20260709 13:17:46.520787  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:46.553862  8350 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:46.547114  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:46.564069  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 62933.7us
I20260709 13:17:46.571077  3101 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:46.502076  8244 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:46.572156  8244 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:46.572292  8376 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:46.574113  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:46.581154  3838 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:46.552628  8209 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:46.572649  8244 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:46.515072  8285 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:46.580464  8107 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:46.596642  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:46.602658  3210 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:46.602897  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:46.603893  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.604529  3128 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:46.587777  8181 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:46.607410  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:46.585304  8379 consensus_queue.cc:1059] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:17:46.612973  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.616489  8329 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:46.619366  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.596396  7893 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:17:46.622525  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.623136  3134 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:17:46.623500  3135 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 16: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:46.619565  3127 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:46.624828  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.625347  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.626551  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.623162  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.628223  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:46.630074  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.630676  3130 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:46.632229  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.606684  8107 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:46.636353  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.636736  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.639394  8107 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:46.639590  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:46.645432  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:46.646046  3277 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:17:46.637363  3133 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:46.649483  3128 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:46.650295  3127 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:46.650565  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.651741  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:46.652374  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:46.653755  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:46.654613  3210 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:46.656598  3283 raft_consensus.cc:3055] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:46.659283  3283 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:46.657370  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:46.661032  3280 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:46.660089  3283 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.663046  3283 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:46.668572  3806 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:46.669494  8420 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:46.672454  8272 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:46.674851  7656 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:46.679431  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:46.681310  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:46.682484  8421 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:46.687889  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:46.688264  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:46.689890  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:46.691175  3281 raft_consensus.cc:2393] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:46.692157  3806 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:46.695452  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:46.696069  8416 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:46.697505  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:46.688953  8421 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:46.699213  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:46.693692  8350 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:46.690862  7871 consensus_queue.cc:1059] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:17:46.704970  7871 consensus_queue.cc:1243] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer fc48eecc27554cb58b15193cd442b1d3 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:17:46.702411  3277 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:17:46.697836  8252 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:46.710386  8252 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:46.710901  8252 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:46.714727  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2239) took 1249 ms. Trace:
I20260709 13:17:46.715188  3204 rpcz_store.cc:276] 0709 13:17:45.465587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.469348 (+  3761us) service_pool.cc:224] Handling call
0709 13:17:45.469717 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.798346 (+328629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.798378 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.798424 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:45.798456 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.714408 (+915952us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b540019e454. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:46.714488 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.714668 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":755316480}
I20260709 13:17:46.703104  8302 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:46.701906  8209 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:46.730844  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.732522  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.313822  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:46.733254  3135 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:17:46.713274  8285 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:46.737435  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2240) took 1266 ms. Trace:
I20260709 13:17:46.737815  3205 rpcz_store.cc:276] 0709 13:17:45.471138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.471703 (+   565us) service_pool.cc:224] Handling call
0709 13:17:45.483688 (+ 11985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.850328 (+366640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.850370 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.850416 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:45.850461 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.737218 (+886757us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54001d7c54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:46.737263 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.737372 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842695552}
I20260709 13:17:46.738974  8420 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:46.733389  8330 raft_consensus.cc:3055] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:46.739544  8330 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:46.740415  8330 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:46.741990  8330 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.744866  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:46.746209  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:46.749313  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:46.750145  8302 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:46.750747  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:46.753227  3281 raft_consensus.cc:2368] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15.
I20260709 13:17:46.734781  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:46.754798  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 62712.7us
I20260709 13:17:46.755330  3135 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 8.
I20260709 13:17:46.757753  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.751802  8244 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.760087  8244 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:46.751399  8302 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.763703  8302 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:46.773986  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:46.780385  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:46.781731  3835 raft_consensus.cc:2410] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:17:46.784103  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:46.786741  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.787388  3130 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:17:46.788625  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.789495  3130 raft_consensus.cc:2410] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:46.790848  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:46.795392  3283 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:17:46.796557  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.802284  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:46.858435  3128 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:46.859524  3130 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:46.802639  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:46.857993  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.808470  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:46.866040  3133 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:46.867796  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.869302  3133 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
W20260709 13:17:46.736909  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.862169  3132 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:46.861323  3283 pending_rounds.cc:85] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 7
I20260709 13:17:46.873324  3283 pending_rounds.cc:107] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:17:46.873548  3283 raft_consensus.cc:2889] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:46.866225  3136 raft_consensus.cc:2368] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10.
I20260709 13:17:46.863603  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:46.877452  3135 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:46.878664  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.879683  3135 raft_consensus.cc:2393] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:46.863507  3129 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:46.864142  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.889796  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:46.891918  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:46.892802  3832 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:46.896996  3129 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:17:46.907377  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 106310us
I20260709 13:17:46.911075  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:46.912592  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:46.912807  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:46.812222  8289 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:46.900816  8341 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:17:46.917840  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:46.916836  3842 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:46.915634  7656 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:17:46.897994  8360 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:46.925181  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:46.913010  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:46.913445  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:46.926326  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:46.926909  3208 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.917132  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:46.901774  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:46.930630  3136 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:46.932099  3832 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:46.923872  3836 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:46.931993  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:46.923252  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 304676us
I20260709 13:17:46.945065  3205 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:17:46.946295  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.946975  3129 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:46.952601  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:46.953408  3277 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:46.956756  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.901190  8280 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:17:46.961802  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.963133  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.963840  3132 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:46.964884  8291 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:46.965502  8291 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.966281  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:46.967008  3132 raft_consensus.cc:2393] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:46.967635  8291 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:46.906669  8367 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:17:46.968918  3806 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:46.917659  8252 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:46.969566  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.970125  8107 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:46.970309  3135 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:46.970561  8107 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.970974  8252 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:46.971063  8107 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.974725  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:46.895798  8282 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:17:46.975436  3128 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 16: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:46.953455  3841 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 16: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:46.980052  3806 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:46.986455  3208 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:17:46.990705  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:46.974047  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:46.976684  7656 consensus_queue.cc:1059] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:46.907802  8333 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:17:46.912763  8374 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:17:46.937783  8388 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.005939  7656 raft_consensus.cc:3055] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:47.006441  7656 raft_consensus.cc:740] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:46.935355  8289 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:47.007964  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 56626.7us
I20260709 13:17:47.004094  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:46.923965  8373 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:17:47.020848  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:47.024755  7656 consensus_queue.cc:260] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:47.030786  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.003963  8273 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:46.901188  8222 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:46.995388  8380 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:47.007627  8219 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.996197  8252 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:47.007814  3101 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:47.007786  8360 raft_consensus.cc:697] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:47.044658  8379 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:47.046653  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:47.052080  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:47.052510  3832 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:17:47.052879  3832 pending_rounds.cc:85] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 11
I20260709 13:17:47.053124  3832 pending_rounds.cc:107] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:17:47.053364  3832 raft_consensus.cc:2889] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:47.057585  3101 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:47.029202  8388 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:47.048017  8244 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:47.058888  8280 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:47.067464  8280 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:47.067864  8280 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:47.068296  8222 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:47.072809  3838 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:47.074831  3102 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:47.076125  3102 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:47.077843  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:47.062935  8181 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:47.082187  3102 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:47.079000  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:47.040545  8330 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 13:17:47.126547  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47659.7us
I20260709 13:17:47.047851  8380 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:47.058492  8126 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:47.132150  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 50080.6us
I20260709 13:17:47.133229  3136 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:47.132933  3102 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:47.066881  8244 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.145217  8244 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.147050  8288 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:47.122931  8272 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:47.150219  8272 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:47.151060  8272 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:47.064023  8077 consensus_queue.cc:1059] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:17:47.131520  8221 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:47.055778  8379 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:47.154656  8379 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:47.131507  8324 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:47.124645  8181 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.155790  8181 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:47.134243  8126 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:47.159479  8126 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:47.134429  8302 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:47.049788  8219 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:47.141644  8373 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:47.190493  8388 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:47.191109  8433 log.cc:927] Time spent T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:17:47.066223  8291 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:17:47.194766  8289 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:47.196460  8380 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:47.131793  8222 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:47.076932  8280 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:47.212498  3136 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:47.204602  8222 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.227298  3250 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:47.248996  3250 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:47.266621  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:47.216049  7893 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:47.269703  3250 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:17:47.270490  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 203401us
I20260709 13:17:47.279052  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:47.204200  8333 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:17:47.219340  8341 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:47.218380  8380 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:47.200012  8360 consensus_queue.cc:237] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:47.283071  3101 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:47.305585  3832 raft_consensus.cc:1240] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:47.292925  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:47.306344  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:47.320816  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:47.314713  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:47.318904  3021 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 023c1461b69c46bdb3c42ee16f303ea2 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0930e3e7657c43bcaaa5b0778f3e08cf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:17:47.360690  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 227813us
W20260709 13:17:47.387082  3021 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 68236.6us
I20260709 13:17:47.299844  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:47.388531  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 249305us
W20260709 13:17:47.392242  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 86002.1us
I20260709 13:17:47.395606  3285 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:47.396004  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:47.321569  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:47.221921  8361 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:47.219558  8379 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:47.385423  3251 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:47.261891  8222 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:47.415684  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:47.417773  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1755) took 1298 ms. Trace:
W20260709 13:17:47.378746  8435 log.cc:927] Time spent T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:17:47.422349  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 139385us
I20260709 13:17:47.426582  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:47.426702  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:47.418254  3284 rpcz_store.cc:276] 0709 13:17:46.119817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.201578 (+ 81761us) service_pool.cc:224] Handling call
0709 13:17:46.239520 (+ 37942us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:46.308322 (+ 68802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:46.308352 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:46.308872 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:17:46.469150 (+160278us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:46.469228 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.407994 (+938766us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b54002f8ad4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:47.408053 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.408106 (+    53us) raft_consensus.cc:1685] finished
0709 13:17:47.408117 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.417699 (+  9582us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2620,"raft.queue_time_us":439,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":6821,"spinlock_wait_cycles":157338880,"thread_start_us":129950,"threads_started":1,"wal-append.queue_time_us":168957}
I20260709 13:17:47.268977  8403 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:47.422959  8441 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:47.283881  8203 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:47.299656  8282 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:47.284740  7889 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:47.284711  8073 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:47.432478  8388 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:17:47.413317  8380 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:47.327730  8439 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:47.442060  8439 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.442672  8439 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:47.445194  8282 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:47.265044  8206 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.160s
I20260709 13:17:47.428228  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:47.461587  3176 leader_election.cc:400] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15.
I20260709 13:17:47.463886  3176 leader_election.cc:403] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:47.420061  8361 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:47.466897  8361 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:47.300441  7893 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:47.468379  8285 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:47.467800  7889 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:47.469107  8285 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:47.469607  8285 raft_consensus.cc:697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:47.408819  8341 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:47.470521  8285 consensus_queue.cc:237] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:47.472853  8341 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:47.490603  8388 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:47.495564  8219 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:47.437878  8279 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:47.426863  8379 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:47.509871  8379 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:47.454272  8073 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:47.513808  8073 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:47.519456  8107 consensus_meta.cc:287] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.001s
I20260709 13:17:47.520051  8107 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:47.523753  8280 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:47.435683  8126 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:47.525692  3204 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:47.526813  8126 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:47.409475  8244 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:47.530055  8244 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:47.453558  8181 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:47.532658  8347 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:47.534406  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:47.535235  3835 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 16: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:47.428650  8302 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:47.534524  8181 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:47.433568  8203 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:47.549474  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 230629us
W20260709 13:17:47.618301  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 233971us
I20260709 13:17:47.460723  8373 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:17:47.627543  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 231676us
I20260709 13:17:47.638425  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:47.549471  8302 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.643110  3250 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:47.645782  3202 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:47.648489  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:47.619285  8203 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.653483  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:47.654254  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:47.654345  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:47.655104  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:47.661619  3133 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:47.656466  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:47.662673  3210 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 16: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:47.663057  3128 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:47.664149  3841 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:47.654994  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:47.665637  3135 raft_consensus.cc:2410] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:47.665287  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:47.662709  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:47.664145  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:47.669607  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:47.670570  3128 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:47.688522  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:47.689302  3205 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:47.693658  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:47.692961  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:47.695209  3209 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:47.692955  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:47.698689  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:47.695714  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:47.700481  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:47.706068  3132 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:17:47.710534  8206 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:47.711115  8206 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:47.713302  8206 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:47.697568  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:47.655645  8302 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.715251  3135 raft_consensus.cc:2410] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:17:47.714532  3128 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:17:47.716177  3129 raft_consensus.cc:2368] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10.
I20260709 13:17:47.660658  8440 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:47.733603  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 275861us
I20260709 13:17:47.772756  3834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 1030) took 1291 ms. Trace:
I20260709 13:17:47.773228  3834 rpcz_store.cc:276] 0709 13:17:46.481353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.481717 (+   364us) service_pool.cc:224] Handling call
0709 13:17:46.493047 (+ 11330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.059632 (+566585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.059677 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.059733 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:47.059779 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.772517 (+712738us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54002175d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:47.772566 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.772697 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1302388608}
I20260709 13:17:47.774004  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:47.773895  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:47.775125  3211 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 16: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:47.775756  3205 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:47.774506  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:47.777254  3208 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:47.779829  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 688) took 1094 ms. Trace:
I20260709 13:17:47.780350  3127 rpcz_store.cc:276] 0709 13:17:46.625928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.626064 (+   136us) service_pool.cc:224] Handling call
0709 13:17:46.649988 (+ 23924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:46.650617 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.720360 (+1069743us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b54000e24d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:47.720534 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54350208}
I20260709 13:17:47.911761  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:47.715375  8451 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:47.930820  3208 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:47.778872  8440 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:47.789513  8324 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15.
I20260709 13:17:47.935307  3805 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:47.933846  3251 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.040s	sys 0.053s
I20260709 13:17:47.783886  8374 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:47.940043  3250 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:47.944007  3805 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:47.941334  3251 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.040s	sys 0.053s
W20260709 13:17:47.948328  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 562949us
I20260709 13:17:47.950356  3805 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:47.944061  8206 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:47.940268  8440 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:47.982818  8288 consensus_meta.cc:287] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.835s	user 0.012s	sys 0.001s
W20260709 13:17:47.998432  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 58459us
I20260709 13:17:47.982508  8455 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:17:47.999205  3203 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:47.999300  3250 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:48.000465  8455 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:48.001530  8455 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:48.002379  8455 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:48.004102  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:48.005797  3284 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:48.007177  3277 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:48.008270  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:48.001817  8456 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:48.001353  8347 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:48.000613  3250 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:48.010807  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:47.951241  8209 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:48.012058  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 63152.4us
I20260709 13:17:48.013226  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:48.018621  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:48.017226  8324 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.020660  8463 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:48.020475  8347 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.021018  8324 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:48.021768  8347 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:48.011399  8361 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.022575  8361 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:48.023442  8324 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:48.024653  8361 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:48.027136  3250 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:47.981230  8232 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:47.983003  8273 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:48.010390  8260 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.043332  8232 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:47.989984  8379 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:48.017192  8456 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:47.947719  8374 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:47.982509  8206 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:48.031524  8459 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:48.049839  8314 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:48.072681  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 45612.8us
I20260709 13:17:48.074484  3250 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:48.058305  8456 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.081303  8203 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:48.087875  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:48.091777  3250 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:48.093150  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 64294.9us
I20260709 13:17:48.052083  8260 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:48.094420  3251 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:17:48.131371  3102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.003s	sys 0.009s
W20260709 13:17:48.133293  3102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.003s	sys 0.009s
I20260709 13:17:48.134739  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 2077) took 1330 ms. Trace:
W20260709 13:17:48.135041  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 701238us
I20260709 13:17:48.078189  8107 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:48.061549  8379 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:48.139209  3281 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:48.135332  3131 rpcz_store.cc:276] 0709 13:17:46.804722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.805332 (+   610us) service_pool.cc:224] Handling call
0709 13:17:46.805736 (+   404us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:46.862583 (+ 56847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:46.862625 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:46.863417 (+   792us) log.cc:844] Serialized 52 byte log entry
0709 13:17:47.077475 (+214058us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:47.132724 (+ 55249us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.529681 (+396957us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b180028d080. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b90ff455 00007fb3bc1e7060 00007fb3bc1f9716 00007fb3bc20a287 00007fb3bc20a208
0709 13:17:47.979851 (+450170us) log.cc:844] Serialized 14 byte log entry
0709 13:17:48.124721 (+144870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.124822 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.134430 (+  9608us) raft_consensus.cc:1685] finished
0709 13:17:48.134463 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.134664 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":213429,"prepare.queue_time_us":325636,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":84,"raft.queue_time_us":86756,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":5461,"spinlock_wait_cycles":12521344,"thread_start_us":578181,"threads_started":3,"wal-append.queue_time_us":252946}
W20260709 13:17:48.142494  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 50797.8us
W20260709 13:17:48.144845  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 194685us
I20260709 13:17:48.144790  3250 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:48.128777  8181 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:48.191473  3285 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:48.075999  8314 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:48.090588  8463 consensus_queue.cc:1059] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:17:48.140362  8471 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:17:48.225265  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 80533.8us
I20260709 13:17:48.226166  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:48.211706  7893 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:48.209574  8181 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:48.236673  3250 leader_election.cc:400] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10.
I20260709 13:17:48.237623  3250 leader_election.cc:403] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:17:48.221673  8459 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:48.208915  8474 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:48.323310  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1752) took 2117 ms. Trace:
W20260709 13:17:48.327517  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 191807us
W20260709 13:17:48.237654  3203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 3366) took 1949 ms (client timeout 2348 ms). Trace:
I20260709 13:17:48.191699  8107 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 13:17:48.339167  3203 rpcz_store.cc:269] 0709 13:17:46.284238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.284421 (+   183us) service_pool.cc:224] Handling call
0709 13:17:48.233431 (+1949010us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b540027c254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:48.233542 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3874102144}
I20260709 13:17:48.338801  3282 rpcz_store.cc:276] 0709 13:17:46.118241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.120137 (+  1896us) service_pool.cc:224] Handling call
0709 13:17:46.120495 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:46.554525 (+434030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:46.554560 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:46.555026 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:17:46.604207 (+ 49181us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:46.604251 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.231219 (+1626968us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b540022db54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:48.231272 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.231323 (+    51us) raft_consensus.cc:1685] finished
0709 13:17:48.231337 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.235671 (+  4334us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7145,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":997299072,"thread_start_us":48784,"threads_started":1,"wal-append.queue_time_us":95095,"wal-append.run_cpu_time_us":1839,"wal-append.run_wall_time_us":1060262}
I20260709 13:17:48.191609  8470 consensus_queue.cc:1059] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.191s
W20260709 13:17:48.369438  8467 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:17:48.351372  8440 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:48.372175  8440 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:48.350863  8232 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:48.412698  8203 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:48.413950  8314 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:48.412698  8475 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:17:48.439745  8471 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:48.442984  8471 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:48.448556  8477 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:48.449219  8477 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:48.451850  8495 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:48.452498  8495 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:48.455011  8495 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:48.455502  8495 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.455955  8495 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:48.456588  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 362241us
I20260709 13:17:48.396096  8459 raft_consensus.cc:3055] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:48.477378  8459 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:48.478519  8459 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:48.479859  8459 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:48.376907  8273 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:48.481567  8273 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:48.484138  8273 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:48.471479  8374 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:48.472877  8480 log.cc:927] Time spent T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:17:48.476784  8458 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:48.485787  8458 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:48.493331  8458 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:48.494035  8458 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.494642  8379 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:48.494560  8458 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:48.349943  8479 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
I20260709 13:17:48.501731  8487 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:48.503131  7893 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:48.504798  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 44944.3us
I20260709 13:17:48.507319  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:48.508679  8273 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:48.466140  8486 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:48.513850  8486 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:48.520588  3280 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:17:48.522755  8222 consensus_meta.cc:287] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 1.086s	user 0.010s	sys 0.001s
I20260709 13:17:48.523630  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:48.523350  8222 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:48.525024  3127 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:48.531518  8107 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:48.532215  8107 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:48.535281  8107 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:48.537156  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 300616us
I20260709 13:17:48.538389  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:48.539112  3283 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.541682  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:48.543013  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:48.543773  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:48.544638  3836 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:48.516672  8486 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:48.556341  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:48.557178  3836 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 9.
I20260709 13:17:48.564630  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:48.532893  8302 consensus_meta.cc:287] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.749s	user 0.004s	sys 0.004s
I20260709 13:17:48.549676  7889 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:48.593163  3132 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:17:48.601034  3129 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:17:48.594431  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:48.602201  3130 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:17:48.583102  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:48.609633  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:48.609771  3132 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:48.610020  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:48.464968  8347 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:48.570057  8107 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:48.575443  8439 consensus_meta.cc:287] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.132s	user 0.011s	sys 0.004s
I20260709 13:17:48.463481  8477 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:48.619190  3251 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:48.623179  8498 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:48.624782  8473 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:48.625392  8473 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:48.635404  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:48.636453  8451 consensus_meta.cc:287] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.005s
I20260709 13:17:48.636466  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:48.643903  8451 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:48.644601  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 765) took 1639 ms. Trace:
I20260709 13:17:48.638015  3251 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:48.635466  8473 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:48.609282  8471 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:48.578336  8484 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:48.600801  8440 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:48.653594  3251 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:48.644481  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:48.612000  8455 consensus_meta.cc:287] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.000s
I20260709 13:17:48.647670  3283 raft_consensus.cc:2410] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:17:48.660804  3251 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:48.646173  3841 rpcz_store.cc:276] 0709 13:17:47.004735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.006925 (+  2190us) service_pool.cc:224] Handling call
0709 13:17:47.028321 (+ 21396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.664743 (+636422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.644344 (+979601us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b5400000d54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:48.644542 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453324160}
I20260709 13:17:48.614185  8273 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:48.675715  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:48.736572  3835 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:48.620844  8488 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.675390  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:48.700217  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:48.638818  8492 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:48.771768  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 106850us
I20260709 13:17:48.774029  3282 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:48.775484  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:48.612604  8302 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:48.779819  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:48.645772  8439 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:48.668143  8473 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.655942  8347 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:48.779515  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:48.668092  8459 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:48.651059  8495 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:48.847364  8473 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:48.667932  8484 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:48.787407  8488 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:48.669507  8221 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:48.662787  8292 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.661984  8388 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:48.653437  8377 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:48.853562  3840 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:48.667649  8455 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:48.854779  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 75945.8us
I20260709 13:17:48.646067  8107 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:48.872720  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:48.913961  3276 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:48.990465  3130 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:17:48.882225  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:48.965266  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 94200.3us
I20260709 13:17:48.666801  8380 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:48.771704  8322 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:48.826220  8077 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:48.780237  8291 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:48.670562  8379 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:49.083019  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 464861us
I20260709 13:17:48.856614  8232 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:48.657354  8222 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:48.827766  8492 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:49.076373  8377 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:49.074342  8496 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:48.913717  8289 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:49.017293  8302 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:48.988746  8260 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:48.921684  8293 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.917142  8296 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.834506  8400 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.249s
I20260709 13:17:48.777050  8273 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:48.915016  8324 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:49.172482  8296 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.173020  8324 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.175734  8324 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:48.917253  8314 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:49.093067  3131 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:49.093778  3834 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:48.925714  8288 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.064672  8388 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:49.004778  8487 consensus_meta.cc:287] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.005s
I20260709 13:17:48.824719  8471 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.103943  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:48.651750  8497 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:49.091384  8291 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.104095  8377 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:49.175673  8296 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.088312  8477 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:49.103245  8492 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:49.133015  8107 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.134318  8488 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:49.134972  8439 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:49.136224  8484 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.138083  8455 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:49.163094  3211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 620) took 1387 ms. Trace:
I20260709 13:17:49.088668  8322 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:49.230947  8454 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.187s	user 0.004s	sys 0.011s
I20260709 13:17:49.232661  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:49.233678  3130 raft_consensus.cc:2393] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 16: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:49.234755  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:49.239564  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.240639  3135 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 16: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:49.243072  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:49.245613  8450 log.cc:927] Time spent T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.534s	user 0.005s	sys 0.006s
I20260709 13:17:49.170890  8293 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.158669  8496 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.157996  8479 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.090320  8077 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.131791  8473 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.189338  3842 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:17:49.100653  8232 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:49.170153  8285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.005s	sys 0.019s
I20260709 13:17:49.079815  8292 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.180332  8388 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.185189  8487 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 9. Current term is 10.
I20260709 13:17:49.160825  8289 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.214255  8366 raft_consensus.cc:3055] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:49.184793  8288 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:49.219070  8452 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.156s	user 0.009s	sys 0.000s
I20260709 13:17:49.223063  8181 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.226869  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.204577  8477 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.252138  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.182623  3129 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:49.258951  3132 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:49.260139  3832 raft_consensus.cc:1240] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:49.271246  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 701) took 1172 ms. Trace:
I20260709 13:17:49.296479  3127 rpcz_store.cc:276] 0709 13:17:48.086179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.087596 (+  1417us) service_pool.cc:224] Handling call
0709 13:17:49.258294 (+1170698us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b5400068bd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:49.258487 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003074944}
I20260709 13:17:49.298273  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.272137  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:49.206476  3211 rpcz_store.cc:276] 0709 13:17:47.776064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.776183 (+   119us) service_pool.cc:224] Handling call
0709 13:17:47.776505 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.776735 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:17:47.777108 (+   373us) log.cc:844] Serialized 14 byte log entry
0709 13:17:48.028698 (+251590us) log.cc:844] Serialized 14 byte log entry
0709 13:17:48.658325 (+629627us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b1800303160. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b907cc0a 00007fb3c27bc219 00007fb3b9104a40 00007fb3b90ff4e4 00007fb3b90ff455 00007fb3bc1e7060 00007fb3bc1f9716 00007fb3bc20a287 00007fb3bc20a208
0709 13:17:49.157760 (+499435us) log.cc:844] Serialized 14 byte log entry
0709 13:17:49.158011 (+   251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:49.158078 (+    67us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:49.158141 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.158232 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.162999 (+  4767us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1020904,"prepare.queue_time_us":762,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":3484,"raft.queue_time_us":748965,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":5869,"spinlock_wait_cycles":18493568,"thread_start_us":655179,"threads_started":2,"wal-append.queue_time_us":273725}
I20260709 13:17:49.248885  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:49.299880  3135 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:49.273947  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.274463  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:49.176877  8314 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:49.284358  3250 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.033s	sys 0.060s
W20260709 13:17:49.305784  3250 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.033s	sys 0.060s
W20260709 13:17:49.306169  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 533169us
W20260709 13:17:49.286058  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 364775us
W20260709 13:17:49.280541  8285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.006s	sys 0.020s
I20260709 13:17:49.307662  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.250285  3836 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:49.301193  3130 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:49.302919  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.309129  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.303676  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:49.291141  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 437306us
I20260709 13:17:49.303357  3833 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 11: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:49.318935  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.285837  8322 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.328127  8293 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:49.328830  8293 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.329370  8293 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.331669  8293 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.332791  3101 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:49.336650  8502 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:49.277251  8479 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.337154  8502 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.337226  8181 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:49.337678  8502 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:49.337800  8440 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:49.338363  8440 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:49.337989  8181 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.340335  8181 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.340693  8499 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:49.281816  8439 consensus_queue.cc:1059] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:17:49.287689  8366 raft_consensus.cc:740] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:49.318429  8456 consensus_meta.cc:287] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.176s	user 0.009s	sys 0.004s
I20260709 13:17:49.358562  8291 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.361137  8322 consensus_queue.cc:1059] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:17:49.362149  8322 raft_consensus.cc:3055] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:49.362489  8322 raft_consensus.cc:740] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:49.363255  8322 consensus_queue.cc:260] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.364368  8322 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.367231  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:49.368263  3132 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:49.372155  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.372881  3131 raft_consensus.cc:2393] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:49.373780  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.374943  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.376534  8485 raft_consensus.cc:3055] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:49.376958  8485 raft_consensus.cc:740] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:49.389492  8492 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.393486  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:49.348876  3250 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:49.347677  3832 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:49.352530  8292 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.352743  8477 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.352939  8471 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:49.404386  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:49.412128  3210 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 2272) took 1766 ms (client timeout 1902 ms). Trace:
W20260709 13:17:49.412705  3210 rpcz_store.cc:269] 0709 13:17:47.645458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.648242 (+  2784us) service_pool.cc:224] Handling call
0709 13:17:49.411924 (+1763682us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5400153bd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:49.412062 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30333184}
I20260709 13:17:49.413189  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.341341  8499 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.391817  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:49.417619  8499 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.423429  3135 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 9.
I20260709 13:17:49.423879  8282 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.424396  8388 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.424964  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.425705  8477 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:49.426858  8388 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.427240  3806 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:49.427466  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.423518  3130 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:17:49.428659  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:49.415642  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.353650  8289 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:49.355455  8496 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:49.355180  8366 consensus_queue.cc:260] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.357388  8077 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:49.357918  8479 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.357971  8273 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.478569  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.438000  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.484016  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:49.438671  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 89860.5us
I20260709 13:17:49.484548  8366 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.484797  3203 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:49.486151  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:49.487500  3130 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:17:49.441309  3136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 2087) took 2390 ms (client timeout 2046 ms). Trace:
I20260709 13:17:49.428711  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.465410  3280 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 19.
I20260709 13:17:49.434481  3279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3020) took 2121 ms. Trace:
W20260709 13:17:49.469025  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 57431.8us
I20260709 13:17:49.375833  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:49.496462  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:49.497568  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.475975  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:49.428795  3211 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:49.493216  3279 rpcz_store.cc:276] 0709 13:17:47.313295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.313424 (+   129us) service_pool.cc:224] Handling call
0709 13:17:47.313805 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.441028 (+127223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.441068 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.441130 (+    62us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:47.441160 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.434170 (+1993010us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54002977d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:49.434240 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.434405 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292032256}
I20260709 13:17:49.495167  3131 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.473317  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.474486  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:49.491286  3136 rpcz_store.cc:269] 0709 13:17:46.956328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.973546 (+ 17218us) service_pool.cc:224] Handling call
0709 13:17:49.346315 (+2372769us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54003566d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:49.346429 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253869824}
I20260709 13:17:49.502302  3280 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:49.438769  8471 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:49.506407  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:49.507287  3276 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:49.434213  8439 raft_consensus.cc:3055] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:49.440002  8282 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:49.515324  3136 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:49.466118  8477 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:49.433017  8232 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.535837  8288 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:49.536103  8458 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.536717  8458 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:49.537271  8458 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.537669  8314 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:49.538734  8272 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:49.539222  8272 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:49.539675  8272 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.539844  8458 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.347121  8347 consensus_queue.cc:1059] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.159s
I20260709 13:17:49.544480  3251 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:49.528775  3100 connection.cc:256] RPC call timeout handler was delayed by -1.0961896490000527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2348s for a response
I20260709 13:17:49.512305  7889 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:49.555217  7889 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:49.556209  7889 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.557255  8492 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:49.521942  8439 raft_consensus.cc:740] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:49.553231  8341 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 13:17:49.560984  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 483601us
I20260709 13:17:49.577459  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:49.584746  3130 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:49.591718  3100 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:49.592046  8206 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:49.589171  3033 catalog_manager.cc:5697] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.592671  8477 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:49.358604  8456 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:49.594913  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 50631.5us
I20260709 13:17:49.594740  3130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:49.595741  3130 raft_consensus.cc:606] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:49.596206  3130 raft_consensus.cc:614] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:49.560292  8457 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 1.572s	user 0.003s	sys 0.016s
I20260709 13:17:49.604957  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:49.607522  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.607963  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:49.609817  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:49.610652  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.613678  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.528414  8496 consensus_queue.cc:1059] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:17:49.616969  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.616967  3130 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:49.543098  8282 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.622972  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:49.624655  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:49.609965  8206 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:49.623867  8514 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:49.626497  8206 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:49.627085  8206 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:49.631618  8496 raft_consensus.cc:3055] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:49.632057  8496 raft_consensus.cc:740] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:49.634790  8282 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:49.635584  8485 consensus_queue.cc:260] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.609252  8273 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:17:49.612695  8388 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:17:49.639596  3280 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:49.612546  8221 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:49.641187  8221 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.641793  8502 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.642923  3132 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:49.643517  8221 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:49.644095  8453 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.704s	user 0.000s	sys 0.020s
I20260709 13:17:49.644721  8377 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.645592  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.646344  3279 raft_consensus.cc:2393] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 16: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:49.646996  8377 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:49.647756  3283 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 10: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:49.649201  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:49.649783  3279 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.650074  8456 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:49.653576  3285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1770) took 1649 ms (client timeout 2127 ms). Trace:
W20260709 13:17:49.653968  3285 rpcz_store.cc:269] 0709 13:17:48.004188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.008034 (+  3846us) service_pool.cc:224] Handling call
0709 13:17:49.653365 (+1645331us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54003ba6d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:49.653493 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419713920}
I20260709 13:17:49.654652  3134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 2074) took 2851 ms. Trace:
I20260709 13:17:49.655386  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1766) took 1652 ms. Trace:
I20260709 13:17:49.655773  3281 rpcz_store.cc:276] 0709 13:17:48.002879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.005648 (+  2769us) service_pool.cc:224] Handling call
0709 13:17:48.005945 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.142299 (+136354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.655172 (+1512873us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54001e9e54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:49.655330 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306048896}
I20260709 13:17:49.614881  8473 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:49.657373  8473 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:49.657778  8473 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:49.663992  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.665951  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3021) took 1129 ms. Trace:
I20260709 13:17:49.666381  3278 rpcz_store.cc:276] 0709 13:17:48.536614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.536738 (+   124us) service_pool.cc:224] Handling call
0709 13:17:49.656634 (+1119896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.656810 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.656835 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:49.656873 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:49.656906 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.656956 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.665794 (+  8838us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003ba6d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:49.665892 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2574838016}
I20260709 13:17:49.667776  3279 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:49.668061  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.669888  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.671175  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.695631  3278 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:49.696838  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.672029  3285 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:49.672343  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:49.699831  3837 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:49.673363  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.700886  3284 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:49.655018  3134 rpcz_store.cc:276] 0709 13:17:46.802710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.802966 (+   256us) service_pool.cc:224] Handling call
0709 13:17:46.803302 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:46.803698 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:46.810227 (+  6529us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.414564 (+604337us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b1800369640. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f23a 00007fb3bc1f9a2a
0709 13:17:47.691142 (+276578us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.691328 (+   186us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:47.692036 (+   708us) log.cc:844] Serialized 52 byte log entry
0709 13:17:47.692197 (+   161us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:47.692576 (+   379us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.693266 (+   690us) log.cc:844] Serialized 14 byte log entry
0709 13:17:48.083717 (+390451us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b1800369640. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b907cc0a 00007fb3c27bc219 00007fb3b9104a40 00007fb3b90ff4e4 00007fb3b90ff455 00007fb3bc1e7060 00007fb3bc1f9716 00007fb3bc20a287 00007fb3bc20a208
0709 13:17:48.083919 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.083998 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:49.238197 (+1154199us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b1800369640. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:49.393148 (+154951us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b4800080058. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1118aa1 00007fb3c110fb37 00007fb3c110f9ca 00007fb3c120726f 00007fb3c1206f37 00007fb3c121b55c 00007fb3c121b508 00007fb3c121b488 00007fb3c121b443 00007fb3c121a6ec 00007fb3c0144a96
0709 13:17:49.425915 (+ 32767us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b1800369640. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:49.556399 (+130484us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:49.640495 (+ 84096us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b1800369640. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b9102522 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:17:49.654424 (+ 13929us) raft_consensus.cc:1685] finished
0709 13:17:49.654445 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.654572 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":394264,"prepare.queue_time_us":3903591,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":126,"raft.queue_time_us":436936,"raft.run_cpu_time_us":3547,"raft.run_wall_time_us":1287850,"spinlock_wait_cycles":208943616,"thread_start_us":276060,"threads_started":1,"wal-append.queue_time_us":1118919}
I20260709 13:17:49.636839  8485 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.699666  3131 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:49.701839  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.624876  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.686179  8514 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:49.706147  3841 raft_consensus.cc:1240] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:49.706457  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:49.707922  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:49.702657  3134 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:17:49.702548  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.709748  3131 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:49.709673  3280 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:17:49.722466  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:49.724128  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.725492  3134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:49.711136  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.726263  3134 raft_consensus.cc:606] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:49.730247  3278 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:49.731732  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.675408  8361 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:49.733467  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:49.732437  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.735548  3278 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:49.644703  8502 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:49.750511  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:49.751529  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.754621  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:49.755172  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.632822  8496 consensus_queue.cc:260] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.755905  3131 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:17:49.765409  3131 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:49.753577  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.776991  3278 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:49.706218  8333 consensus_queue.cc:1059] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:17:49.780169  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1776) took 1168 ms. Trace:
I20260709 13:17:49.716315  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1775) took 1117 ms. Trace:
I20260709 13:17:49.786197  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:49.697767  8282 consensus_queue.cc:1059] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:17:49.706534  8288 consensus_queue.cc:1059] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
W20260709 13:17:49.788363  3277 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.020s	sys 0.036s
I20260709 13:17:49.781549  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:49.795271  3277 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.020s	sys 0.036s
I20260709 13:17:49.736425  8366 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:49.794849  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.749821  8077 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:49.797324  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:49.796952  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:49.729954  8289 consensus_queue.cc:1059] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:17:49.798506  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:49.722039  8314 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:17:49.762574  8322 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:49.754369  8293 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:49.787901  3129 rpcz_store.cc:276] 0709 13:17:48.611634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.311543 (+699909us) service_pool.cc:224] Handling call
0709 13:17:49.311780 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.311979 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:49.312823 (+   844us) log.cc:844] Serialized 14 byte log entry
0709 13:17:49.779707 (+466884us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:49.779781 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:49.779854 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.779943 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.780092 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15790,"prepare.queue_time_us":1206,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":15587,"thread_start_us":450713,"threads_started":1}
I20260709 13:17:49.788734  3127 rpcz_store.cc:276] 0709 13:17:48.598933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.310203 (+711270us) service_pool.cc:224] Handling call
0709 13:17:49.310558 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.310803 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:49.313654 (+  2851us) log.cc:844] Serialized 14 byte log entry
0709 13:17:49.715858 (+402204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:49.715927 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:49.715989 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.716080 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.716237 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1356,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":6109,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5505,"thread_start_us":401762,"threads_started":1}
I20260709 13:17:49.802202  3206 raft_consensus.cc:2410] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:49.813582  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:49.829586  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:49.829950  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:49.750788  8361 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.833564  8361 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:49.834452  8496 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:49.837304  8279 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:49.825173  8322 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:49.842200  8322 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:49.846647  8288 consensus_queue.cc:1059] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:49.802755  8366 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.793459  8291 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:49.849421  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.815037  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:49.846727  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:49.796175  8520 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:49.754158  8292 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:49.762856  8347 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:49.855960  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:49.820719  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:49.794610  8367 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:49.826189  3136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:49.858800  3136 raft_consensus.cc:606] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:49.859179  3136 raft_consensus.cc:614] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:49.786759  8440 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.822870  8296 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:49.867978  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 351462us
I20260709 13:17:49.871776  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.874490  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:49.876348  8273 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:49.877735  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:49.882598  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:49.887418  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.858240  8077 raft_consensus.cc:3055] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:49.914459  3101 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:49.858270  8367 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:49.861984  8279 raft_consensus.cc:697] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:49.918469  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:49.925537  3203 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.947314  3276 raft_consensus.cc:2410] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:17:49.948925  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:49.855702  8291 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.950726  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:49.917788  8077 raft_consensus.cc:740] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:49.861991  8347 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.961277  3136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c414d51e428042c596cb410c48956c63"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:49.963083  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:49.927428  8367 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.922330  8388 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:49.963579  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:49.965248  3136 raft_consensus.cc:606] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:49.989773  3136 raft_consensus.cc:614] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:49.868531  8293 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.968130  3101 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:49.857887  8520 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:50.012557  8520 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:49.993534  3209 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:17:49.996650  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:49.821930  8514 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:49.955678  7893 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:50.009801  8525 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:17:50.009461  8206 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:50.013809  8077 consensus_queue.cc:260] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.020184  3250 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:50.024513  8456 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:50.024736  8439 consensus_queue.cc:260] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.028177  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:50.029858  8347 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:50.032534  3204 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:17:49.885555  8296 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:49.943714  8273 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:50.075052  3284 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:50.036211  3276 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:49.969744  8366 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:50.065362  8470 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:50.066795  8463 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.067323  8377 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:50.046054  8221 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:50.123725  3837 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:50.059960  7893 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:50.063851  8272 consensus_meta.cc:287] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.524s	user 0.006s	sys 0.006s
I20260709 13:17:50.103972  8439 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:50.109508  8221 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.131515  8272 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:50.151832  8322 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.152973  8272 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:50.124122  8470 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:50.107563  8463 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.111085  8377 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.166198  8440 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:50.186542  8473 consensus_meta.cc:287] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.528s	user 0.018s	sys 0.000s
I20260709 13:17:50.187180  8473 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:50.189626  8473 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:50.186558  8529 log.cc:927] Time spent T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:50.192641  8463 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:49.992038  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:50.243160  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.248919  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:50.027878  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1779) took 1380 ms. Trace:
I20260709 13:17:50.258266  3132 rpcz_store.cc:276] 0709 13:17:48.647372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.501380 (+854008us) service_pool.cc:224] Handling call
0709 13:17:49.510618 (+  9238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.643262 (+132644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.027630 (+384368us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54002da354. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:50.027811 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303775104}
W20260709 13:17:50.250077  3135 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.017s	sys 0.021s
W20260709 13:17:50.259955  3135 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.019s	sys 0.022s
I20260709 13:17:50.254727  3131 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:50.263882  3135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faebd952bf73433d84a3292167ecd165"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:50.265065  3135 raft_consensus.cc:606] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:50.265733  3135 raft_consensus.cc:614] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:50.267802  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.268829  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:17:50.269229  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:50.269165  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 454146us
I20260709 13:17:50.274940  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:50.279584  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:50.064723  3203 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:50.283957  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:50.287250  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:50.288873  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:50.290799  3203 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:50.292281  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:50.293723  3203 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:50.047945  3208 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:50.295912  3205 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:50.064440  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:50.311106  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:50.312610  3277 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.032s	sys 0.020s
W20260709 13:17:50.313176  3277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.032s	sys 0.021s
I20260709 13:17:50.314926  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 806) took 1088 ms. Trace:
I20260709 13:17:50.316306  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:50.081895  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:50.318392  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:50.319598  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:50.330750  3840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1018) took 1341 ms. Trace:
I20260709 13:17:50.331353  3840 rpcz_store.cc:276] 0709 13:17:48.989562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.028432 (+ 38870us) service_pool.cc:224] Handling call
0709 13:17:49.074335 (+ 45903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:49.074737 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.074817 (+    80us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:49.559996 (+485179us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b2c00047a38. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:17:49.560386 (+   390us) log.cc:844] Serialized 26 byte log entry
0709 13:17:49.882562 (+322176us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:49.882602 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.882675 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.329901 (+447226us) raft_consensus.cc:1685] finished
0709 13:17:50.329952 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.330453 (+   501us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4512,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":6721,"spinlock_wait_cycles":74910976,"thread_start_us":321864,"threads_started":1,"wal-append.queue_time_us":542805}
I20260709 13:17:50.336540  3280 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:50.315415  3277 rpcz_store.cc:276] 0709 13:17:49.226751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.226867 (+   116us) service_pool.cc:224] Handling call
0709 13:17:49.227218 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.227491 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:49.798363 (+570872us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.314076 (+515713us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:50.314194 (+   118us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:50.314365 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.314513 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.314782 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":733808,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":14552,"thread_start_us":1083050,"threads_started":2}
I20260709 13:17:50.342890  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:50.156508  8260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.017s	sys 0.058s
I20260709 13:17:50.374571  8405 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:50.375166  8542 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:50.368600  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:50.377174  8542 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:50.377602  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 96674.9us
I20260709 13:17:50.377945  8542 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:50.378676  8406 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:50.381064  3276 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 20: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:50.148149  8221 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:50.394984  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:50.395869  8232 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:50.396597  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:50.403687  8374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.010s	sys 0.014s
W20260709 13:17:50.404203  8374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.010s	sys 0.014s
I20260709 13:17:50.400766  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:50.106199  8279 consensus_queue.cc:237] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.405047  8496 raft_consensus.cc:3055] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:50.413486  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 125487us
I20260709 13:17:50.396643  8232 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:50.430085  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 181602us
I20260709 13:17:50.434571  8296 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:50.420125  8496 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:50.439038  8497 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:50.438804  8333 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:17:50.439615  8272 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.443499  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:50.447187  8291 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:50.448067  8366 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:50.448808  3206 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:17:50.449142  8377 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:50.452244  8206 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:50.452721  8293 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:50.460922  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:50.462289  8374 raft_consensus.cc:3055] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:50.464504  8232 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.468528  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:50.470477  8473 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:50.492620  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 414853us
I20260709 13:17:50.495405  3251 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:50.476043  8366 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.474251  8260 raft_consensus.cc:3055] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:50.508720  8232 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:50.509636  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:50.482023  8388 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:17:50.511771  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 131412us
I20260709 13:17:50.482189  8374 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:50.488368  8497 raft_consensus.cc:697] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:50.522964  8502 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:50.523236  3203 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 16: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:50.419100  8405 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.503130  8366 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:50.503954  8260 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:50.535965  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 92959.9us
I20260709 13:17:50.537472  8546 consensus_queue.cc:1059] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:50.541658  8538 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.360s	user 0.003s	sys 0.008s
I20260709 13:17:50.541951  8374 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.543030  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:50.544546  8077 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:50.548466  8405 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:50.536718  8322 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:50.554540  8473 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:50.566901  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:50.500834  8272 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.180759  8470 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.583266  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:50.577737  8377 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:50.589849  8289 raft_consensus.cc:3055] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:50.592476  8289 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:50.596252  8421 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.598043  8272 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:50.597873  8289 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.598464  8421 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:50.599786  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:50.600297  3211 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:50.602402  3203 raft_consensus.cc:2410] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:50.603349  8542 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.606420  3177 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:50.607751  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:50.607295  8497 consensus_queue.cc:237] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.609397  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:50.610327  3840 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:17:50.610579  8260 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.611912  8260 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:50.616488  8374 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.619619  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:50.620290  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 152104us
I20260709 13:17:50.596138  7889 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:50.622028  7889 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.622637  8421 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:50.623106  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:50.622648  3205 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:50.624740  7889 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:50.599783  8289 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:50.641978  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:50.625414  8377 raft_consensus.cc:697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:50.582643  8496 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:50.666566  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:50.707041  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.710502  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:50.712018  8324 raft_consensus.cc:3055] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:50.712508  8324 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:50.716028  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:50.716575  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.717581  8279 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:50.718055  8279 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.718464  8279 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:50.719710  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.722970  3100 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:50.725239  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:50.726091  3208 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:50.725630  8377 consensus_queue.cc:237] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:50.728432  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:50.732337  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:50.733584  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:50.735386  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:50.735881  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:50.737694  8324 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.739068  8324 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:50.736209  3135 raft_consensus.cc:2376] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15. Re-sending same reply.
I20260709 13:17:50.658183  8361 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.733888  8499 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:17:50.753624  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 176255us
I20260709 13:17:50.764699  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:50.766124  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:50.766355  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1795) took 1141 ms. Trace:
I20260709 13:17:50.766845  3128 rpcz_store.cc:276] 0709 13:17:49.624572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.664985 (+ 40413us) service_pool.cc:224] Handling call
0709 13:17:50.765987 (+1101002us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54003db654. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:50.766155 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911111552}
I20260709 13:17:50.768535  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:50.770283  3840 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:50.767814  3100 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:50.777621  8366 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.778863  3206 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:50.781883  8333 raft_consensus.cc:3055] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:50.782303  8333 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:50.783314  8333 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.784574  8333 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:50.787587  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.788448  8485 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:50.790270  3208 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:50.802181  3177 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:50.810259  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:50.811515  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:50.814028  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:50.814448  8473 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:50.816082  8496 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:50.812832  3835 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:50.791203  8361 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:50.820094  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:50.821094  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1792) took 1206 ms. Trace:
I20260709 13:17:50.821437  3130 rpcz_store.cc:276] 0709 13:17:49.614411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.622330 (+  7919us) service_pool.cc:224] Handling call
0709 13:17:50.819759 (+1197429us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b5800002798. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11b50a0 00007fb3c11b4984 00007fb3ba72f6d4 00007fb3ba72f662
0709 13:17:50.821013 (+  1254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122734976}
I20260709 13:17:50.822762  8400 raft_consensus.cc:3055] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:50.823189  8400 raft_consensus.cc:740] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:50.828629  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:17:50.833362  8367 consensus_meta.cc:287] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.787s	user 0.016s	sys 0.004s
I20260709 13:17:50.833855  8367 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.835391  3207 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:50.836405  8367 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:50.837042  3033 catalog_manager.cc:5697] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:50.839274  3033 catalog_manager.cc:5697] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:50.845605  8550 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:50.847322  3207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2282) took 1029 ms. Trace:
I20260709 13:17:50.847755  3207 rpcz_store.cc:276] 0709 13:17:49.818383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.819027 (+   644us) service_pool.cc:224] Handling call
0709 13:17:49.819384 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.835914 (+1016530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.836889 (+   975us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540019f854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:50.847256 (+ 10367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2335509888}
I20260709 13:17:50.856312  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:50.834389  8361 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:50.824393  8400 consensus_queue.cc:260] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.793324  8406 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:50.852371  3033 catalog_manager.cc:5697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:50.806901  8542 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:50.889699  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.891494  3833 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:50.904194  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 111900us
I20260709 13:17:50.903612  3249 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:50.900465  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:50.918437  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:50.925911  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 158230us
I20260709 13:17:50.901473  8366 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:50.942108  3100 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:50.944711  7656 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:50.944585  3100 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:50.877769  8485 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:50.897570  8388 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:17:50.955394  3127 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:50.945516  8542 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:50.957998  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:50.966614  3202 raft_consensus.cc:2410] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:17:50.927687  8406 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:17:50.967235  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:50.970902  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:50.971839  3209 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
W20260709 13:17:50.973531  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.974068  7893 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:50.974547  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:50.977214  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.978252  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:50.974094  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:50.979352  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 86471.9us
I20260709 13:17:50.956599  8324 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:50.967042  8405 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:50.952481  8279 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:50.990377  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:50.993332  3127 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:50.994547  8360 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:51.004375  3833 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:51.005406  8302 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:51.007369  8550 raft_consensus.cc:993] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:17:51.007987  8550 raft_consensus.cc:1081] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:17:50.982093  8400 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:51.013410  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:51.014241  3835 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:51.015417  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:51.015879  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 71516.5us
I20260709 13:17:51.016165  3280 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:51.017232  8542 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:50.988831  8463 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.018627  8463 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.019732  3100 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:51.020046  8542 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:51.021421  8463 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:51.025573  8222 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:51.025830  3127 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:17:51.016285  8279 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:51.043255  3127 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:50.997769  3033 catalog_manager.cc:5697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 10 to 11, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 11 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:51.026160  8222 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:51.049700  3251 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:51.050447  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:51.063130  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:51.051069  3033 catalog_manager.cc:5697] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 10 to 13, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 13 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:51.047986  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:51.053037  3030 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38218 (request call id 244) took 22346 ms (client timeout 15000 ms). Trace:
W20260709 13:17:51.057904  8221 consensus_meta.cc:287] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.608s	user 0.016s	sys 0.000s
I20260709 13:17:51.054603  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:51.056239  8366 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:51.076856  8329 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.077527  8329 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.078696  3132 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:17:51.079941  8532 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:17:51.081439  3133 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:51.080327  3033 catalog_manager.cc:5697] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 12 to 14, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:51.083170  3033 catalog_manager.cc:5697] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 11 to 14, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 14 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.084514  8502 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:51.085280  8502 raft_consensus.cc:697] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:51.085429  8405 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:51.086254  8405 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:51.086512  8502 consensus_queue.cc:237] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:51.089123  8405 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:51.091460  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 231675us
I20260709 13:17:51.092466  3249 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:51.093510  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:51.076890  8366 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:51.095407  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:51.055445  8485 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:51.094398  8360 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:51.065354  8222 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:51.073597  3177 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
W20260709 13:17:51.098732  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.070451  8377 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:51.114104  3033 catalog_manager.cc:5697] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 11 to 13, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 13 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:51.115443  8377 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.117575  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:51.118137  8377 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:51.118506  3132 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:17:51.113219  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:51.114388  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:51.096956  8366 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:51.120505  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:51.121906  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.119947  3129 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:51.121397  3128 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
W20260709 13:17:51.128281  8232 consensus_meta.cc:287] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.007s
I20260709 13:17:51.073448  8221 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.116575  3033 catalog_manager.cc:5697] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:51.119936  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:51.131839  8221 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:51.132143  3134 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:51.106815  3136 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:51.128034  8566 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:51.113219  8565 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:51.137874  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:51.139089  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:51.140198  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 69150.9us
I20260709 13:17:51.131094  3033 catalog_manager.cc:5697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.142164  3177 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:51.143610  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.144169  3202 raft_consensus.cc:2410] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:51.145402  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:51.139348  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:51.148954  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:51.157475  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 137902us
I20260709 13:17:51.144909  7656 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:51.161150  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:51.151329  3033 catalog_manager.cc:5697] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 11 to 13, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 13 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.169514  3100 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:51.144042  8565 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.177479  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:51.148032  8324 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:51.176270  8279 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:51.180075  8324 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.181010  8366 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:51.188508  8366 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.188952  8366 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:51.182093  3280 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:51.193737  3279 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:51.174739  8406 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.194720  8329 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:51.195192  8406 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:51.182243  3033 catalog_manager.cc:5697] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 8 to 12, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 12 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:17:51.208026  8561 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:17:51.211664  7656 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:51.216391  3203 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:51.216389  7656 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:51.219036  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 76998us
I20260709 13:17:51.218369  3033 catalog_manager.cc:5697] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.218611  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:51.225301  3177 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:51.175135  8565 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:51.225885  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:51.232280  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 62898.6us
I20260709 13:17:51.233902  3840 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:51.230273  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:51.232952  3133 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 2109) took 3570 ms (client timeout 1902 ms). Trace:
W20260709 13:17:51.236168  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 188350us
I20260709 13:17:51.241315  3279 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 19: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:17:51.239864  3133 rpcz_store.cc:269] 0709 13:17:47.658357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.693436 (+ 35079us) service_pool.cc:224] Handling call
0709 13:17:51.218170 (+3524734us) spinlock_profiling.cc:243] Waited 3.39 s on lock 0x7b5400416ed4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:51.228983 (+ 10813us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7789228800}
I20260709 13:17:51.252503  3117 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e1a4d71ef0f4287999b5ee60fe02740 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:40280
I20260709 13:17:51.253029  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:51.253331  3805 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.088s (SENT) [suppressed 21 similar messages]
I20260709 13:17:51.255151  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:51.254091  3284 raft_consensus.cc:2410] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:51.260018  3033 catalog_manager.cc:5697] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:51.261899  8552 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:51.262530  8473 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:51.263253  8473 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:51.261802  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:51.234457  8279 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:51.268464  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:51.276597  3127 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:51.269883  3100 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:51.270998  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 45778.8us
I20260709 13:17:51.271106  8252 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:51.271832  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:51.272560  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 175757us
W20260709 13:17:51.280350  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.266753  8260 consensus_meta.cc:287] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.649s	user 0.016s	sys 0.000s
W20260709 13:17:51.069420  3030 rpcz_store.cc:269] 0709 13:17:28.706283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.709215 (+  2932us) service_pool.cc:224] Handling call
0709 13:17:51.052766 (+22343551us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:41.526367 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:41.527041 (+   674us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:41.527091 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:17:41.527110 (+    19us) tablet.cc:662] Decoding operations
0709 13:17:41.528671 (+  1561us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:41.528794 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:41.528818 (+    24us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:17:41.582831 (+ 54013us) tablet.cc:701] Row locks acquired
0709 13:17:41.582901 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:17:41.583384 (+   483us) write_op.cc:270] Start()
0709 13:17:41.633230 (+ 49846us) write_op.cc:276] Timestamp: P: 1783603061583075 usec, L: 0
0709 13:17:41.633263 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:17:41.669271 (+ 36008us) log.cc:844] Serialized 6684 byte log entry
0709 13:17:42.077437 (+408166us) op_driver.cc:464] REPLICATION: finished
0709 13:17:42.651530 (+574093us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3b90e50ac 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bfc25ef0
0709 13:17:42.812336 (+160806us) write_op.cc:301] APPLY: starting
0709 13:17:42.812440 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:43.512461 (+700021us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:43.519591 (+  7130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:44.314182 (+794591us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:44.314578 (+   396us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:17:44.314626 (+    48us) write_op.cc:312] APPLY: finished
0709 13:17:44.314980 (+   354us) log.cc:844] Serialized 156 byte log entry
0709 13:17:44.460934 (+145954us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:44.511385 (+ 50451us) write_op.cc:454] Released schema lock
0709 13:17:44.516627 (+  5242us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:44.627910 (+111283us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:44.630011 (+  2101us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":106,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":734558,"apply.run_cpu_time_us":62054,"apply.run_wall_time_us":1765531,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75323,"num_ops":17,"prepare.queue_time_us":165005,"prepare.run_cpu_time_us":33667,"prepare.run_wall_time_us":196290,"raft.queue_time_us":273373,"raft.run_cpu_time_us":32883,"raft.run_wall_time_us":921626,"replication_time_us":443691,"spinlock_wait_cycles":77940480,"thread_start_us":1501908,"threads_started":5,"wal-append.queue_time_us":305273,"wal-append.run_cpu_time_us":65845,"wal-append.run_wall_time_us":2533358}]]}
I20260709 13:17:51.294636  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:51.303340  3133 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:51.308152  3131 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:51.311228  3279 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.262544  8552 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:51.279620  8252 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.330658  3249 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:51.324785  8252 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:51.346247  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:51.349490  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 87964.2us
I20260709 13:17:51.352344  8442 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:17:51.354787  8567 log.cc:927] Time spent T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:17:51.355141  8442 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:51.352453  8473 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:51.356520  8442 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:51.358995  8442 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:51.359654  8406 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:51.363297  8559 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.307s	user 0.002s	sys 0.000s
I20260709 13:17:51.365430  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 3401) took 1082 ms. Trace:
I20260709 13:17:51.365535  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:51.366314  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 62808.4us
I20260709 13:17:51.366466  8463 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:51.367156  8463 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:51.368300  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:51.369518  8360 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:17:51.370018  8572 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:51.368178  8463 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.319911  8552 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.383736  3279 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:51.388952  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:51.377893  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.409194  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:51.420993  3130 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:17:51.409432  3128 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:17:51.365837  3204 rpcz_store.cc:276] 0709 13:17:50.282883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.600958 (+318075us) service_pool.cc:224] Handling call
0709 13:17:50.601442 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:50.624185 (+ 22743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:50.624228 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:50.624880 (+   652us) log.cc:844] Serialized 26 byte log entry
0709 13:17:50.951103 (+326223us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:50.951146 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.951228 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:51.362554 (+411326us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:51.365098 (+  2544us) raft_consensus.cc:1685] finished
0709 13:17:51.365120 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.365363 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33955,"raft.queue_time_us":23299,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":1021,"spinlock_wait_cycles":24485632,"thread_start_us":321119,"threads_started":1,"wal-append.queue_time_us":355357}
I20260709 13:17:51.406790  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:51.426151  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 57931.7us
I20260709 13:17:51.424082  3100 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:51.320549  8272 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:51.437927  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:51.439253  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:51.395521  8288 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.443522  8288 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.441283  8566 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:51.387652  8377 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:51.448410  3134 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:17:51.446718  3805 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:51.448613  3250 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:51.457213  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:51.459753  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 76042.1us
I20260709 13:17:51.444753  8439 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:17:51.462853  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:51.461261  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:51.456899  8221 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:51.461620  3250 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:51.467104  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.469712  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:51.469974  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:51.471374  3250 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:51.411417  8366 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:51.444342  3176 connection.cc:256] RPC call timeout handler was delayed by -1.3132447519999459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
I20260709 13:17:51.475755  3130 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:17:51.446122  8206 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:51.481946  3250 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:51.456933  8551 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:51.485654  3834 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
W20260709 13:17:51.488274  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 64344.2us
I20260709 13:17:51.470536  8566 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:51.492561  3832 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:51.495090  3206 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 17: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:51.503479  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:51.482342  8360 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:51.506179  3100 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:51.488220  7893 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:51.495575  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:51.526027  3841 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:51.526567  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:51.518154  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:51.484768  8473 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:51.504565  8485 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:51.526947  8206 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:51.504829  8566 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:51.510470  8360 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.539093  8470 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:17:51.539813  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.539407  8552 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:51.540527  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 93892.5us
I20260709 13:17:51.481216  8222 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:51.548317  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.548043  8366 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:51.541785  8566 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:51.546830  8360 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.532347  7893 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:51.541581  8206 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.551846  8388 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:17:51.552192  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 46437.1us
I20260709 13:17:51.541056  8485 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.558525  8498 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:51.546543  8439 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:51.570812  3101 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:51.578370  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:51.578801  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:51.501994  8279 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:51.580690  7656 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:51.581804  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 86322.7us
W20260709 13:17:51.583655  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 81932.5us
I20260709 13:17:51.567519  7893 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.568564  8485 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:51.591183  3100 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:51.583022  8502 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:51.596027  8222 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:51.596557  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 78562.8us
I20260709 13:17:51.601539  3020 catalog_manager.cc:5028] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): tablet 8e1a4d71ef0f4287999b5ee60fe02740 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:17:51.575342  8439 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:51.602877  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:51.611418  8439 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:51.615917  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.617581  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 126307us
I20260709 13:17:51.619885  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:51.621518  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 65604.2us
I20260709 13:17:51.620857  3128 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:51.630213  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:51.615170  8406 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:51.611617  8502 raft_consensus.cc:697] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:17:51.640605  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.594259  8324 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:51.645238  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:51.613477  8279 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:51.635231  8288 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:51.666714  3249 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:51.672777  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 82632.9us
W20260709 13:17:51.675846  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 87003us
I20260709 13:17:51.682192  8221 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.682869  8221 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:51.684307  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 57486.7us
I20260709 13:17:51.671478  8222 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.678088  8552 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:51.677580  8578 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:51.688560  8366 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:51.704044  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:51.713871  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.716334  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:51.717036  8221 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:51.717785  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:51.699398  8578 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.705291  8463 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:51.696764  8579 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:51.706351  8366 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:51.730808  3102 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:51.737164  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:51.737493  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:51.709467  8206 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:51.713698  8361 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.746125  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:51.743194  3207 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:17:51.706090  8222 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.748937  3207 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:51.749464  8565 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:51.749768  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:51.753057  3206 raft_consensus.cc:1240] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:17:51.750476  8575 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:17:51.750370  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:51.755642  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:51.756237  3204 raft_consensus.cc:2410] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:51.724419  8578 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:51.693496  8502 consensus_queue.cc:237] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.758198  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:51.754798  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:51.760689  3211 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:51.738126  8366 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.730763  8288 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.777377  8288 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:51.778766  8566 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.779628  8288 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:51.745451  8406 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:51.750970  8579 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:51.769273  8314 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:51.770041  8583 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:17:51.760063  3210 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
W20260709 13:17:51.780459  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 103969us
I20260709 13:17:51.747071  3202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:17:51.787585  3203 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.789857  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:51.793201  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 85938.3us
I20260709 13:17:51.763706  8206 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:51.802636  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 71596.3us
I20260709 13:17:51.802947  3204 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 17: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:51.783026  8406 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.833559  8406 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.782701  8361 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.801960  8272 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:51.812585  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:51.814558  8566 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:51.814936  3202 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:17:51.815291  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 111316us
I20260709 13:17:51.816006  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:51.845934  3202 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.809361  8288 consensus_queue.cc:1059] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:17:51.817524  8565 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:51.818022  8314 consensus_queue.cc:1059] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:51.803383  8324 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:51.823055  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:51.788184  8581 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.838348  8272 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.820498  8579 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:51.803644  8279 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:51.859459  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:51.866626  3279 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:51.843182  3284 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 9.
W20260709 13:17:51.859287  8583 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:17:51.865339  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:51.884341  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 68445.6us
I20260709 13:17:51.868512  8590 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 13:17:51.888037  8252 consensus_meta.cc:287] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.543s	user 0.013s	sys 0.002s
I20260709 13:17:51.888564  8252 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:51.893265  3833 raft_consensus.cc:2393] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 13: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:51.894340  8252 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:51.892113  8551 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:51.905972  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 106730us
I20260709 13:17:51.868366  8581 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.908123  8361 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:51.909798  8581 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:51.913998  3128 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:51.913991  7893 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.917215  7893 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:51.879038  8222 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:51.919896  8442 consensus_meta.cc:287] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.560s	user 0.004s	sys 0.008s
I20260709 13:17:51.885592  8324 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:51.922468  8590 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:51.923400  3249 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:51.925969  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:51.927011  8272 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:51.922499  8439 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:51.929718  8406 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:51.949693  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:51.949338  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:51.939322  3833 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:17:51.957799  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.963389  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:51.938395  3203 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:51.952227  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:51.981662  3279 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
W20260709 13:17:51.982560  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.938306  3202 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.990540  3207 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:51.948213  3101 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:52.005626  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 57553.6us
I20260709 13:17:52.006913  8272 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:52.008062  8324 raft_consensus.cc:3055] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:52.008651  8324 raft_consensus.cc:740] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:51.956583  8360 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:52.009989  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 84095.2us
I20260709 13:17:52.011281  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:52.011433  8360 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:52.012136  8485 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.012764  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:51.906128  8578 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.019821  8587 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:52.020126  8360 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.020955  8360 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.023919  8366 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:51.989463  8597 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:52.027544  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 104250us
I20260709 13:17:51.979197  8590 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:52.030202  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:52.032032  7893 consensus_queue.cc:1059] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:17:52.032222  3202 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:52.031733  8579 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:17:52.034557  3285 raft_consensus.cc:2368] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:17:52.017796  8442 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:52.029016  8360 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:52.054030  3128 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:52.039711  8597 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:52.039784  8288 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:52.056968  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:52.066174  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:52.031857  8439 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:52.065723  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 53036.6us
I20260709 13:17:52.032166  8566 consensus_queue.cc:1059] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:17:52.067914  3284 raft_consensus.cc:2393] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:52.070744  8485 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:52.073312  3249 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:52.067786  8588 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:52.074471  8588 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:52.074874  8588 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.071841  8565 raft_consensus.cc:3055] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:52.090593  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:52.072369  3176 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:52.072804  8324 consensus_queue.cc:260] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:52.073226  8206 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:52.042972  8442 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.092096  8279 raft_consensus.cc:3055] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:52.092979  8470 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:52.105311  8442 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:52.105578  8470 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:52.106624  8470 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:52.096077  3021 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 023c1461b69c46bdb3c42ee16f303ea2 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0930e3e7657c43bcaaa5b0778f3e08cf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:17:52.096804  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:52.105327  8279 raft_consensus.cc:740] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:52.109220  8279 consensus_queue.cc:260] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:52.109772  8470 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:52.110606  8279 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:52.113688  8366 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:52.115583  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 306654us
I20260709 13:17:52.117654  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:52.121500  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.122391  3134 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:52.123788  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:52.123821  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:52.124471  3135 raft_consensus.cc:3060] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:52.123684  3100 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:52.126048  8587 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:52.127395  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 54195.5us
I20260709 13:17:52.127895  8591 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:52.128798  8578 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:52.030138  8590 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.132617  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:52.132889  7893 raft_consensus.cc:3055] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:52.133315  3131 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:52.134243  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:52.134815  3131 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:52.135782  3132 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:17:52.136749  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:52.132768  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:52.137280  3132 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:17:52.091104  8565 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:17:52.138039  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.138213  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:52.133317  7893 raft_consensus.cc:740] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:52.142426  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:52.142545  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:52.144929  3127 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:52.149626  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 77351.1us
I20260709 13:17:52.149605  3250 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:52.150337  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:52.131273  8578 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:52.156941  8578 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.157793  8593 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.158306  8593 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.159060  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:52.160511  8593 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:52.161506  8552 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:52.161923  8552 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.162284  8552 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:52.162549  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:52.162989  3202 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:52.145644  8590 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:52.151235  3128 raft_consensus.cc:2376] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15. Re-sending same reply.
I20260709 13:17:52.154186  8377 consensus_queue.cc:1059] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:17:52.175823  8366 consensus_queue.cc:1059] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:52.176685  8593 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:52.176808  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:52.178557  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:52.179348  8588 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:52.181591  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:52.182117  8591 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:52.182387  8314 consensus_queue.cc:1059] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:52.182614  8565 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.183262  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:52.184134  8565 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:52.184840  8589 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:52.185509  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:52.166854  7893 consensus_queue.cc:260] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.192498  3279 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:52.171666  3127 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:52.189574  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:52.190726  3100 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:52.189356  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 44036.4us
I20260709 13:17:52.197566  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:52.151770  8272 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:52.206983  3101 leader_election.cc:400] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:17:52.207304  3101 leader_election.cc:403] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:52.213809  8314 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:52.206265  8502 consensus_queue.cc:1059] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:52.218883  8502 raft_consensus.cc:3055] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:52.219236  8502 raft_consensus.cc:740] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:52.192641  8485 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:52.230724  8566 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:52.224445  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:52.209561  8592 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:52.207845  8272 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.223062  3135 raft_consensus.cc:2468] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
W20260709 13:17:52.243233  3805 leader_election.cc:336] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.531s (SENT)
I20260709 13:17:52.199659  8578 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:52.248523  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:52.248549  3100 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:52.254160  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:52.254781  3208 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
W20260709 13:17:52.250977  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 69971.7us
W20260709 13:17:52.250470  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:52.255827  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:52.256222  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.251050  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:52.249403  8406 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:52.245339  8566 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.264418  3285 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 17. Ops: []
I20260709 13:17:52.265302  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:52.265910  3208 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:52.260918  3805 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:52.259413  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:52.263082  3131 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:17:52.270447  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:52.250909  8272 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:52.273419  8593 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.273990  8593 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.275286  3250 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:52.276036  8593 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:52.276566  8593 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.237582  8206 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:17:52.278899  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:52.279484  3208 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.282518  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:52.282680  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:52.249466  8388 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:17:52.272552  8442 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.277002  8593 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.277473  8222 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:52.286623  3204 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:52.283947  3132 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:17:52.286782  3203 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:52.290289  3279 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:52.292132  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:52.293097  3211 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:52.293695  3283 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:52.268922  8566 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:52.291455  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:52.316243  7893 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.300815  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:52.301647  3134 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:52.289803  8597 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:52.311354  3210 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:17:52.289584  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:52.250764  8552 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.328142  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:52.319339  3176 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:52.321671  3209 raft_consensus.cc:2393] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 17: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:52.315954  8473 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:52.280040  8485 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:52.289299  8578 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:52.259193  8366 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:17:52.329528  3206 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
W20260709 13:17:52.294112  8599 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:17:52.325603  8597 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.331549  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:52.333907  8288 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:52.333634  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:52.351187  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:52.326041  3250 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:52.333534  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:52.335846  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:52.285797  8324 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:52.290864  8588 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:52.292344  8463 raft_consensus.cc:3055] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:17:52.337738  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 94544.8us
W20260709 13:17:52.339635  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 91243.4us
I20260709 13:17:52.288803  8593 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:52.333701  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:52.343642  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:52.287050  8442 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:52.330987  3134 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:52.320253  8314 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:52.315683  8555 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:17:52.353684  3203 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.368228  3250 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:52.360049  3281 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:17:52.358208  3208 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:52.349098  8578 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:52.370119  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:52.370729  8578 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.367570  8421 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:52.373762  8421 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:52.375844  8421 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:52.365872  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:52.366161  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:52.379622  3276 raft_consensus.cc:2410] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:17:52.380383  3249 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:52.383543  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:52.384225  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:52.387365  3211 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:52.387259  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:52.390043  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:52.390290  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:52.355775  8485 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:52.385840  8473 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:52.391485  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:52.391652  8473 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:52.393256  3278 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:52.393895  8611 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:52.359515  8463 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:52.392786  3250 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:52.395149  8463 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.361904  8470 raft_consensus.cc:2804] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:52.397281  8377 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:52.397581  8590 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:52.397786  8377 raft_consensus.cc:697] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:52.398777  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:52.392167  3210 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:52.394098  8473 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:52.385880  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:52.411458  3207 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:52.401782  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:52.398671  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:52.413102  3840 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.408357  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:52.413986  3208 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:52.414566  3833 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:52.358405  8597 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:52.417044  3177 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:52.417539  3251 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:52.428970  3249 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:52.406985  8575 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:52.447134  3100 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:52.457569  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:52.458648  3285 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:52.408835  3280 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:17:52.329521  8502 consensus_queue.cc:260] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:52.478619  3202 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:52.479177  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:52.410151  8314 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.440851  8588 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:52.474273  8473 consensus_queue.cc:1059] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:52.454502  8360 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:52.460642  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:52.452543  8591 raft_consensus.cc:3055] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:52.378727  8593 consensus_queue.cc:1059] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:17:52.483429  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:52.483981  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:52.508369  3208 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:52.484512  3282 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:52.486796  7656 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:52.385612  8579 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:17:52.491967  3203 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:52.412146  8592 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:17:52.482206  3207 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:17:52.503547  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:52.512355  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 119646us
I20260709 13:17:52.514825  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:52.515326  3206 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:17:52.516680  3208 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:52.517159  3208 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:52.504364  8206 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.391530  8485 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:52.495828  8588 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:52.542095  8588 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:52.546921  3100 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:52.548198  3100 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:52.518791  8222 consensus_queue.cc:1059] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:17:52.550426  8221 consensus_queue.cc:1059] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:52.552100  8221 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:52.552469  8221 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.552809  8221 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:52.553256  8329 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:52.553800  8329 raft_consensus.cc:697] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:52.554745  8329 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.556708  8406 raft_consensus.cc:3055] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:52.557139  8406 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:52.557895  8406 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:52.559224  8406 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.560528  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:52.561659  8552 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:52.562485  8566 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.527957  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:52.639032  3203 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:52.528703  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.528821  8592 raft_consensus.cc:3055] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:52.524003  8377 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.531555  3205 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:52.530858  8324 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:52.510303  8388 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:52.504940  8591 raft_consensus.cc:740] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:52.510892  8502 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:52.494766  8314 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.527091  8360 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:52.533818  3211 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:52.510299  8288 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.566133  8442 consensus_queue.cc:1059] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:52.522296  3250 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:52.566671  3210 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:17:52.526180  3208 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.581019  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:52.752946  3207 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:52.583143  3840 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:52.588590  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:52.574255  8405 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:52.580271  8470 raft_consensus.cc:697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:17:52.604444  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 197372us
I20260709 13:17:52.619983  3204 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:52.620316  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:52.769994  3202 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:52.630913  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:52.584244  8590 raft_consensus.cc:697] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:52.771039  3282 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 11: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:17:52.771593  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 249411us
I20260709 13:17:52.634773  3279 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:17:52.636292  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:52.555732  3285 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
W20260709 13:17:52.693374  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 360153us
W20260709 13:17:52.727972  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.746342  3203 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:52.665915  8592 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:52.694653  8566 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:52.780894  3207 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:52.768733  3129 raft_consensus.cc:2393] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:52.740556  8324 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.784184  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:52.750643  8288 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:52.793713  3805 leader_election.cc:336] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.752s (SENT)
I20260709 13:17:52.752027  8360 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:52.801518  3280 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:52.802146  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.829294  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:52.830505  3129 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:52.836086  3280 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:52.825727  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:52.789709  8617 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:52.794405  8324 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:52.866046  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:52.821877  8360 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:52.875350  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:52.875851  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:52.875928  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:52.823463  8566 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:52.903476  3249 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:52.916203  3283 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 11: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:52.864909  8421 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:52.795701  8588 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.917060  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:52.939625  3284 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:52.926381  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:52.927374  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:52.929533  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:52.931753  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:52.941744  3133 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:17:52.932988  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:52.942504  3282 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:52.942943  3132 raft_consensus.cc:3055] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:52.943482  3132 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:52.934316  3249 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:52.935055  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:52.936172  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:52.937223  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:52.936244  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 95331.6us
I20260709 13:17:52.945761  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:52.950042  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:52.950721  3127 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:52.953421  3136 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:52.901386  8617 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:52.953873  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:52.953823  3128 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
W20260709 13:17:52.958547  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 187997us
I20260709 13:17:52.929823  8587 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:17:52.963320  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 138317us
I20260709 13:17:52.936029  8405 raft_consensus.cc:697] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:52.965639  3202 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:17:52.966266  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:52.945664  8612 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:17:52.975011  3101 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:52.978076  3131 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:52.951608  3132 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:52.985849  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.902958  8591 consensus_queue.cc:260] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.987030  8591 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:52.934077  8566 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:52.993844  8628 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:17:52.995100  8566 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:52.998011  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 227526us
I20260709 13:17:52.956326  8620 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:52.946363  8470 consensus_queue.cc:237] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.002600  8624 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:53.003180  8624 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.004688  3132 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:52.966821  8594 consensus_queue.cc:1059] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:17:53.006781  8206 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:53.007714  8360 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.008963  3130 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:53.009866  8221 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.010715  3276 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:53.010851  7656 raft_consensus.cc:3055] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:53.011384  7656 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:53.011976  8221 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:53.013336  8360 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:53.014384  8589 raft_consensus.cc:3055] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:53.014917  8589 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:52.866384  8592 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.012492  7656 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:52.967041  8485 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:53.016117  8589 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.031929  3132 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:53.032992  3282 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:53.034515  3840 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:53.041452  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:53.043485  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 109252us
I20260709 13:17:52.930591  8590 consensus_queue.cc:237] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.054917  8314 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:53.059527  8581 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
W20260709 13:17:53.050472  3805 leader_election.cc:336] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.058s (SENT)
I20260709 13:17:53.063968  3805 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:53.069494  8405 consensus_queue.cc:237] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.073405  8324 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.075711  8324 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:53.076699  8643 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.078495  8643 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:53.082552  8272 consensus_meta.cc:287] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.777s	user 0.010s	sys 0.000s
I20260709 13:17:53.082795  8587 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:53.083032  8272 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.083464  8643 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:53.036514  8485 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:53.085353  8485 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.085826  8421 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:53.091066  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 111944us
I20260709 13:17:53.034511  8634 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:53.102083  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 127137us
I20260709 13:17:53.115880  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:53.116804  3279 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.126402  3284 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:53.125412  8388 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:17:53.101711  8272 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:53.131816  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 81407.8us
I20260709 13:17:53.132727  3805 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:53.144765  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:53.146279  3279 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:17:53.120729  8221 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:53.154726  8324 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.154793  8591 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.156349  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:53.156492  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:53.131839  8643 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:53.160334  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.162976  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:53.163563  3211 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 17: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:53.163516  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:53.164336  8624 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:53.159305  8597 consensus_meta.cc:287] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.679s	user 0.007s	sys 0.004s
I20260709 13:17:53.170087  8597 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.165225  8221 raft_consensus.cc:697] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:53.172339  8597 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:53.173337  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.173218  8221 consensus_queue.cc:237] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:53.174093  8644 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:17:53.175437  8588 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:53.162719  8591 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.166070  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:53.167412  8580 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:53.165372  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:53.178977  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.108139  8634 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.181742  8634 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:53.151042  8617 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.187882  3136 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:53.163072  8594 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:53.193341  7656 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:53.195143  3131 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:53.191491  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:53.196791  3136 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:53.200765  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:53.201596  3132 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:17:53.203428  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.203919  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.204156  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:53.205415  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:53.160712  8485 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.207105  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:53.210040  3206 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 17: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:53.208205  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:53.161458  8324 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.210803  3202 raft_consensus.cc:2410] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:17:53.211629  3833 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:53.213236  3281 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:53.213624  3210 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:53.189488  8636 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.215849  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:53.225440  3207 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:53.218240  8589 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:53.218855  8463 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:53.166479  8643 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.225859  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:53.162357  8288 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.233204  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:53.287065  3285 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:17:53.287454  7893 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:53.283592  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 47443.8us
I20260709 13:17:53.287897  7893 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.288847  3250 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:53.291405  3833 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:53.303351  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:53.312405  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 100003us
I20260709 13:17:53.285490  8360 consensus_queue.cc:1059] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:17:53.349596  8624 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:53.366971  8648 log.cc:927] Time spent T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:53.366784  8624 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.370636  8624 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:53.373296  8639 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:53.374074  8639 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.374704  8360 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:53.375291  8360 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:53.375669  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:53.312736  3209 raft_consensus.cc:2368] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 13. Current term is 15.
I20260709 13:17:53.361840  7893 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:53.318912  3204 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 11: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:53.285494  8629 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.311115  8588 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:53.380478  3207 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:17:53.385442  3203 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:53.385926  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 253252us
I20260709 13:17:53.395099  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:53.236012  8636 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.396616  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:53.397665  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.398331  3127 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:17:53.398777  8636 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:53.403056  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:53.404493  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 178191us
I20260709 13:17:53.405743  3207 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:53.387939  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:53.408710  3249 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:53.409252  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:53.410074  3840 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:17:53.422358  3280 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:53.389694  8588 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.422731  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:53.426162  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:53.388603  8485 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:53.404846  8616 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:17:53.411160  8624 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:53.430984  3102 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:53.410924  8405 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:53.376801  8360 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.424144  8579 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:53.437150  3279 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:53.436429  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 209558us
I20260709 13:17:53.457870  3100 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:53.459846  7656 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:53.460325  7656 raft_consensus.cc:697] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:53.461063  7656 consensus_queue.cc:237] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.461357  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:53.463948  8594 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:53.464525  8594 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.467000  8388 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:53.467793  8594 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:53.468689  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:53.471777  8555 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:53.473821  8639 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:53.475679  3100 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:53.444012  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:53.437543  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:53.445565  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:53.449582  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:53.449885  3128 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:53.428105  8588 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:53.434504  8602 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:17:53.431466  8578 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:53.454223  8405 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.456158  8360 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:53.479465  3101 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:53.483389  3835 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:17:53.484167  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 51492.2us
I20260709 13:17:53.480317  3205 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:53.489395  8552 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:53.492554  8591 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:53.475309  8643 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:53.489244  3211 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:53.389504  8629 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.497493  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:53.499400  3101 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:53.502503  3250 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:53.500092  7656 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:53.500973  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:53.494485  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.476564  8581 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:53.513948  3842 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:17:53.518782  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:53.490006  8324 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:53.489476  8565 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:53.519511  3205 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:53.524282  8593 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:53.525478  8615 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.526345  8591 consensus_queue.cc:1059] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:53.436636  8612 consensus_queue.cc:1059] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:17:53.544518  8591 raft_consensus.cc:3055] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:53.549285  8591 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:53.550182  8591 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.551430  8591 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:53.527944  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:53.515007  8578 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:53.553969  8578 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.554244  8615 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.556675  8615 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:53.529345  3135 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:17:53.515380  8581 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.516546  8552 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:53.565112  3282 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:53.568866  8612 raft_consensus.cc:3055] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:53.568269  8552 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.534792  8579 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:53.573470  3283 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:53.574342  7656 raft_consensus.cc:697] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:53.565861  8581 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:53.577301  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.558912  8629 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:53.581175  8361 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:53.581410  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.581753  8221 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:53.584537  8405 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:53.597808  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 69969.9us
I20260709 13:17:53.648521  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:53.648190  8221 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.650391  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:53.651437  8221 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:53.651788  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:53.569571  8612 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:53.562523  8616 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:17:53.573784  8615 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:53.626704  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 127405us
I20260709 13:17:53.626085  8555 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:53.655429  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:53.656991  7656 consensus_queue.cc:237] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.665323  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:53.667286  8624 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:53.661754  8555 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.668442  8555 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.673108  8597 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:53.678789  8615 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:53.679422  8615 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:53.659279  8324 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:53.680790  8615 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.659021  8361 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.659895  8593 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:53.685199  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:53.687654  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:53.689725  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:53.690613  3285 raft_consensus.cc:2393] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 14: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:53.690811  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:53.691211  8405 consensus_queue.cc:1059] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:53.691411  3276 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:17:53.691457  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:53.692277  3128 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:17:53.692859  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:53.693663  3282 raft_consensus.cc:2393] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:53.654212  8612 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.698009  3176 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:53.699182  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:53.700071  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:53.694969  8555 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.701913  8324 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:53.702131  8587 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:53.722675  8288 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:53.705844  8405 raft_consensus.cc:3055] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:53.728129  8405 raft_consensus.cc:740] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:53.729135  8405 consensus_queue.cc:260] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.730247  8502 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:53.730512  8405 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.730969  8502 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.705966  8593 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:53.706362  8637 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:53.733453  8502 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:53.733393  8637 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.734754  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:53.730310  8361 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:53.735958  8637 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:53.705580  8624 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:53.736845  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:53.737540  3128 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:53.715899  3177 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:53.717109  3835 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:53.665403  8588 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.739679  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:53.739888  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:53.741067  3130 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:17:53.741353  8588 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:53.716815  8592 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.742003  8588 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:53.718290  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:53.717779  8612 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:53.751212  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:53.752080  3835 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:53.721650  8581 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.722190  8589 consensus_queue.cc:1059] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:17:53.792855  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:53.793787  3132 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.753847  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:53.798437  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 44674us
I20260709 13:17:53.801971  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:53.727288  3208 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:53.727478  8555 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:53.803763  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:53.732661  8632 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.671s	user 0.000s	sys 0.007s
I20260709 13:17:53.742300  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:53.721369  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:53.746376  8288 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:53.746502  8324 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:53.824414  3840 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:17:53.747812  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:53.829470  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:53.830137  3209 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.749383  8421 raft_consensus.cc:3055] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:53.749662  8647 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:53.750087  3130 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:53.753625  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:53.763011  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:53.742481  8588 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.811779  3276 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.812175  3128 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:53.802745  3283 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:17:53.814189  3133 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:53.810359  3251 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:53.815459  3280 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:53.815660  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:53.824298  3207 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
W20260709 13:17:53.825248  3805 leader_election.cc:336] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.968s (SENT)
I20260709 13:17:53.825628  3806 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:53.819635  3101 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:53.747138  8593 raft_consensus.cc:697] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:53.835409  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:53.851743  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:53.836054  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:53.852470  3279 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:53.834858  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:53.791404  8624 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:53.802986  8587 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:53.849417  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:53.835549  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:53.848929  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:53.829748  8324 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:53.854144  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 43884us
I20260709 13:17:53.745304  8360 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:17:53.854346  3204 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 18: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:53.827396  8288 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.824620  8597 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:53.870316  3208 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:17:53.871258  3281 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:53.871673  3278 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 17: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:53.866911  3284 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 16: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:53.802392  8552 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:17:53.867848  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:53.874032  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:53.879000  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:53.881929  3132 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:17:53.887308  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2324) took 1496 ms. Trace:
I20260709 13:17:53.834843  8421 raft_consensus.cc:740] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:53.892896  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:53.887630  3208 rpcz_store.cc:276] 0709 13:17:52.374793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.516045 (+141252us) service_pool.cc:224] Handling call
0709 13:17:52.516376 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.726739 (+1210363us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b580083edd0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc14b0aa 00007fb3bc1cd447 00007fb3bc1e5fe7 00007fb3bc1e77de 00007fb3bc1f1b49 00007fb3bc1f2416 00007fb3bc1eed8f 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4
0709 13:17:53.870729 (+143990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.870948 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1580171648}
I20260709 13:17:53.891922  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:53.867874  8551 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:53.894403  3128 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:53.895116  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:53.895565  3207 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.891999  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:53.897442  3132 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:53.854772  8588 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:53.903714  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.868501  8324 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:53.874002  8288 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:53.881424  8279 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:17:53.865630  8647 raft_consensus.cc:697] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:53.900332  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:53.900167  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:53.910065  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 100216us
I20260709 13:17:53.828115  8618 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:17:53.868705  8377 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:53.914661  8377 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.915117  8377 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:53.915480  8647 consensus_queue.cc:237] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:53.919767  3134 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:53.890545  8597 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:53.909027  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:53.930819  3130 raft_consensus.cc:2393] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 17: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:53.907563  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:53.868732  8589 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:53.885293  8639 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:53.832919  8626 consensus_queue.cc:1059] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:17:53.878161  8591 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:53.894634  8629 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:53.894424  8551 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.901468  8555 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:17:53.937777  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:53.942284  3132 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:53.947425  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:53.939435  8388 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:53.974128  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:53.910799  3805 leader_election.cc:336] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.088s (SENT)
I20260709 13:17:53.960239  3207 raft_consensus.cc:2410] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:17:53.966147  3210 raft_consensus.cc:3055] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:53.976846  3210 raft_consensus.cc:740] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:53.966432  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 54175.4us
I20260709 13:17:53.869820  8587 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.979107  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:53.977837  3210 consensus_queue.cc:260] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:53.992413  3210 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:53.995368  3805 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:53.999753  3278 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:53.979624  3250 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:54.003207  7893 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:54.003947  7893 raft_consensus.cc:697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:53.934442  8589 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:54.015251  3207 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:53.922649  8617 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:17:53.968505  8551 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:54.024467  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:53.952512  8629 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:54.040452  3284 raft_consensus.cc:1275] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:54.025213  7893 consensus_queue.cc:237] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.043363  3210 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:17:54.043787  3210 pending_rounds.cc:85] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 5
I20260709 13:17:53.992306  8579 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:53.984050  8388 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:54.018698  8589 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:54.044175  3210 pending_rounds.cc:107] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:17:54.061343  3210 raft_consensus.cc:2889] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:54.059911  8552 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:17:54.041482  8421 consensus_queue.cc:260] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.064093  8421 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.046357  8498 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:54.068410  8665 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:17:54.069979  3210 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:54.071305  3210 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:53.957430  8620 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.084s
W20260709 13:17:54.077911  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 167127us
I20260709 13:17:54.050474  8629 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:54.089567  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 110547us
I20260709 13:17:53.955857  8593 consensus_queue.cc:237] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.093775  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:54.093641  3276 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:17:54.013906  8591 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.054021  8388 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:54.096521  3835 raft_consensus.cc:2468] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:54.103864  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:54.105162  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:54.107903  8615 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:54.031351  8634 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:17:54.041056  8565 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:17:54.085642  8671 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:54.089835  8581 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:54.090066  8566 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.014410  8624 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.068374  8377 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.137454  8633 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:54.138979  8673 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:54.139264  8663 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:17:54.139550  8673 raft_consensus.cc:697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:54.141726  8670 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:17:54.142997  8669 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:17:54.109345  8626 consensus_queue.cc:1243] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer 48080cf0460346769ab046a4f9457aa5 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:54.152215  3209 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:17:54.145064  8591 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:54.133972  8615 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:54.153330  8671 consensus_queue.cc:1059] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:54.140501  8673 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.088156  8597 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.109683  8642 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.236s
I20260709 13:17:54.162686  3840 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:17:54.162959  3177 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:54.163757  8587 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:54.163815  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:54.163957  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:54.164860  3836 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:54.172236  3836 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:17:54.147189  8566 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.175837  8566 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:54.187207  8627 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.177s
I20260709 13:17:54.197614  8643 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.206164  8377 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:54.223354  3101 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:54.225741  8405 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:17:54.226118  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 63223.9us
I20260709 13:17:54.226471  8615 raft_consensus.cc:2804] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:54.227065  3134 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:54.226719  8643 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.227207  8615 raft_consensus.cc:697] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:54.233902  8288 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.226583  8405 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:54.280400  8405 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.240268  8361 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.289831  3130 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:54.241533  8324 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.229972  8615 consensus_queue.cc:237] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.296139  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:54.296960  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:54.250778  8592 consensus_meta.cc:287] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.002s
I20260709 13:17:54.262982  3131 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:17:54.239466  8643 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:54.291345  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 184162us
I20260709 13:17:54.292158  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:54.301482  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:54.192823  8588 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.306478  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:54.291417  8377 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.311015  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:54.311971  3129 raft_consensus.cc:2410] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:17:54.315510  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:54.317044  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:54.317878  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:54.318152  3202 raft_consensus.cc:2393] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 13: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:17:54.319073  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.319257  3283 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:54.320964  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:54.323726  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:54.324501  3135 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:54.308563  8681 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:54.314585  8279 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:54.322930  8591 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:54.333787  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 254889us
I20260709 13:17:54.294198  8388 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.297848  8361 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.325466  8633 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:54.336781  3805 leader_election.cc:336] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.196s (SENT)
I20260709 13:17:54.344062  8288 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:54.345691  3805 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:54.322079  8377 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.346841  3128 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:54.345520  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:54.347841  3133 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:54.348443  3835 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:54.348982  8324 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:54.355940  3285 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:54.342028  8551 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.358368  8388 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:54.359468  8551 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:54.360275  3130 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 21: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:54.360898  8588 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:54.364449  8592 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.365304  8329 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.365728  8629 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.364989  8592 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.368290  7656 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:54.365798  8329 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.368515  8581 consensus_queue.cc:1059] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:17:54.374783  8580 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:54.383512  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:54.386025  3278 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 21: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:54.387280  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:54.387575  8683 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:54.382813  3250 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:54.389021  8581 raft_consensus.cc:3055] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:54.400825  3279 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:17:54.402626  8329 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:54.403126  3101 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:54.404878  8361 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:54.402693  8485 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:54.406684  8485 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.404958  8634 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:54.408334  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:54.407096  8485 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:54.421490  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:54.393389  8581 raft_consensus.cc:740] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:54.429225  3133 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:17:54.430507  3250 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:54.430617  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 93856.4us
I20260709 13:17:54.431610  8361 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:54.432510  3835 raft_consensus.cc:1275] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:17:54.385844  8588 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:17:54.402043  8592 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:54.393739  8470 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:17:54.432777  8634 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:54.434026  8361 raft_consensus.cc:697] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:54.442950  8683 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.478645  3835 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:17:54.488831  8361 consensus_queue.cc:237] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.507225  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1817) took 1585 ms. Trace:
I20260709 13:17:54.507850  3129 rpcz_store.cc:276] 0709 13:17:52.921718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.921952 (+   234us) service_pool.cc:224] Handling call
0709 13:17:54.506936 (+1584984us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54003db654. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:54.507140 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3130990464}
I20260709 13:17:54.468915  8683 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.515789  8683 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:54.516987  8636 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:54.517832  8636 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.462813  8589 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.469945  8629 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:54.521068  8636 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:54.549525  8690 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:17:54.564749  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:54.565502  3836 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:54.572067  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:54.573302  3805 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:54.558213  8612 consensus_meta.cc:287] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.766s	user 0.013s	sys 0.000s
I20260709 13:17:54.588284  8485 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.528550  8634 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.524665  8581 consensus_queue.cc:260] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.598902  8639 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:54.600677  8589 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:54.602638  8645 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:54.581070  8580 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:54.615481  3836 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
I20260709 13:17:54.627112  8360 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:54.632344  8485 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:54.603966  8643 consensus_queue.cc:1048] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:17:54.636274  3251 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:54.625504  8581 raft_consensus.cc:3060] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:54.622874  8639 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.664387  8683 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:54.729025  3207 raft_consensus.cc:3055] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:54.729449  3207 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:54.730185  3207 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.731443  3207 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:54.751314  8360 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.752106  8360 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.755649  8627 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.756387  8627 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.758618  8627 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:54.761236  3207 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:54.761879  3835 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:17:54.762267  8360 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:54.726321  8594 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.764835  3207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2348) took 1044 ms. Trace:
I20260709 13:17:54.727952  8683 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:54.767650  3207 rpcz_store.cc:276] 0709 13:17:53.720700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.041988 (+321288us) service_pool.cc:224] Handling call
0709 13:17:54.060029 (+ 18041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.728916 (+668887us) spinlock_profiling.cc:243] Waited 88.9 ms on lock 0x7b54004a1120. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc166dc0 00007fb3bc1f11c0 00007fb3bc1f2231 00007fb3bc1eed8f 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c
0709 13:17:54.764084 (+ 35168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.764773 (+   689us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204393856}
I20260709 13:17:54.793162  8638 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:54.766791  8647 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
W20260709 13:17:54.807245  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 486302us
I20260709 13:17:54.809372  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:54.765411  8589 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:54.818290  3100 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:54.771515  8360 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:17:54.817348  8589 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.771075  8594 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.835093  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:54.816969  8681 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:54.837625  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:54.823050  8592 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.812156  8638 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.816376  8685 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:54.849547  8463 raft_consensus.cc:3055] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:54.850031  8463 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:54.850800  8638 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:54.850945  8463 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.852391  8463 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:54.857194  8588 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:54.858865  8588 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:54.832486  8579 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.860638  8579 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.862908  8579 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:54.863466  8579 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:54.864408  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:54.864681  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:54.865264  3285 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:54.865800  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:54.866393  3835 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:54.867842  3284 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:17:54.868223  3284 pending_rounds.cc:85] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 8
I20260709 13:17:54.868435  3284 pending_rounds.cc:107] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:17:54.868649  3284 raft_consensus.cc:2889] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:54.869118  8639 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:54.870285  3250 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:54.838624  8615 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:54.871268  8683 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:54.872768  8470 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:54.873225  8470 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:54.873381  8704 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:17:54.873647  8470 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:54.838376  8624 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:54.865267  3281 raft_consensus.cc:2393] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:54.877161  8681 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:54.878180  3251 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:54.879026  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:54.879462  8681 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:54.880157  8627 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:54.880539  8627 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.880858  8627 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:54.883279  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45734.2us
I20260709 13:17:54.885293  3840 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
W20260709 13:17:54.912331  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.914388  3102 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:54.836462  8377 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:54.919456  3130 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:17:54.929409  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:54.930049  3136 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:17:54.930546  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:54.930855  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:54.931160  3135 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:54.931303  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:54.922387  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:54.925035  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:54.934885  3205 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:54.926458  3805 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:54.921648  3208 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:54.939782  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:54.940630  3280 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:54.943068  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:54.945813  3284 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:54.948204  3129 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:54.949216  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:54.949672  8645 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:54.959412  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:54.960142  3207 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
I20260709 13:17:54.955646  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:54.962649  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:54.963456  3835 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:17:54.964769  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:54.889586  8626 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:54.972725  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:54.973433  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:54.974015  3130 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:54.974675  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:54.974876  3128 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:54.892247  8679 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.981071  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:54.982832  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 56468.8us
I20260709 13:17:54.982846  3208 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:54.984987  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:54.985783  3842 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 21: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:54.932245  8638 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.957804  8324 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:55.007507  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 56467.6us
I20260709 13:17:55.013103  3102 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:55.014077  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:55.019096  3209 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 18: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:54.967921  8633 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.961588  8377 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:55.020994  3280 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:54.970777  8634 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:55.016443  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:55.025601  3206 raft_consensus.cc:1275] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:54.970896  8647 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:54.955138  8680 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:54.977984  8388 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.054785  3134 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:17:55.056941  3130 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:54.957700  8685 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:17:55.092412  3203 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:55.095856  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.018163  8645 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:55.017935  8709 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:55.062938  8695 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:17:55.099654  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.109946  3209 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:17:55.102646  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:55.026028  8566 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.056938  8612 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:55.061703  8579 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:55.012645  8679 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.025126  8324 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.019856  8638 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.146533  3209 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:55.098243  8624 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:55.107363  8706 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.063584  8377 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.128466  8612 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.160147  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.090934  8680 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.057585  8633 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.161741  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.164608  3203 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:55.093312  8388 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.165419  3209 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
W20260709 13:17:55.167306  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 144599us
I20260709 13:17:55.095317  8647 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.123713  8645 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.180956  3102 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:55.187023  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.133314  8566 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.166481  8612 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:55.189565  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:55.205832  7893 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.206589  7893 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:55.187860  8714 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:17:55.195946  8634 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:55.226553  8709 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:55.182735  8594 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:55.158869  8624 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.233642  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:55.149760  8579 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.239725  3205 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
W20260709 13:17:55.239725  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 219853us
W20260709 13:17:55.241098  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.231321  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:55.250258  8634 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.251117  8709 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.281291  3207 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:17:55.253497  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.254741  3210 raft_consensus.cc:1240] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:17:55.256472  8647 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:55.258029  8712 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:17:55.199848  8615 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:17:55.261705  8713 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:17:55.266569  8566 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:55.157640  8706 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:55.270864  8717 log.cc:927] Time spent T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:17:55.178828  8643 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:55.273279  3285 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 18.
I20260709 13:17:55.274739  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.275441  3177 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:55.234426  8720 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:17:55.311201  8581 consensus_meta.cc:287] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
I20260709 13:17:55.283473  3210 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:55.313572  8706 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:55.313920  8388 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:55.314636  8709 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:55.316576  8324 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:55.280615  3101 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:55.317215  8388 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.317732  8388 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.318941  8680 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:55.319764  8388 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:55.320196  8377 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:55.320304  8388 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:55.320784  8388 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:55.297720  3284 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:17:55.304549  8633 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:55.329048  3249 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:55.321627  8679 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:55.321761  8719 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:55.317062  8685 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:55.330175  8685 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:55.330590  8685 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.330801  3249 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:55.330955  8377 consensus_queue.cc:1059] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:55.300537  3203 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:55.331789  8377 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:55.332140  8377 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:55.332221  8566 raft_consensus.cc:3055] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:55.332479  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.332679  8566 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:55.333174  3203 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:55.333595  8566 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.334738  8566 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:55.323917  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.336671  8624 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:55.301064  8615 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.338135  3836 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:55.339180  8615 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:55.339956  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:55.341358  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:55.324596  8592 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.325232  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.340847  3250 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:55.357991  3210 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:17:55.301872  3806 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:55.323897  8638 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:55.325958  8470 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.326699  8643 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.328162  8612 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.293695  7893 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:55.329660  8388 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.336598  3202 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:55.371590  3277 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:55.373492  7893 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.374876  3202 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:55.324466  3834 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.343963  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:55.345608  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.359922  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:55.362562  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 60776.5us
I20260709 13:17:55.377601  3285 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:17:55.378551  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:55.379053  3806 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:55.129173  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:55.363813  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:55.380573  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:55.381302  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:55.381877  3134 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:55.382383  8706 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:55.382862  8706 raft_consensus.cc:697] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:55.383162  3128 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:55.383353  3834 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:17:55.383450  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:55.369653  3127 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.383877  8706 consensus_queue.cc:237] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.384361  3136 raft_consensus.cc:2393] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 14: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:55.387807  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:55.387179  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:55.386569  3133 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:17:55.332521  8377 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:55.394286  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 48513.1us
I20260709 13:17:55.308756  8627 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.404469  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:55.405036  3134 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:55.395294  3806 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:55.392423  3249 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:55.397174  8588 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:55.357946  8463 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.408164  3127 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:55.403017  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:55.363374  8680 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.369985  8709 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:55.389117  8360 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:55.439741  3284 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:55.441376  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.399145  8679 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:55.458987  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:55.459607  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:55.455725  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.449693  3133 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:55.466979  3834 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:55.419564  8588 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.465601  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:55.469774  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.470386  3202 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:17:55.470646  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:55.471266  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:55.468462  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:55.425765  8421 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:55.475507  3202 raft_consensus.cc:2393] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 13: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:55.478072  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:55.478832  3133 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:55.439116  8709 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.483666  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:55.407795  8615 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:17:55.399744  8620 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:17:55.482523  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:55.442608  8206 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:55.442425  8360 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.474519  8597 consensus_queue.cc:1059] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:17:55.497493  8645 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:55.497882  8597 raft_consensus.cc:3055] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:55.498235  8597 raft_consensus.cc:740] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:55.480654  8421 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.498726  8421 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.499177  8597 consensus_queue.cc:260] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.500372  8597 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.486249  8709 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:55.440171  8680 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.504524  8680 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:55.505350  8711 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:55.506310  7893 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:55.474080  8588 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:55.513458  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45103.2us
I20260709 13:17:55.439697  8463 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.481169  8593 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:17:55.488224  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:55.417893  8673 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:17:55.510124  3101 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:55.485535  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 86926.9us
I20260709 13:17:55.516896  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:55.517951  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:55.481582  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:55.523411  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 82494.5us
I20260709 13:17:55.449399  8647 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:17:55.486426  8324 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:55.529181  3249 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:55.510886  8360 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:55.493158  8206 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.535416  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:55.505990  8711 raft_consensus.cc:697] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:17:55.539937  8725 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 13:17:55.540732  8728 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:17:55.541266  8626 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:55.547888  8683 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:55.538344  3285 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:17:55.537896  8620 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:55.550486  8206 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:55.551162  8737 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:55.566574  8737 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.566964  8737 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:55.569907  8683 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:17:55.551564  8724 log.cc:927] Time spent T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:17:55.539153  3249 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:55.559844  3805 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:55.579195  3805 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:55.560817  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.562472  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.581486  3205 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:17:55.533205  8638 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:55.563979  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.566083  8620 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.554421  8624 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:55.581804  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:55.583773  8498 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.587262  8645 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:55.535702  8592 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:17:55.594568  8578 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:55.624281  8612 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:55.624536  8579 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:55.545243  8720 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:17:55.595564  3805 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:55.562541  8681 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:17:55.624786  8470 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:55.642560  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 54286.1us
I20260709 13:17:55.585179  8638 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.587273  8589 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:55.591423  8620 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.703351  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:55.624503  8463 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:55.716354  8589 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:55.719339  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 161965us
I20260709 13:17:55.719965  8711 consensus_queue.cc:237] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:55.720784  8732 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:17:55.628144  8578 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:55.719774  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 76010.6us
I20260709 13:17:55.730099  8498 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:55.734402  8498 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:55.734803  8498 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.653981  8739 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:55.701499  8593 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.704519  8638 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.712159  8627 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:55.751976  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:55.771515  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:55.753908  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.772130  3833 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:55.757252  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:55.701112  8579 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:17:55.765049  3128 raft_consensus.cc:1275] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:17:55.773005  3128 pending_rounds.cc:85] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 10
I20260709 13:17:55.773288  3128 pending_rounds.cc:107] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:17:55.773533  3128 raft_consensus.cc:2889] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:55.773820  3131 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:55.741384  8578 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:55.775204  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:55.628876  8624 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.770159  3132 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:55.770638  3127 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:55.746789  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 190004us
I20260709 13:17:55.755664  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.786458  3205 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
W20260709 13:17:55.787941  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 192493us
I20260709 13:17:55.788637  3805 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:55.712507  8421 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.807824  3833 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:17:55.808871  3102 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:55.823873  8496 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:55.824488  8496 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:55.825464  8496 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.834299  8498 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.838107  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:55.838598  8498 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:55.838981  8685 consensus_meta.cc:287] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260709 13:17:55.887382  8681 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:55.765141  8588 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.887442  8643 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:55.887629  8685 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.889215  3207 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.889480  8588 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:17:55.893455  8746 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:17:55.797751  8645 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.861521  3842 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:17:55.913897  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:55.866341  8624 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:55.871651  8629 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.881678  8206 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.882622  3127 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:17:55.884085  8421 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:55.885103  8737 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.770002  8739 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.894189  3277 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 16: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:55.773456  8593 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:55.894480  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 56462.6us
I20260709 13:17:55.894816  8685 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:55.901372  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.901877  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:55.903249  3203 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
W20260709 13:17:55.903723  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.947875  3203 pending_rounds.cc:85] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 9
I20260709 13:17:55.948172  3203 pending_rounds.cc:107] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:17:55.903586  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:55.904033  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.904336  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:55.948494  3203 raft_consensus.cc:2889] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:55.905313  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.913188  3840 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:55.949501  3133 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.916953  3207 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:55.922823  3100 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:55.924144  8736 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:17:55.925431  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:55.927609  8633 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:17:55.928023  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 140535us
I20260709 13:17:55.929147  8661 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.906086  8681 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:55.930287  8579 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:55.930418  8629 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.933868  3209 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:17:55.983525  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 220040us
I20260709 13:17:55.959106  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:55.960620  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:55.950978  7656 consensus_queue.cc:1059] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:55.986632  7656 raft_consensus.cc:3055] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:55.986974  7656 raft_consensus.cc:740] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:55.977488  3250 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:55.880743  8388 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:55.988154  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:55.991096  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:55.992569  3210 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:55.993571  3805 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:55.945633  8647 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:55.995611  3251 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:55.930299  8722 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:17:55.978897  8221 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:55.979354  8634 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.982254  8681 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.955914  8591 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:17:56.001969  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:56.006404  3280 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:17:56.021796  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:56.022950  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:56.023028  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:56.023947  3280 raft_consensus.cc:2410] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:17:55.990383  3834 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:17:56.025765  3177 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:56.007215  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:56.008173  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:56.019291  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:56.029049  3276 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:55.991820  8442 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:55.991021  8579 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.000398  8645 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.026942  8634 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:55.965859  8324 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:17:55.966161  8624 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:17:56.039554  8634 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:55.966064  8673 consensus_queue.cc:1048] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:17:56.040156  8638 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.042032  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:56.042549  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:56.043193  8709 consensus_meta.cc:287] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
I20260709 13:17:56.043292  8588 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:56.033824  8685 raft_consensus.cc:2764] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:17:56.034399  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:56.043694  8709 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:56.044480  3129 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:56.036918  8579 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:56.042675  3130 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:56.046025  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:56.032477  3133 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:17:56.051790  3128 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:17:56.046618  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:56.047791  3134 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:56.056255  7893 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.989070  8661 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.081287  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:56.081799  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:56.082028  3840 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:56.033116  3834 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:17:56.015159  8647 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:56.058388  8360 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.061381  8578 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.062858  8629 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:56.062944  8734 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.557s	user 0.005s	sys 0.000s
I20260709 13:17:56.104691  3834 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:56.048974  8442 raft_consensus.cc:697] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:56.107090  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:56.064047  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:56.066061  8737 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:56.072088  3101 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:56.140139  3834 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:17:56.140368  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 68383.4us
I20260709 13:17:56.072785  8588 raft_consensus.cc:697] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:56.001869  8221 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:56.075699  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:56.142889  3282 raft_consensus.cc:2368] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15.
I20260709 13:17:56.077059  8739 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:56.078365  8206 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:56.078963  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:56.090345  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:56.154261  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 63993.3us
I20260709 13:17:56.092864  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:56.155869  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:56.098050  3211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2354) took 1179 ms. Trace:
I20260709 13:17:56.081799  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:56.156461  3278 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:56.156481  3134 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:56.155088  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:56.167179  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:56.167490  3129 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
W20260709 13:17:56.056056  8377 consensus_meta.cc:287] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.637s	user 0.006s	sys 0.006s
I20260709 13:17:56.103530  3284 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 18: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:56.168979  3133 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:17:56.106015  8360 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:56.043226  8388 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:56.179077  3208 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:56.181810  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:56.183790  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:56.143759  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 54736.9us
W20260709 13:17:56.103062  8597 consensus_meta.cc:287] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.598s	user 0.014s	sys 0.000s
I20260709 13:17:56.148123  8221 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:56.152276  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 165451us
I20260709 13:17:56.102269  8593 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:56.173375  3840 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:56.261329  8593 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.105214  3210 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:17:56.150122  3279 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:17:56.336107  3279 pending_rounds.cc:85] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 13
I20260709 13:17:56.336403  3279 pending_rounds.cc:107] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:17:56.336660  3279 raft_consensus.cc:2889] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:56.147838  8633 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:56.258563  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:56.338666  3833 raft_consensus.cc:2393] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 19: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:56.156592  3211 rpcz_store.cc:276] 0709 13:17:54.919106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.957521 (+ 38415us) service_pool.cc:224] Handling call
0709 13:17:54.985011 (+ 27490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.160092 (+175081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.160139 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.169628 (+  9489us) log.cc:844] Serialized 26 byte log entry
0709 13:17:55.291100 (+121472us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:55.292262 (+  1162us) log.cc:844] Serialized 14 byte log entry
0709 13:17:55.295502 (+  3240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.414292 (+118790us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b48002727d8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1118aa1 00007fb3c110fb37 00007fb3c110f9ca 00007fb3c120726f 00007fb3c1206f37 00007fb3c121b55c 00007fb3c121b508 00007fb3c121b488 00007fb3c121b443 00007fb3c121a6ec 00007fb3c0144a96
0709 13:17:56.097717 (+683425us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b5400246654. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:56.097785 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.097830 (+    45us) raft_consensus.cc:1685] finished
0709 13:17:56.097841 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.097991 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30213,"prepare.queue_time_us":102692,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":10143,"raft.queue_time_us":7809,"raft.run_cpu_time_us":2703,"raft.run_wall_time_us":124447,"spinlock_wait_cycles":406092928,"thread_start_us":73911,"threads_started":2,"wal-append.queue_time_us":98691}
I20260709 13:17:56.185105  3249 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:56.103396  8722 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:17:56.186305  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:56.171305  8739 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:56.357220  8588 consensus_queue.cc:237] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.175452  8377 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.359958  8377 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:56.361500  8442 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.341779  8633 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.362888  8633 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:56.365144  8591 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:17:56.365847  8620 consensus_meta.cc:287] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
I20260709 13:17:56.366427  8620 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.187747  8624 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:56.256620  8324 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:56.188127  8711 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:56.368459  8620 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:56.176043  8685 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:56.368985  8578 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:56.334780  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:56.369961  3281 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:56.098623  8673 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
W20260709 13:17:56.346477  8751 log.cc:927] Time spent T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.254s	user 0.000s	sys 0.000s
I20260709 13:17:56.145671  8502 consensus_queue.cc:1059] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.120s
I20260709 13:17:56.365900  8661 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:56.372725  3276 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:56.373497  3283 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:56.375061  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 190069us
I20260709 13:17:56.385476  3806 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:17:56.344439  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 158221us
W20260709 13:17:56.378206  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 117404us
I20260709 13:17:56.391004  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:56.391928  3133 raft_consensus.cc:2410] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 13:17:56.471834  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 84352us
I20260709 13:17:56.471257  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2372) took 1189 ms. Trace:
I20260709 13:17:56.479702  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:17:56.377053  8620 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:56.485740  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:56.490217  3207 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:17:56.383549  8744 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:56.492136  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:56.496451  3208 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:56.501135  3127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.026s	sys 0.027s
W20260709 13:17:56.501555  3127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.026s	sys 0.027s
I20260709 13:17:56.504204  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:56.395370  8685 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:56.506415  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:56.513021  3211 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:56.508016  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:56.515345  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:56.516710  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:56.470396  8206 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.475010  8624 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.398475  8645 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:56.500622  3207 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:17:56.372349  8593 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.476681  3204 rpcz_store.cc:276] 0709 13:17:55.282117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.287175 (+  5058us) service_pool.cc:224] Handling call
0709 13:17:55.287468 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.294185 (+  6717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.294222 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.294674 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:17:55.450594 (+155920us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:55.556163 (+105569us) log.cc:844] Serialized 14 byte log entry
0709 13:17:55.556459 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.556528 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.062201 (+505673us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:56.384237 (+322036us) raft_consensus.cc:1685] finished
0709 13:17:56.471018 (+ 86781us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.471181 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34326,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":7188,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":19225,"spinlock_wait_cycles":114320128,"thread_start_us":147360,"threads_started":2,"wal-append.queue_time_us":164239}
I20260709 13:17:56.532199  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:56.529685  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:56.533712  3134 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:56.536446  8720 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:56.473421  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:56.537207  8720 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.538379  8711 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:56.538759  8711 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:56.539119  8711 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.539551  8720 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:56.547092  3136 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.013s	sys 0.044s
W20260709 13:17:56.547503  3136 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.013s	sys 0.044s
I20260709 13:17:56.503063  8579 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:56.488337  8661 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:56.489224  8638 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:56.496117  8744 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.502156  8485 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.483958  8324 consensus_queue.cc:1059] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:17:56.512027  8685 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:56.577736  7893 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.525815  8388 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:56.580520  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:56.563376  8731 log.cc:927] Time spent T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:17:56.495142  8592 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:17:56.579877  7893 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.549203  8421 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:56.568629  8734 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:56.505184  8620 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.575098  8647 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:56.614632  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:56.581327  8744 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:56.569365  8645 raft_consensus.cc:697] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:56.541592  8206 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.591135  8579 raft_consensus.cc:697] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:56.549474  8624 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.597929  8470 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.623463  7893 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:56.594698  8485 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:56.630715  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:56.631307  3277 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.632285  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:56.632848  3210 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:56.600090  8388 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.636327  8485 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:56.634048  3202 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.006s	sys 0.003s
W20260709 13:17:56.638664  3202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.006s	sys 0.003s
I20260709 13:17:56.578272  8661 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:56.647213  8647 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:56.647806  8647 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.648537  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:56.650502  8647 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:56.651732  8757 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:17:56.652386  8593 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:56.652554  8624 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:56.654049  8620 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:56.628779  8685 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.658344  3279 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:17:56.626132  8681 consensus_meta.cc:287] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.002s
W20260709 13:17:56.663439  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 191799us
I20260709 13:17:56.664592  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:56.672104  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 141868us
I20260709 13:17:56.675205  3250 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:56.676940  3835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.015s	sys 0.050s
I20260709 13:17:56.607787  8421 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:56.680828  3208 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:56.684558  3280 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:56.686849  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:56.689378  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:56.701260  3835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.016s	sys 0.050s
I20260709 13:17:56.701191  7893 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:56.636327  8388 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:56.700608  3250 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:56.706041  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:56.706502  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:56.707767  3203 raft_consensus.cc:2393] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 19: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:56.712544  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:56.717728  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:56.717969  7893 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.697089  8647 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:56.720012  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:56.710063  8485 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:56.717643  8324 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:56.720834  8639 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:56.720031  8647 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:56.721522  8639 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:56.723768  8762 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:56.724167  8647 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:56.724414  8762 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:56.725610  3176 leader_election.cc:400] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15.
I20260709 13:17:56.725477  8762 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.727281  3131 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:56.729637  8647 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:56.642076  8498 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:17:56.697228  8593 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:56.638664  8470 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:56.676546  3132 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.017s	sys 0.014s
I20260709 13:17:56.741931  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:56.751876  3132 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.018s	sys 0.015s
I20260709 13:17:56.752097  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:56.743523  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:56.740553  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:56.747573  3210 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
W20260709 13:17:56.750573  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 261425us
I20260709 13:17:56.697770  8758 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:56.759110  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:56.670419  8681 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.699277  8624 consensus_queue.cc:1059] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:17:56.773025  3100 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:56.781522  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:56.786962  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:56.789613  3205 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:17:56.791257  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:56.792729  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:56.793068  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:56.797885  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:56.798774  3209 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:17:56.801257  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:56.794138  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:56.771968  8753 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:56.806166  3209 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:56.776551  8442 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:56.811523  8624 consensus_queue.cc:1059] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:56.812374  8624 raft_consensus.cc:3055] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:56.812690  8624 raft_consensus.cc:740] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:56.813500  8624 consensus_queue.cc:260] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:56.814772  8624 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.789902  8638 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:56.758844  8388 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:17:56.806694  3251 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:56.809043  3209 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:56.769441  8761 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:17:56.805510  8597 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:56.816211  8769 raft_consensus.cc:3055] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:56.854103  8769 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:56.854538  8722 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:56.855120  8769 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.856550  8769 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:56.816890  8592 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:56.850823  8593 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:56.859390  8593 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:56.847350  8765 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.136s	user 0.003s	sys 0.000s
I20260709 13:17:56.861503  8593 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:56.820277  8753 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:56.863605  8753 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:56.823711  8647 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:56.772655  8579 consensus_queue.cc:237] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:56.805927  8377 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:17:56.864607  8647 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.814316  8711 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.871124  8711 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:56.799917  8629 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 13:17:56.876545  8221 consensus_meta.cc:287] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.003s
I20260709 13:17:56.827035  8639 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:56.887022  8421 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:56.827555  8766 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:17:56.869284  8647 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:56.896008  3211 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:56.765341  8645 consensus_queue.cc:237] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:56.906203  3208 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:56.773200  8758 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.915577  3209 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:17:56.943308  8592 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:17:56.944620  8754 log.cc:927] Time spent T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.461s	user 0.000s	sys 0.011s
I20260709 13:17:56.949043  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 3486) took 1046 ms. Trace:
I20260709 13:17:56.849563  8620 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:56.949514  3205 rpcz_store.cc:276] 0709 13:17:55.902258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.903754 (+  1496us) service_pool.cc:224] Handling call
0709 13:17:56.948766 (+1045012us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b54003741d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:56.948965 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1933604096}
I20260709 13:17:56.952702  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:56.954361  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2381) took 1204 ms. Trace:
I20260709 13:17:56.965178  3277 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:17:56.966349  3278 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:56.957388  3206 rpcz_store.cc:276] 0709 13:17:55.749540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.749758 (+   218us) service_pool.cc:224] Handling call
0709 13:17:55.750251 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.761520 (+ 11269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.761557 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.768817 (+  7260us) log.cc:844] Serialized 26 byte log entry
0709 13:17:55.988037 (+219220us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:55.988076 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.988140 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.894833 (+906693us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:56.949206 (+ 54373us) raft_consensus.cc:1685] finished
0709 13:17:56.949232 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.954277 (+  5045us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1076,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4252,"spinlock_wait_cycles":31448832,"thread_start_us":195401,"threads_started":1,"wal-append.queue_time_us":418374}
I20260709 13:17:56.913735  8597 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.919253  8221 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:56.987802  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:56.965636  8661 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:56.991482  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:56.969343  8206 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:57.001230  3129 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:56.993281  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:57.003655  3277 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:17:57.008522  8767 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:17:57.009112  8221 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:57.010638  8787 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:57.011373  8787 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:57.011881  8709 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:57.015707  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:57.016690  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:57.008800  8770 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:57.019431  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:57.025626  8221 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:57.028046  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 290255us
W20260709 13:17:57.028859  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 289181us
I20260709 13:17:57.033280  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:57.018875  8470 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:57.023284  8681 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:57.039098  3100 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:57.042912  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:57.043582  3836 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:57.047140  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:57.049060  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:57.037611  8624 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:57.055096  8661 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.006s
W20260709 13:17:57.061812  8771 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:17:57.063045  8758 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:57.065407  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1845) took 1019 ms. Trace:
I20260709 13:17:57.065825  3283 rpcz_store.cc:276] 0709 13:17:56.046002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.046702 (+   700us) service_pool.cc:224] Handling call
0709 13:17:56.373056 (+326354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.380009 (+  6953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.065196 (+685187us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b540022e550. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:57.065344 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":749890944}
I20260709 13:17:57.048401  8221 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:57.085201  8221 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:57.085424  8778 log.cc:927] Time spent T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:17:57.085661  8221 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:57.052970  8624 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:57.037618  8709 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:17:57.090684  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:57.117008  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:57.123930  8759 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:17:57.135531  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:57.137406  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1844) took 1121 ms. Trace:
I20260709 13:17:57.137974  3276 rpcz_store.cc:276] 0709 13:17:56.016255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.049287 (+ 33032us) service_pool.cc:224] Handling call
0709 13:17:56.372552 (+323265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.379524 (+  6972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.137171 (+757647us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400318650. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:57.137341 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725636992}
I20260709 13:17:57.091041  7656 consensus_queue.cc:260] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:57.237996  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 454898us
I20260709 13:17:57.282969  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:57.285054  7656 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:57.285385  3806 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:57.287137  3277 raft_consensus.cc:2393] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 19: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:57.288509  3285 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:17:57.290360  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:57.291740  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:57.293251  3277 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:57.294600  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 225208us
I20260709 13:17:57.296283  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:57.296370  3251 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:57.298717  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 162481us
I20260709 13:17:57.299135  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:57.300797  3134 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:57.296428  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:57.307034  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:57.295668  8779 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.210s	user 0.000s	sys 0.012s
W20260709 13:17:57.290472  8780 log.cc:927] Time spent T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.172s	user 0.007s	sys 0.002s
W20260709 13:17:57.300058  8633 consensus_meta.cc:287] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.937s	user 0.021s	sys 0.003s
I20260709 13:17:57.313557  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:57.303819  8789 log.cc:927] Time spent T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.187s	user 0.000s	sys 0.024s
I20260709 13:17:57.315763  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:57.322557  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:57.286885  8786 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:57.302069  8744 consensus_meta.cc:287] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.675s	user 0.008s	sys 0.011s
I20260709 13:17:57.318904  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:57.304692  8769 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:57.324460  8633 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:57.314137  8206 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:57.333563  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:57.305660  8597 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:57.340533  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:57.341423  3835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 803) took 1408 ms. Trace:
W20260709 13:17:57.347774  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 53719.7us
I20260709 13:17:57.349714  3835 rpcz_store.cc:276] 0709 13:17:55.933118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.933239 (+   121us) service_pool.cc:224] Handling call
0709 13:17:55.933575 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.961419 (+ 27844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.961465 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.976109 (+ 14644us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.702032 (+725923us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:56.702091 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.702180 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:57.341193 (+639013us) raft_consensus.cc:1685] finished
0709 13:17:57.341214 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.341365 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27376,"raft.queue_time_us":28190,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":19237,"thread_start_us":709731,"threads_started":1,"wal-append.queue_time_us":1007684}
I20260709 13:17:57.364078  3101 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:57.325750  8783 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:57.344399  8206 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.367285  3134 raft_consensus.cc:2368] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16.
I20260709 13:17:57.374532  3132 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:17:57.331033  8681 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:57.400120  3806 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:57.431149  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:57.437107  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 73089.9us
I20260709 13:17:57.438429  3101 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:57.331444  8786 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:57.365247  8597 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:57.362695  8634 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:17:57.442266  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 76899.1us
I20260709 13:17:57.430446  8206 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:57.346283  8769 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:57.429195  8709 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:17:57.452597  8789 log.cc:927] Time spent T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:17:57.336952  8744 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:57.457126  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 101351us
I20260709 13:17:57.468982  3101 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:57.470944  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 2244) took 1451 ms. Trace:
I20260709 13:17:57.484498  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:57.463593  8777 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:57.480298  3136 rpcz_store.cc:276] 0709 13:17:56.011252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.013866 (+  2614us) service_pool.cc:224] Handling call
0709 13:17:56.014286 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:56.565513 (+551227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.565564 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:56.592965 (+ 27401us) log.cc:844] Serialized 52 byte log entry
0709 13:17:56.949336 (+356371us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:56.949371 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.949443 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:57.462846 (+513403us) raft_consensus.cc:1685] finished
0709 13:17:57.462880 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.463068 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30649,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":20613,"thread_start_us":855255,"threads_started":2,"wal-append.queue_time_us":421617}
I20260709 13:17:57.440003  8681 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:57.461187  8502 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:57.507511  8790 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:57.507952  3837 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:57.472437  8719 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:57.517095  3837 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:57.518785  8769 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:57.511754  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:57.519969  8797 log.cc:927] Time spent T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:17:57.521109  8799 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:17:57.521240  8791 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.523s	user 0.003s	sys 0.018s
I20260709 13:17:57.498588  8661 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:57.509227  8747 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:57.530833  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:57.532380  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3138) took 2123 ms. Trace:
I20260709 13:17:57.534057  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:57.534080  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:57.473824  8597 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:17:57.534894  3132 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:17:57.540336  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:57.536216  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:57.541657  3133 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:57.532853  3281 rpcz_store.cc:276] 0709 13:17:55.401362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.401534 (+   172us) service_pool.cc:224] Handling call
0709 13:17:55.401773 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.370324 (+968551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.524346 (+1154022us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54001ea854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:57.524530 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2226222976}
I20260709 13:17:57.505396  8645 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:57.537606  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:57.550864  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:57.515661  8790 raft_consensus.cc:697] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:57.502642  8758 consensus_queue.cc:1059] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:17:57.475618  8709 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:57.515018  8502 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:57.535679  8769 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:57.506369  8777 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:57.556378  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:57.595567  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:17:57.596828  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 196840us
W20260709 13:17:57.598272  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 144161us
I20260709 13:17:57.557152  8788 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.630002  8788 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:57.538919  8221 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:57.564059  8388 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:57.608777  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:57.619801  8798 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:17:57.620855  8786 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:57.622316  8744 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:57.624625  8597 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:57.628515  8581 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:57.565582  8719 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:17:57.629326  8566 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:57.633603  8795 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:17:57.636664  3133 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:17:57.636895  8324 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:57.640341  8681 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:57.639653  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:57.565940  8776 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:57.641319  8790 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:57.643441  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.646196  8709 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:57.650290  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 2248) took 1145 ms. Trace:
W20260709 13:17:57.602839  8792 log.cc:927] Time spent T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:17:57.602519  8769 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:57.654388  3177 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:57.657696  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 48995.3us
W20260709 13:17:57.654960  8794 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:17:57.607921  8633 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:57.607182  8579 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:57.676730  3127 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:57.552304  8645 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:57.638978  8777 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:57.671871  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 164592us
I20260709 13:17:57.828699  3129 rpcz_store.cc:276] 0709 13:17:56.505395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.505591 (+   196us) service_pool.cc:224] Handling call
0709 13:17:56.518631 (+ 13040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.001920 (+483289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.650037 (+648117us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54003f8254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:57.650224 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109016832}
I20260709 13:17:57.689002  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:57.838244  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1854) took 1109 ms. Trace:
I20260709 13:17:57.831931  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:57.842276  3132 raft_consensus.cc:2393] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 17: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:17:57.727883  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.844339  8786 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:57.844906  8786 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:57.847004  8786 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:57.841117  3280 rpcz_store.cc:276] 0709 13:17:56.729193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.639321 (+910128us) service_pool.cc:224] Handling call
0709 13:17:57.838169 (+198848us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:57.849684  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:57.666334  8581 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:57.675884  8783 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:57.667454  8788 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:57.858309  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 203815us
W20260709 13:17:57.746119  8802 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:17:57.864675  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:57.865094  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 260015us
I20260709 13:17:57.863749  3100 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:57.678100  8566 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:57.841724  8579 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.748401  8221 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:57.747622  8809 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:57.747223  8502 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:57.662710  8388 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:57.889240  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:57.849478  8776 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:57.869971  8612 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.861600  8324 raft_consensus.cc:697] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:57.883627  8579 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:57.875038  8811 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.882941  8788 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:57.876113  8566 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:57.874032  8591 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:57.925695  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:57.921185  8588 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:57.883076  8681 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:57.882838  8806 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:57.948745  8685 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:57.949131  8324 consensus_queue.cc:237] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:57.949636  8804 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.936655  8811 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:57.950268  8804 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:57.952628  8811 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:57.882881  8361 consensus_queue.cc:1059] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:17:57.954429  8620 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:57.929243  8581 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:57.954995  8620 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:57.955940  8581 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:57.935703  8808 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:57.952862  8804 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:57.957654  8808 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:57.978533  3210 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:17:57.979000  3210 pending_rounds.cc:85] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 9
I20260709 13:17:57.979229  3210 pending_rounds.cc:107] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:17:57.979465  3210 raft_consensus.cc:2889] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:57.979779  3210 pending_rounds.cc:107] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:17:57.980187  3210 raft_consensus.cc:2889] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:57.928349  8812 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.983913  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:57.985656  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:57.888579  8809 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:57.928604  8788 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.958670  8388 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:57.961174  8597 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:57.996670  8673 raft_consensus.cc:3055] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:58.018285  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:58.015422  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:58.021100  3202 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:17:58.021507  3206 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:17:58.027540  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:58.030562  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:57.927073  8612 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.019778  8673 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:58.035637  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:58.036337  3135 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:58.035881  8673 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.020359  8788 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.037638  8673 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.042421  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:57.957280  8681 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:57.961369  8588 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.027362  8804 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:58.016356  8812 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:57.957650  8806 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.050622  8421 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.050411  8774 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:17:58.089689  8421 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.090668  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:58.092130  3132 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:58.051657  3805 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:58.094973  8806 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.031603  8597 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.096974  8812 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.097348  8783 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:58.097937  8783 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:58.097765  8804 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.085184  8620 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:58.099874  8804 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:17:58.079586  8206 consensus_meta.cc:287] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.001s
W20260709 13:17:58.059755  8810 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:17:58.100932  8773 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:58.100812  8206 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.048702  8831 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:58.102099  8831 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.103358  8206 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:58.104226  8831 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.069723  8769 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:58.058393  8817 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:17:58.060863  8811 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:58.106498  8811 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.106851  8811 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.108013  8566 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:58.110229  3033 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55102 (request call id 139) took 15898 ms (client timeout 15000 ms). Trace:
I20260709 13:17:58.070182  8776 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.078950  8612 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:58.077389  8645 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.072631  3210 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
W20260709 13:17:58.059046  8820 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:17:58.062512  8809 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.071661  8681 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:58.117770  8624 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:58.118829  8811 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.129302  8685 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.133275  3842 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:58.137439  3202 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:17:58.138576  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:58.138939  3132 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:17:58.052569  3176 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.645s (SENT) [suppressed 5 similar messages]
I20260709 13:17:58.092634  8421 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:58.110630  3033 rpcz_store.cc:269] 0709 13:17:42.212346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.213341 (+   995us) service_pool.cc:224] Handling call
0709 13:17:43.029850 (+816509us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54000a87d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc159090 00007fb3bc1f7f3a 00007fb3c1fae1cc 00007fb3c20ac37e 00007fb3c056d2a4 00007fb3c056d232 00007fb3c056d161 00007fb3c056d0dc 00007fb3c056c392 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:58.110116 (+15080266us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:51.580636 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:51.597852 (+ 17216us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:51.597915 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:17:51.597941 (+    26us) tablet.cc:662] Decoding operations
0709 13:17:51.599497 (+  1556us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:51.599609 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:51.599640 (+    31us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:17:51.718975 (+119335us) tablet.cc:701] Row locks acquired
0709 13:17:51.734961 (+ 15986us) write_op.cc:260] PREPARE: finished
0709 13:17:51.759642 (+ 24681us) write_op.cc:270] Start()
0709 13:17:51.801851 (+ 42209us) write_op.cc:276] Timestamp: P: 1783603071751777 usec, L: 0
0709 13:17:51.811245 (+  9394us) op_driver.cc:348] REPLICATION: starting
0709 13:17:51.893402 (+ 82157us) log.cc:844] Serialized 5912 byte log entry
0709 13:17:52.268099 (+374697us) op_driver.cc:464] REPLICATION: finished
0709 13:17:52.997787 (+729688us) write_op.cc:301] APPLY: starting
0709 13:17:53.014840 (+ 17053us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:53.403136 (+388296us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:53.421475 (+ 18339us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:53.652909 (+231434us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:53.653285 (+   376us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:17:53.653339 (+    54us) write_op.cc:312] APPLY: finished
0709 13:17:53.653863 (+   524us) log.cc:844] Serialized 139 byte log entry
0709 13:17:54.091399 (+437536us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:54.123586 (+ 32187us) write_op.cc:454] Released schema lock
0709 13:17:54.134059 (+ 10473us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:54.213758 (+ 79699us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:54.213803 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4045325,"reported_tablets":24,"spinlock_wait_cycles":1397566848,"child_traces":[["op",{"apply.queue_time_us":662075,"apply.run_cpu_time_us":45756,"apply.run_wall_time_us":1250651,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66947,"num_ops":15,"prepare.queue_time_us":102824,"prepare.run_cpu_time_us":18900,"prepare.run_wall_time_us":488322,"raft.queue_time_us":52379,"raft.run_cpu_time_us":35604,"raft.run_wall_time_us":482633,"replication_time_us":456676,"thread_start_us":1019016,"threads_started":5,"wal-append.queue_time_us":598806,"wal-append.run_cpu_time_us":7537,"wal-append.run_wall_time_us":2356597}]]}
I20260709 13:17:58.158154  8681 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:58.173516  3206 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:58.173816  8681 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.174521  8566 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:58.175228  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:58.175788  3206 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.175879  8681 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.097265  8597 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:58.172135  8811 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.157490  8685 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.179226  8685 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:58.182761  8788 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.183713  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:58.186220  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:58.186306  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:58.186571  8755 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:58.187124  8755 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.187594  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:58.188253  3285 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:17:58.182997  8833 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:58.189255  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:58.189968  8755 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:58.189368  8833 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.192153  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:58.192509  8833 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:58.193177  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:58.194582  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:58.194878  8764 log.cc:927] Time spent T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 1.394s	user 0.011s	sys 0.011s
I20260709 13:17:58.196009  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 1860) took 2141 ms. Trace:
I20260709 13:17:58.197659  3206 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:17:58.196389  3130 rpcz_store.cc:276] 0709 13:17:56.054880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.055296 (+   416us) service_pool.cc:224] Handling call
0709 13:17:56.065913 (+ 10617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:56.066327 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.066366 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:56.066889 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.511138 (+444249us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:56.511189 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.511254 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.194215 (+1682961us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:58.195710 (+  1495us) raft_consensus.cc:1685] finished
0709 13:17:58.195733 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.195933 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7760,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"spinlock_wait_cycles":8931584,"thread_start_us":422734,"threads_started":1,"wal-append.queue_time_us":696738}
I20260709 13:17:58.200289  8783 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.187076  3280 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:17:58.203459  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:58.204480  3279 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:58.204849  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:58.207929  3283 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:17:58.184892  8788 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.231005  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:58.232532  3280 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 16: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:58.240267  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:58.202689  8808 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.197799  8811 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:58.241245  3280 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:17:58.260469  3130 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:58.201434  8579 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.265426  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:58.265884  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:58.270591  3283 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:58.242255  8498 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:58.275002  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:58.273540  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:58.266865  8790 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:58.291287  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 238714us
I20260709 13:17:58.291605  3836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 1152) took 1148 ms. Trace:
I20260709 13:17:58.292048  3836 rpcz_store.cc:276] 0709 13:17:57.143711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.294928 (+151217us) service_pool.cc:224] Handling call
0709 13:17:57.295259 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.442275 (+147016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.442313 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:57.442359 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:57.442398 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.291389 (+848991us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54005aa5d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:58.291434 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.291549 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337600768}
I20260709 13:17:58.293803  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:58.294932  8782 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.295590  8782 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.296167  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:58.298032  8782 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:58.303532  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:58.305377  8324 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.306269  8808 consensus_queue.cc:1059] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:58.306154  8324 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.306684  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:58.307327  8808 raft_consensus.cc:3055] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:58.307374  3130 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:17:58.307830  8808 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:58.308847  8324 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.308722  8808 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.308554  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:58.312007  8787 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:58.312544  3130 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:58.315955  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:58.320253  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:58.266461  8811 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.289064  8773 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:58.325383  3134 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.325716  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:58.326251  3208 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:17:58.279124  8498 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.348461  3134 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:17:58.330925  8811 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:58.339644  8683 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:58.340318  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:58.341282  8833 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:58.345844  8579 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:58.364428  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:58.346763  8783 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.351879  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:58.356925  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:58.385154  3277 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:17:58.336903  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.346107  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:58.387351  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:58.324793  8808 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:58.388310  3176 leader_election.cc:400] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16.
I20260709 13:17:58.391636  3176 leader_election.cc:403] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:17:58.322412  8790 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.369555  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:58.395439  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:58.392850  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:17:58.400991  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.403534  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:17:58.407421  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.400859  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:58.404503  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:58.408850  3277 raft_consensus.cc:2393] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:17:58.410840  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:58.412086  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:58.413098  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:58.413669  3207 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:17:58.414444  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:58.395051  8787 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:58.434331  8787 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:58.434795  8787 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:58.401985  8592 consensus_queue.cc:1059] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:17:58.446029  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.446234  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:58.446311  8592 raft_consensus.cc:3055] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:58.446774  8592 raft_consensus.cc:740] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:58.447717  8592 consensus_queue.cc:260] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.401865  8324 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:17:58.449568  8324 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.452494  8324 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:58.402110  8829 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:58.453672  8829 raft_consensus.cc:697] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:58.454772  8829 consensus_queue.cc:237] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.417896  8830 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:17:58.461735  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:58.397925  8811 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16.
I20260709 13:17:58.463402  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:58.466921  3100 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:58.467303  8636 consensus_queue.cc:1059] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:58.467849  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:58.468672  3835 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:58.468847  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:58.468401  3100 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:58.469311  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:58.469899  3836 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:17:58.470093  8629 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:58.470661  8629 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:58.471129  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:58.471526  8629 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.472770  8744 raft_consensus.cc:3055] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:58.468859  8722 raft_consensus.cc:3055] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:58.473789  8722 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:17:58.475520  8588 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:58.475998  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:58.476667  3841 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 10.
W20260709 13:17:58.429370  8796 log.cc:927] Time spent T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.058s	user 0.003s	sys 0.000s
I20260709 13:17:58.477206  8755 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:58.473248  8744 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:58.477730  8755 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:58.479354  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:58.394866  8711 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:58.479952  3833 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:17:58.480073  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:58.480290  8711 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:58.468580  8636 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:58.480737  8711 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.473119  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:17:58.482051  8818 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.422s	user 0.004s	sys 0.000s
I20260709 13:17:58.484822  8685 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.429842  8498 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.433748  8790 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:58.485469  8685 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.486269  8811 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.486501  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:58.486878  8811 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.487931  8685 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.488684  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3151) took 2159 ms. Trace:
I20260709 13:17:58.408092  3127 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:17:58.489308  3282 rpcz_store.cc:276] 0709 13:17:56.329106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.329363 (+   257us) service_pool.cc:224] Handling call
0709 13:17:56.361927 (+ 32564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:56.362289 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.362317 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:57.651368 (+1289051us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b2c00138fe8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:17:57.651755 (+   387us) log.cc:844] Serialized 26 byte log entry
0709 13:17:57.921020 (+269265us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:57.921056 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.921220 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.481494 (+560274us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:17:58.488482 (+  6988us) raft_consensus.cc:1685] finished
0709 13:17:58.488503 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.488628 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6776,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":62546560,"thread_start_us":268868,"threads_started":1,"wal-append.queue_time_us":382228}
I20260709 13:17:58.490891  8790 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:58.492066  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:58.478868  8744 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.479035  8755 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.477632  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:58.419485  3805 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:58.502439  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 83019.9us
I20260709 13:17:58.500533  8744 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:58.506266  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:58.496208  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 97043.7us
I20260709 13:17:58.507058  3130 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:17:58.512223  8498 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:58.512714  8498 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.513057  8498 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.514147  3282 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:58.515180  8755 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:58.516079  8837 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:58.517310  8837 raft_consensus.cc:3055] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:58.517642  8837 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:17:58.518481  8837 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.518885  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:58.519688  8837 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.488932  8811 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:58.525599  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 3500) took 1729 ms. Trace:
I20260709 13:17:58.525996  3209 rpcz_store.cc:276] 0709 13:17:56.795788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.842010 (+ 46222us) service_pool.cc:224] Handling call
0709 13:17:56.909053 (+ 67043us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:56.916271 (+  7218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.525406 (+1609135us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b5400247050. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:17:58.525538 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153325824}
I20260709 13:17:58.530062  8581 consensus_queue.cc:1059] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:58.511348  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:58.531890  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:58.533298  3127 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:58.533792  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:58.532060  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:58.535606  3837 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:58.537194  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:58.538594  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:58.539301  3205 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 10.
I20260709 13:17:58.534307  3100 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:17:58.545702  3805 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:58.547823  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.544296  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:58.501571  8592 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:58.569281  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 62767.9us
I20260709 13:17:58.536761  8405 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:58.545096  8681 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:58.595160  8720 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:58.523416  8498 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.544291  8811 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:58.545466  8636 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:58.565743  8776 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:58.585920  8837 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:58.601233  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:58.602377  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:58.601991  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:17:58.608486  3177 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:58.609560  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:58.599208  8633 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.002s	sys 0.013s
I20260709 13:17:58.614624  3837 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:17:58.615043  3206 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 16: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:17:58.618593  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:58.618707  3177 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:58.616976  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:58.564687  8612 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:17:58.620388  8824 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:58.620851  8824 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.621261  8824 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.621415  3842 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:17:58.622367  8498 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.622529  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:58.623667  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:58.625206  8593 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:58.624603  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:58.626317  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:58.601068  8405 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.614694  8837 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:58.629338  8405 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.629554  8837 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.608984  8681 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.633452  8681 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:58.635880  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:58.613109  8776 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:17:58.643102  8776 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:58.643747  8837 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.646245  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:17:58.647444  8824 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.648296  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:58.611053  8811 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.649782  8685 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:58.650169  8811 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:58.650269  8685 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:58.650775  8685 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.651716  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:17:58.653635  3805 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:58.656169  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:17:58.656788  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 110464us
I20260709 13:17:58.657230  3177 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:58.656677  3249 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:17:58.653515  8633 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.002s	sys 0.013s
I20260709 13:17:58.660192  7893 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:58.660871  3203 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 16: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:17:58.656715  8591 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:58.660302  8645 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:58.661742  8324 consensus_queue.cc:1059] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:58.661245  3249 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:58.665788  3177 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:58.667290  8636 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:58.656388  8588 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:58.667438  8463 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:58.668378  8588 raft_consensus.cc:697] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:58.669526  8588 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:58.671571  3249 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:58.672710  8463 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:58.664470  8645 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:58.673465  8463 raft_consensus.cc:697] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:58.673839  8645 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.679684  3249 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:58.682289  3834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1094) took 1194 ms. Trace:
I20260709 13:17:58.682749  3177 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:17:58.690198  3249 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:58.656874  8593 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:58.682749  3834 rpcz_store.cc:276] 0709 13:17:57.487942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.489368 (+  1426us) service_pool.cc:224] Handling call
0709 13:17:57.489666 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.603575 (+113909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.603607 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:57.603647 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:57.603679 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.682041 (+1078362us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54005e74d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:17:58.682090 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.682216 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261531904}
W20260709 13:17:58.703316  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 158838us
W20260709 13:17:58.719812  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.724978  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:58.699795  8633 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.698904  8597 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:58.701236  8206 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:58.799206  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 74317.7us
I20260709 13:17:58.808235  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:58.701040  8835 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:58.800077  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:17:58.800668  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 74888.5us
I20260709 13:17:58.678300  8722 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:58.830775  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.814227  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:17:58.818205  8840 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.092s	user 0.009s	sys 0.000s
I20260709 13:17:58.798764  8824 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:58.681964  8463 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:58.879515  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 319157us
I20260709 13:17:58.885231  3101 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:17:58.814929  8815 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:58.873819  8858 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:17:58.863840  8852 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:17:58.861223  8855 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:58.877947  8824 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.815296  8597 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:58.801873  8633 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:58.814147  8837 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:58.987537  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.008846  8824 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:59.014743  8824 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:58.945629  8815 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:59.016876  8815 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:58.944881  8722 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:59.002600  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 342934us
I20260709 13:17:58.831058  8711 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:59.061831  3805 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:17:59.072448  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 51535.7us
I20260709 13:17:59.073515  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:59.079151  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:58.986506  8855 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:59.006191  8597 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.011829  8633 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:59.208194  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 98764us
I20260709 13:17:59.307687  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:59.313203  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:17:59.272686  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.230088  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:17:59.318270  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 49169.6us
W20260709 13:17:59.319372  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.072594  8498 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:17:59.115533  8787 consensus_meta.cc:287] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.650s	user 0.008s	sys 0.004s
W20260709 13:17:59.124163  8850 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:17:59.082864  8612 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:59.182225  8840 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:17:59.183982  8809 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.216789  8720 raft_consensus.cc:3055] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:17:59.205303  8755 consensus_meta.cc:287] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.005s
W20260709 13:17:59.180959  8592 consensus_meta.cc:287] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.591s	user 0.006s	sys 0.001s
I20260709 13:17:59.251798  3031 catalog_manager.cc:5697] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 10 to 16, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 16 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.207912  8861 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:59.212605  8860 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:59.347522  3102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.026s	sys 0.063s
W20260709 13:17:59.361867  3102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.027s	sys 0.063s
I20260709 13:17:59.233120  8814 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:17:59.364486  3100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.026s	sys 0.050s
W20260709 13:17:59.349514  8681 consensus_meta.cc:287] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.001s
W20260709 13:17:59.368770  3100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.027s	sys 0.050s
I20260709 13:17:59.344919  8612 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:59.371551  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 663207us
I20260709 13:17:59.375474  3100 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:59.347508  8720 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:17:59.369221  8785 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.042s	sys 0.034s
I20260709 13:17:59.360637  8597 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:59.350489  8835 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:59.002656  8624 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:59.389739  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:59.391155  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:59.393844  3100 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:17:59.339514  8787 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:59.007526  8830 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:59.379403  8744 consensus_meta.cc:287] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.865s	user 0.012s	sys 0.000s
W20260709 13:17:59.381269  8206 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.050s	sys 0.030s
I20260709 13:17:59.384506  3031 catalog_manager.cc:5697] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:59.370942  8592 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:59.452719  8592 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:59.454996  8821 log.cc:927] Time spent T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.392s	user 0.006s	sys 0.005s
I20260709 13:17:59.455384  8592 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:59.413792  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:59.374485  8814 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:59.386384  8785 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.043s	sys 0.035s
I20260709 13:17:59.377501  8612 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:59.431232  3203 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:59.353947  8809 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:59.377789  8681 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:59.450886  8835 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:59.452157  8206 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.051s	sys 0.030s
I20260709 13:17:59.464455  8814 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:17:59.460644  3031 catalog_manager.cc:5697] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.396147  8867 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:59.408450  8860 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:17:59.469926  8593 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.042s	sys 0.067s
W20260709 13:17:59.475137  8593 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.043s	sys 0.067s
I20260709 13:17:59.468701  8206 raft_consensus.cc:697] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:59.476739  8206 consensus_queue.cc:237] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:59.478102  8814 consensus_queue.cc:1059] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:59.477802  3031 catalog_manager.cc:5697] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 8 to 13, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 13 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:59.479758  3031 catalog_manager.cc:5697] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 9 to 10, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 10 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.411109  8859 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:59.473754  3209 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:59.481448  8681 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:59.483647  3031 catalog_manager.cc:5697] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 10 to 12, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 12 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
W20260709 13:17:59.398044  8811 consensus_meta.cc:287] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.747s	user 0.006s	sys 0.006s
W20260709 13:17:59.499266  8361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.089s	sys 0.121s
I20260709 13:17:59.471479  8720 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:59.538480  8591 raft_consensus.cc:3055] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:59.538793  8720 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:59.538952  8591 raft_consensus.cc:740] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:17:59.539922  8591 consensus_queue.cc:260] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:59.522537  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:59.408809  8685 consensus_meta.cc:287] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.758s	user 0.013s	sys 0.000s
I20260709 13:17:59.541618  3211 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
W20260709 13:17:59.504462  8776 consensus_meta.cc:287] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.858s	user 0.009s	sys 0.004s
I20260709 13:17:59.535910  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:17:59.536012  8361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.090s	sys 0.121s
I20260709 13:17:59.562647  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:59.564653  3136 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:59.516673  8755 raft_consensus.cc:3055] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:59.568943  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:59.584657  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:17:59.586530  3136 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:17:59.502105  8405 consensus_meta.cc:287] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.872s	user 0.011s	sys 0.003s
I20260709 13:17:59.538966  3031 catalog_manager.cc:5697] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 8 to 14, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 14 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:59.544804  3134 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:59.654464  8645 consensus_meta.cc:287] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.980s	user 0.015s	sys 0.001s
I20260709 13:17:59.599995  3806 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:59.566254  8591 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.493458  8867 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:59.614598  8785 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.614605  3207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 679) took 1202 ms. Trace:
I20260709 13:17:59.707733  3207 rpcz_store.cc:276] 0709 13:17:58.412441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.415215 (+  2774us) service_pool.cc:224] Handling call
0709 13:17:58.415521 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:58.415912 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:58.415940 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:58.416355 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.432824 (+ 16469us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b48002727d8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1118aa1 00007fb3c110fb37 00007fb3c110f9ca 00007fb3c120726f 00007fb3c1206f37 00007fb3c121b55c 00007fb3c121b508 00007fb3c121b488 00007fb3c121b443 00007fb3c121a6ec 00007fb3c0144a96
0709 13:17:58.690164 (+257340us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b180037b8e0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:17:58.986863 (+296699us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:58.986917 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.986992 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:59.614253 (+627261us) raft_consensus.cc:1685] finished
0709 13:17:59.614288 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.614520 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":1975,"raft.run_wall_time_us":15417,"spinlock_wait_cycles":188851840,"thread_start_us":296494,"threads_started":1,"wal-append.queue_time_us":1130893}
I20260709 13:17:59.564399  8681 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:59.624358  3249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.094s	sys 0.164s
W20260709 13:17:59.736840  3249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.094s	sys 0.165s
I20260709 13:17:59.736346  3031 catalog_manager.cc:5697] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
W20260709 13:17:59.737263  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 923026us
I20260709 13:17:59.570070  8755 raft_consensus.cc:740] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:17:59.397807  8855 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:59.549649  8685 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:17:59.645948  3099 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.015s	sys 0.055s
I20260709 13:17:59.474515  8830 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.645756  8593 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:59.634307  8783 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:59.554065  8776 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:59.760396  3031 catalog_manager.cc:5697] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 11 to 15, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 15 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.706698  8824 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:59.762799  3031 catalog_manager.cc:5697] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.659159  8612 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:59.643687  8747 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:17:59.655079  8470 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.019s	sys 0.057s
W20260709 13:17:59.504365  8808 consensus_meta.cc:287] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 1.109s	user 0.009s	sys 0.006s
I20260709 13:17:59.634953  8597 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:59.739993  3249 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:17:59.644600  8711 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:17:59.748553  3099 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.015s	sys 0.055s
W20260709 13:17:59.660032  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 331468us
I20260709 13:17:59.746594  8874 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:59.735806  8645 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:59.701161  8405 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:59.767663  3031 catalog_manager.cc:5697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:17:59.782438  8470 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.019s	sys 0.058s
I20260709 13:17:59.768653  8809 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:17:59.757658  8830 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:59.794883  3250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.007s	sys 0.003s
I20260709 13:17:59.788341  3206 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:17:59.537552  8811 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:59.788720  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 48830.2us
I20260709 13:17:59.836041  3249 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:17:59.744732  8681 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:59.742802  8785 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:59.841663  3127 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 13: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:17:59.795240  8629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.006s	sys 0.007s
I20260709 13:17:59.759158  8593 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:17:59.861334  8629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.008s	sys 0.008s
I20260709 13:17:59.891436  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:59.786580  8787 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:17:59.764560  8783 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:59.832357  3031 catalog_manager.cc:5697] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 6 to 12, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 12 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:59.831980  8711 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:59.842832  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:59.843505  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:59.844061  3277 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:17:59.844901  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:59.925168  3285 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:17:59.845629  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:59.785305  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:17:59.847236  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:59.847546  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:59.846990  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:59.848017  3176 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.015s	sys 0.034s
I20260709 13:17:59.844424  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:17:59.927629  3176 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.015s	sys 0.034s
W20260709 13:17:59.856189  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.928009  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 651483us
W20260709 13:17:59.833127  3250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.011s	sys 0.003s
I20260709 13:17:59.920385  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:17:59.932493  3203 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:17:59.925694  3280 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:17:59.934831  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:59.937232  3834 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:17:59.776342  8824 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:59.931759  3031 catalog_manager.cc:5697] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:59.940277  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:59.849673  8361 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:59.942276  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:59.916641  3134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:17:59.950969  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:59.951541  3134 raft_consensus.cc:606] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:17:59.951926  3134 raft_consensus.cc:614] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:59.952028  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:59.948731  3279 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:59.949681  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:17:59.786211  8747 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:59.952803  3277 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:17:59.954895  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:59.891178  8592 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.814102  8755 consensus_queue.cc:260] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:17:59.979200  3202 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:59.980713  3837 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:59.891286  8809 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:17:59.977746  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:59.969558  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:59.954631  3031 catalog_manager.cc:5697] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 8 to 14, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 14 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
W20260709 13:17:59.986460  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 386528us
I20260709 13:17:59.986547  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:17:59.987578  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:59.915105  8774 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:59.822196  8874 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.020500  3031 catalog_manager.cc:5697] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:59.998708  8809 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:59.996039  8592 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:17:59.998863  8808 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:00.034255  3282 raft_consensus.cc:2368] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16.
I20260709 13:18:00.035789  8873 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:00.036352  8871 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:00.037118  8870 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:00.040244  8722 consensus_meta.cc:287] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.973s	user 0.011s	sys 0.000s
I20260709 13:18:00.040537  8681 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.042019  3031 catalog_manager.cc:5697] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 9 to 15, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 15 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.977432  8638 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:00.061772  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:17:59.944238  8711 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:00.106765  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.102680  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:00.104050  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 173870us
I20260709 13:18:00.105839  3031 catalog_manager.cc:5697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:17:59.985816  8633 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:17:59.998158  8744 consensus_queue.cc:1059] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.108s
I20260709 13:18:00.115171  8890 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:00.116976  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 122680us
I20260709 13:18:00.121227  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:00.122253  3283 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:00.105780  8685 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:00.139328  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:00.141889  3031 catalog_manager.cc:5697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:00.140671  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 169028us
W20260709 13:18:00.141031  8815 consensus_meta.cc:287] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 1.124s	user 0.009s	sys 0.005s
I20260709 13:18:00.145015  3283 raft_consensus.cc:2368] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14.
I20260709 13:18:00.117422  8867 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.142443  3100 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:00.152626  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:00.144510  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:00.100942  8870 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:00.149380  3031 catalog_manager.cc:5697] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:00.095005  8808 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:00.163920  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:00.165407  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:00.112300  8638 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.135672  8612 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.134802  8776 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:00.173134  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 180499us
I20260709 13:18:00.119045  8633 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:00.146785  8597 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:00.145200  8829 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:00.193426  3031 catalog_manager.cc:5697] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 5 to 15, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 15 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:00.197882  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:00.161965  8685 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:00.164822  8882 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:00.151312  8722 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:18:00.120018  8871 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:00.203094  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.196141  8893 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.165179  8405 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:00.206558  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 64179.1us
I20260709 13:18:00.192202  8790 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.152338  8815 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.213048  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:00.195489  8612 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:00.165618  8645 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.134155  8890 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:00.217940  3031 catalog_manager.cc:5697] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 9 to 11, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 11 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:00.198967  8593 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.224356  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:00.224540  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:00.215545  8891 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:00.232753  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:00.233482  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:00.267493  3203 raft_consensus.cc:2368] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:00.268669  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:00.270145  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:00.270848  3203 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:18:00.235811  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:00.203567  8785 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.275731  3210 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 16: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:00.242313  8897 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.244508  8811 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.247886  8633 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:00.248637  8638 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.249820  8815 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:00.205673  8597 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:00.253356  3276 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:18:00.238117  8880 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.292s	user 0.001s	sys 0.001s
I20260709 13:18:00.200596  8776 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:00.258486  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 94689.3us
I20260709 13:18:00.262145  3283 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:00.262518  8470 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:00.260699  3031 catalog_manager.cc:5697] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 5 to 16, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 16 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.238453  8783 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.203034  8762 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:00.275015  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:00.277978  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:00.278658  3806 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:00.279053  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:00.202207  8829 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.303911  8829 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:00.304979  8892 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:00.284189  8747 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.284196  8897 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:00.307683  8897 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.308300  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2417) took 1696 ms. Trace:
I20260709 13:18:00.310544  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:00.311793  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:00.238951  8893 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.299082  3203 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
W20260709 13:18:00.280134  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 117435us
I20260709 13:18:00.209961  8685 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.308820  3202 rpcz_store.cc:276] 0709 13:17:58.612024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.612171 (+   147us) service_pool.cc:224] Handling call
0709 13:17:58.612481 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.996420 (+1383939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.307544 (+311124us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b54004a2520. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc166dc0 00007fb3bc1f2a02 00007fb3bc1eedd6 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:18:00.308051 (+   507us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540019f854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:00.308224 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3151792256}
W20260709 13:18:00.281765  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 50480.1us
I20260709 13:18:00.282469  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:00.250645  8612 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:00.329469  8502 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:18:00.317945  8877 log.cc:927] Time spent T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.193s	user 0.001s	sys 0.001s
I20260709 13:18:00.286666  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:00.330031  8502 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:00.329957  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 51439.5us
I20260709 13:18:00.332235  8502 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.329506  8612 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:00.334178  8871 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:00.334704  8879 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:18:00.293761  8597 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.336400  8874 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:00.338121  8597 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.293541  8711 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.339437  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:00.254866  8900 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:00.299070  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:00.300372  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:00.300879  8470 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:00.317817  8887 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:18:00.351919  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 51638.2us
I20260709 13:18:00.330513  3842 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 11: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:00.340565  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:00.352658  3280 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:18:00.353221  8833 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:00.353451  8783 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:00.355208  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:00.356222  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:00.313714  8888 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:18:00.328830  3100 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:00.287066  8592 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.362766  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:00.344274  3031 catalog_manager.cc:5697] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 9 to 10, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 10 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:00.289680  8896 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:00.251143  8790 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:00.311800  8591 consensus_meta.cc:287] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.003s
I20260709 13:18:00.355036  3206 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
W20260709 13:18:00.349367  8720 consensus_meta.cc:287] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.810s	user 0.007s	sys 0.007s
I20260709 13:18:00.354732  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:00.280503  8891 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:00.321026  3176 leader_election.cc:336] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.645s (SENT)
W20260709 13:18:00.367434  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 46440.8us
I20260709 13:18:00.369761  8815 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:00.365435  8636 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:00.370676  8636 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.370725  8815 consensus_queue.cc:1059] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:00.371173  8636 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:00.371431  8891 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:00.371881  8815 raft_consensus.cc:3055] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:00.372262  8815 raft_consensus.cc:740] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:00.373102  8815 consensus_queue.cc:260] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.373701  8896 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:00.374315  8815 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:00.374560  8890 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.374675  8790 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.376137  8896 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.377112  8893 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:00.379506  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.380081  8855 consensus_meta.cc:287] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.616s	user 0.006s	sys 0.006s
I20260709 13:18:00.363994  8833 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:00.383692  8870 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:00.385720  8685 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.356635  8900 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:00.390640  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.394408  3031 catalog_manager.cc:5697] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 12 to 13, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 13 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:00.399065  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:00.399324  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:00.298175  8776 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.402455  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:00.385851  8470 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:00.380534  8855 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.407738  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:00.408514  3834 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:00.385766  8755 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:00.410403  3177 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:00.396266  8897 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:00.412564  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:00.413604  3205 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:00.413899  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:00.415648  3202 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:18:00.419240  3100 leader_election.cc:400] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:00.420374  3100 leader_election.cc:403] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:18:00.424182  3211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 3531) took 2020 ms (client timeout 1891 ms). Trace:
W20260709 13:18:00.424664  3211 rpcz_store.cc:269] 0709 13:17:58.394993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.395184 (+   191us) service_pool.cc:224] Handling call
0709 13:18:00.415328 (+2020144us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400194e54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:00.415433 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2634310400}
I20260709 13:18:00.425351  3133 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:18:00.426973  3279 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 18. Current term is 19. Ops: []
W20260709 13:18:00.422101  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 57505.1us
I20260709 13:18:00.429430  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:00.428373  3100 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:00.430122  3203 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:00.438282  3100 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:00.439108  3205 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
W20260709 13:18:00.439757  8830 consensus_meta.cc:287] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.600s	user 0.006s	sys 0.006s
I20260709 13:18:00.439529  8502 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:00.440366  8502 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.441567  8502 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:00.440306  8830 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.442900  3285 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:00.443938  8830 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:00.412774  8897 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.437776  8788 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:00.446507  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:00.414939  8591 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:00.424046  8720 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:00.454676  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2420) took 1837 ms. Trace:
I20260709 13:18:00.456830  3209 rpcz_store.cc:276] 0709 13:17:58.616928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.617230 (+   302us) service_pool.cc:224] Handling call
0709 13:17:58.617492 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.481438 (+863946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.454426 (+972988us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b5400195354. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:00.454614 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1968743808}
I20260709 13:18:00.450546  3805 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:00.457790  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:00.455717  3205 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:00.458664  3211 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:00.462733  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:00.463557  3210 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:18:00.464227  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:00.464707  3210 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 10.
I20260709 13:18:00.464843  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:00.461515  3805 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:00.469213  3805 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:00.465493  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:00.454870  8897 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:00.474036  3176 leader_election.cc:336] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.578s (SENT)
I20260709 13:18:00.456382  8788 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.474525  3176 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:00.486816  8837 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:00.487622  8837 raft_consensus.cc:697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:00.491204  8809 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.491832  8809 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:00.495060  8855 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:00.456539  8591 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:00.472086  8911 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:00.468393  8891 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:00.506520  8900 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.473219  8906 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:00.508140  8906 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:00.508621  8906 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:00.517241  3130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:18:00.518153  3130 raft_consensus.cc:606] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:00.518622  3130 raft_consensus.cc:614] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:00.497054  8788 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:00.500267  8591 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:00.488567  8837 consensus_queue.cc:237] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:00.498227  8911 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:00.514010  8891 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:00.536966  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:00.538110  3209 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:00.532357  8612 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.542023  8612 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.552620  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 762) took 1240 ms. Trace:
I20260709 13:18:00.553052  3127 rpcz_store.cc:276] 0709 13:17:59.312712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.312856 (+   144us) service_pool.cc:224] Handling call
0709 13:18:00.552423 (+1239567us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b540032e6d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:00.552555 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1212886400}
I20260709 13:18:00.555433  8897 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:00.563679  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.574697  8911 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:00.548153  8891 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:00.579006  8808 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:00.591389  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:00.592068  3211 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:00.596712  8776 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:00.600143  8883 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.559s	user 0.000s	sys 0.001s
I20260709 13:18:00.603268  8502 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.604261  8873 raft_consensus.cc:3055] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:00.604648  8873 raft_consensus.cc:740] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:00.605499  8873 consensus_queue.cc:260] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:00.607298  3281 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:00.607520  8636 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.612360  8873 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:00.586489  8900 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:00.613585  8900 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:00.614840  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57442 (request call id 763) took 1300 ms. Trace:
I20260709 13:18:00.615244  3133 rpcz_store.cc:276] 0709 13:17:59.314799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.376402 (+ 61603us) service_pool.cc:224] Handling call
0709 13:18:00.614666 (+1238264us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b54003dbb54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:00.614775 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2289303808}
I20260709 13:18:00.617923  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:00.618245  8901 log.cc:927] Time spent T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.331s	user 0.001s	sys 0.001s
I20260709 13:18:00.618609  3842 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:18:00.619117  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 764) took 1242 ms. Trace:
W20260709 13:18:00.614010  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.619493  3128 rpcz_store.cc:276] 0709 13:17:59.376834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.376966 (+   132us) service_pool.cc:224] Handling call
0709 13:17:59.377334 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:59.377579 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.377602 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:59.386062 (+  8460us) log.cc:844] Serialized 26 byte log entry
0709 13:17:59.751523 (+365461us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:59.751580 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.751685 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:00.599488 (+847803us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:18:00.618802 (+ 19314us) raft_consensus.cc:1685] finished
0709 13:18:00.618823 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.619054 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34589952,"thread_start_us":351811,"threads_started":1,"wal-append.queue_time_us":513384}
I20260709 13:18:00.626444  3100 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:00.627523  3100 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:00.628587  8502 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.629393  8591 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:00.592782  8911 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.631222  8897 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.633505  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:00.615752  8900 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.668182  3128 raft_consensus.cc:2410] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:18:00.637848  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:00.658023  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:00.659588  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:00.669533  3204 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:00.662585  3100 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:00.636703  8866 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:00.664673  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:00.669477  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:00.683132  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:00.689411  3135 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 20: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:00.683210  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:00.690374  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:00.691148  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:00.691651  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:00.691781  3841 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 21.
I20260709 13:18:00.688170  3131 raft_consensus.cc:2368] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13.
I20260709 13:18:00.693560  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:00.694401  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:00.689638  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:00.695683  3837 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:00.637295  8777 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:00.672009  3211 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:00.754427  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:00.755674  8324 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:00.756145  8683 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.782262  8898 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:00.783207  8683 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.783429  8898 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:00.758611  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:00.660386  8864 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:00.791483  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:00.792042  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:00.661034  8876 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.768205  3207 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:00.774091  3206 raft_consensus.cc:1240] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:00.668792  8636 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.782172  8324 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:00.688544  8866 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:00.759104  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 64917.2us
I20260709 13:18:00.790143  3102 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:00.794018  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:00.785442  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:00.604983  8788 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.761953  8502 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:00.762683  8777 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:00.805722  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:00.661487  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:00.829136  3102 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:00.851239  3210 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:00.832289  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:00.825991  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:00.813822  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:18:00.805785  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.852648  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:00.807478  8884 log.cc:927] Time spent T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:00.803462  8864 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:00.853675  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:00.835507  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:00.863040  3206 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:00.864192  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:00.865002  3209 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:00.838874  3207 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:00.867827  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:00.668223  8911 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.807263  3176 leader_election.cc:400] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13.
I20260709 13:18:00.871778  3176 leader_election.cc:403] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:18:00.873061  3206 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
W20260709 13:18:00.872815  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 65742.8us
W20260709 13:18:00.875528  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.805419  8866 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:00.842434  8885 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:00.827715  8502 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:00.860309  8777 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:00.870754  8762 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.846858  8591 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:00.847663  8683 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:00.892256  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.844499  8324 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:00.897747  7893 consensus_queue.cc:1059] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:00.898721  8502 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:00.881840  8809 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:00.955751  7893 consensus_queue.cc:1243] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:00.890553  8885 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:00.805894  8876 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:00.799969  8906 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:00.915912  8898 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:00.972256  8885 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:00.904019  8762 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.006731  8906 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:01.008558  8911 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:01.040331  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 254851us
W20260709 13:18:01.119647  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 213632us
I20260709 13:18:01.123692  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:18:01.043740  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 214609us
I20260709 13:18:00.828366  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:01.045853  3133 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 16: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:18:01.048357  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 162129us
I20260709 13:18:01.048722  3134 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:01.137231  8808 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:01.138350  8808 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.140501  8788 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:00.889838  3210 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:00.913430  8683 consensus_queue.cc:1059] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:18:01.060663  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:01.064502  3834 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:00.996775  8891 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.143038  3208 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 10.
W20260709 13:18:01.097936  8755 consensus_meta.cc:287] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.683s	user 0.017s	sys 0.007s
I20260709 13:18:01.101990  8864 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:01.103804  8720 consensus_meta.cc:287] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.000s
I20260709 13:18:01.106968  8876 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:01.107931  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 760) took 1797 ms. Trace:
I20260709 13:18:01.110960  8592 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:01.111431  8638 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:01.112426  8907 raft_consensus.cc:3055] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:01.110963  8629 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:01.117007  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.116844  8324 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:01.100817  8762 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:01.157389  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:01.161820  8588 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:01.162530  8588 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:01.163069  8588 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:01.150883  3132 rpcz_store.cc:276] 0709 13:17:59.309809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.309962 (+   153us) service_pool.cc:224] Handling call
0709 13:17:59.310332 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.787698 (+477366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.787729 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.787776 (+    47us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:59.787824 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.106972 (+1319148us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b540036abd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:01.107155 (+   183us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.107536 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097319296}
I20260709 13:18:01.154469  8638 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.174278  8683 raft_consensus.cc:3055] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:01.174830  8683 raft_consensus.cc:740] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:01.179016  8891 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:01.181604  3278 raft_consensus.cc:2410] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:18:01.181905  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:01.151918  8907 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:01.184516  8907 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.186161  8907 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:01.189893  8808 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:01.190496  3834 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:01.151895  8592 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.198541  8762 consensus_queue.cc:1059] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:01.198730  3249 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:18:01.201867  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.176819  8720 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:01.200237  8592 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:01.205803  3100 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:18:01.223491  8927 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.212s	user 0.000s	sys 0.004s
W20260709 13:18:01.226172  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 44522.3us
I20260709 13:18:01.211714  8591 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:01.229429  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:01.233266  8683 consensus_queue.cc:260] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.235155  8683 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:01.237613  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.238495  3285 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:01.238580  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:01.239588  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:01.241346  3276 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:18:01.241888  3276 pending_rounds.cc:85] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 8
I20260709 13:18:01.241588  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:01.242267  3276 pending_rounds.cc:107] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:18:01.242910  3276 raft_consensus.cc:2889] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:01.228425  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:01.247989  8566 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:01.248191  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.225998  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:01.248567  8566 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.268730  8566 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:01.270648  3837 consensus_meta.cc:287] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.512s	user 0.019s	sys 0.003s
I20260709 13:18:01.265480  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.271082  3837 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
W20260709 13:18:01.266755  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 111502us
I20260709 13:18:01.217573  8638 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:01.267854  8868 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:01.285502  3279 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:01.271916  8624 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:01.218881  8324 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.293471  8591 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:01.308363  8911 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:01.310920  8206 consensus_queue.cc:1059] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:18:01.295136  8868 raft_consensus.cc:697] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:01.319639  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:01.320995  3284 raft_consensus.cc:2368] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16.
I20260709 13:18:01.321138  3837 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:01.326047  3102 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:01.333503  8911 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.336547  8809 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13.
I20260709 13:18:01.337260  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.338389  8911 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:01.339128  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:01.340112  3279 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:01.304124  8624 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:01.343812  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 115625us
I20260709 13:18:01.355247  8868 consensus_queue.cc:237] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.357182  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:01.347190  8824 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:01.332932  8588 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.363425  8324 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:01.359390  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 138892us
W20260709 13:18:01.356925  8925 log.cc:927] Time spent T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.352s	user 0.003s	sys 0.001s
W20260709 13:18:01.364380  3204 consensus_meta.cc:287] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.635s	user 0.016s	sys 0.009s
I20260709 13:18:01.353331  8911 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:01.373822  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.371547  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.374691  3204 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:01.379666  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:01.382412  3276 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:18:01.382480  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.384238  3281 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
W20260709 13:18:01.385272  8923 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.402s	user 0.000s	sys 0.003s
W20260709 13:18:01.390214  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 71071.3us
I20260709 13:18:01.393155  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.393644  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1865) took 1548 ms. Trace:
I20260709 13:18:01.394007  3281 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:18:01.394083  3278 rpcz_store.cc:276] 0709 13:17:59.845179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.845341 (+   162us) service_pool.cc:224] Handling call
0709 13:18:01.393381 (+1548040us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540022d654. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:01.393561 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2873707776}
I20260709 13:18:01.404363  3284 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 19: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:01.405887  8502 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.406538  3250 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:01.406739  3837 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:18:01.407778  8872 raft_consensus.cc:3055] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:01.411090  8872 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:01.415825  3130 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:01.415940  8872 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.417702  8872 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:01.421296  8874 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:01.422443  8588 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:01.424399  3250 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:01.431419  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.453143  8777 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.454309  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.436187  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.437597  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.455480  8777 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:01.455838  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.456472  3284 raft_consensus.cc:2410] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:18:01.456745  3281 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:01.437345  8762 consensus_queue.cc:1059] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:01.457371  3209 consensus_meta.cc:287] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.014s
I20260709 13:18:01.439066  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.458209  8762 raft_consensus.cc:3055] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:01.438553  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.458655  3282 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:01.440964  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.441607  8361 consensus_queue.cc:1059] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:01.458631  8762 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:01.442167  8720 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:01.460728  8720 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.460960  8762 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.462445  8762 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.463312  8720 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:01.446555  8913 raft_consensus.cc:3055] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:01.448127  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.464087  8913 raft_consensus.cc:740] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:01.448379  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.465421  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.465538  8913 consensus_queue.cc:260] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.466352  3282 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:18:01.467092  8913 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:01.468238  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.470708  8502 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:01.471127  8929 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:18:01.471532  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:01.472081  3209 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:01.472275  3283 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:01.475636  8932 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:18:01.477123  3280 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:18:01.482577  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:01.483223  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:01.483451  3205 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:18:01.483968  3211 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:01.484198  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:01.484951  3209 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:01.485570  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 54668.5us
I20260709 13:18:01.484866  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:01.487107  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:01.487308  8720 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:01.451556  8592 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.452422  8885 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.434372  8683 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:01.457551  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.438581  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.455870  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:18:01.443216  8866 consensus_meta.cc:287] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.009s
I20260709 13:18:01.492051  8638 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:01.492254  8788 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.489532  8720 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:01.489866  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:01.489861  8629 raft_consensus.cc:3055] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:01.506021  3284 raft_consensus.cc:2410] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:18:01.493394  8876 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:01.493459  8859 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:01.512931  8788 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.532647  8788 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:01.534355  3283 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:18:01.534677  3281 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:01.533962  3279 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:01.537052  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.536422  8720 raft_consensus.cc:697] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:01.518374  8624 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:01.511582  8629 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:01.516894  8638 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.521415  3285 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:01.521658  8866 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.526569  8911 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:01.542806  3128 raft_consensus.cc:2368] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12.
I20260709 13:18:01.542734  8911 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.543753  8866 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:01.537636  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:01.544704  3208 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:18:01.545238  8911 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:01.517376  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.540717  3209 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
W20260709 13:18:01.547235  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.548586  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.548717  8859 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.550726  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:01.551249  8859 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:01.553336  8783 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:01.553404  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:01.554051  8783 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:01.554592  8783 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.555553  8629 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.554589  8885 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:01.563920  8629 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:01.567039  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:18:01.567821  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.568408  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:01.560705  8876 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.572329  8876 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:01.572741  3276 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:18:01.545845  3280 raft_consensus.cc:2376] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18. Re-sending same reply.
I20260709 13:18:01.573813  3278 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:01.575388  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:01.576210  3834 raft_consensus.cc:2368] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17.
I20260709 13:18:01.578848  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:01.579669  3283 raft_consensus.cc:2368] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17.
I20260709 13:18:01.565779  8624 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.585306  3128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "432d705ff69845aaac398233202f4081"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:18:01.585690  8624 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.586232  3128 raft_consensus.cc:606] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:01.586020  8566 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.588011  8624 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:01.589756  3100 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:01.589010  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.593742  8638 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:01.597389  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.597842  3208 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:01.599246  8859 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:01.599953  8859 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:01.601060  3277 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:01.603276  8859 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.605423  3128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:18:01.606168  3128 raft_consensus.cc:606] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:01.606830  3128 raft_consensus.cc:614] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:01.599267  8566 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:01.611373  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.584828  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.613857  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.612928  3128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:18:01.614151  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.593813  3280 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:01.618008  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:01.618527  3282 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:18:01.621850  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.623288  3128 raft_consensus.cc:606] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:01.623397  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:01.624136  3128 raft_consensus.cc:614] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:01.631922  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.630620  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:01.630887  8624 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:01.636181  3132 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:18:01.630687  8638 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:18:01.637032  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:01.620559  8872 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:01.640874  8872 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.641785  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:01.648211  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.652951  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.653517  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:01.653755  3279 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:18:01.655105  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:01.657215  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:01.659914  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:18:01.662137  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.661717  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:01.664837  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.668455  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.669581  3277 raft_consensus.cc:2393] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:01.672418  3102 leader_election.cc:400] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17.
I20260709 13:18:01.672758  3102 leader_election.cc:403] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.674201  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:01.681720  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:01.683718  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.674680  8592 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:01.660434  8720 consensus_queue.cc:237] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.678385  8859 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:01.693300  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.694700  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.696575  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:01.702682  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:01.691830  8824 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:18:01.700177  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:01.707365  3280 raft_consensus.cc:2410] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:18:01.700838  8900 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.708746  8900 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.709735  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.710999  8900 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:01.711340  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.711912  3278 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:18:01.713518  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:01.713635  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.714260  3277 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:01.714311  3276 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:18:01.715026  8824 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:01.715657  8824 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 18 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:01.701608  8872 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:01.716691  8824 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.714463  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.721745  3278 raft_consensus.cc:2368] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12.
I20260709 13:18:01.722992  3176 leader_election.cc:400] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12.
I20260709 13:18:01.729090  3176 leader_election.cc:403] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.729879  8624 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:18:01.725266  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:01.725490  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.731959  3283 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:01.726991  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:01.737514  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:18:01.738700  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 60603.7us
I20260709 13:18:01.750823  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:01.755370  3277 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:01.756760  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.757647  3278 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:01.764708  3282 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:01.766731  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:01.769971  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:01.770633  3202 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:01.771390  3177 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:01.771891  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:01.773197  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:01.773415  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:01.774158  3211 raft_consensus.cc:2410] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:18:01.774335  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:01.775178  3211 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:01.775635  8681 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:01.776098  8681 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:01.776513  8681 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.779546  3205 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:18:01.759054  8592 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:01.771484  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:01.783727  3208 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:01.767647  3282 raft_consensus.cc:2410] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:18:01.785143  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:01.786540  8911 consensus_queue.cc:1059] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:01.786687  8885 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:01.788005  3806 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:01.788508  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:01.789161  8900 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:01.789420  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:01.783488  3101 leader_election.cc:400] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17.
I20260709 13:18:01.790766  3101 leader_election.cc:403] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.792959  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:01.751686  8783 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.796104  3209 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:01.798421  8903 consensus_queue.cc:1059] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:18:01.799190  3206 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:01.805394  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:01.794332  8824 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:01.806514  3836 raft_consensus.cc:1240] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:01.808058  8900 raft_consensus.cc:697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:01.808756  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:01.795774  8891 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:18:01.821789  8720 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:01.823007  8891 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:01.823563  8891 raft_consensus.cc:697] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:01.826058  3100 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:01.816927  8683 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:01.826912  8624 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12.
I20260709 13:18:01.827193  8683 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:01.826562  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45608.3us
I20260709 13:18:01.809155  8900 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.866187  3100 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:01.846084  8872 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.863487  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:01.849606  8866 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.824667  8891 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:01.874138  8940 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:18:01.875495  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:01.876487  3249 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:01.878003  8777 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:01.878465  8777 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.878902  8777 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:01.882339  3100 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:01.882798  8913 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:01.847705  8206 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:01.886487  8744 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:01.886950  8744 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.887327  8744 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:01.887452  8361 consensus_queue.cc:1059] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:01.888451  8361 raft_consensus.cc:3055] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:01.888536  8592 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:01.888880  8361 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:01.889008  8592 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:01.863547  8629 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:01.886435  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:01.893796  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:01.910615  8588 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:01.894582  8911 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:01.883503  8913 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:01.916081  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:01.917672  3249 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:01.901630  8876 raft_consensus.cc:3055] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:01.926791  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:01.894754  8629 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:01.912720  8874 consensus_queue.cc:1059] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:01.872445  8872 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:01.934160  8941 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:18:01.934774  8942 raft_consensus.cc:3055] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:01.935233  8942 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:01.935549  8861 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:01.936149  8861 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:01.936684  8861 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:01.896050  8868 consensus_queue.cc:1059] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:18:01.938130  8868 raft_consensus.cc:3055] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:01.938531  8868 raft_consensus.cc:740] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:01.930922  8911 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:01.939584  8868 consensus_queue.cc:260] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.939949  8911 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.931306  8824 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:01.929024  8783 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:01.943532  8824 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.944273  8629 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.889981  8592 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.929113  8876 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:01.947926  8592 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:01.948665  8876 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.949513  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:01.949747  8876 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:01.936429  8942 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.951854  8942 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:01.940999  8868 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.930423  3100 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:18:01.937263  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.920346  8588 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:01.889940  8361 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.895201  8681 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:01.971405  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:01.955641  8824 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:01.989373  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 127622us
I20260709 13:18:01.918704  8866 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:01.960345  8683 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:01.963482  8762 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:01.966549  8502 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:01.995422  3206 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:18:01.995957  3202 raft_consensus.cc:1240] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:01.918795  8206 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:02.013110  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 95489.6us
I20260709 13:18:01.995182  8361 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:02.018358  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:02.011953  3250 leader_election.cc:336] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.615s (SENT)
W20260709 13:18:02.024461  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.987560  8788 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:18:02.038560  3206 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:18:02.054598  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:02.061708  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 66375.7us
W20260709 13:18:02.084508  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 114560us
I20260709 13:18:02.086665  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:02.083272  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:02.039168  8502 raft_consensus.cc:697] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:02.089476  8683 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.093014  8683 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:02.095492  8683 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:02.097358  3278 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
W20260709 13:18:02.099496  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.101999  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.102612  3134 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:18:02.103879  8866 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:02.104820  8872 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:02.083850  8720 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17.
I20260709 13:18:02.098968  8744 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:02.101068  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 108130us
I20260709 13:18:02.007556  8913 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:02.109042  3210 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:18:02.126504  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:02.174934  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 57228.5us
I20260709 13:18:02.175261  8955 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:02.177838  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 56395.6us
I20260709 13:18:02.123747  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.120625  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:02.121042  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:02.112407  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 100484us
I20260709 13:18:02.125552  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.110213  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:02.110107  8502 consensus_queue.cc:237] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:02.173803  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:02.181828  3834 raft_consensus.cc:2410] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:18:02.178934  3128 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:18:02.180801  3835 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:02.121042  8681 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:02.115226  8744 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:02.198220  8864 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:02.198706  8864 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:02.199076  8864 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:02.199222  8859 consensus_meta.cc:287] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.002s
I20260709 13:18:02.199746  8859 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17.
I20260709 13:18:02.209065  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:02.210268  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 46405.8us
I20260709 13:18:02.210402  8206 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:02.212387  8903 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:02.213519  8952 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:18:02.221949  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:02.222735  3211 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:02.223788  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:02.231950  8864 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:02.234115  8911 raft_consensus.cc:3055] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:02.234318  8907 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:02.236923  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:18:02.251932  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 74232.6us
W20260709 13:18:02.257426  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 207386us
I20260709 13:18:02.110528  8629 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:02.270397  3101 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:02.264223  3211 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:02.264631  8874 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:02.259199  8907 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:02.277212  3203 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:02.265352  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:02.258899  8911 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:02.271117  8629 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:02.263269  8885 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.290221  8907 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:02.291088  8885 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:02.291621  8907 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:02.293396  8885 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:02.281241  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.283547  8683 consensus_queue.cc:1059] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:18:02.284946  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:02.277042  8874 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.294891  8874 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:02.289726  8911 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:02.290372  8864 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:02.297719  8859 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:02.298316  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:02.299129  3842 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:02.298348  8859 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:02.300561  8859 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:02.298019  8683 raft_consensus.cc:3055] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:02.301419  3203 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
I20260709 13:18:02.303443  3102 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:18:02.305291  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.306130  8683 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:02.310674  8683 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:02.259079  8943 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:18:02.311928  8683 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:02.308430  8876 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:02.314342  8876 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.314718  8876 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:02.316071  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 60082.4us
I20260709 13:18:02.317636  3251 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:02.271896  8777 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:02.321205  8206 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:02.322144  8777 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:02.330277  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 125426us
I20260709 13:18:02.336757  3100 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:02.336807  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:02.337497  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:02.341673  3207 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:02.342111  8962 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:02.343811  3176 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:02.344810  8962 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:02.346407  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:02.347208  8962 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:02.349475  3282 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:02.351511  8943 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:02.349527  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:02.353717  8962 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:02.354120  8962 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:02.354496  8962 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:02.355263  8861 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:02.356564  3130 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:02.354449  8911 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:02.344852  8776 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:02.357056  3249 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:02.360457  8776 raft_consensus.cc:697] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:02.360826  8361 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:02.361528  8361 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:02.362511  8361 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:02.361523  8776 consensus_queue.cc:237] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:02.379297  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.389184  8681 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
W20260709 13:18:02.385355  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 88487.7us
I20260709 13:18:02.412346  8943 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.389501  3176 leader_election.cc:400] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16.
I20260709 13:18:02.397919  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:02.421033  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:02.423736  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:02.426859  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:02.424887  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:02.431876  3209 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:02.434523  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:02.434901  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:02.435715  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:02.436028  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:02.442258  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:02.444036  3207 raft_consensus.cc:2393] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 14: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:02.444799  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:02.435590  3280 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:18:02.469344  3283 raft_consensus.cc:2393] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:02.397472  8861 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:02.475329  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 85990.6us
I20260709 13:18:02.475226  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:02.475740  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:02.475984  3806 leader_election.cc:336] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.911s (SENT)
I20260709 13:18:02.475270  3203 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:02.476656  3033 catalog_manager.cc:5697] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 19 to 21, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 21 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:02.477995  3284 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:02.478118  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:02.385010  8859 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:02.473820  8868 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:02.485780  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:02.488339  3283 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:02.412969  8943 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:02.390412  8876 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:02.489545  3278 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:02.417284  8874 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:02.490710  8962 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:02.472617  8638 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:02.449396  8956 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:02.494856  3130 raft_consensus.cc:1240] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:02.496176  3127 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:02.496838  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:02.497164  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:02.497867  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.498606  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.500901  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:02.505398  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:02.514446  3133 raft_consensus.cc:1240] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:02.522135  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 138584us
I20260709 13:18:02.535146  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:02.534070  3806 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:02.580078  3207 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:18:02.547437  3100 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:02.547333  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:02.581797  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:02.582361  3282 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:02.586009  3279 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:18:02.586433  3279 pending_rounds.cc:85] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 9
I20260709 13:18:02.586707  3279 pending_rounds.cc:107] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:18:02.586941  3279 raft_consensus.cc:2889] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:02.592334  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 44973.6us
I20260709 13:18:02.595502  3033 catalog_manager.cc:5697] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:02.587574  8872 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:02.601270  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:02.593997  8776 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:02.546224  8592 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:18:02.606755  3134 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
W20260709 13:18:02.615299  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 68038.3us
I20260709 13:18:02.546952  8868 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:02.619395  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.592609  8864 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:02.619238  3033 catalog_manager.cc:5697] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 14 to 18, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 18 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:02.594383  8947 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:02.622998  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.626879  3128 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:02.588614  8955 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 13:18:02.631109  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 155173us
I20260709 13:18:02.604911  8638 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:02.633904  8859 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:02.634330  8638 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:02.637341  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:02.637962  3277 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:02.628289  8872 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:02.630254  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.648039  8872 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:02.616199  8629 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:02.652100  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:02.654173  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:02.656935  3277 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:02.657527  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:02.606316  8885 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:18:02.596927  8956 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:02.659112  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:02.663532  8943 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:02.669446  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:02.670698  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.671561  3127 raft_consensus.cc:1240] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:02.665292  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.676905  3207 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:02.673663  8962 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:02.674571  8876 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:02.675985  8868 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:02.715328  3211 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:02.682595  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:02.723518  3033 catalog_manager.cc:5697] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:02.726202  3204 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:02.679510  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 48259.5us
I20260709 13:18:02.720804  3129 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:02.682866  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:02.681388  3135 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:02.671855  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.728299  3134 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:18:02.722573  3133 raft_consensus.cc:2393] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 18: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:02.729471  3836 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:02.681730  8681 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:02.723971  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:02.738761  3210 raft_consensus.cc:2393] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 17: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:02.724959  3203 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:02.739236  3209 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 16: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:02.677456  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.730077  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.722681  3132 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:18:02.740103  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:02.740721  3129 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:02.733496  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:02.725747  3100 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:02.676970  8874 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:02.747833  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.738292  8681 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:02.750293  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.754325  3130 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:02.751883  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.755209  3134 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:18:02.748633  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.744832  3033 catalog_manager.cc:5697] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 5 to 19, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 19 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:02.763723  3129 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
I20260709 13:18:02.763825  3211 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:02.757455  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.766080  3127 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 22: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:02.766456  3129 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:02.766736  3130 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:02.765511  3131 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:02.770363  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.771430  3033 catalog_manager.cc:5697] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:02.746711  8876 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:02.779775  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:02.781354  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:02.782737  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:02.783733  8961 raft_consensus.cc:2764] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:18:02.784431  8961 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:02.784765  8961 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:02.763265  8681 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:02.785130  8961 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:02.785300  8864 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:02.766399  8861 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:18:02.778460  8502 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
W20260709 13:18:02.789981  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.773363  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.793525  8876 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:02.794480  8876 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:02.731886  8683 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:18:02.815119  8864 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:02.815193  3204 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:02.816342  3836 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:02.819846  3102 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:02.820963  8868 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:02.821790  8868 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:02.824124  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:02.828970  3134 raft_consensus.cc:1240] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 13. Current term is 14. Ops: []
W20260709 13:18:02.836675  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.823897  8956 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:02.823216  8868 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:02.851904  8683 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:02.855449  3806 leader_election.cc:336] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 2.157s (SENT)
I20260709 13:18:02.855085  8683 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:02.855981  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:02.858517  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:02.874823  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:02.875664  3285 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:18:02.860823  3033 catalog_manager.cc:5697] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 10 to 13, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 13 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:02.868348  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:02.877602  3842 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:02.878062  3806 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:02.878501  3128 consensus_queue.cc:237] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:02.879464  8942 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:02.879853  8942 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.880174  8942 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:02.867053  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:02.887590  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.889422  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.889762  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.890117  3130 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:02.890406  3127 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:18:02.891252  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:02.859745  8943 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:18:02.897011  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.897362  3276 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:18:02.865684  8874 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:02.908535  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:02.909417  3209 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:02.909772  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:02.913566  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:18:02.918634  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 135992us
I20260709 13:18:02.921682  3249 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:02.931468  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:02.933357  3211 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:02.933658  3033 catalog_manager.cc:5697] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 8 to 11, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 11 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:02.913931  8683 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:02.950690  3131 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:18:02.955420  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:02.951400  8744 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
W20260709 13:18:02.971318  8973 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:02.949208  8943 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:18:02.981349  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:02.950610  8361 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:02.930831  8874 raft_consensus.cc:697] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:02.988649  3133 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:18:02.994290  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:03.002133  3127 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 22: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:02.984743  8962 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:03.013008  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 57825.5us
I20260709 13:18:02.986903  8361 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.017452  3128 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:03.021852  3211 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:03.021132  8361 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:03.039321  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 68974.8us
I20260709 13:18:03.040467  8206 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.041455  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.043608  3842 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:03.044144  8206 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:03.060010  8874 consensus_queue.cc:237] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:03.061311  3806 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.988s (SENT) [suppressed 39 similar messages]
I20260709 13:18:03.067696  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:03.073374  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:03.074059  3285 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:03.074224  3202 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:03.074779  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:03.039433  8681 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.077297  3207 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
W20260709 13:18:03.078904  3031 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38226 (request call id 254) took 23668 ms (client timeout 15000 ms). Trace:
I20260709 13:18:03.079128  3033 catalog_manager.cc:5697] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.081951  3283 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:03.083021  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:03.083633  3277 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:03.079332  3031 rpcz_store.cc:269] 0709 13:17:39.410287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.410611 (+   324us) service_pool.cc:224] Handling call
0709 13:17:39.957207 (+546596us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54000a87d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc159090 00007fb3bc1f7f3a 00007fb3c1fae1cc 00007fb3c20ac37e 00007fb3c056d2a4 00007fb3c056d232 00007fb3c056d161 00007fb3c056d0dc 00007fb3c056c392 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:03.078682 (+23121475us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:00.844751 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:00.845626 (+   875us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:00.845682 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:18:00.845713 (+    31us) tablet.cc:662] Decoding operations
0709 13:18:00.848096 (+  2383us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:00.848168 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:00.848194 (+    26us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:18:01.002637 (+154443us) tablet.cc:701] Row locks acquired
0709 13:18:01.002666 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:18:01.002877 (+   211us) write_op.cc:270] Start()
0709 13:18:01.003027 (+   150us) write_op.cc:276] Timestamp: P: 1783603081002808 usec, L: 0
0709 13:18:01.003056 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:18:01.135738 (+132682us) log.cc:844] Serialized 9385 byte log entry
0709 13:18:01.445538 (+309800us) spinlock_profiling.cc:243] Waited 89.9 ms on lock 0x7b54000a87d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1eae28 00007fb3bfc25581 00007fb3bfc24d58 00007fb3bfc299f1 00007fb3bfc299a9 00007fb3bfc29939 00007fb3bfc29901 00007fb3bfc28b2d 000000000038f354 000000000038f199
0709 13:18:01.708399 (+262861us) op_driver.cc:464] REPLICATION: finished
0709 13:18:01.865203 (+156804us) write_op.cc:301] APPLY: starting
0709 13:18:01.865340 (+   137us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:02.168383 (+303043us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:02.168421 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:02.364502 (+196081us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:02.365015 (+   513us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 13:18:02.365110 (+    95us) write_op.cc:312] APPLY: finished
0709 13:18:02.365726 (+   616us) log.cc:844] Serialized 212 byte log entry
0709 13:18:02.365953 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:02.366321 (+   368us) write_op.cc:454] Released schema lock
0709 13:18:02.366414 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:02.385433 (+ 19019us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:02.385476 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":492421,"reported_tablets":51,"spinlock_wait_cycles":635769984,"child_traces":[["op",{"apply.queue_time_us":124898,"apply.run_cpu_time_us":36604,"apply.run_wall_time_us":513668,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104639,"num_ops":24,"prepare.queue_time_us":294444,"prepare.run_cpu_time_us":41171,"prepare.run_wall_time_us":601117,"raft.queue_time_us":100717,"raft.run_cpu_time_us":29988,"raft.run_wall_time_us":91968,"replication_time_us":703442,"spinlock_wait_cycles":206757120,"thread_start_us":776816,"threads_started":4,"wal-append.queue_time_us":209655}]]}
I20260709 13:18:03.088903  3837 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:03.090296  8913 consensus_queue.cc:1059] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:18:03.064164  8783 consensus_queue.cc:1059] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:18:03.098475  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:03.099159  3209 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:03.084285  8961 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.090659  3806 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.100904  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:03.112223  3279 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:03.101979  3282 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:18:03.112819  3282 pending_rounds.cc:85] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 8
I20260709 13:18:03.112684  3277 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:03.113119  3282 pending_rounds.cc:107] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:18:03.113376  3282 raft_consensus.cc:2889] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:03.098389  3033 catalog_manager.cc:5697] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 12 to 15, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 15 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:03.115775  3033 catalog_manager.cc:5697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 11 to 14, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 14 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:03.123638  3033 catalog_manager.cc:5697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 12 to 13, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 13 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:03.132411  8981 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:18:03.136008  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 46265.1us
I20260709 13:18:03.136112  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:03.130404  3033 catalog_manager.cc:5697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 10 to 12, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 12 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:03.091981  8783 raft_consensus.cc:3055] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:03.111584  8974 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:03.152051  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 54725us
W20260709 13:18:03.152295  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 116288us
I20260709 13:18:03.152721  3101 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:03.153108  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.156865  3209 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:03.158010  3136 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:03.158766  8206 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:03.159612  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:03.162369  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 115542us
I20260709 13:18:03.071210  8776 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:18:03.146607  8783 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:03.174172  3210 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:03.153258  8885 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:18:03.163055  8859 consensus_queue.cc:1059] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:18:03.147194  8913 consensus_queue.cc:1243] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer fc48eecc27554cb58b15193cd442b1d3 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:03.151120  8943 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:03.161634  8866 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:03.182641  8592 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.184131  8956 raft_consensus.cc:3055] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:03.184653  8950 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.073s
I20260709 13:18:03.176410  3279 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
W20260709 13:18:03.200888  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.161577  8868 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:03.226377  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 45957.9us
I20260709 13:18:03.226423  8206 consensus_queue.cc:1059] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:03.251852  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 99223.5us
W20260709 13:18:03.251624  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 161055us
I20260709 13:18:03.187805  8962 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:03.257869  3837 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:03.262784  3101 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:03.271282  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 159622us
I20260709 13:18:03.272321  3249 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:03.226441  8947 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:03.224104  8861 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:18:03.276427  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:03.255295  8956 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:18:03.278429  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 125426us
I20260709 13:18:03.269767  8681 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:03.299878  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:03.254429  8876 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:18:03.260409  8777 consensus_queue.cc:1059] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:18:03.306695  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.257266  8592 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.292603  8638 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:03.290856  8866 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:03.382627  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 81822.4us
I20260709 13:18:03.301000  8988 raft_consensus.cc:3055] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:03.309424  8683 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:18:03.400035  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 96461.1us
W20260709 13:18:03.406920  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.269373  8783 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:03.280387  8947 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:03.412559  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 112812us
I20260709 13:18:03.419152  3101 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:03.398290  8988 raft_consensus.cc:740] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:03.401551  8961 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:03.410324  8683 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.422588  8861 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:03.436292  8744 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:03.436619  8990 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:18:03.436693  8861 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.436908  8744 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:03.437183  8972 raft_consensus.cc:3055] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:18:03.437580  8989 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:18:03.437796  8972 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:03.439664  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:03.439895  8592 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:03.440493  8592 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:03.441854  8592 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:03.422081  8956 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:03.443140  8866 consensus_queue.cc:1175] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "48080cf0460346769ab046a4f9457aa5" responder_term: 14 status { last_received { term: 14 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 14 index: 7 } }
I20260709 13:18:03.443751  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:03.437249  8861 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:03.450718  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 137245us
I20260709 13:18:03.444356  3250 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.424120  8885 raft_consensus.cc:3055] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:03.454687  3101 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:03.432910  8683 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:03.459551  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:03.461352  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.456318  8885 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:03.458290  8720 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:03.420742  8943 consensus_queue.cc:1059] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:18:03.464987  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:03.457046  8776 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:03.468814  8885 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.462975  9001 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:03.479161  8947 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:03.461185  8783 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:03.436334  8988 consensus_queue.cc:260] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.490559  8988 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:03.493705  3176 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:03.495162  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.496462  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.497381  8997 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:03.498339  8997 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:03.498947  8955 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:03.499338  8955 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:03.500140  8955 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.501247  8961 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:03.502620  8911 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:03.481949  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.463119  8991 consensus_queue.cc:1059] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:18:03.466274  8592 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:03.481572  9002 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:18:03.508756  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 207990us
W20260709 13:18:03.509368  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.509366  8206 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:03.514670  8206 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:18:03.483477  8942 consensus_meta.cc:287] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.000s
I20260709 13:18:03.462232  8502 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:18:03.517477  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.520246  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:03.521337  3837 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:03.524498  8993 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:18:03.525921  9002 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:03.527177  8982 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:03.438716  8972 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.531611  8972 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:03.535770  8956 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:03.522239  8206 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:03.465550  8361 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.510316  8947 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:03.548262  8683 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:03.510775  8744 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:03.514040  8955 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:03.523067  8942 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:03.555389  8638 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:18:03.559248  8683 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:03.563264  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.565253  8864 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:03.566445  8744 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:03.570719  8361 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:03.571246  3284 raft_consensus.cc:2368] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:03.572311  8885 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:03.592602  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 76000.2us
I20260709 13:18:03.554096  8950 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:03.598995  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:03.599788  3835 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:18:03.605784  8206 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:03.608426  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 126790us
I20260709 13:18:03.607774  3101 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:03.623481  8942 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:03.633500  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:03.638219  9003 raft_consensus.cc:3055] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:03.638754  9003 raft_consensus.cc:740] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:03.639843  9003 consensus_queue.cc:260] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:03.642484  3101 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:03.620522  8861 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.654465  3210 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:03.646435  3835 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
I20260709 13:18:03.573689  9001 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:18:03.597456  9007 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.663178  3101 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:03.664887  9012 raft_consensus.cc:3055] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:03.650440  9003 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:03.681501  3101 leader_election.cc:400] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:03.680084  8629 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:18:03.682359  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.692414  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 83155.6us
I20260709 13:18:03.654809  8911 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:03.685542  8993 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:03.690933  3101 leader_election.cc:403] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:03.695292  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:03.662739  8638 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:03.707106  8720 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:18:03.681324  9012 raft_consensus.cc:740] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:18:03.709170  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 111866us
I20260709 13:18:03.710670  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:03.711400  8999 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:18:03.712339  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:03.713033  3136 raft_consensus.cc:2376] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15. Re-sending same reply.
W20260709 13:18:03.680200  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 134725us
I20260709 13:18:03.699694  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:03.718175  3133 raft_consensus.cc:2376] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17. Re-sending same reply.
I20260709 13:18:03.700929  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:03.704250  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:03.719736  3210 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:03.705605  3203 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:03.706169  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:03.721494  3135 raft_consensus.cc:2376] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19. Re-sending same reply.
I20260709 13:18:03.724488  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:03.728327  3209 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:03.729787  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 212372us
I20260709 13:18:03.733067  3127 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:03.694458  8911 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:03.689285  8776 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:18:03.741377  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:03.742115  3135 raft_consensus.cc:2376] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15. Re-sending same reply.
I20260709 13:18:03.735859  8502 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:03.745679  8502 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:03.749881  3835 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:18:03.720686  8629 raft_consensus.cc:697] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:03.735512  8777 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:03.753703  8777 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:03.754026  8629 consensus_queue.cc:237] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.729367  8961 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:03.726287  8866 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:03.762766  8866 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.762965  8876 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:03.763339  3210 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:03.678171  9007 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:03.771955  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 49377.1us
W20260709 13:18:03.776891  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 66279.9us
I20260709 13:18:03.778669  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.780064  8961 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:03.781018  9022 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.781136  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.782279  8991 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:03.782701  3250 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:03.782559  9022 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.783661  8991 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:03.781886  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.757642  8911 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:03.773638  3251 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:03.787776  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:03.788599  9021 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:03.784195  8991 raft_consensus.cc:697] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:03.789137  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:03.790063  8991 consensus_queue.cc:237] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.790064  3127 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:03.793601  9002 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:03.794523  9012 consensus_queue.cc:260] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.796015  9012 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:03.786475  3250 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:03.804900  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:03.809614  3249 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:03.812510  8861 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:03.812831  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:03.810151  8982 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:03.810300  8502 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:03.811034  9014 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:03.812767  9018 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:03.816471  9018 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:03.782230  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.811127  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:03.823369  3130 raft_consensus.cc:2410] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 19 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 13:18:03.823776  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 55511.6us
I20260709 13:18:03.826339  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:03.832885  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:03.841398  3209 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
I20260709 13:18:03.843647  3284 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:03.806304  9002 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:03.864997  9002 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:03.868186  9016 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.852880  3284 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:03.868799  9016 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:03.871158  9016 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:03.873636  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:03.874255  3280 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:03.877780  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:03.881021  3278 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:03.842463  9001 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:03.863869  9018 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.867566  9002 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:03.839043  8982 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:03.843775  3806 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:03.907238  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:03.907424  8992 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:03.831543  8872 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:03.838833  8720 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:03.912892  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:03.909879  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:03.923238  3203 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:03.923529  3205 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:03.913745  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:03.848932  8864 raft_consensus.cc:2764] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:18:03.851569  8947 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:03.924537  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:03.916074  3283 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:18:03.924554  3841 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:03.846439  8874 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:03.919405  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 137299us
I20260709 13:18:03.920145  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:03.927604  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:03.932261  3278 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:18:03.842855  8943 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:18:03.929153  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:03.936081  8206 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:03.936463  8206 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.936755  8206 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:03.939906  3203 raft_consensus.cc:2410] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:18:03.942015  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:03.916049  9001 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:03.944345  3128 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
W20260709 13:18:03.944672  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 101027us
I20260709 13:18:03.910115  8861 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:18:03.952273  8206 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:03.955451  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:03.955564  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:03.962284  3833 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:03.957760  8776 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:18:03.939639  8864 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.964383  8864 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:03.966775  8997 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:03.938977  8872 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.935631  8982 raft_consensus.cc:697] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:03.974020  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:03.974682  3281 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:03.941504  9002 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:03.941627  8956 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:03.943843  8947 raft_consensus.cc:697] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:18:03.963723  9019 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:18:03.969172  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:03.959525  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:03.975915  8206 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:03.990332  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.990610  3205 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:18:03.999933  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:04.005465  3833 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:04.009212  9010 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:04.009840  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.012728  8872 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:03.939502  8874 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:03.973775  8638 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:04.020885  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:04.032557  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 221520us
I20260709 13:18:04.031626  3281 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
W20260709 13:18:04.033437  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 90819.5us
I20260709 13:18:03.987383  8861 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.038584  8206 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:03.987954  8956 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.041703  8206 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:04.039958  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:04.059377  8206 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:04.060642  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:04.061681  3204 raft_consensus.cc:2393] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:04.063671  9004 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:04.065724  9025 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:18:04.033396  8974 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:04.054401  3250 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:04.072991  3833 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:04.029780  9014 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:04.089646  8988 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:04.037695  8872 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:04.043762  8956 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:04.098191  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 148513us
I20260709 13:18:04.102361  8866 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:04.103127  9030 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:18:04.043740  8638 raft_consensus.cc:697] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:18:04.108963  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 167001us
I20260709 13:18:04.113648  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:04.114197  3277 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
W20260709 13:18:04.097743  9024 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:18:04.131243  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:04.049495  8861 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:04.144367  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:04.145133  3130 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:18:04.146790  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:04.156862  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:04.161168  3131 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:18:04.174156  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:04.132856  9021 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:04.182756  3134 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 19.
I20260709 13:18:04.176874  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:18:04.185092  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 132135us
I20260709 13:18:04.105382  8638 consensus_queue.cc:237] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:04.194772  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.109316  8872 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:04.158098  8974 raft_consensus.cc:2764] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:18:04.098896  9014 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:04.207122  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 230869us
I20260709 13:18:04.174021  9002 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:04.095086  8982 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:04.209266  3834 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:04.198277  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:04.098285  9001 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:04.181775  8777 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:04.209197  3806 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:04.227540  3806 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:04.229360  9020 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:04.230368  9020 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:04.230965  9020 raft_consensus.cc:697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:04.232116  9020 consensus_queue.cc:237] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:04.208324  8592 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:18:04.239660  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 108515us
I20260709 13:18:04.140827  8947 consensus_queue.cc:237] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:04.241973  3102 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:04.251785  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:04.243544  8592 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:18:04.269304  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 124416us
I20260709 13:18:04.278294  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:04.305414  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:04.307327  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:04.276625  8592 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.266888  8992 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:04.296726  8974 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:04.347149  8961 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:04.349061  8874 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:04.375420  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:04.366305  9023 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.299s	user 0.000s	sys 0.002s
I20260709 13:18:04.374550  9017 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:04.390094  9051 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.386791  9017 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:04.390669  9051 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:04.393976  8859 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.394713  8859 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:04.395212  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 87999.1us
I20260709 13:18:04.396047  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:04.397342  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:04.431007  3205 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
W20260709 13:18:04.453536  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 56273.7us
I20260709 13:18:04.454644  3176 leader_election.cc:400] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12.
I20260709 13:18:04.381910  8974 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:04.456220  3176 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:04.392951  9051 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:04.278488  9032 raft_consensus.cc:2955] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 6 to 11, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:04.354122  9002 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:04.388227  8861 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:04.452145  8961 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:04.493865  8911 consensus_meta.cc:287] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.700s	user 0.012s	sys 0.000s
I20260709 13:18:04.494386  8911 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:04.495978  9039 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:18:04.496745  9004 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:04.489965  9012 consensus_meta.cc:287] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.694s	user 0.014s	sys 0.000s
I20260709 13:18:04.542579  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:04.543303  3842 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:04.497793  8974 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:04.469097  9017 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:04.535099  8993 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:04.556025  3102 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:04.548720  8974 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:04.583200  9007 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:04.594798  9055 log.cc:927] Time spent T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:18:04.596453  9048 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:18:04.587975  8872 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:04.601173  9058 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:04.601719  9058 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:04.602089  9058 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.606403  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:04.609714  9056 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:18:04.570031  8974 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.611997  8911 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:04.622900  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.569706  9057 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:04.563959  8993 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:04.626024  8956 consensus_meta.cc:287] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
W20260709 13:18:04.656106  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 100201us
I20260709 13:18:04.653765  8629 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.646363  8956 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:04.664256  9061 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:04.666219  9065 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:04.666051  8592 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:04.666607  9068 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.670701  9014 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:04.673719  8864 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:04.676261  8993 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:04.679018  8629 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:04.689664  8859 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:04.702621  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:04.703231  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:04.713790  3842 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:04.709488  9061 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.701035  9068 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:04.712100  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:04.721944  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:04.722795  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:04.728762  3204 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 16: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:04.726114  3211 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:04.753034  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:04.747090  3204 raft_consensus.cc:3055] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:04.754458  3208 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:04.754973  3204 raft_consensus.cc:740] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:18:04.767210  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 67133.3us
I20260709 13:18:04.725468  9072 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.726591  9061 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:04.755816  3204 consensus_queue.cc:260] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:04.775761  3835 raft_consensus.cc:2955] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 6 to 11, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:04.769851  9022 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:04.795374  3204 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:04.797427  9037 log.cc:927] Time spent T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.707s	user 0.003s	sys 0.001s
W20260709 13:18:04.798190  9026 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.697s	user 0.005s	sys 0.000s
I20260709 13:18:04.779229  9072 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:04.802500  9072 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:04.806607  8629 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:04.809197  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:04.809947  3842 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:18:04.810915  3128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:18:04.811491  3128 raft_consensus.cc:606] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:04.811964  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:04.812481  3128 raft_consensus.cc:614] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:04.812366  3102 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:04.812426  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 2331) took 1024 ms. Trace:
I20260709 13:18:04.812638  3208 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:18:04.813974  3136 rpcz_store.cc:276] 0709 13:18:03.787625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.790251 (+  2626us) service_pool.cc:224] Handling call
0709 13:18:03.790560 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:03.790896 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.790943 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:03.791421 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:18:03.906045 (+114624us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:04.146134 (+240089us) log.cc:844] Serialized 14 byte log entry
0709 13:18:04.146379 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.146464 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:04.680815 (+534351us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:18:04.808253 (+127438us) raft_consensus.cc:1685] finished
0709 13:18:04.812210 (+  3957us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:04.812366 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6787,"prepare.queue_time_us":288593,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":7712,"raft.queue_time_us":35720,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":7546,"spinlock_wait_cycles":93807488,"thread_start_us":327925,"threads_started":2,"wal-append.queue_time_us":239504}
I20260709 13:18:04.821338  3204 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:04.822214  3177 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:04.821929  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:04.823657  3128 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:04.820571  9077 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:04.826248  9077 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.826562  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:04.827472  3203 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:18:04.826272  9072 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:04.828823  9072 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.829214  9072 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:04.833859  9007 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:04.840864  8592 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:04.834419  9075 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:18:04.844267  8956 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:04.826680  9077 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.813632  8974 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:04.850256  3206 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:04.855419  3834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 1224) took 1022 ms. Trace:
I20260709 13:18:04.855984  3834 rpcz_store.cc:276] 0709 13:18:03.833114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.833277 (+   163us) service_pool.cc:224] Handling call
0709 13:18:03.833644 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:04.225782 (+392138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.855071 (+629289us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b540055f854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:04.855322 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863204608}
I20260709 13:18:04.861349  3100 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:04.871387  3100 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:04.877393  9076 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:04.877888  3208 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:18:04.878283  3208 pending_rounds.cc:85] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 6
I20260709 13:18:04.878489  3208 pending_rounds.cc:107] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:18:04.878705  3208 raft_consensus.cc:2889] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:04.880191  9068 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:04.881040  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:04.883242  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:18:04.885797  9046 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.352s	user 0.002s	sys 0.000s
W20260709 13:18:04.893025  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 436843us
I20260709 13:18:04.892134  3210 raft_consensus.cc:2955] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 6 to 11, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:04.894114  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:04.894867  8961 raft_consensus.cc:2764] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:18:04.905453  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:04.906401  3203 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 11.
I20260709 13:18:04.896615  8950 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:04.911371  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.911571  8950 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:04.901620  8991 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:04.914108  8950 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:04.917165  8991 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:04.919778  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.921689  8913 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:04.922254  8913 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:04.924660  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:04.924980  9074 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:04.925547  9074 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:04.926060  9074 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.926865  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:04.928017  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:04.928710  3202 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:04.925997  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:04.931145  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3261) took 1060 ms. Trace:
I20260709 13:18:04.931562  3284 rpcz_store.cc:276] 0709 13:18:03.870676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.870920 (+   244us) service_pool.cc:224] Handling call
0709 13:18:03.871271 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:03.871701 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.871731 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:03.872461 (+   730us) log.cc:844] Serialized 52 byte log entry
0709 13:18:04.181711 (+309250us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:04.412650 (+230939us) log.cc:844] Serialized 14 byte log entry
0709 13:18:04.930573 (+517923us) log.cc:844] Serialized 14 byte log entry
0709 13:18:04.930802 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.930875 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:04.930910 (+    35us) raft_consensus.cc:1685] finished
0709 13:18:04.930921 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:04.931064 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":481753,"prepare.queue_time_us":115153,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":370,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":50,"thread_start_us":481468,"threads_started":2,"wal-append.queue_time_us":363498}
I20260709 13:18:04.844872  9058 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:04.926890  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:04.877894  9076 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.897171  8974 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:04.958217  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:04.958720  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:04.959054  3280 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:04.959430  3277 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.959859  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:04.960422  3278 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.963399  3284 raft_consensus.cc:1240] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17. Ops: [14.9-16.10]
I20260709 13:18:04.964915  3283 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:04.968832  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:04.960687  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:04.972718  3277 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:18:04.982722  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:04.983232  8913 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:04.983408  3285 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.968408  8864 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.984143  8864 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:04.984274  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:04.985662  9057 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:04.982722  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:04.987488  3279 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:04.993505  3211 raft_consensus.cc:1240] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:04.994282  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:04.953130  9076 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:04.919801  8991 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:05.009629  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:05.006717  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 79902.3us
I20260709 13:18:05.010596  3250 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:05.013645  8683 raft_consensus.cc:2764] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:18:05.024101  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 63542us
I20260709 13:18:04.986286  8864 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:05.023759  3205 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:18:05.002184  8993 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.030529  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.031987  3209 raft_consensus.cc:2393] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 18: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:05.009778  8783 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.040699  3278 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
W20260709 13:18:05.030131  3176 connection.cc:256] RPC call timeout handler was delayed by -1.2889007510000283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
I20260709 13:18:05.031075  8361 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:05.039805  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.042487  3280 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
W20260709 13:18:05.042621  3176 connection.cc:256] RPC call timeout handler was delayed by -1.0117007510000349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
I20260709 13:18:05.043016  3206 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:18:05.048197  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.048856  3206 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:18:04.986268  9057 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:05.063438  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.030267  9032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40280 (request call id 4) took 2337 ms. Trace:
I20260709 13:18:05.069772  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.058141  8683 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.059334  9014 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:05.060094  8913 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:05.066377  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.067847  3285 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:18:05.053068  3206 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:05.057547  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 47040.9us
I20260709 13:18:05.052760  8361 raft_consensus.cc:697] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:05.070729  3207 raft_consensus.cc:2368] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 20. Current term is 21.
I20260709 13:18:05.079536  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.082667  3251 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:05.039278  8993 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.084280  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.083745  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:05.083714  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3263) took 1209 ms. Trace:
I20260709 13:18:05.086756  3251 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:05.049190  8783 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.086973  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:05.081486  9072 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.137146  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:05.088788  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.091952  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:05.092608  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:05.098794  9057 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:05.098471  8361 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.105470  8876 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.115564  3210 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:05.118993  9058 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:05.114318  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:05.125880  8866 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.140518  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:05.131837  3282 rpcz_store.cc:276] 0709 13:18:03.874270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.874410 (+   140us) service_pool.cc:224] Handling call
0709 13:18:03.874844 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:03.909580 (+ 34736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.909611 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:03.910027 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:18:04.118653 (+208626us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:04.177146 (+ 58493us) log.cc:844] Serialized 14 byte log entry
0709 13:18:05.083382 (+906236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.083470 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:05.083512 (+    42us) raft_consensus.cc:1685] finished
0709 13:18:05.083523 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:05.083650 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":739869,"prepare.queue_time_us":118956,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":44,"raft.queue_time_us":738838,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":133,"thread_start_us":392916,"threads_started":3,"wal-append.queue_time_us":208850}
I20260709 13:18:05.126579  8777 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:05.144121  3835 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:18:05.074131  8683 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.129165  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:05.130061  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.147841  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:05.133422  3207 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:05.135783  3208 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 18: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:18:05.147236  9028 log.cc:927] Time spent T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 1.002s	user 0.007s	sys 0.000s
I20260709 13:18:05.143468  8866 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.151270  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:05.165102  3136 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:05.135017  3806 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:05.137710  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3259) took 1284 ms. Trace:
I20260709 13:18:05.170552  3209 raft_consensus.cc:2368] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 19. Current term is 20.
I20260709 13:18:05.144112  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:05.128199  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:05.145597  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:05.075654  8913 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:05.178851  3131 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:18:05.167992  3276 rpcz_store.cc:276] 0709 13:18:03.853461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.853574 (+   113us) service_pool.cc:224] Handling call
0709 13:18:03.853840 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:04.055435 (+201595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:04.055465 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:04.055974 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:18:04.096983 (+ 41009us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:04.147251 (+ 50268us) log.cc:844] Serialized 14 byte log entry
0709 13:18:04.713029 (+565778us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:18:04.896048 (+183019us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b18004943e0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b907cc0a 00007fb3c27bc219 00007fb3b9104a40 00007fb3b90ff4e4 00007fb3b90ff455 00007fb3bc1e7060 00007fb3bc1f9716 00007fb3bc20a287 00007fb3bc20a208
0709 13:18:04.987065 (+ 91017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.137290 (+150225us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54002d1254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:05.137360 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:05.137428 (+    68us) raft_consensus.cc:1685] finished
0709 13:18:05.137447 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:05.137637 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101444,"prepare.queue_time_us":59682,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":768877,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":248,"spinlock_wait_cycles":497778048,"thread_start_us":131278,"threads_started":2,"wal-append.queue_time_us":33567}
I20260709 13:18:05.174775  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:18:05.180605  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 48612us
W20260709 13:18:05.181655  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 94974.8us
I20260709 13:18:05.183694  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:05.130185  8911 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:18:05.186058  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:05.147156  9045 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:05.195679  3285 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:05.185290  8913 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:05.200212  9072 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:05.195382  9057 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:05.205644  9057 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:05.206167  9057 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:05.206230  8783 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:05.189415  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:05.189314  8720 consensus_queue.cc:1059] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:05.186232  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:05.187018  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:05.176113  8943 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:05.191804  9041 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:05.174117  9061 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.196693  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:18:05.197448  9085 log.cc:927] Time spent T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.137s	user 0.003s	sys 0.000s
I20260709 13:18:05.198064  3279 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:05.197450  8950 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.190393  3282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:05.216002  8943 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:05.068912  9032 rpcz_store.cc:276] 0709 13:18:02.667982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.764874 (+ 96892us) service_pool.cc:224] Handling call
0709 13:18:02.881123 (+116249us) log.cc:844] Serialized 494 byte log entry
0709 13:18:03.055885 (+174762us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b18001e0a00. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:18:03.498067 (+442182us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54005026a0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc164dbe 00007fb3bc16f930 00007fb3bc16f8d8 00007fb3bc16f858 00007fb3bc16f813 00007fb3bc16ea9c 00007fb3c205a626 00007fb3c2054dd8 00007fb3bc1ab7cb 00007fb3bc1ae2c0
0709 13:18:05.002797 (+1504730us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55424,"raft.queue_time_us":13080,"raft.run_cpu_time_us":1744,"raft.run_wall_time_us":81269,"spinlock_wait_cycles":317777152,"thread_start_us":50780,"threads_started":1,"wal-append.queue_time_us":134979,"wal-append.run_cpu_time_us":5805,"wal-append.run_wall_time_us":1480973}
I20260709 13:18:05.217312  9005 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:05.218011  9041 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.234869  9041 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:05.216674  9089 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.237394  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 023c1461b69c46bdb3c42ee16f303ea2 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
I20260709 13:18:05.223073  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:05.224627  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:05.238965  9074 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.237866  9089 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.239885  9002 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:05.240404  3129 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 13. Current term is 14. Ops: []
W20260709 13:18:05.241529  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 54625.1us
I20260709 13:18:05.242462  9089 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:05.242748  8950 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:05.247071  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:05.227305  9061 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:05.182111  9077 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.228912  8866 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:05.230921  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:05.231585  3282 raft_consensus.cc:606] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:05.251848  9077 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:05.252087  3134 raft_consensus.cc:2368] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15.
I20260709 13:18:05.251643  3128 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 20: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:05.227731  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:05.254458  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:05.258447  3207 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:18:05.288101  3203 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:05.258873  3127 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:18:05.232167  8683 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:05.261997  8997 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:05.262247  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:05.263585  9005 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:05.231901  8943 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:05.265157  3128 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:05.267765  3131 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:05.268772  3129 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:05.269632  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:05.301193  3132 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:05.270840  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:05.303506  3279 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:05.270972  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:05.304216  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:05.273142  8993 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:05.276116  3277 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:18:05.276837  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:05.279301  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:05.307142  3281 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:18:05.280357  3285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c414d51e428042c596cb410c48956c63"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
W20260709 13:18:05.281937  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 66534.1us
I20260709 13:18:05.282049  9051 consensus_queue.cc:1059] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:05.281692  9074 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:05.282891  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:05.283228  3206 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:18:05.284399  3278 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:05.292586  8720 raft_consensus.cc:3055] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:05.315061  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.315857  3207 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:05.292704  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.316929  3209 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:05.294636  3135 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:05.295390  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:05.308441  3100 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:05.309381  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:05.312637  3805 leader_election.cc:400] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 20. Current term is 21.
I20260709 13:18:05.319819  3805 leader_election.cc:403] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:05.317921  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:05.143572  8876 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.317658  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:05.325336  3176 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:05.314255  8720 raft_consensus.cc:740] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:05.366911  3282 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:05.280768  9057 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.370965  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:05.382176  3835 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:05.371861  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 54017.7us
I20260709 13:18:05.374527  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:05.326668  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:05.379132  3278 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:05.326131  3033 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55102 (request call id 140) took 3744 ms. Trace:
W20260709 13:18:05.380102  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 54902.2us
I20260709 13:18:05.390092  3281 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:05.298748  9045 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.390952  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:05.380733  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 68188.1us
I20260709 13:18:05.380617  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:05.392323  3805 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:05.400497  3835 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:18:05.299064  9016 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:18:05.404825  3133 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
W20260709 13:18:05.405529  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 97167us
I20260709 13:18:05.326292  8864 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:05.323187  9058 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:05.413470  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.414115  3206 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:18:05.366740  8683 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.422662  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:05.430331  3211 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:05.423229  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:05.390542  3033 rpcz_store.cc:276] 0709 13:18:01.570536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.570873 (+   337us) service_pool.cc:224] Handling call
0709 13:18:05.314600 (+3743727us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:03.546998 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:03.547806 (+   808us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:03.547863 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:18:03.547880 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:03.771710 (+223830us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:03.771807 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:03.771832 (+    25us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:18:03.777235 (+  5403us) tablet.cc:701] Row locks acquired
0709 13:18:03.777279 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:18:03.777467 (+   188us) write_op.cc:270] Start()
0709 13:18:03.777625 (+   158us) write_op.cc:276] Timestamp: P: 1783603083777392 usec, L: 0
0709 13:18:03.777647 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:18:03.778554 (+   907us) log.cc:844] Serialized 5094 byte log entry
0709 13:18:04.356548 (+577994us) op_driver.cc:464] REPLICATION: finished
0709 13:18:04.617505 (+260957us) write_op.cc:301] APPLY: starting
0709 13:18:04.617594 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:04.840596 (+223002us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:04.840724 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:05.205265 (+364541us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:05.205562 (+   297us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:18:05.205619 (+    57us) write_op.cc:312] APPLY: finished
0709 13:18:05.207015 (+  1396us) log.cc:844] Serialized 121 byte log entry
0709 13:18:05.207207 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:05.207392 (+   185us) write_op.cc:454] Released schema lock
0709 13:18:05.207452 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:05.233028 (+ 25576us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:05.233065 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":275457,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":259188,"apply.run_cpu_time_us":25540,"apply.run_wall_time_us":599157,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58571,"num_ops":13,"prepare.queue_time_us":85862,"prepare.run_cpu_time_us":20653,"prepare.run_wall_time_us":328895,"raft.queue_time_us":200486,"raft.run_cpu_time_us":56903,"raft.run_wall_time_us":267508,"replication_time_us":505742,"thread_start_us":368935,"threads_started":4,"wal-append.queue_time_us":166057}]]}
I20260709 13:18:05.423877  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.313478  9072 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:18:05.393333  8361 raft_consensus.cc:2764] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:18:05.393096  8974 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:05.448532  3279 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:05.300269  9076 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:05.450662  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 46264.8us
W20260709 13:18:05.451793  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 80173us
I20260709 13:18:05.412931  8992 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:05.411928  8783 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 20. Current term is 21.
I20260709 13:18:05.425005  8961 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:05.409403  9005 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:05.499451  9058 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:05.500200  9058 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.501201  9091 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:05.447779  8683 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.501797  9091 raft_consensus.cc:697] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:05.502743  9091 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.503921  8683 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:05.486204  8720 consensus_queue.cc:260] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.506614  8720 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:05.447165  8864 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.509965  8913 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.511816  8864 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:05.512607  8913 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:05.515691  8872 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:05.534049  9076 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:05.515944  3250 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:05.535840  3250 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:05.536765  9051 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.537417  9068 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.450227  8982 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:05.537827  9057 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:05.538512  9057 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.538625  8874 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:05.539222  9001 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.539731  9001 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.537957  9068 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.541302  8988 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:05.537433  9051 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.541850  8988 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.543237  8876 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:05.543731  9051 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:05.522826  3280 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:05.524178  3131 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:05.524888  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:05.524894  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:05.516647  8361 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:05.527784  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:05.528606  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:05.531279  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:05.538283  8982 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.517624  9067 raft_consensus.cc:3055] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:18:05.521759  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 111894us
I20260709 13:18:05.549883  3134 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 20: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:05.556641  3285 raft_consensus.cc:606] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:05.557205  3285 raft_consensus.cc:614] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:05.451119  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:05.407969  9045 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.561698  9045 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:05.562572  8982 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:05.566059  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.490192  8992 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.550457  3135 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:05.451342  9003 consensus_queue.cc:1059] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 13:18:05.537707  9049 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.557907  3211 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:18:05.577008  3204 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:18:05.584220  3204 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:05.539167  8874 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.496832  9005 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:05.585014  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.585415  8874 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:05.576359  3210 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 20: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:05.592311  8874 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.595206  8874 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:05.594916  9058 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:05.539088  9057 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.535866  9016 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:05.600656  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 208392us
I20260709 13:18:05.601786  3805 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:05.544024  8988 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:05.612387  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.620267  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:05.451119  9041 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.575774  8876 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:05.451872  9002 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:05.556280  9067 raft_consensus.cc:740] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:05.632650  3805 leader_election.cc:400] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 19. Current term is 20.
I20260709 13:18:05.583151  8992 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:05.650398  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:05.651216  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 165141us
I20260709 13:18:05.651580  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:05.655166  3202 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:05.651239  3837 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 22.
I20260709 13:18:05.654650  3101 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:05.608685  9016 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.661768  3136 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 13: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:05.647245  8876 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:05.667874  8876 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:05.657984  9002 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:05.669922  9002 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.672101  9002 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:05.672812  8629 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:05.673636  9074 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:05.673816  3101 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:05.674101  9074 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.645503  8783 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:05.674616  9074 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:05.674923  8783 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.675190  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:05.662357  9016 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:05.677260  9076 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:05.677668  9032 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:05.677800  9076 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:05.678223  9032 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:05.678879  9076 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.679194  9032 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.681633  9005 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.657836  9099 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:05.686264  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:05.687917  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:05.691326  3278 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:05.688045  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.692276  3205 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:05.690217  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:05.693688  3135 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:05.693637  3101 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:05.691434  3282 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 22.
I20260709 13:18:05.694507  8777 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:05.696647  9001 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:05.697377  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:05.699011  9057 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:05.696904  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:05.596822  8874 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.632788  9049 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.677039  8783 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:05.704134  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:05.704854  3205 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:05.683043  9067 consensus_queue.cc:260] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.660889  9051 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:18:05.701879  9061 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:05.713840  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 322967us
I20260709 13:18:05.714975  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:05.696885  8777 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.723846  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:05.726025  3250 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:05.724540  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:05.736930  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:05.738752  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:05.707644  8874 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.743739  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:05.718294  9061 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.702821  9099 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:18:05.747397  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:05.754001  3127 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:05.746348  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:05.741282  9041 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:05.738489  9006 raft_consensus.cc:2764] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:18:05.763360  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 126426us
I20260709 13:18:05.740952  8974 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:05.734292  9104 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:18:05.769114  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 117173us
I20260709 13:18:05.771216  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:05.750803  9058 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:05.786903  3133 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 22.
I20260709 13:18:05.758683  9061 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:05.789842  3205 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:05.791798  9104 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 18 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:05.808478  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:05.793166  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.818228  3133 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:05.818698  3205 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:18:05.820261  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.822970  3842 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:18:05.789535  8974 raft_consensus.cc:697] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:05.800601  8874 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:05.798628  8777 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:05.797298  8783 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:05.844846  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.792397  9102 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:05.810338  9068 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:05.805739  9103 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:05.846652  9049 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:05.811188  9099 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:18:05.884192  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:18:05.884528  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 71070us
I20260709 13:18:05.863862  9102 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.891013  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.825069  9074 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.891673  3205 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
W20260709 13:18:05.907558  9107 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:18:05.910533  3203 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:05.910943  9016 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.914626  9074 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:05.914976  8974 consensus_queue.cc:237] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.916455  9061 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:05.919652  8997 consensus_meta.cc:287] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.626s	user 0.006s	sys 0.006s
I20260709 13:18:05.920153  8997 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:05.864890  8783 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.931315  8783 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:05.803483  9104 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:05.890247  9102 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:05.936977  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 106908us
I20260709 13:18:05.939139  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:05.949491  3203 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:05.949342  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:05.950592  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:05.951789  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:05.953284  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:05.953824  3836 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 22.
I20260709 13:18:05.946758  9089 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
W20260709 13:18:05.941915  8943 consensus_meta.cc:287] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.000s
I20260709 13:18:05.959864  3251 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:05.966598  3838 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:05.972767  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.973793  3210 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:18:05.974436  9032 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:05.977432  9032 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:05.979996  9032 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:05.983970  3100 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:05.950271  9016 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:05.988663  3100 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:05.990123  3100 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:05.951537  9061 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:05.991209  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 106029us
I20260709 13:18:05.998603  3100 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:06.002398  3285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:05.990031  9001 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:05.991453  9074 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:06.015581  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:05.991878  9032 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:05.989953  9014 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:06.017606  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:05.995561  8993 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:05.962013  8943 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.004017  9068 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:05.988334  8876 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.017952  9001 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.995041  9018 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:18:05.952414  9117 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.087s
I20260709 13:18:06.041381  9001 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:06.025317  9074 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 20 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:18:06.045898  9095 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.545s	user 0.005s	sys 0.000s
I20260709 13:18:06.045773  9074 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:06.049038  9114 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:18:06.051822  3276 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:05.893543  9100 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.142s
I20260709 13:18:06.052480  8876 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:06.074513  8992 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.026513  8993 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.075260  8943 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:06.031977  9068 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.881471  9103 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.075619  8993 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:06.077407  9068 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:06.031870  9014 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.078941  9103 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:06.082290  3285 raft_consensus.cc:606] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:06.082695  3285 raft_consensus.cc:614] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:06.084090  3131 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:18:06.076880  8992 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:06.086793  9014 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:06.089449  3834 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:06.092314  9102 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.059079  9032 raft_consensus.cc:697] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:06.098765  9102 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:06.099892  9032 consensus_queue.cc:237] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:06.101537  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 45312us
I20260709 13:18:06.107954  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:06.108569  3838 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:06.109637  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:06.113456  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:06.115355  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:06.116681  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:06.118257  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:06.118628  3838 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:18:06.119764  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:06.122397  3102 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:06.123648  8720 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:06.124703  9102 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.126216  9001 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:06.129261  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 66960.1us
I20260709 13:18:06.130741  3102 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:06.131959  3834 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:06.138906  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:06.139696  3204 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:06.125789  9102 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.140471  3102 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:06.149482  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:06.150782  3102 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:06.152652  3102 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:06.198701  3204 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:06.136724  9051 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:18:06.146339  8961 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.014s	sys 0.028s
W20260709 13:18:06.206847  8961 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.014s	sys 0.028s
I20260709 13:18:06.210055  8961 raft_consensus.cc:697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:06.152206  9076 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:06.190119  8955 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:06.205336  8866 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:18:06.231721  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 79122.4us
I20260709 13:18:06.217377  9076 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.235180  8866 raft_consensus.cc:697] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:06.241582  8866 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.228029  9001 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:06.244725  9076 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:06.223551  8961 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.226183  9068 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.234818  8993 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.261664  3134 raft_consensus.cc:2368] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17.
I20260709 13:18:06.284207  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 924) took 1004 ms. Trace:
I20260709 13:18:06.288532  9102 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:06.255625  9068 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:06.258663  8993 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:06.301051  9076 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.301129  9007 raft_consensus.cc:3055] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:06.304174  9007 raft_consensus.cc:740] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:06.305857  9076 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:06.305270  9007 consensus_queue.cc:260] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.306659  9007 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.314366  3176 leader_election.cc:400] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15.
I20260709 13:18:06.314750  3176 leader_election.cc:403] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:18:06.315505  9102 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15.
I20260709 13:18:06.323091  9102 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:06.298117  3834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54908 (request call id 857) took 1022 ms. Trace:
I20260709 13:18:06.325196  3176 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:06.325266  8997 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:06.326354  9122 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:06.326820  8997 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:06.327749  8997 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.328766  8997 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:06.325742  3834 rpcz_store.cc:276] 0709 13:18:05.276149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.276534 (+   385us) service_pool.cc:224] Handling call
0709 13:18:06.297843 (+1021309us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b54004e39d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:06.298028 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799579904}
W20260709 13:18:06.335286  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 302892us
I20260709 13:18:06.284756  3283 rpcz_store.cc:276] 0709 13:18:05.280078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.280988 (+   910us) service_pool.cc:224] Handling call
0709 13:18:05.281313 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.294712 (+ 13399us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:05.325361 (+ 30649us) log.cc:844] Serialized 14 byte log entry
0709 13:18:05.407151 (+ 81790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:05.407226 (+    75us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:05.407297 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.526647 (+119350us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b1800408820. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:18:06.283851 (+757204us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b54002f85d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:06.283939 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.284125 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12214,"prepare.queue_time_us":30956,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":11879,"raft.queue_time_us":30267,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":49636864,"thread_start_us":69112,"threads_started":1,"wal-append.queue_time_us":232266}
I20260709 13:18:06.346081  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:06.357750  9122 consensus_queue.cc:1059] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:18:06.370016  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:06.370958  3838 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:06.360023  9003 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:06.389065  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:06.409816  3838 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 23.
I20260709 13:18:06.413691  3251 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:06.410229  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:18:06.415529  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 69569.7us
I20260709 13:18:06.416026  3832 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 23: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:06.418870  3128 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:06.420928  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:06.435739  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:06.412385  9104 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:06.394495  9003 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.444155  3129 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:06.445007  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:06.449503  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:06.450250  3211 raft_consensus.cc:2368] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 19. Current term is 20.
I20260709 13:18:06.430087  9018 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:06.452917  3207 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:06.432896  9117 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
W20260709 13:18:06.465826  9126 log.cc:927] Time spent T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:18:06.455951  9120 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:06.468984  9003 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:06.462417  9018 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 23 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:06.471387  9104 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:06.471689  9018 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.480377  3283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:06.481304  3283 raft_consensus.cc:606] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:06.481729  3283 raft_consensus.cc:614] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:06.489589  3805 leader_election.cc:400] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 19. Current term is 20.
I20260709 13:18:06.490002  3805 leader_election.cc:403] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:18:06.491757  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:06.446842  8961 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:06.499219  9120 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 19. Current term is 20.
I20260709 13:18:06.499445  8974 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:18:06.495157  9003 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:06.516929  9003 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.519295  9003 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:06.529127  3250 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:06.532451  3211 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:18:06.532927  3806 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:06.536626  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.582553  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 44802us
W20260709 13:18:06.583822  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 50988.7us
I20260709 13:18:06.587634  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:06.589725  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:06.597019  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:06.618161  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 89139.6us
I20260709 13:18:06.623441  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:06.632769  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.588608  9104 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:06.646330  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:06.624812  9120 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:06.647549  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:06.648104  3130 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:06.649878  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:06.650015  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:06.651046  3133 raft_consensus.cc:2368] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 19. Current term is 20.
I20260709 13:18:06.652225  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:06.652107  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:06.637382  8361 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:18:06.653438  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:06.526748  8961 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.618297  9117 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:18:06.637669  9014 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:06.655202  3806 leader_election.cc:400] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 19. Current term is 20.
I20260709 13:18:06.637676  9139 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:06.659188  3133 raft_consensus.cc:2393] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 19: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:06.640552  9138 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.640964  8720 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:06.689479  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:06.690699  9120 raft_consensus.cc:3055] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:06.691175  9120 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:06.692107  9120 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.693054  9120 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:06.698638  3130 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:06.659512  9103 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:06.650094  8992 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:06.701617  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:06.681778  8997 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:06.714097  8997 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.716346  8997 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:06.685683  9014 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.718215  9014 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:06.700181  9138 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.722596  9106 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:06.723801  9138 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:06.723490  9106 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.727293  9106 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:06.727780  9005 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:06.695116  9139 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.730386  9139 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:06.709889  9099 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:06.732925  8961 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:06.706246  9001 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:06.733634  9001 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:06.734495  9001 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.735410  9058 raft_consensus.cc:3055] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:06.735751  9001 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:06.736094  9058 raft_consensus.cc:740] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:06.651928  9104 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.710312  3128 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 23: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:06.728070  9106 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:06.742607  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.749393  3249 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:06.751309  3249 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:06.753757  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:06.760349  3249 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:06.762511  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:06.738070  8992 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.758255  8361 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:18:06.766826  8861 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:06.767462  8861 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.767812  8361 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:06.768599  8361 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:06.769671  9068 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:06.770254  9068 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.747577  9058 consensus_queue.cc:260] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.772138  9058 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.772516  9068 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:06.775120  9104 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:06.759253  8991 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:06.776214  8991 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:06.776732  8991 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:06.777868  9147 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:18:06.779276  8991 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:06.783414  8361 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:06.784147  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:06.745882  9106 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.790351  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:06.791344  9143 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:18:06.791877  3128 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19. Ops: []
W20260709 13:18:06.792062  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.798611  9006 raft_consensus.cc:993] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
W20260709 13:18:06.798759  9101 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 1.101s	user 0.004s	sys 0.000s
I20260709 13:18:06.799176  9006 raft_consensus.cc:1081] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:18:06.800343  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 801) took 1486 ms. Trace:
I20260709 13:18:06.800734  3132 rpcz_store.cc:276] 0709 13:18:05.313790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.313947 (+   157us) service_pool.cc:224] Handling call
0709 13:18:05.326854 (+ 12907us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.327306 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.327345 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.367476 (+ 40131us) log.cc:844] Serialized 26 byte log entry
0709 13:18:05.558662 (+191186us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:05.558733 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.558831 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:06.798190 (+1239359us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:18:06.800049 (+  1859us) raft_consensus.cc:1685] finished
0709 13:18:06.800071 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.800284 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75630,"raft.queue_time_us":38641,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":24954,"spinlock_wait_cycles":4446976,"thread_start_us":117220,"threads_started":1,"wal-append.queue_time_us":289050}
I20260709 13:18:06.807024  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 2367) took 1078 ms. Trace:
I20260709 13:18:06.807490  3131 rpcz_store.cc:276] 0709 13:18:05.728338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.801635 (+ 73297us) service_pool.cc:224] Handling call
0709 13:18:05.802005 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:06.084491 (+282486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.806706 (+722215us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54002dad54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:06.806939 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648183168}
I20260709 13:18:06.810837  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1943) took 1502 ms. Trace:
I20260709 13:18:06.811264  3276 rpcz_store.cc:276] 0709 13:18:05.308397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.308543 (+   146us) service_pool.cc:224] Handling call
0709 13:18:06.051624 (+743081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.052312 (+   688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.810620 (+758308us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b5400177fd0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:06.810772 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708135808}
I20260709 13:18:06.811826  9106 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:06.813045  9145 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:06.815193  8955 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:06.815749  8955 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.817952  8955 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:06.817719  3034 catalog_manager.cc:5697] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 8 to 10, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 10 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.819507  9007 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:18:06.794498  9124 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.399s	user 0.004s	sys 0.007s
I20260709 13:18:06.780894  8861 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:06.789747  9068 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:06.827755  9106 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:18:06.825886  9068 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.821987  9007 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.793808  8361 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.874316  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:06.827135  3034 catalog_manager.cc:5697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
W20260709 13:18:06.879542  3206 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 3695) took 1461 ms (client timeout 1679 ms). Trace:
I20260709 13:18:06.877666  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:06.888022  3206 rpcz_store.cc:269] 0709 13:18:05.421067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.423660 (+  2593us) service_pool.cc:224] Handling call
0709 13:18:06.874745 (+1451085us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b5400189a54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:06.874873 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2237572352}
I20260709 13:18:06.877295  3202 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:06.889003  3211 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 17: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:06.882120  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:06.889952  3203 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
W20260709 13:18:06.876860  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.885174  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:06.891284  3208 raft_consensus.cc:3060] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:18:06.886381  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:06.876377  9106 consensus_queue.cc:1243] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:06.894116  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:06.896745  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:06.901785  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:06.903358  3276 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19. Ops: [16.11-18.12]
I20260709 13:18:06.897213  9005 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.904522  9005 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.906886  9005 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:06.906539  3034 catalog_manager.cc:5697] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 6 to 8, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 8 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:06.898974  8874 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:06.903380  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:06.904016  8992 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:06.918634  3208 raft_consensus.cc:2468] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:06.910463  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:06.913132  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:06.921484  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:06.913786  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:06.915177  3282 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:06.917105  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:06.917812  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:06.899883  9149 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:06.909557  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:06.895725  9103 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:06.930339  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:06.925019  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:06.931016  3276 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:06.931278  3285 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:06.931911  3281 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:06.933852  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:06.934752  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:06.936611  9141 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:06.937305  9141 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:06.939525  9068 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:06.920853  8874 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:06.948874  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.949726  9106 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:06.950310  9106 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.951751  9103 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.952368  9106 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:06.953198  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:06.954260  9103 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:06.954523  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:06.955901  9007 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:06.918584  3206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34342
I20260709 13:18:06.957472  3206 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:06.957832  3206 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:06.959758  8361 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:06.960477  9149 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:06.962987  9149 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:06.967489  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:06.902655  9006 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:06.970676  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:06.980050  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:06.977028  3206 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:06.983091  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:06.981258  3135 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:06.985615  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:06.943076  8874 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:06.991551  3176 leader_election.cc:400] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17.
I20260709 13:18:06.991993  3176 leader_election.cc:403] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:06.994076  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.001964  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:07.002467  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.003701  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.004303  9014 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.004817  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.006598  9014 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:07.009171  3278 raft_consensus.cc:2368] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17.
I20260709 13:18:07.010761  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.012938  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:07.015393  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.020532  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:07.021615  3281 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:07.029587  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.029899  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:07.029898  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:07.030799  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.012457  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.030813  3281 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:07.035000  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:07.035462  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:07.035939  3281 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.038497  3202 pending_rounds.cc:85] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 10
I20260709 13:18:07.038949  3202 pending_rounds.cc:107] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:18:07.039232  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:07.039966  3276 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:07.039263  3202 raft_consensus.cc:2889] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:07.021152  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:07.037170  9067 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:07.059422  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:07.041647  3132 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 17: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:07.061029  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:07.071642  3249 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.074378  9106 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:07.075207  9106 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:07.074285  3806 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:07.078186  9118 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:07.079136  8874 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:07.079731  8874 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:07.083761  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:07.011987  9058 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:18:07.091318  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:07.091977  3283 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:07.089468  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 68422.6us
I20260709 13:18:07.089589  8961 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:07.089854  9098 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 1.443s	user 0.007s	sys 0.007s
I20260709 13:18:06.988989  9006 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.094009  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:07.059013  9138 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:07.097275  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:07.042196  9103 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.099295  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:07.101366  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.103871  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:07.108094  3283 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:07.128659  3249 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.130959  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:07.132543  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.094110  8961 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:07.143276  3281 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:07.103184  8974 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:07.145349  3276 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:07.136456  3249 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:07.153561  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.158344  3250 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.157922  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:07.162223  3281 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:07.130142  9051 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:07.130023  9001 raft_consensus.cc:2764] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:18:07.168457  3806 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.100402  8874 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:07.169624  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:07.173430  3285 raft_consensus.cc:3055] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:07.173760  3285 raft_consensus.cc:740] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:07.174568  3285 consensus_queue.cc:260] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:07.175544  3806 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.176350  9099 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:07.177335  3806 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.178304  9117 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:07.178521  9099 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:07.175756  3285 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:07.180262  9117 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:07.180783  9117 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:07.135691  8991 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:07.138023  8961 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:07.138936  9005 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:07.138378  9058 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:07.127928  9103 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:07.192267  3276 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:07.193784  9139 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:07.202298  3283 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:07.202702  3285 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:18:07.186730  9148 raft_consensus.cc:2804] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:07.186421  9007 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:07.209244  9139 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:07.220471  9158 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:18:07.219988  9139 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:07.196805  9014 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:07.170565  8974 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.249366  9148 raft_consensus.cc:697] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:07.258553  9148 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:07.264447  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 78858.4us
W20260709 13:18:07.252857  9160 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:18:07.298642  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.302237  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 146875us
I20260709 13:18:07.309494  3279 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:18:07.313302  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 47396.2us
I20260709 13:18:07.314971  9006 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:07.320853  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.326344  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:07.319608  9156 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:18:07.334378  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 242779us
I20260709 13:18:07.335390  9149 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:07.337357  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:07.338347  8720 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:07.338900  8720 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:07.339833  8720 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:07.345961  9006 consensus_queue.cc:1059] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:07.346964  9164 raft_consensus.cc:3055] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:07.347348  9164 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:07.348183  9164 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.350168  9164 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.357858  9117 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:07.358315  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.359571  9103 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:07.360354  3250 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.362704  9169 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:07.364440  3128 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:18:07.364905  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.364989  9010 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.365759  9169 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:07.365721  9010 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:07.367424  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:07.367535  3250 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.368398  9169 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:07.368428  9155 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:18:07.368798  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:07.371273  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.371899  9169 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:07.372422  9169 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:07.367909  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:07.374706  9169 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:07.375240  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.375473  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:07.365897  8974 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:07.359614  9149 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:07.378230  9014 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:07.378798  9014 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.381852  3282 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:07.382978  9014 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:07.386744  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.387496  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.387619  3127 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:18:07.392045  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:07.392634  3204 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:07.394518  3177 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.395581  9169 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:07.397434  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.397899  8997 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:07.398461  8997 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:07.398646  8961 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.399266  3210 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:07.399864  3206 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:07.399696  8997 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:07.398543  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.404789  3209 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:18:07.405246  3209 pending_rounds.cc:85] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 11
I20260709 13:18:07.406322  3209 pending_rounds.cc:107] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:18:07.410324  3209 raft_consensus.cc:2889] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:07.410414  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:07.411109  3841 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:07.413362  3204 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:07.406652  3177 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:07.414849  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.415113  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:07.415638  3210 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:07.414578  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.416500  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.417431  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.417624  3249 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.417130  3210 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:18:07.419607  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.405736  9163 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:07.405932  9167 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:07.421342  3177 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:07.426102  9163 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.440435  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.426367  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.428900  3832 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:07.430826  3841 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:18:07.432679  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.449630  3209 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 13: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:07.436930  3133 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:18:07.431123  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.438915  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.452775  9014 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:07.454101  3249 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.425266  9171 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:07.452005  9108 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:07.457747  9108 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:07.458453  9014 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:07.459112  9014 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:07.459653  9014 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.460072  9108 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:07.456724  8974 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:07.423735  8777 consensus_queue.cc:1059] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:18:07.464977  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:07.467974  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:07.470080  3100 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:07.468945  3177 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:07.444597  9148 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:07.475090  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:07.475961  3277 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:18:07.484359  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:07.484251  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.421902  8961 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:07.488588  3205 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:18:07.479976  9148 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:07.491384  3277 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:07.488472  3249 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.494002  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:07.494169  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:07.495744  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:07.498601  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:07.498669  3280 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:18:07.499612  3280 pending_rounds.cc:85] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 11
I20260709 13:18:07.499845  3280 pending_rounds.cc:107] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:18:07.500088  3280 raft_consensus.cc:2889] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:07.506551  3841 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:18:07.507792  9067 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:07.508522  3101 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:07.509333  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.510242  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:07.485011  8974 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:18:07.518783  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 53559.9us
I20260709 13:18:07.522132  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:07.525060  3101 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:07.527500  9073 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:07.509042  9148 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:07.548045  9122 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:07.548496  9122 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:07.550019  3202 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:07.536659  9164 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.553588  9164 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.555807  9164 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:07.518263  9138 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17.
I20260709 13:18:07.488023  9103 consensus_queue.cc:1059] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:18:07.557291  9103 raft_consensus.cc:3055] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:07.508565  9161 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.542229  8955 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:07.531666  9067 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:18:07.490294  8866 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:18:07.451828  9167 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.557638  9103 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:18:07.569547  9174 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:18:07.586024  9103 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:07.587785  9103 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:07.588011  9130 raft_consensus.cc:3055] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:07.588502  9130 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:07.590898  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:07.590919  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.592789  9130 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.594105  9130 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:07.559494  9169 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:07.597645  3206 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:07.531895  8974 raft_consensus.cc:697] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:18:07.607093  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 82122.8us
I20260709 13:18:07.607904  3101 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:07.601858  9068 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:07.609558  9068 raft_consensus.cc:697] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:18:07.609804  9173 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:18:07.610644  9068 consensus_queue.cc:237] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.613236  9163 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:07.614427  9167 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:07.615088  9149 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:07.560735  9161 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:07.617580  3251 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.599073  9099 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.627794  9099 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:07.629065  9161 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:07.629711  9161 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.596820  8955 raft_consensus.cc:697] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:07.630164  9161 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.631017  8955 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.632467  9161 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:07.620046  9077 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:07.633333  9077 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:07.633699  9148 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.634225  9077 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.635871  9148 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:07.636965  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.599185  9122 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.625247  8777 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:07.639701  9122 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:07.643574  9010 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:07.649645  9099 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:07.651644  9017 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:07.654167  9058 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:07.654757  9058 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.658564  3249 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:18:07.662276  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 53332us
I20260709 13:18:07.623183  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:07.673884  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:07.674674  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:07.675446  3281 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:18:07.677340  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:07.680166  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 57052.8us
I20260709 13:18:07.681389  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:07.683653  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:07.684039  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:07.686816  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:07.687929  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 64542.7us
I20260709 13:18:07.690047  3204 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:07.688238  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 218223us
I20260709 13:18:07.675312  8361 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:07.697842  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:07.701326  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:07.702008  3841 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:18:07.682466  9067 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:07.686259  9061 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:07.708026  3204 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:07.705552  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.685791  8866 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:07.690552  9058 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:07.690670  9161 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.695111  8777 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:07.724895  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.690927  9010 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:18:07.762591  3249 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.732698  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.735291  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:07.724749  9161 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:07.726729  9058 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:07.758555  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:07.768765  3837 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 13: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:07.705349  8991 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:18:07.722020  9067 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:07.773237  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.776719  9169 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:07.777325  9169 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:07.777834  9169 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:07.781760  9149 raft_consensus.cc:3055] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:07.782226  9149 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:07.783066  9149 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.784507  9149 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:07.775467  9058 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.790822  3203 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:18:07.795466  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.715968  8974 consensus_queue.cc:237] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:07.785921  9181 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:18:07.810595  8991 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:07.794274  9077 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:18:07.843894  3202 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:07.853266  9167 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:07.851953  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 141876us
I20260709 13:18:07.853856  9167 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:07.854702  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.855291  3136 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:18:07.855988  9167 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:07.857523  9187 log.cc:927] Time spent T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:18:07.858134  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.861406  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.862012  3130 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:07.865427  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.865927  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.864989  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.868574  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.866017  3207 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:18:07.870153  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:07.870838  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:07.870749  3205 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:07.876585  3806 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:07.879091  9058 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:07.880631  8997 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:07.880805  9014 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:07.886987  9014 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:07.874536  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.889705  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:07.898792  3806 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:07.906755  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:07.908686  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.910043  3176 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:07.849721  8991 raft_consensus.cc:697] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:18:07.917613  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 66404us
I20260709 13:18:07.921238  3176 leader_election.cc:400] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17.
I20260709 13:18:07.923811  3250 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.926353  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.906698  9002 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:07.924836  9103 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:07.932273  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:07.912612  9058 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:07.917418  9118 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.935578  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.920512  8997 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:07.949397  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.927794  8974 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:07.950701  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.964524  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:07.922876  9171 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:18:07.968631  3100 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:07.938781  9002 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:07.942668  9103 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.942317  9122 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:07.975755  3205 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:07.977993  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:07.983901  3805 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:07.929230  8874 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:18:07.930578  9141 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:18:07.949470  9165 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:07.990772  9103 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:07.991258  9002 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:07.957090  9166 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:07.957050  8961 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:07.961580  9058 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:18:08.028024  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 61925.4us
I20260709 13:18:07.990775  9108 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:07.950562  9118 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:08.041642  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:08.044190  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 55493.7us
I20260709 13:18:08.046880  3100 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:18:08.048768  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 111265us
I20260709 13:18:08.023495  8961 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:08.051143  3205 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:18:08.054374  9118 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:08.057680  9195 log.cc:927] Time spent T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:08.058172  9161 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:08.059768  8876 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:08.060189  8876 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.060552  8876 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.038040  8993 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:08.032441  9169 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:08.064206  9108 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:08.064430  9169 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:08.064752  9108 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:08.065178  9108 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:08.069939  9193 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 13:18:08.013129  8991 consensus_queue.cc:237] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:08.080771  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:08.082544  3833 raft_consensus.cc:2410] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:18:08.082409  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:08.065197  3284 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 11. Current term is 12. Ops: []
W20260709 13:18:08.085419  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 127844us
I20260709 13:18:08.086424  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:08.087389  3837 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:18:08.090886  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 146777us
I20260709 13:18:08.107591  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:08.096369  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:08.097865  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:08.104373  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:08.094231  3832 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:18:08.136361  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:08.146579  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:08.059798  9014 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:08.152889  3134 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:08.081426  8961 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:08.155082  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:08.157860  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:08.087606  8955 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:08.158275  3134 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:08.169780  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:08.170055  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:08.171062  3283 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:18:08.087829  9061 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.182175  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:08.169273  9161 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:08.188689  9192 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:18:08.204780  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:08.138059  9058 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.089s
I20260709 13:18:08.229579  8955 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:08.232101  8955 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:08.233405  9061 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:08.235595  9061 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:08.237804  9170 consensus_queue.cc:1059] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:08.238747  9170 raft_consensus.cc:3055] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:08.239075  9170 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:08.239081  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:08.239970  9170 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:08.149462  8361 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:08.248214  3281 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:18:08.252871  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:08.254443  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:08.255625  9161 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:08.256049  8974 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:08.262591  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:08.265565  3176 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:08.272715  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:08.271083  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:08.284778  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:08.290584  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 306769us
I20260709 13:18:08.299531  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:08.287132  9122 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:08.286505  8974 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:08.287731  9058 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:08.305845  9170 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:08.380155  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:08.392141  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:08.393039  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:08.413406  3136 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:08.396027  9148 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:08.405416  9161 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:08.422128  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 373338us
I20260709 13:18:08.417596  9149 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:08.406078  9183 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:18:08.400986  9108 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:08.434665  3835 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:08.460721  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:08.479691  3832 raft_consensus.cc:1240] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:08.421890  9002 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:08.425449  9161 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:08.480353  9210 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:18:08.499816  9108 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:08.500262  9181 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.519356  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:08.519807  9181 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:08.522231  9181 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:08.521682  9103 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:08.511865  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:08.440425  9171 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:18:08.524179  9103 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:08.516749  9010 consensus_queue.cc:1059] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:18:08.534221  9010 raft_consensus.cc:3055] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:08.534582  9010 raft_consensus.cc:740] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:08.535415  9010 consensus_queue.cc:260] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:08.536609  9010 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:08.452950  8720 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:18:08.518679  3277 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:08.452433  8861 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:18:08.542690  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:08.552069  3211 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:08.560716  3841 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:18:08.517611  9209 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.458995  9205 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.105s
W20260709 13:18:08.584290  8876 consensus_meta.cc:287] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.000s
I20260709 13:18:08.589778  9205 consensus_queue.cc:1243] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer fc48eecc27554cb58b15193cd442b1d3 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:08.609791  3202 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:18:08.589481  8876 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:08.595379  8720 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.575992  9167 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:18:08.628000  9002 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:08.629691  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:08.635469  3277 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:18:08.629691  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:08.630637  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:08.636814  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:08.636824  3204 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 13: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:08.601817  3211 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
W20260709 13:18:08.633113  3034 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38226 (request call id 253) took 53725 ms (client timeout 15000 ms). Trace:
I20260709 13:18:08.641259  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:08.590112  9209 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:08.644322  9058 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:08.644770  9058 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.628556  9161 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:08.647290  3127 raft_consensus.cc:2393] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:08.651248  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:08.663537  3204 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:18:08.651432  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:08.664760  3835 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.681233  3203 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:18:08.685488  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.650245  8982 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:08.688947  8982 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:08.691259  8982 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:08.697788  3805 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:08.699415  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:08.644932  9209 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:08.717852  3210 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:08.715453  3202 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:18:08.645166  9058 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:08.718894  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:08.601579  8961 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:08.719435  3278 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:08.721923  3204 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:08.723212  3283 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:08.701726  3805 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:08.648555  8876 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:08.731443  3835 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:18:08.742959  3283 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:18:08.638957  3034 rpcz_store.cc:269] 0709 13:17:14.877815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.910000 (+ 32185us) service_pool.cc:224] Handling call
0709 13:18:08.602568 (+53692568us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:07.088750 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:07.089338 (+   588us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:07.089381 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:18:07.089403 (+    22us) tablet.cc:662] Decoding operations
0709 13:18:07.089974 (+   571us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:07.090084 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:07.090112 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:07.090481 (+   369us) tablet.cc:701] Row locks acquired
0709 13:18:07.090503 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:18:07.090651 (+   148us) write_op.cc:270] Start()
0709 13:18:07.099449 (+  8798us) write_op.cc:276] Timestamp: P: 1783603087090600 usec, L: 0
0709 13:18:07.101959 (+  2510us) op_driver.cc:348] REPLICATION: starting
0709 13:18:07.196462 (+ 94503us) log.cc:844] Serialized 1308 byte log entry
0709 13:18:07.507279 (+310817us) op_driver.cc:464] REPLICATION: finished
0709 13:18:07.606978 (+ 99699us) write_op.cc:301] APPLY: starting
0709 13:18:07.613835 (+  6857us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:07.616117 (+  2282us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:07.616398 (+   281us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:07.639298 (+ 22900us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:07.639525 (+   227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:18:07.639590 (+    65us) write_op.cc:312] APPLY: finished
0709 13:18:07.639813 (+   223us) log.cc:844] Serialized 41 byte log entry
0709 13:18:07.639980 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:07.640080 (+   100us) write_op.cc:454] Released schema lock
0709 13:18:07.640124 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:07.640552 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:07.640587 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":95207,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":88613,"apply.run_cpu_time_us":6187,"apply.run_wall_time_us":40555,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16691,"num_ops":3,"prepare.queue_time_us":150393,"prepare.run_cpu_time_us":24154,"prepare.run_wall_time_us":314941,"raft.queue_time_us":78716,"raft.run_cpu_time_us":14117,"raft.run_wall_time_us":35112,"replication_time_us":405120,"thread_start_us":341476,"threads_started":4,"wal-append.queue_time_us":228746,"wal-append.run_cpu_time_us":22211,"wal-append.run_wall_time_us":1214039}]]}
I20260709 13:18:08.721942  3202 pending_rounds.cc:85] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 10
I20260709 13:18:08.746033  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:08.749039  3202 pending_rounds.cc:107] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:18:08.749410  3202 raft_consensus.cc:2889] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:08.772786  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 71164us
I20260709 13:18:08.773703  3805 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
W20260709 13:18:08.778628  3833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.004s	sys 0.008s
I20260709 13:18:08.711916  9148 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.724009  9108 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:08.789332  3207 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 11. Current term is 12. Ops: []
W20260709 13:18:08.779724  3833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.004s	sys 0.008s
I20260709 13:18:08.641815  8720 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:08.793013  3280 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:18:08.725368  8982 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.803558  8982 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:08.805778  8982 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:08.799259  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:08.807416  9171 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:08.807894  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:08.807996  9171 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:08.810341  9171 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:08.812296  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:08.812793  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:08.813309  3127 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 16: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:08.813483  3280 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:08.815454  3202 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:18:08.777091  9167 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.839768  9191 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:08.843947  3100 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:08.845745  9068 consensus_queue.cc:1059] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:08.847697  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:08.849512  8777 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:08.851423  8876 raft_consensus.cc:3055] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:08.851835  8876 raft_consensus.cc:740] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:08.852628  8876 consensus_queue.cc:260] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:08.853770  8876 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:08.853978  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:08.858487  9001 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:08.858954  9001 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.859321  9001 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:08.859822  8997 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:08.860258  8997 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:08.847613  9183 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:08.862672  9108 raft_consensus.cc:697] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:08.864045  9108 consensus_queue.cc:237] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:08.864828  9183 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:08.866080  9211 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:08.783308  9209 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:08.868505  3130 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:18:08.784854  9202 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:08.789494  9148 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:08.851591  8777 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:18:08.872759  9130 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:08.836802  9169 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:18:08.860625  8997 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:08.889995  3132 pending_rounds.cc:85] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 10
I20260709 13:18:08.893932  3132 pending_rounds.cc:107] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:18:08.894218  3132 raft_consensus.cc:2889] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:08.890774  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:08.891177  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:08.894867  3832 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:08.895076  3133 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:08.892321  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:08.907858  3131 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:08.892189  9138 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.919032  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:08.896183  9010 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.917013  9148 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:08.917469  9138 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:08.930775  9138 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:08.934769  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:08.936820  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:08.937649  3134 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:08.938333  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:08.940323  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:08.943806  3133 raft_consensus.cc:2368] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 13. Current term is 14.
I20260709 13:18:08.937311  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:08.994987  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 64503.8us
I20260709 13:18:09.000818  3130 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:18:08.987584  3806 leader_election.cc:400] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 13. Current term is 14.
W20260709 13:18:09.003095  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 67404.1us
I20260709 13:18:09.002550  3806 leader_election.cc:403] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:18:08.970867  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:09.005158  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:09.005997  3278 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:09.007246  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:09.008765  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:09.021591  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:09.022642  3285 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:09.024145  3806 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:08.994840  9002 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.034981  3250 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:09.018677  9207 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:08.947089  9010 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:09.020952  8961 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:09.025027  9007 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 13. Current term is 14.
I20260709 13:18:09.025710  9148 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:09.051848  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 220691us
I20260709 13:18:09.033692  9118 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:18:09.068888  9222 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:18:09.070091  9211 consensus_queue.cc:1059] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:09.071223  9181 raft_consensus.cc:3055] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:09.071586  9181 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:09.072361  9181 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:09.073763  9181 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:09.078537  9010 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:09.047281  9207 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.080722  9207 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:09.084323  3134 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:18:09.092296  8720 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:09.038811  9002 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:09.099112  9002 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:09.067525  9148 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:09.103403  9148 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:09.104048  9118 raft_consensus.cc:697] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:09.104514  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:09.105023  9118 consensus_queue.cc:237] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:09.112833  3131 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:18:09.067673  9199 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:09.113595  8874 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.117170  8874 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:09.115746  8974 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:09.119275  8874 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:09.121776  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:09.086510  9170 consensus_meta.cc:287] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.711s	user 0.008s	sys 0.004s
I20260709 13:18:09.134701  3210 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:18:09.135179  3210 pending_rounds.cc:85] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 7
I20260709 13:18:09.135434  3210 pending_rounds.cc:107] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:18:09.135712  3210 raft_consensus.cc:2889] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:09.076849  9058 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:09.161732  3283 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:18:09.162833  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:09.166421  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:09.167091  3284 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:09.171834  3281 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:09.214937  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:09.215822  3282 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:18:09.219467  9001 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:09.223331  9232 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:18:09.230182  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:09.231737  3281 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
W20260709 13:18:09.246592  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 206014us
I20260709 13:18:09.254736  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:09.258415  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 223513us
I20260709 13:18:09.259586  3250 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:09.260140  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:09.260790  3281 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:09.276079  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:09.276755  3840 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:18:09.280867  3251 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:09.288410  3101 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:09.325438  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 56618.4us
I20260709 13:18:09.278350  8861 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:18:09.268400  9194 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:18:09.341807  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:09.342943  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 56099.3us
I20260709 13:18:09.358940  9167 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:09.343253  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 54917.7us
W20260709 13:18:09.367863  9226 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:18:09.368402  9207 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:09.368920  9068 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:09.370607  9207 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:09.373196  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:09.325156  9106 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:09.379215  9237 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:18:09.295491  9209 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:09.380147  9209 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:09.383778  9058 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:09.383795  9247 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:09.384635  9058 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:09.384553  9247 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.385357  9058 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:09.386044  9247 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:09.387343  3101 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:09.326881  8874 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:09.389430  8874 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.389791  8874 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:09.393437  9256 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:09.393975  9256 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.394302  9256 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:09.353185  9001 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:09.399580  3284 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:18:09.405012  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:09.410025  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:09.410446  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:09.411305  3278 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:09.414814  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:09.428596  3207 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:09.444020  3278 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:18:09.290352  8720 consensus_queue.cc:1059] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.135s
I20260709 13:18:09.455976  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:09.461373  3207 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:18:09.456959  3203 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:09.469213  3204 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
W20260709 13:18:09.527400  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.530471  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:09.531960  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:09.532205  3101 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:09.532568  3130 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:09.530056  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:18:09.540799  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 46497.2us
I20260709 13:18:09.543200  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:09.549054  3130 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:09.535053  9167 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:09.553493  9167 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:09.559180  9194 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.559993  9194 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:09.564966  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:09.565899  3203 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:09.568094  3249 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:09.569380  9194 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:09.555805  9239 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:18:09.595119  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.599743  9167 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:09.592990  9001 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:09.601614  9239 raft_consensus.cc:697] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:09.592777  9058 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:09.643195  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 46782us
I20260709 13:18:09.594080  9165 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:09.605667  8993 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:09.654386  3203 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:09.655122  9165 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:09.657379  9247 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:09.659778  9247 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:09.641858  9001 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.668321  3203 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:18:09.661170  8997 consensus_meta.cc:287] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.757s	user 0.001s	sys 0.012s
W20260709 13:18:09.675513  9246 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:18:09.677323  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 145207us
I20260709 13:18:09.681202  9002 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:09.684335  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 116387us
I20260709 13:18:09.684509  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:09.685151  3130 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:09.685902  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:09.691735  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:09.666535  9001 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:09.706027  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 44006.5us
W20260709 13:18:09.704576  9251 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.120s	user 0.001s	sys 0.001s
I20260709 13:18:09.702360  9205 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:09.731936  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:09.743678  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:09.707856  8720 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:09.708184  8993 raft_consensus.cc:697] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:09.686930  8997 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:09.749234  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:09.749946  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:09.750105  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:09.761283  3133 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:09.729768  9067 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:09.769431  3211 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:09.776417  9202 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:09.778189  9261 log.cc:927] Time spent T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:18:09.779189  9259 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:18:09.783468  8997 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:09.784524  8993 consensus_queue.cc:237] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:09.760728  8720 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:09.792148  8720 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:09.793602  3211 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:09.798764  9165 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:09.749683  9205 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:09.802506  9205 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:09.807922  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:09.800555  8874 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:09.810369  3278 raft_consensus.cc:2368] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15.
I20260709 13:18:09.811452  8874 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:09.811084  9256 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:09.754846  9262 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:18:09.705878  9239 consensus_queue.cc:237] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:09.840147  9209 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:09.814261  9268 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:18:09.841691  3833 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:09.842628  9209 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:09.773645  9067 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:09.776974  9202 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:09.845593  9256 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:09.817921  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:09.849542  3283 raft_consensus.cc:2368] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17.
I20260709 13:18:09.818533  9058 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.850695  9058 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:09.818725  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:09.853353  3202 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:18:09.837366  9262 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:09.862761  3176 leader_election.cc:400] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17.
I20260709 13:18:09.880244  3176 leader_election.cc:403] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:18:09.868105  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:09.869127  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:09.870393  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:09.881702  3203 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:09.882102  3838 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:09.883083  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:09.886646  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:09.897554  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:09.898303  3283 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:09.902333  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:09.905277  3202 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:18:09.910337  3838 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:18:09.914337  3203 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:09.857581  9058 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:09.915894  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3335) took 1196 ms. Trace:
I20260709 13:18:09.907577  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:09.916944  3251 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:09.918759  3276 rpcz_store.cc:276] 0709 13:18:08.719181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.719788 (+   607us) service_pool.cc:224] Handling call
0709 13:18:08.720083 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:08.871176 (+151093us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:08.871529 (+   353us) log.cc:844] Serialized 14 byte log entry
0709 13:18:09.316960 (+445431us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.317596 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 13:18:09.323117 (+  5521us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:09.323158 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.904723 (+581565us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400002154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:09.904775 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:09.904876 (+   101us) raft_consensus.cc:1685] finished
0709 13:18:09.915642 (+ 10766us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:09.915825 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17119,"prepare.queue_time_us":762,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":26135,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":17309,"spinlock_wait_cycles":346524416,"thread_start_us":437361,"threads_started":2,"wal-append.queue_time_us":279660}
I20260709 13:18:09.926056  9148 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:09.911949  9263 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:09.926776  9263 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.927153  9263 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:09.892030  9171 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17.
I20260709 13:18:09.946254  9106 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:09.877729  9262 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:10.037950  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:09.901494  9201 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:18:10.038700  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 112848us
I20260709 13:18:10.042174  9239 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:10.042385  9058 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:10.109800  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 61308.4us
I20260709 13:18:10.046651  9106 raft_consensus.cc:697] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:10.049973  8974 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:10.143996  9205 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.174957  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:10.177001  3276 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:18:10.189128  3100 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 1.540s (SENT) [suppressed 3 similar messages]
I20260709 13:18:10.152390  9118 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:10.242501  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 185462us
I20260709 13:18:10.149555  9167 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:10.052695  9239 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:10.051651  9201 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:10.252925  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 321685us
I20260709 13:18:10.257614  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:10.233767  9205 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:10.239277  9207 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.150388  9001 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:10.334303  9001 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:10.263950  9148 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:10.342418  9148 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:10.281011  9274 log.cc:927] Time spent T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 13:18:10.176393  8974 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:10.292122  9201 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:10.260713  9167 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:10.350739  9167 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:10.297958  9106 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:10.150878  9058 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:10.306097  3806 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:18:10.364786  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 175698us
W20260709 13:18:10.315634  9244 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.960s	user 0.003s	sys 0.009s
W20260709 13:18:10.321044  9250 log.cc:927] Time spent T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:18:10.156769  9262 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:10.241948  9209 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:18:10.323818  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 45257.8us
I20260709 13:18:10.331046  9239 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:10.331851  9207 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:10.356508  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:10.365056  3276 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 18. Current term is 19. Ops: []
W20260709 13:18:10.365621  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 59621.2us
I20260709 13:18:10.350008  8974 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:10.369206  9256 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:10.373677  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:10.377405  9167 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:18:10.311513  9236 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.964s	user 0.000s	sys 0.009s
I20260709 13:18:10.379419  3129 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:18:10.380214  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 104084us
I20260709 13:18:10.388221  3250 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:10.378664  9002 raft_consensus.cc:2764] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:18:10.368710  9264 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:10.344921  9148 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:10.252112  9118 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:10.426061  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:10.407099  3281 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:10.308670  3030 catalog_manager.cc:5697] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 16 to 17, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 17 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:10.435161  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:10.440629  3100 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:10.450757  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:10.358112  9263 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:10.478152  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:10.481573  3250 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:10.391323  9209 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:10.424757  9264 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:10.424787  9280 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:10.488253  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:10.470996  9202 consensus_meta.cc:287] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.625s	user 0.006s	sys 0.006s
I20260709 13:18:10.508466  3281 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:10.509371  3840 raft_consensus.cc:2368] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15.
I20260709 13:18:10.413343  9167 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:10.472693  9199 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.483280  9164 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.525508  3177 leader_election.cc:400] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15.
I20260709 13:18:10.526016  3177 leader_election.cc:403] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:10.527238  9170 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15.
I20260709 13:18:10.431502  9256 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:10.491154  9068 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:10.572184  3030 catalog_manager.cc:5697] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 13 to 14, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 14 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:10.589797  3030 catalog_manager.cc:5697] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 10 to 12, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 12 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:10.561919  9278 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.424s	user 0.002s	sys 0.000s
I20260709 13:18:10.529979  9017 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:10.571554  9236 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:18:10.588784  9265 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:10.604496  9263 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:10.529574  9280 raft_consensus.cc:697] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:18:10.606242  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 360767us
I20260709 13:18:10.512513  9202 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:10.609584  9205 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:10.610215  9207 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:10.620199  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 144374us
I20260709 13:18:10.617281  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:10.608235  9256 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:10.629832  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 148808us
I20260709 13:18:10.534952  9164 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:10.606730  9264 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:10.668932  3030 catalog_manager.cc:5697] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.529762  9199 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:10.710891  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 74683.2us
I20260709 13:18:10.713591  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:10.710680  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 269927us
W20260709 13:18:10.709865  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 219540us
I20260709 13:18:10.739324  3835 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:10.631484  9058 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:10.635553  9265 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:10.744786  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 2418) took 1855 ms. Trace:
I20260709 13:18:10.750856  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:10.750734  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 114287us
I20260709 13:18:10.747701  3132 rpcz_store.cc:276] 0709 13:18:08.889409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.889515 (+   106us) service_pool.cc:224] Handling call
0709 13:18:08.889795 (+   280us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:08.905104 (+ 15309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.905157 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:08.905831 (+   674us) log.cc:844] Serialized 52 byte log entry
0709 13:18:09.134120 (+228289us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:09.156878 (+ 22758us) log.cc:844] Serialized 14 byte log entry
0709 13:18:09.157157 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.157256 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:09.781887 (+624631us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b18004ca440. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:18:10.310880 (+528993us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:18:10.744547 (+433667us) raft_consensus.cc:1685] finished
0709 13:18:10.744571 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.744714 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7539,"prepare.queue_time_us":35130,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":11130,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":19930,"spinlock_wait_cycles":120533632,"thread_start_us":131137,"threads_started":1,"wal-append.queue_time_us":354643}
I20260709 13:18:10.758490  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:10.759060  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:10.759308  3130 raft_consensus.cc:2368] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17.
I20260709 13:18:10.756330  3030 catalog_manager.cc:5697] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 10 to 12, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 12 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.762575  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:10.763271  3209 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:18:10.766826  3251 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:10.768160  9167 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:10.769410  9298 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:10.770388  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:10.771704  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:10.753947  9006 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:10.794246  9202 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:10.796408  9209 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:10.797045  9209 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.797516  9209 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:10.798610  9164 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:10.800053  9209 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:10.800603  9209 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:10.801442  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 1983) took 1258 ms. Trace:
I20260709 13:18:10.801774  9199 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:10.801939  3278 rpcz_store.cc:276] 0709 13:18:09.542681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.542841 (+   160us) service_pool.cc:224] Handling call
0709 13:18:10.801139 (+1258298us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54002f85d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:10.801361 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":612684032}
I20260709 13:18:10.802949  3030 catalog_manager.cc:5697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.806923  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:10.807541  3129 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:10.809435  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:10.813189  9191 raft_consensus.cc:3055] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:10.813726  9191 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:10.804582  3030 catalog_manager.cc:5697] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 15 to 16, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 16 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.814742  9296 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:10.815281  9296 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:10.817752  9201 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:10.814159  3102 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:10.824004  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:10.825623  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:10.829442  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:10.814769  9191 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:10.839781  9191 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:10.842072  9296 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:10.815281  3030 catalog_manager.cc:5697] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 14 to 15, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 15 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:10.846669  3030 catalog_manager.cc:5697] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 13 to 14, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.823544  9209 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:10.851580  9209 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:10.853376  9289 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.242s	user 0.004s	sys 0.009s
I20260709 13:18:10.848613  3030 catalog_manager.cc:5697] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 10 to 15, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 15 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:10.857504  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:10.861455  3832 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:10.862200  9067 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:10.865321  8720 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:10.865801  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 51724.5us
I20260709 13:18:10.866612  3102 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:10.866097  8720 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:10.870605  3833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1190) took 1572 ms. Trace:
I20260709 13:18:10.870709  9061 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.871011  3833 rpcz_store.cc:276] 0709 13:18:09.298220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.298690 (+   470us) service_pool.cc:224] Handling call
0709 13:18:09.299063 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.842119 (+543056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.870341 (+1028222us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b540002b054. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:10.870518 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1247445760}
I20260709 13:18:10.871544  9061 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:10.872319  9264 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:10.873013  9272 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:10.873728  9272 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:10.874044  3211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 2624) took 1462 ms (client timeout 1836 ms). Trace:
I20260709 13:18:10.874244  9161 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:18:10.874501  3211 rpcz_store.cc:269] 0709 13:18:09.411854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.414495 (+  2641us) service_pool.cc:224] Handling call
0709 13:18:10.873805 (+1459310us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54001d7754. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:10.873975 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":813015936}
I20260709 13:18:10.874884  9161 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:10.875435  9265 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:10.877846  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:10.879159  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:10.878958  9181 consensus_queue.cc:1175] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "48080cf0460346769ab046a4f9457aa5" responder_term: 19 status { last_received { term: 18 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:18:10.850936  9248 log.cc:927] Time spent T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 1.270s	user 0.010s	sys 0.000s
I20260709 13:18:10.880487  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:10.881052  3205 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:10.881609  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 1976) took 2233 ms. Trace:
I20260709 13:18:10.881973  3277 rpcz_store.cc:276] 0709 13:18:08.647787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.648686 (+   899us) service_pool.cc:224] Handling call
0709 13:18:08.648956 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:08.649290 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.649342 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.155144 (+505802us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b2c00138fe8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:18:09.175862 (+ 20718us) log.cc:844] Serialized 26 byte log entry
0709 13:18:09.288029 (+112167us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:09.288081 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.288184 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.850154 (+1561970us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:18:10.881385 (+ 31231us) raft_consensus.cc:1685] finished
0709 13:18:10.881408 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.881531 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":235,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":90540800,"thread_start_us":111758,"threads_started":1,"wal-append.queue_time_us":301019}
I20260709 13:18:10.883520  9058 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:10.883602  9264 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:10.884338  9058 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:10.885672  3204 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 3782) took 2095 ms (client timeout 1540 ms). Trace:
I20260709 13:18:10.885798  9264 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:10.886133  3204 rpcz_store.cc:269] 0709 13:18:08.790558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.790825 (+   267us) service_pool.cc:224] Handling call
0709 13:18:10.885490 (+2094665us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b54001d8154. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:10.885603 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062244096}
I20260709 13:18:10.887311  3209 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:10.888175  3176 leader_election.cc:400] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17.
I20260709 13:18:10.888096  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:10.890121  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:10.864919  3100 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:10.868906  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.896901  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:10.897256  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:10.903826  3100 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:10.908231  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:10.911264  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:10.914811  3177 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:10.916404  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:10.926332  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:10.933514  3131 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 1984) took 1990 ms (client timeout 1996 ms). Trace:
W20260709 13:18:10.934047  3131 rpcz_store.cc:269] 0709 13:18:08.911650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.912682 (+  1032us) service_pool.cc:224] Handling call
0709 13:18:10.901520 (+1988838us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54003b7ed4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:10.901628 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377879296}
I20260709 13:18:10.938450  3129 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:10.864214  3030 catalog_manager.cc:5697] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 11 to 13, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 13 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:10.943249  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:10.943816  3211 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:18:10.943531  3100 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:10.946158  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:10.953578  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:10.766786  9118 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:11.000145  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 56748.7us
I20260709 13:18:11.045522  3030 catalog_manager.cc:5697] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 13 to 14, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.923312  9296 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:10.934522  8974 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:10.922930  8955 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:11.068302  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:11.069021  3131 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:18:11.070502  3030 catalog_manager.cc:5697] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 8 to 11, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 11 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:11.079066  3205 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:11.063439  9279 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:11.098692  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:11.161614  3277 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:11.066731  9256 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:11.068329  8974 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:11.098326  3030 catalog_manager.cc:5697] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:11.072149  9182 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:11.103088  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:11.083663  8720 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:11.111243  3206 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.037s	sys 0.110s
I20260709 13:18:11.086982  9161 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:11.136693  3129 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:11.144528  3832 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:11.142021  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:11.169667  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 3781) took 2170 ms. Trace:
W20260709 13:18:11.122499  8876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.014s	sys 0.037s
I20260709 13:18:11.206096  3210 rpcz_store.cc:276] 0709 13:18:08.786397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.786845 (+   448us) service_pool.cc:224] Handling call
0709 13:18:08.787245 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.136197 (+348952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.956478 (+1820281us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b5400189a54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:10.956686 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798033792}
I20260709 13:18:10.773653  9280 consensus_queue.cc:237] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:11.225564  8876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.014s	sys 0.038s
I20260709 13:18:11.184316  9258 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:11.249907  3030 catalog_manager.cc:5697] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
W20260709 13:18:11.233422  9183 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.058s	sys 0.076s
I20260709 13:18:11.225801  9061 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:11.200062  9171 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:11.182471  8974 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:11.182281  8992 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:18:11.265408  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 198247us
I20260709 13:18:11.203039  9256 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:11.259907  9183 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.058s	sys 0.077s
I20260709 13:18:11.184893  9279 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:11.280272  3030 catalog_manager.cc:5697] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 11 to 12, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 12 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:11.205636  9182 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:11.332172  3250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.024s	sys 0.002s
W20260709 13:18:11.332552  3250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.024s	sys 0.002s
W20260709 13:18:11.331768  9301 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:18:11.355533  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:11.356418  3129 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:11.359078  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:11.270815  9171 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:11.271142  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:11.263551  9258 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:11.398137  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:11.402621  9311 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:11.405237  9304 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:18:11.402894  9263 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:11.406275  9263 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:11.406491  9307 log.cc:927] Time spent T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:11.406713  9263 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:11.408005  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3357) took 1358 ms. Trace:
I20260709 13:18:11.415866  9263 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:11.417254  9279 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:11.418995  9256 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:11.360201  9282 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:11.420265  9282 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:11.423792  9258 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:11.408377  3283 rpcz_store.cc:276] 0709 13:18:10.049384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.050649 (+  1265us) service_pool.cc:224] Handling call
0709 13:18:10.051116 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.510958 (+459842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.510989 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.511462 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.752359 (+240897us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:10.752414 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.752538 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.407749 (+655211us) raft_consensus.cc:1685] finished
0709 13:18:11.407770 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.407931 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11046,"raft.queue_time_us":117534,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5059,"thread_start_us":686442,"threads_started":2,"wal-append.queue_time_us":446671}
I20260709 13:18:11.427196  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:11.278491  8992 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:11.403029  9199 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.404978  9311 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:11.428151  9191 consensus_meta.cc:287] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.586s	user 0.004s	sys 0.008s
I20260709 13:18:11.415699  9306 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:11.440455  3283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:11.441903  3283 raft_consensus.cc:606] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 23 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:11.442361  3129 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:11.441679  9199 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:11.445017  9311 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:11.430325  9308 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:11.446134  9306 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:11.450404  9306 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:11.454061  9282 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:11.456719  9263 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:11.468662  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:11.469992  3209 raft_consensus.cc:2410] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
W20260709 13:18:11.388051  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 116972us
I20260709 13:18:11.480957  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:11.481246  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:11.480638  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:11.485328  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:11.486168  3205 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:11.495534  3204 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:11.474452  9263 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:11.536628  9263 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:11.541669  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:11.475888  9272 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:11.478152  9256 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:11.549350  3277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:11.550103  3277 raft_consensus.cc:606] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:11.550521  3277 raft_consensus.cc:614] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:11.491734  8861 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:11.493515  3030 catalog_manager.cc:5697] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 16 to 17, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 17 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:11.565501  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:11.565974  8992 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:11.566993  9182 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:11.580137  3806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.011s	sys 0.035s
W20260709 13:18:11.580785  3806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.011s	sys 0.035s
I20260709 13:18:11.580874  3209 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:18:11.544577  9295 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:18:11.587386  3174 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.020s	sys 0.032s
W20260709 13:18:11.591934  3174 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.021s	sys 0.032s
I20260709 13:18:11.591429  3806 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:11.551740  9272 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:11.553290  9256 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:11.594295  9199 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:11.605253  9167 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:11.608736  9167 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:11.601464  9302 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:18:11.597811  9118 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:11.600064  9198 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:11.613355  9167 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:11.617915  9171 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:11.590061  9295 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:11.626307  9256 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:11.626706  9272 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:11.627626  9295 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:11.625264  9198 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.628405  9198 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:11.633828  9263 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:11.632965  8974 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:11.634900  9198 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:11.638031  9198 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:11.642541  8974 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:11.762431  3204 raft_consensus.cc:2393] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 18: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:11.773996  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:11.776752  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:11.779678  3128 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:11.772548  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:11.833055  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 223676us
I20260709 13:18:11.833688  9058 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:11.835242  9058 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:11.840703  9058 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:11.841611  9058 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:11.842857  9058 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:11.853691  9118 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:11.855010  9205 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:11.855928  9205 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:11.901176  9205 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:11.910346  9263 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:11.911427  9263 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:11.918051  9171 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:11.919185  9171 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:11.982429  9058 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:11.982785  9318 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:11.983253  9058 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:11.983871  9318 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:11.984217  9058 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.011943  9309 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:12.012878  9309 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.016201  9309 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:11.986291  9166 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.026002  9166 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.018631  9171 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.031085  9263 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.033510  9266 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:12.034684  9266 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.035365  9205 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:12.036217  9205 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:12.037557  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.023965  9058 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:11.986570  8974 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:12.116243  9166 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.116789  8974 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.119412  8974 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.122421  9058 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:12.123543  9205 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.124049  9161 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:12.187384  9058 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.190130  9058 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.150727  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:11.986181  9239 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.211170  9309 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:12.219826  9309 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.226861  9309 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.237355  9239 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.240299  9239 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.246476  9318 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.250092  3133 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:12.256018  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.220809  9266 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.259007  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:12.267081  3206 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:18:12.266389  3806 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:12.267653  9161 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.281659  9002 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:12.282313  9002 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:12.282825  9002 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:12.272380  9239 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.287835  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:12.288722  3205 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:12.291958  9171 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:12.297953  9171 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.300333  9171 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.295681  9239 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.307252  9161 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.308925  9239 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.335657  9171 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.336517  9171 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.339352  9171 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.341106  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:12.347833  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:12.348832  3208 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:18:12.352015  3100 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:12.355340  8861 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:12.383945  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:12.386222  9205 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:12.387089  9205 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.387801  8991 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.387989  9270 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.388525  9230 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.387288  9165 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.389006  9270 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.389365  9230 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.390777  9205 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.389998  9165 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.391779  9230 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.392091  9270 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.393805  9165 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.394627  9262 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:12.395061  9165 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.395742  9165 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.377750  8861 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.397413  8861 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:12.398638  9165 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.398878  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.384872  3208 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:12.413067  9161 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.414062  9161 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.417411  8991 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.422449  3205 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:12.428974  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:12.429705  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:12.430619  3838 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:18:12.430848  9171 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.428853  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:12.431463  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:12.431649  3276 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:12.408041  9318 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:12.433257  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:12.433584  9318 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.431655  9171 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.435787  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.436041  9318 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.436542  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.436647  3276 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:12.437588  9171 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.422765  8991 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.438830  9309 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.439747  9309 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.443054  9309 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.445915  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.446581  9171 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.447666  9171 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.449582  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.450234  9171 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.450407  3277 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:12.451839  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.453017  3129 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 20.
I20260709 13:18:12.453953  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.456210  9161 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.459285  9067 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.460472  9067 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.461911  9247 consensus_queue.cc:1059] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:12.463621  9201 raft_consensus.cc:3055] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:12.463445  9067 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.464172  9201 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:12.465641  9201 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.468516  9201 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:12.476421  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:12.476413  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.477679  3841 raft_consensus.cc:2393] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 17: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:12.481498  3806 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:12.483433  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:12.485880  3838 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 21.
I20260709 13:18:12.485980  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:12.488377  9306 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:12.489111  9306 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.459703  3102 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:12.493393  9191 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.498242  9191 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.500900  9191 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.494604  9306 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:12.514520  9303 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.207s	user 0.005s	sys 0.014s
I20260709 13:18:12.493685  9318 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:12.529839  9201 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:12.529970  9318 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.540504  9318 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.541360  3209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 763) took 1053 ms. Trace:
I20260709 13:18:12.541493  8861 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.542040  3209 rpcz_store.cc:276] 0709 13:18:11.480220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.480384 (+   164us) service_pool.cc:224] Handling call
0709 13:18:12.528863 (+1048479us) spinlock_profiling.cc:243] Waited 98.6 ms on lock 0x7b54003cb4d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:12.529062 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226690432}
I20260709 13:18:12.543023  9207 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.543685  9207 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.544073  8861 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.545807  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.546873  3130 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
W20260709 13:18:12.547979  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 999299us
I20260709 13:18:12.548713  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:12.555114  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:12.555985  3840 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:12.556197  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:12.557202  3838 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:18:12.557701  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:12.561594  8861 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:12.562047  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 102700us
I20260709 13:18:12.564486  3102 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:12.564318  8861 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:12.560953  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:12.565745  8861 raft_consensus.cc:3055] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:12.584966  3835 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:12.595073  9002 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.585055  8861 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:12.626170  3833 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:12.627043  8861 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.598013  9207 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.601565  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:12.605384  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:12.629518  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.630084  3132 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 17: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:12.630371  3276 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:18:12.630841  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.533058  9201 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:18:12.631217  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.631507  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.632256  3285 raft_consensus.cc:2393] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 19: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:12.565918  9306 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:12.634750  9306 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:12.635274  9306 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:12.636154  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:12.637369  8876 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:12.637589  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.638394  3134 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 21.
I20260709 13:18:12.638562  9002 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.638924  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.639356  9002 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:12.639838  3135 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:12.640914  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.620846  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.621028  3208 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:12.619845  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:12.605576  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 55767.8us
I20260709 13:18:12.648729  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:12.648952  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:12.648296  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:12.648416  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:12.652674  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:12.654099  3841 raft_consensus.cc:2393] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:12.631286  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.626036  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.654629  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.643160  8861 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:12.656517  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:12.658483  3132 raft_consensus.cc:2376] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12. Re-sending same reply.
I20260709 13:18:12.639874  9002 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:12.654176  9318 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.667171  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.675458  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.657642  9266 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:12.679173  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.670904  9002 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:12.693420  3177 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:12.700582  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.701364  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.690995  3250 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:12.690394  9309 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:12.704685  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.709527  8874 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:18:12.710266  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 221770us
I20260709 13:18:12.709997  9309 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.705849  3177 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:12.706122  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.705610  9198 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.705174  9241 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:12.704540  9255 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.707211  9161 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:18:12.723666  9308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.242s	user 0.010s	sys 0.031s
I20260709 13:18:12.699082  8876 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:12.724872  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.726361  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.709146  9276 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.736110  9149 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.736590  9276 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.736984  9149 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.739157  9276 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.739233  9149 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.739768  9255 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.743541  9255 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.744055  9296 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.744685  9296 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.745226  9241 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.747710  9305 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:12.747809  9241 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.748458  9305 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.748752  9198 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.750767  9305 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.751148  9198 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.749279  3127 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
W20260709 13:18:12.753125  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 69875.1us
W20260709 13:18:12.751998  9308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.305s	user 0.010s	sys 0.031s
I20260709 13:18:12.754647  9308 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:12.756251  9331 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:12.756796  9331 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.757200  9331 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:12.757015  9308 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.757949  8991 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.758600  8991 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.760416  9171 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.739094  9161 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:12.705210  9194 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:12.697347  9318 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.761130  9171 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.761583  9276 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.761698  9194 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.762393  9276 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.762835  9207 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:12.763248  9318 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.763551  9207 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.763821  8874 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.764529  9276 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:12.765239  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 59497.4us
I20260709 13:18:12.757355  8361 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.765911  8874 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.766268  8361 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.766916  3177 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:12.768049  9239 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:12.768433  9239 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:12.768788  9239 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:12.761165  9161 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:12.755211  9266 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.771692  9266 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.773217  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.773401  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.773857  9058 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:12.760807  8991 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.774255  9058 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:12.761230  9149 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.774791  9058 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:12.775305  9149 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.769222  8876 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.778442  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.777508  9149 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.777441  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.779135  9309 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.779696  3284 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:12.780144  8876 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.780623  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.781385  3277 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 11.
I20260709 13:18:12.782460  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.783164  3284 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 18.
I20260709 13:18:12.783665  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.785727  3279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "fc48eecc27554cb58b15193cd442b1d3"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:12.784798  9171 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.768743  8361 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.794027  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.764109  9194 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.748890  9296 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.821767  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.822664  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.799078  3805 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:12.819429  9302 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:12.784796  8874 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.825139  3279 raft_consensus.cc:606] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Received request to transfer leadership to TS fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:12.836123  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.836182  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.824744  8991 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.847498  9335 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:12.847817  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.848255  8991 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.848601  9302 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.849416  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.823967  9149 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.850807  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.851158  9149 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.852169  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.823586  9207 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.850854  9302 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.847463  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.837998  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.854861  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.839852  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.840943  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:12.843158  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 117612us
I20260709 13:18:12.843895  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.843794  9239 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:12.835510  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 68672.2us
I20260709 13:18:12.838979  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.856034  3132 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:12.858866  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.858034  3177 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:12.861304  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.844201  9058 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.863322  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.863899  3127 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:18:12.864315  9058 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.866528  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.867343  9306 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.867957  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.869217  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.869762  9308 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.870364  9308 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.871412  3249 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:12.872190  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.864733  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.874148  9194 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:12.874389  3805 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:12.874697  9194 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.875221  9194 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:12.875273  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.875895  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.876364  3282 raft_consensus.cc:2410] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:12.877244  9302 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:12.877480  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.877964  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.878173  9302 consensus_queue.cc:1059] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:12.878695  3284 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:12.879396  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.847432  8874 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.883894  9149 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.884384  3283 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:12.884511  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.850814  8991 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.886097  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.886942  3128 raft_consensus.cc:2410] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:12.889158  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.889257  3130 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:12.890261  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.880764  9302 raft_consensus.cc:3055] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:12.891644  3281 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:12.876888  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:12.892597  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.891417  3102 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:18:12.891809  9337 log.cc:927] Time spent T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:18:12.898903  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.852068  9002 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.904737  9306 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 21 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:12.905738  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.905287  9309 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:12.908540  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.897132  9302 raft_consensus.cc:740] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:12.930567  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:12.937274  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 45940.8us
I20260709 13:18:12.941413  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.942098  3277 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:12.941941  9171 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:12.942185  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.902091  8876 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:12.943485  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.900226  9207 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:12.944478  9207 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.944851  9207 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:12.949878  9331 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.952129  9331 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:12.923331  9309 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:12.959576  9309 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:12.961170  3276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:12.970432  3276 raft_consensus.cc:606] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:12.970834  3276 raft_consensus.cc:614] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:12.965267  9161 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:12.974596  9161 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:12.975253  9161 consensus_queue.cc:1059] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:12.966960  3835 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:12.976572  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:12.969197  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:12.980799  9338 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:12.981531  9338 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:12.982934  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.983850  9338 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:12.984413  9338 raft_consensus.cc:3055] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:12.989485  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:12.991525  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:12.992765  3278 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:12.998917  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:12.984761  9338 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:18:12.961054  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 55806.4us
I20260709 13:18:13.006376  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:13.007565  9239 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:13.008854  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:13.009549  3133 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:18:13.008304  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.011276  8361 consensus_queue.cc:1059] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:13.011970  9058 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:13.013298  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.014947  9294 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:13.015945  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:13.018565  9276 raft_consensus.cc:993] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: : Instructing follower fc48eecc27554cb58b15193cd442b1d3 to start an election
I20260709 13:18:13.018079  9302 consensus_queue.cc:260] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.019004  9276 raft_consensus.cc:1081] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Signalling peer fc48eecc27554cb58b15193cd442b1d3 to start an election
I20260709 13:18:13.013952  3249 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:13.024196  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 116807us
I20260709 13:18:13.019452  9302 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.026069  3250 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:13.019487  9308 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:13.025409  9058 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:13.038319  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.045481  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:13.039366  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.053965  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:13.056550  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:13.059574  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:13.063433  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.063728  9002 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:13.064282  3204 raft_consensus.cc:2393] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 20: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:13.065174  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.065717  3204 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:13.066665  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.036799  9331 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:13.085588  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:13.086115  9331 raft_consensus.cc:697] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:13.086448  3833 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:13.086619  8874 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:13.087148  9331 consensus_queue.cc:237] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.088722  9255 raft_consensus.cc:3055] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:13.089334  9255 raft_consensus.cc:740] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:13.089918  9338 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.090301  9255 consensus_queue.cc:260] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.091430  9338 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.091838  9255 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:13.037904  9058 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:13.096748  9058 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:13.099077  9207 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.101289  3208 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:13.102953  9161 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:13.103585  9161 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.046590  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:18:13.107360  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 74363.3us
I20260709 13:18:13.108492  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:13.070919  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.109911  3211 raft_consensus.cc:2410] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:18:13.110816  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.111613  3211 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:13.112025  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.112161  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.112490  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.112637  3204 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:18:13.071815  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.072530  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:13.113735  3203 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:13.075904  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.076586  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.077242  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.079514  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:13.113025  3208 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:13.080952  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:13.081620  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.084136  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.084692  9276 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:13.118178  9276 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:13.118512  9207 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:13.118898  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.119211  3206 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:13.084887  3838 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:18:13.120092  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.123188  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.123852  3206 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:13.124401  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.085371  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.117493  3834 raft_consensus.cc:1813] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Handling vote request from an unknown peer 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:13.105507  3806 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:13.113833  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.128232  3834 raft_consensus.cc:2410] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:18:13.117664  3207 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:18:13.118615  9276 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:13.069887  9194 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.133605  3206 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:18:13.139108  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:13.139386  3100 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:13.143146  3838 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:13.143376  3206 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:13.144049  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.144910  3208 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:13.144743  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.146674  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:13.145848  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:13.146678  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:13.146425  3205 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:18:13.152379  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:13.128052  9342 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:13.149060  3211 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
W20260709 13:18:13.159113  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.143146  9296 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:13.160774  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 55362us
I20260709 13:18:13.161819  9336 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:13.163121  9309 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.165202  9342 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:13.165673  9342 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:13.169323  9341 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:13.171063  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:13.171564  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:13.173108  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 64736.3us
I20260709 13:18:13.174453  3835 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:13.174886  3176 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.176105  9239 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:13.177232  3276 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:13.177527  3176 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:13.180495  9194 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:13.182166  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:13.189874  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 163908us
I20260709 13:18:13.190274  3206 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:13.191344  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:13.191848  3838 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.187815  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:13.137507  9207 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:13.197566  3100 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:13.197763  9341 raft_consensus.cc:697] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:13.160864  9296 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:13.204876  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:13.202991  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.208621  3806 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.194940  9239 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:13.223652  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 189068us
I20260709 13:18:13.211759  3100 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:13.196689  8874 consensus_queue.cc:1059] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:18:13.222363  9309 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:13.222416  9161 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:13.230458  9265 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:13.231114  9265 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.231544  9265 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:13.234457  3251 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:13.224608  9335 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:13.235862  9335 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:13.236276  9335 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.239859  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.209721  9171 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.209606  9296 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:13.223086  9239 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:13.224380  8876 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:18:13.249250  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.210999  9201 consensus_queue.cc:1059] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:18:13.249562  9341 consensus_queue.cc:237] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:13.253479  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 58771.6us
W20260709 13:18:13.254550  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 49652.5us
I20260709 13:18:13.243139  9262 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:13.246603  9194 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:13.206015  9207 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.263257  3838 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:13.265511  3806 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:13.256954  9239 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:13.270865  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.266976  9106 raft_consensus.cc:3055] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:13.283109  9352 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:13.283794  9352 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:13.272768  9302 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:13.284370  9352 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.284729  9302 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:13.285511  9302 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:13.278041  3251 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.289322  8361 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:13.290858  3251 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.275415  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.283135  3276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:13.291704  3276 raft_consensus.cc:606] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:13.270303  9276 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.293403  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.283267  9106 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:13.295315  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:13.294803  9106 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.296669  9106 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.293573  9161 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:13.298444  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:13.299418  9201 raft_consensus.cc:3055] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:13.299835  9201 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:13.300805  9201 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.302264  9309 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:13.302681  9309 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:13.303045  9309 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:13.303133  9276 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:13.263404  9171 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.305497  9171 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:13.306084  9171 raft_consensus.cc:3055] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:13.306911  9171 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:13.307408  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.308207  3208 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 17: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:13.308030  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.309427  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.308741  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.313374  3204 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:18:13.314034  8874 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:13.314034  9241 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:13.316869  3251 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.317329  9171 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.312906  9309 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.318889  9171 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:13.320089  9309 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:13.322257  9336 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:13.323091  9342 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:13.328235  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.328661  9342 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:13.333904  3203 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:13.262303  9262 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.335053  9262 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:13.335209  9255 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:13.335657  9255 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:13.336016  9255 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:13.341029  9201 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:13.343640  9207 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:13.346732  3209 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:18:13.348763  9241 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:13.349750  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.350694  3203 raft_consensus.cc:1240] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:13.351017  3283 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:13.354471  3204 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:13.357250  3208 raft_consensus.cc:1240] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:13.352627  9296 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.388401  9345 consensus_queue.cc:1059] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:13.390012  9296 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:13.390460  3211 raft_consensus.cc:2393] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 20: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:13.390002  9345 raft_consensus.cc:3055] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:13.358140  9058 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.392691  3202 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:13.380766  9255 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.395759  9255 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:13.369524  9239 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.361647  9335 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.428108  9262 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.385495  3249 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.459724  9255 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:13.459899  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 74538.5us
I20260709 13:18:13.460163  9255 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:13.460551  9255 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:13.460687  3249 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:13.391628  9345 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:13.461798  3249 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.349802  3251 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:13.462718  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 112994us
I20260709 13:18:13.462998  9345 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.464608  9345 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.465279  9241 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:13.465693  9241 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:13.466032  9241 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.469331  9106 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:13.470152  9106 consensus_queue.cc:1059] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:13.471201  9276 raft_consensus.cc:3055] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:13.471612  9276 raft_consensus.cc:740] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:13.472106  9348 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:13.472579  9348 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:13.472426  9276 consensus_queue.cc:260] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.473745  3249 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.472958  9348 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:13.477345  9106 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:13.478621  3249 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.480216  9106 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:13.480608  9106 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:13.405781  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 218008us
I20260709 13:18:13.482123  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.410740  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:13.411825  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:13.411487  9352 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.413003  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:13.413218  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:13.416044  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:13.417290  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:13.417500  3838 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:13.418936  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:18:13.419487  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 147978us
I20260709 13:18:13.419912  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:13.422106  3101 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:13.422691  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 180448us
I20260709 13:18:13.378973  9302 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.430081  9335 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:13.431455  9239 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:13.480408  9255 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.396816  9058 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:13.479151  3251 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.473757  9276 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:13.504206  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 82278.4us
I20260709 13:18:13.504706  9354 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:13.505220  9352 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:13.505417  9302 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:13.506114  9161 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:13.506737  9345 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:13.508953  9255 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:13.480962  9106 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:13.458688  3210 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:13.399981  9265 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.482507  3249 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.500162  3177 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:13.488112  3832 raft_consensus.cc:1240] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:13.505666  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:13.514189  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:13.515937  3834 raft_consensus.cc:2393] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 19: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:13.516260  3835 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:18:13.512948  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:13.517895  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:13.520653  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:13.521746  3838 raft_consensus.cc:2393] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 17: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:13.522711  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:13.523434  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:13.519660  9161 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:13.527272  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:13.528160  9354 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:13.529457  9354 raft_consensus.cc:3055] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:13.529835  9354 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:13.530759  9354 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.519793  9058 raft_consensus.cc:2764] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:18:13.524662  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:13.520462  9296 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:13.537426  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.540081  9265 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:13.533865  3841 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:13.540848  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.542229  9241 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.554637  3208 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:18:13.554955  9354 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:13.547293  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:13.556268  9241 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:13.556931  3280 raft_consensus.cc:1240] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:13.557154  9296 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:13.561070  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.563285  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.563825  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:13.564461  3278 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.565716  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.566417  3208 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 21.
I20260709 13:18:13.568439  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.569466  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.572697  9345 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:13.575547  9201 consensus_queue.cc:1059] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:13.579895  9106 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.581607  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.587670  3283 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:18:13.587760  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:13.579900  3211 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:18:13.556951  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:13.593153  3278 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:18:13.594161  3249 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.595453  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.598836  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.598912  3249 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.601652  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:13.589504  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:13.604382  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:13.604615  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.608191  9265 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:13.613446  9309 consensus_queue.cc:1059] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:18:13.605821  9336 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.614444  9262 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:13.614737  9336 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:13.615324  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 89288.3us
I20260709 13:18:13.600102  9255 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:13.597018  9161 raft_consensus.cc:697] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:13.604233  9194 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:13.621780  9194 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:13.622226  9194 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:13.606281  9201 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:13.620786  3206 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 21.
I20260709 13:18:13.608618  9265 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:13.600303  9345 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:13.600442  9239 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:13.638379  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.639065  3210 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:13.634790  9346 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:13.642920  9346 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:13.643329  9346 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:13.646369  9335 raft_consensus.cc:3055] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:13.646848  9335 raft_consensus.cc:740] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:13.647816  9335 consensus_queue.cc:260] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.649327  9239 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.650698  9106 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:13.651908  9161 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.632954  9265 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.616992  9336 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:13.665513  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 61611.2us
W20260709 13:18:13.668161  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 111311us
I20260709 13:18:13.669694  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:13.667054  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:13.670889  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.671422  9336 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:13.672012  9336 raft_consensus.cc:697] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:13.672894  9336 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.671299  9262 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:13.630985  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.636561  9345 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:13.683243  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.678886  3210 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 21.
I20260709 13:18:13.711896  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:13.702387  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:13.721874  3203 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
W20260709 13:18:13.708725  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 77855us
I20260709 13:18:13.703680  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:13.723881  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.730191  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:13.730201  3249 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:13.731321  3100 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:13.732571  3249 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.733471  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:13.734150  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.735643  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.737289  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.697314  9335 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.697367  9345 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.736672  9331 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:13.727166  9239 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:13.753477  3133 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:13.743345  9266 raft_consensus.cc:993] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:18:13.742002  9258 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:13.685036  9262 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:13.736899  8874 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:13.737047  9198 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:13.750816  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:13.767805  9266 raft_consensus.cc:1081] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:18:13.769380  3128 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:13.742126  9308 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:13.726727  9241 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:13.734086  9106 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:13.773110  9106 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:13.773634  9106 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:13.778462  3832 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:13.780186  9296 raft_consensus.cc:3055] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:13.780337  9239 consensus_queue.cc:1059] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:13.782610  9346 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.783437  9161 raft_consensus.cc:3055] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:13.783804  9161 raft_consensus.cc:740] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:18:13.756047  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 55947.2us
I20260709 13:18:13.786644  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:13.803184  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:13.693296  9348 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.805461  3276 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:18:13.805588  3128 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:13.808923  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:13.810658  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:13.768353  3249 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:13.780833  9296 raft_consensus.cc:740] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:13.812443  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:18:13.813305  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45706.7us
I20260709 13:18:13.814431  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:13.816390  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:13.814810  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:13.784852  9161 consensus_queue.cc:260] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.784816  9346 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:13.818507  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:13.822532  9348 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:13.819597  3806 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:18:13.831533  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.825265  9161 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:13.788066  9258 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 21 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:13.828744  9002 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:13.835963  9241 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:13.836449  9258 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.837316  9241 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:13.837749  9241 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:13.833528  9336 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:13.830642  8874 consensus_queue.cc:1059] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:18:13.839922  9336 raft_consensus.cc:697] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:13.840441  9276 raft_consensus.cc:3055] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:13.787488  9265 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.791335  9194 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.833487  9262 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:13.840909  9276 raft_consensus.cc:740] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:13.846824  9265 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:13.849880  9194 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:13.853776  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:13.818570  8991 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:13.858533  3841 raft_consensus.cc:2393] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:13.859212  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.863767  3203 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:13.864442  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.878242  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.879499  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.865070  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.880959  3210 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:13.881939  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.882751  3209 raft_consensus.cc:2393] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 15: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
W20260709 13:18:13.882823  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 72255.8us
W20260709 13:18:13.867726  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 51944.2us
I20260709 13:18:13.863216  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:13.885412  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:13.884649  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:13.886562  3208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34342
I20260709 13:18:13.892746  3208 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.893190  3208 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:13.901031  3805 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:13.902681  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:13.904992  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:13.906486  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:13.885023  9346 consensus_queue.cc:1059] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:18:13.838718  9241 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.910032  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:13.911793  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:13.912835  3278 raft_consensus.cc:2410] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:18:13.913794  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:13.915419  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:13.916692  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:13.918596  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:13.919502  3280 raft_consensus.cc:2393] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 12: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:13.890326  8991 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:13.899528  9354 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:13.922662  3805 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:13.932276  3208 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.923103  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:13.935537  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47242us
I20260709 13:18:13.855651  3135 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:13.906446  9201 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:13.960656  3101 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:13.963167  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:13.963341  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:13.958212  3131 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:18:13.968595  3204 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:13.967438  3249 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:13.919764  9002 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:13.960701  3805 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:13.975241  3805 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:13.979122  3208 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:13.983108  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:13.841002  9336 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:13.983762  3841 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:13.965291  9335 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:13.977859  9260 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:13.984525  9302 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:13.984174  9346 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:18:14.005748  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45176.5us
I20260709 13:18:14.009367  8991 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.011396  9352 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:13.987854  9241 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:13.958612  9276 consensus_queue.cc:260] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:13.976835  9294 consensus_queue.cc:1059] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 13:18:13.987839  9359 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:13.945194  9296 consensus_queue.cc:260] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.029712  9294 raft_consensus.cc:3055] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:14.042369  3101 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:14.042204  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 63379.6us
I20260709 13:18:14.040624  9294 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:14.046314  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.046463  9294 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.047688  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.048105  9294 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:14.014957  9302 raft_consensus.cc:697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:14.049314  9161 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:14.049744  9161 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:14.050185  9161 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.049872  9302 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.051908  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:14.052574  9058 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:14.061316  9106 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.060895  9194 raft_consensus.cc:3055] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:14.063799  9194 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:14.064482  9276 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:14.069957  9308 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:14.066884  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:14.073711  9106 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:14.075582  9255 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:14.078315  9262 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:14.081027  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.085712  3841 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:18:14.087294  3177 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:14.093575  3832 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:14.085459  3250 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:14.097488  3276 raft_consensus.cc:1240] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:14.100539  3282 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:14.105392  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:14.107231  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:14.110723  3276 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:14.111440  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:14.042747  9359 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:14.112634  3278 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:14.116359  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:14.117067  3284 raft_consensus.cc:1240] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:18:14.084474  9352 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:14.095803  9239 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:14.034268  9345 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.100127  9331 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:14.131489  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.131963  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:14.132059  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:14.132556  3277 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:14.137123  3211 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:14.150403  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:14.154848  3132 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 13: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:14.157539  3278 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 21.
I20260709 13:18:14.158499  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:14.164878  3135 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:14.162410  3279 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:14.162701  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:14.165844  3133 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:14.166637  3280 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:14.076903  9194 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.135854  9331 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.113752  9106 consensus_queue.cc:1059] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:18:14.167518  3131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
 from {username='slave'} at 127.0.0.1:49692
I20260709 13:18:14.177281  3131 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:14.177692  3131 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:14.136962  9354 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:14.166045  3127 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:14.174649  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:18:14.174923  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 69300us
I20260709 13:18:14.173300  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:18:14.179884  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 73891.8us
I20260709 13:18:14.182351  3276 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:14.182355  3176 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:14.165098  8861 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:14.183530  3133 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:14.183751  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.184158  3135 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:14.165450  9255 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:18:14.196805  3283 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:14.198902  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:14.271361  9308 raft_consensus.cc:3055] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:14.271854  9308 raft_consensus.cc:740] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:14.272753  9308 consensus_queue.cc:260] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.275481  9308 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:14.162122  3033 catalog_manager.cc:5697] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:14.271350  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:14.246315  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:14.200338  3127 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:14.206931  3250 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.197171  3133 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:14.198434  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:14.197988  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:14.198623  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.188280  8861 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.189910  9194 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:14.216521  3132 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:14.177591  9331 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.186986  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:14.198856  9058 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:14.243640  3131 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.262099  9360 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:14.218518  9265 consensus_queue.cc:1059] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:18:14.191809  9161 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:14.263131  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 79920.8us
I20260709 13:18:14.311008  3806 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:14.281728  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 83190us
I20260709 13:18:14.300077  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:14.284569  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:14.285704  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 206341us
I20260709 13:18:14.317860  3135 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
W20260709 13:18:14.228178  9365 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 13:18:14.289299  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.290606  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 83781us
I20260709 13:18:14.290489  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:14.217489  9296 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:14.306602  8861 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:14.308735  3131 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:14.343223  3101 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:14.221315  9345 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:14.314237  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.318357  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:14.229123  9370 log.cc:927] Time spent T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:18:14.356787  9260 raft_consensus.cc:3055] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:14.369202  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:14.369529  9260 raft_consensus.cc:740] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:14.319427  9239 raft_consensus.cc:697] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:14.370451  9260 consensus_queue.cc:260] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.370808  9239 consensus_queue.cc:237] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.371665  9260 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:14.186022  9354 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.327639  9262 consensus_queue.cc:1059] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:18:14.374214  9354 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:14.312466  9352 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:14.376036  3132 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.313858  9373 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:14.334411  9161 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:14.377889  9161 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:14.377933  9309 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:14.337226  3033 catalog_manager.cc:5697] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:14.325863  9360 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:14.345569  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.348474  3285 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 22.
I20260709 13:18:14.379513  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:14.232654  9359 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.354776  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:14.381525  3209 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 21: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:14.382701  9258 raft_consensus.cc:3055] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:14.383234  9258 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:14.384111  9258 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.390350  3033 catalog_manager.cc:5697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:14.364988  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.367885  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 53719.5us
I20260709 13:18:14.395308  3176 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:14.368419  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:18:14.368628  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 50399.8us
I20260709 13:18:14.396430  3835 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:14.396763  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.398136  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.401134  9379 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:14.392719  3033 catalog_manager.cc:5697] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 13 to 14, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 14 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.403362  9309 consensus_queue.cc:1059] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:14.404623  9379 raft_consensus.cc:3055] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:14.405012  9379 raft_consensus.cc:740] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:14.407866  3100 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:14.409284  9381 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:14.410179  3285 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:14.405826  9379 consensus_queue.cc:260] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.411811  9379 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:14.417981  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.403947  3033 catalog_manager.cc:5697] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:14.422602  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.423626  9352 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:14.424639  9352 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:14.425424  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:14.425730  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 82650.4us
I20260709 13:18:14.426477  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:14.427721  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.427956  3835 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:18:14.420953  3133 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:18:14.429270  3102 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:14.435581  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.427508  9201 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:14.437047  9294 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:14.432619  9360 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:14.437922  9296 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:14.437613  3033 catalog_manager.cc:5697] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:14.438028  9335 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:18:14.435210  8876 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:14.439170  3033 catalog_manager.cc:5697] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 13 to 15, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 15 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:14.440878  3033 catalog_manager.cc:5697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 9 to 12, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 12 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.442241  9345 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.442616  3033 catalog_manager.cc:5697] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 6 to 11, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New cstate: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:14.442857  9331 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.445143  9380 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:14.445422  9352 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:14.445724  9380 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:14.445879  9352 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:14.446252  9380 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:14.446379  9352 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:14.442798  9345 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.444301  3033 catalog_manager.cc:5697] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 16 to 18, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 18 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:14.449790  9258 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:14.462342  3132 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:14.464291  9296 raft_consensus.cc:697] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:18:14.477852  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47820.9us
I20260709 13:18:14.478747  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.480650  9382 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.481215  9382 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.483580  9382 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:14.473192  9296 consensus_queue.cc:237] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.484997  9331 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:14.489677  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:14.493173  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:14.502211  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:14.510133  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:14.511444  3284 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:14.508385  3806 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:14.496357  9161 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:14.497700  9241 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:18:14.514912  9255 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:14.515084  9385 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:14.517033  9308 consensus_queue.cc:1059] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:14.499550  9265 consensus_queue.cc:1059] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:18:14.517508  3250 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.539513  3250 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.517957  9381 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:14.497411  8876 consensus_queue.cc:1059] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:18:14.513320  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:14.524854  3281 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:14.525369  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:14.546149  3283 raft_consensus.cc:3055] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:14.546452  3283 raft_consensus.cc:740] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:14.529584  3209 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:14.530357  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:14.527186  3806 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:14.547189  3210 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:14.534304  3284 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:18:14.548722  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:14.535118  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:14.526461  9309 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:14.549606  3835 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:14.550436  3250 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.526262  9345 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:14.532231  9058 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:14.539899  9239 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:14.533733  9161 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:14.536674  9255 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:14.513104  9201 consensus_queue.cc:1059] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:18:14.559755  9002 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:14.565688  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:14.545161  9373 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:14.549325  9294 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:14.552425  9335 raft_consensus.cc:2804] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:14.551288  9309 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.552266  9198 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:18:14.569394  9161 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:14.589936  3250 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.565517  3283 consensus_queue.cc:260] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.558092  9194 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:18:14.573989  9255 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:14.573734  9276 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:14.584987  9372 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:14.588761  9296 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:14.593456  9309 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:14.641193  3209 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:18:14.646301  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 56461.6us
I20260709 13:18:14.593199  9335 raft_consensus.cc:697] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:18:14.649467  9388 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:18:14.649394  9335 consensus_queue.cc:237] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.644299  3283 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:14.656019  9371 raft_consensus.cc:3055] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:14.656541  9371 raft_consensus.cc:740] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:14.622571  9352 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.659096  9352 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:14.645298  9106 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:14.662200  9380 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.664448  9380 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:14.643059  9296 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:14.670419  9296 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.671705  9296 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:14.672209  9331 raft_consensus.cc:3055] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:14.672641  9331 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:14.673584  9331 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.674887  9331 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:14.675457  8874 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:14.671653  3283 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:18:14.686770  3250 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:14.709860  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 62787.1us
I20260709 13:18:14.710675  3250 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.642172  9276 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.717996  9266 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:18:14.719650  3030 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38218 (request call id 245) took 22329 ms (client timeout 15000 ms). Trace:
I20260709 13:18:14.632517  9294 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:14.729043  3209 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:14.735136  3204 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: []
W20260709 13:18:14.737282  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 244204us
I20260709 13:18:14.717666  9345 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:14.739094  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:14.742439  9380 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:14.743106  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.743662  9260 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:14.746163  9394 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:14.746594  9394 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:14.749291  9394 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.722034  9276 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:14.748610  9161 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.740780  9294 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:14.760938  9380 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:14.806044  9294 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:14.720994  3030 rpcz_store.cc:269] 0709 13:17:52.389853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.412751 (+ 22898us) service_pool.cc:224] Handling call
0709 13:17:53.205943 (+793192us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54000a87d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc159090 00007fb3bc1f7f3a 00007fb3c1fae1cc 00007fb3c20ac37e 00007fb3c056d2a4 00007fb3c056d232 00007fb3c056d161 00007fb3c056d0dc 00007fb3c056c392 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:14.719388 (+21513445us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:12.259119 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:12.268876 (+  9757us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:12.269875 (+   999us) write_op.cc:435] Acquired schema lock
0709 13:18:12.269965 (+    90us) tablet.cc:662] Decoding operations
0709 13:18:12.299935 (+ 29970us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:12.300025 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:12.300051 (+    26us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:18:12.301815 (+  1764us) tablet.cc:701] Row locks acquired
0709 13:18:12.301866 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:18:12.302063 (+   197us) write_op.cc:270] Start()
0709 13:18:12.302223 (+   160us) write_op.cc:276] Timestamp: P: 1783603092301993 usec, L: 0
0709 13:18:12.302264 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:18:12.303175 (+   911us) log.cc:844] Serialized 6685 byte log entry
0709 13:18:12.970820 (+667645us) op_driver.cc:464] REPLICATION: finished
0709 13:18:13.103405 (+132585us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b54000a87d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ec32a 00007fb3bc171f14 00007fb3bc171ec3 00007fb3bc171e38 00007fb3bc171df3 00007fb3bc1710dc 00007fb3bc19ae16 00007fb3bc182cbb 00007fb3bc16d39d 00007fb3bc170d75
0709 13:18:13.233242 (+129837us) write_op.cc:301] APPLY: starting
0709 13:18:13.233358 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:13.440189 (+206831us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:13.440241 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:13.779987 (+339746us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:13.817520 (+ 37533us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:18:13.817591 (+    71us) write_op.cc:312] APPLY: finished
0709 13:18:13.818059 (+   468us) log.cc:844] Serialized 156 byte log entry
0709 13:18:13.820442 (+  2383us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:13.820649 (+   207us) write_op.cc:454] Released schema lock
0709 13:18:13.820763 (+   114us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:13.873902 (+ 53139us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:13.884299 (+ 10397us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"spinlock_wait_cycles":564071168,"child_traces":[["op",{"apply.queue_time_us":234015,"apply.run_cpu_time_us":27700,"apply.run_wall_time_us":606342,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75323,"num_ops":17,"prepare.queue_time_us":135795,"prepare.run_cpu_time_us":128875,"prepare.run_wall_time_us":242370,"raft.queue_time_us":239522,"raft.run_cpu_time_us":22964,"raft.run_wall_time_us":136612,"replication_time_us":668338,"spinlock_wait_cycles":2621696,"thread_start_us":429862,"threads_started":4,"wal-append.queue_time_us":299809}]]}
I20260709 13:18:14.779301  9258 raft_consensus.cc:3055] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:14.737784  8876 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:18:14.787932  9394 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:14.739442  9371 consensus_queue.cc:260] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.774807  9359 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:14.808537  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 65575.6us
I20260709 13:18:14.814074  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:14.809629  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 66705.6us
I20260709 13:18:14.818222  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:14.784720  9309 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.821334  9380 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:14.809919  9258 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:14.836905  3209 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:14.834317  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:14.854938  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:14.856269  9399 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:14.859972  3805 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:14.861249  9302 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:14.858319  9400 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:14.862519  9400 raft_consensus.cc:697] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 18 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:14.863413  9400 consensus_queue.cc:237] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.863906  9276 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.878839  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:14.879527  3210 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:14.879657  3133 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:18:14.820488  9395 consensus_queue.cc:1059] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:18:14.836589  9380 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:14.850878  8874 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.887529  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:14.819648  9359 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.898679  3133 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:18:14.900163  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.860136  9371 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.904431  3285 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:14.908748  3132 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:14.910151  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:14.910733  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:14.914306  9395 raft_consensus.cc:3055] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:14.914775  9395 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:14.915642  9395 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.858955  9399 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 22 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:14.901741  8874 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.918181  9374 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:14.917861  9399 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:14.923440  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:14.918790  9374 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:14.921427  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:14.937467  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:14.939570  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:14.939867  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:14.916821  9395 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:14.942988  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:14.944777  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:14.945204  3280 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 16: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:14.941155  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:14.943811  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:14.935938  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:14.946700  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:14.947535  3835 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:14.949004  3251 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:14.952454  3276 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:18:14.952876  3276 pending_rounds.cc:85] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 13
I20260709 13:18:14.957779  3281 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:18:14.954972  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:14.961174  3129 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:14.961673  3282 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:14.953106  3276 pending_rounds.cc:107] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:18:14.965747  3276 raft_consensus.cc:2889] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:14.977097  3279 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:14.978336  3250 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:14.982749  3806 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:14.951601  8874 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:14.993275  3285 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:18:14.980032  9345 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:14.985680  9255 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:15.005108  9255 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:15.005987  3284 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:15.006713  9374 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:14.984372  9198 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:14.979691  9372 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:15.010239  3282 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:15.012741  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:15.018721  3835 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:14.928164  9258 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:15.021445  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:15.023316  3209 raft_consensus.cc:2393] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 17: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:15.020146  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:15.023958  3210 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:15.030138  3102 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:14.995249  9382 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:15.019414  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:15.037998  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:15.040714  3211 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:18:15.043031  3211 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:18:15.045293  3202 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:15.045809  3835 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:15.046691  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:15.038894  3204 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:18:14.984582  9335 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
W20260709 13:18:15.051972  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 66282.7us
I20260709 13:18:15.052860  3210 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:15.044883  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:15.054390  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:15.055558  9198 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:15.056136  9198 raft_consensus.cc:697] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:15.057045  9198 consensus_queue.cc:237] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:15.057781  9262 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:15.010471  9161 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:15.064925  3835 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:15.068334  9380 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:15.077232  9398 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:15.077876  9398 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:15.078292  9398 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:15.033723  9382 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.011138  9241 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:18:15.086186  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:15.046065  9352 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.050089  9296 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:15.109053  3020 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 023c1461b69c46bdb3c42ee16f303ea2 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 6 but the committed config has opid_index of 11
I20260709 13:18:15.109190  9407 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:18:15.118932  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:15.109721  9396 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:18:15.126861  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:15.127177  3129 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:15.110330  9345 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.112457  9276 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:15.113021  9359 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:15.034222  8876 consensus_queue.cc:1059] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:18:15.128257  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:15.131002  3281 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:15.101969  9382 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:15.134063  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:15.030731  9372 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:15.098486  9309 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:15.135664  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:15.064736  9360 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:18:15.148010  3835 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:15.098552  9380 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:18:15.134877  9161 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:15.135439  9345 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:15.136343  9058 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:15.147327  9399 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:15.118000  9352 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:15.150728  9400 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.155341  9239 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:15.143725  3020 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f4a8a614fca4531aab11f5963396f62 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc48eecc27554cb58b15193cd442b1d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:18:15.160167  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 107072us
I20260709 13:18:15.174170  9413 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.174853  9413 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:15.178320  9372 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:15.179621  9354 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:15.160895  9399 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:15.180493  9399 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:15.181334  9400 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:15.183545  9400 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:15.159893  9296 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:18:15.184571  9258 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:15.188367  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:15.155664  9161 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:15.189316  9161 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:15.159395  9058 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:15.191112  9058 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:15.180042  9354 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:15.207480  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:15.211653  3284 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:15.225883  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:15.227133  3127 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:15.227151  3130 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:15.233695  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:15.241202  3205 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 16: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:15.241066  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:15.246534  3835 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
W20260709 13:18:15.272305  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 136718us
I20260709 13:18:15.246891  9413 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:15.287041  3176 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:15.288534  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:15.289597  9400 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:15.293644  9400 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:15.294199  9352 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:15.285988  9407 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:15.294651  9400 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:15.295476  9407 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:15.253557  9372 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.314437  3127 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:18:15.258695  9002 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 13:18:15.329352  9380 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:15.359571  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:15.361438  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:15.356706  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:15.357234  3280 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:15.350240  9374 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:15.366459  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:15.355269  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:15.367569  3277 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 11.
I20260709 13:18:15.362558  3134 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:15.364138  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:15.372690  3281 raft_consensus.cc:2393] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:15.373112  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:15.345518  9360 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.325778  9372 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:15.315670  9354 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:15.359637  9407 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:15.372342  9296 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:15.356613  9385 consensus_queue.cc:1059] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:18:15.350594  9379 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:18:15.410527  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:15.339893  9398 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:15.426378  9385 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:15.427208  9427 raft_consensus.cc:3055] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:15.454885  9427 raft_consensus.cc:740] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:18:15.456027  9418 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:15.455857  9427 consensus_queue.cc:260] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:15.401763  9425 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:18:15.433212  9296 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:15.376677  9374 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:15.434356  9382 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:15.394259  9360 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:15.422022  9331 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:15.462632  9331 raft_consensus.cc:697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:15.463075  9398 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:15.463821  3131 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:18:15.379609  9335 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:18:15.466544  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:15.468290  9416 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 13:18:15.469596  9427 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:15.463637  9331 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:15.488046  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:15.488857  3838 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:18:15.493247  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:15.496830  3127 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:15.506672  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:15.526678  9423 log.cc:927] Time spent T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.237s	user 0.002s	sys 0.000s
I20260709 13:18:15.532050  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:15.532923  3208 raft_consensus.cc:2393] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 16: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:15.535722  3249 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:15.554672  3100 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:15.627009  3177 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
W20260709 13:18:15.629817  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 57668.5us
I20260709 13:18:15.653620  3835 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
W20260709 13:18:15.663537  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 306903us
I20260709 13:18:15.666868  3832 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:15.668426  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:15.668715  3806 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:15.673224  3806 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:15.634410  9106 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:15.634156  9395 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:15.632702  9352 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:15.647327  9403 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.685612  3834 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:18:15.659912  9382 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:15.684046  9262 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:15.670285  9380 raft_consensus.cc:697] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:15.681355  9335 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:15.684176  9425 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:15.793128  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 124771us
I20260709 13:18:15.800374  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:15.842088  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 179036us
I20260709 13:18:15.724877  9413 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:15.680477  9302 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.119s
I20260709 13:18:15.790150  8991 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.862185  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:15.864624  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 155227us
W20260709 13:18:15.885028  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.799841  9425 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.903301  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:15.845999  9296 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:15.786780  9352 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:15.853382  9413 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.916283  3131 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:15.846091  9416 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:18:15.919554  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 52831us
W20260709 13:18:15.920915  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:15.922077  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 121749us
I20260709 13:18:15.858230  9335 raft_consensus.cc:697] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:15.931250  3135 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:18:15.894924  9400 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:15.840653  9262 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:15.786036  9403 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:15.974639  9422 log.cc:927] Time spent T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.631s	user 0.006s	sys 0.004s
W20260709 13:18:15.985666  9371 consensus_meta.cc:287] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 1.066s	user 0.018s	sys 0.000s
W20260709 13:18:15.986651  9399 consensus_meta.cc:287] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.806s	user 0.012s	sys 0.003s
W20260709 13:18:15.987497  9058 consensus_meta.cc:287] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.796s	user 0.014s	sys 0.005s
I20260709 13:18:15.988071  9437 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:15.861043  9385 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
W20260709 13:18:16.106927  3128 consensus_meta.cc:287] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.682s	user 0.013s	sys 0.016s
I20260709 13:18:16.107347  3128 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:15.919246  9425 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:15.932669  9413 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:16.111968  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 164207us
I20260709 13:18:15.887663  8991 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.120591  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.134447  3211 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:15.991221  9360 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:16.107111  9258 consensus_meta.cc:287] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.922s	user 0.012s	sys 0.006s
W20260709 13:18:16.114894  9161 consensus_meta.cc:287] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.925s	user 0.006s	sys 0.009s
I20260709 13:18:16.148753  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:15.991892  9331 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.146s
W20260709 13:18:16.138860  9345 consensus_meta.cc:287] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.980s	user 0.013s	sys 0.012s
I20260709 13:18:16.130040  9239 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.182770  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:15.969671  9416 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.181509  3131 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 18.
I20260709 13:18:16.184127  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 2044) took 1234 ms. Trace:
W20260709 13:18:16.172268  9432 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
I20260709 13:18:16.173251  9372 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:16.186759  9451 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:16.183568  9359 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:16.187402  9433 log.cc:927] Time spent T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:18:16.188723  9431 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
I20260709 13:18:16.190598  8991 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:16.191610  9438 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:18:16.191154  9335 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.194962  9425 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.183058  9400 consensus_queue.cc:1059] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:18:16.248070  9425 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:16.197052  3132 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
W20260709 13:18:16.198109  9439 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:18:16.211661  9239 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.108883  9399 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.252739  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 924) took 1056 ms. Trace:
I20260709 13:18:16.208691  3130 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:16.201581  3128 rpcz_store.cc:276] 0709 13:18:14.939181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.939303 (+   122us) service_pool.cc:224] Handling call
0709 13:18:16.173595 (+1234292us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b540039e254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:16.173708 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108095744}
I20260709 13:18:16.256928  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49692 (request call id 2514) took 1092 ms. Trace:
I20260709 13:18:16.253449  3210 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:16.108198  9058 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.066154  9380 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.242553  9453 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.243845  9434 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.182613  9437 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:18:16.245796  9352 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:16.162850  9161 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.246038  9435 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:18:16.265239  3136 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.007s	sys 0.010s
I20260709 13:18:16.268572  9385 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:16.233819  9359 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.271325  9457 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:16.254303  9416 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:16.275089  9400 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:16.275579  9058 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:16.277447  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3443) took 1003 ms. Trace:
W20260709 13:18:16.279808  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 104802us
I20260709 13:18:16.279943  9403 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:16.257244  9265 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.283651  9453 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.311241  3284 rpcz_store.cc:276] 0709 13:18:15.273967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.274124 (+   157us) service_pool.cc:224] Handling call
0709 13:18:15.274465 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.287460 (+ 12995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.287562 (+   102us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.316190 (+ 28628us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.674363 (+358173us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:15.674418 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.674521 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.277158 (+602637us) raft_consensus.cc:1685] finished
0709 13:18:16.277185 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.277362 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12518,"raft.queue_time_us":15808,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":314778,"threads_started":1,"wal-append.queue_time_us":578328}
I20260709 13:18:16.322935  9453 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:16.253127  3841 rpcz_store.cc:276] 0709 13:18:15.196534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.197417 (+   883us) service_pool.cc:224] Handling call
0709 13:18:15.197703 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.239667 (+ 41964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.239707 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.240268 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.710872 (+470604us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:15.710932 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.711030 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.252471 (+541441us) raft_consensus.cc:1685] finished
0709 13:18:16.252492 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.252635 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38261,"raft.queue_time_us":17594,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":5406,"thread_start_us":423052,"threads_started":1,"wal-append.queue_time_us":604811}
I20260709 13:18:16.323629  9400 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.326344  9400 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:16.327306  9265 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.330641  9265 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:16.331343  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.333318  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.333650  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.335419  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.336410  9161 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:16.338963  9359 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:16.311353  9457 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.342193  9457 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:16.291680  9434 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:16.291944  3102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.008s	sys 0.022s
I20260709 13:18:16.198576  9345 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.309827  9385 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.347144  9345 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:16.347741  9385 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:16.348621  3102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.008s	sys 0.022s
W20260709 13:18:16.294538  3136 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.007s	sys 0.010s
I20260709 13:18:16.262002  3129 rpcz_store.cc:276] 0709 13:18:15.164588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.164722 (+   134us) service_pool.cc:224] Handling call
0709 13:18:15.216100 (+ 51378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.238142 (+ 22042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.238171 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.252688 (+ 14517us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.680826 (+428138us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:15.725548 (+ 44722us) log.cc:844] Serialized 14 byte log entry
0709 13:18:15.787924 (+ 62376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.788030 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.256662 (+468632us) raft_consensus.cc:1685] finished
0709 13:18:16.256683 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.256836 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30246,"prepare.queue_time_us":44427,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":163662,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":41740,"thread_start_us":383447,"threads_started":1,"wal-append.queue_time_us":509605}
I20260709 13:18:16.253069  9399 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:16.313304  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:16.354012  9374 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:16.354844  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:16.357285  9399 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:16.357487  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:16.357712  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.357877  9399 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:16.358330  3209 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:18:16.319356  3208 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:16.320510  9445 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.358777  9399 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.359182  9445 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.361042  3205 raft_consensus.cc:3060] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:16.361268  9445 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:16.361799  9435 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:16.344885  9434 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:16.364214  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.364814  3206 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:18:16.365218  8876 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:16.365731  8876 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.366190  9239 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:16.367709  8876 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:16.369293  9381 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.369837  9381 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.370956  8876 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.371420  8876 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.372247  9266 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:16.372778  9266 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.371474  9398 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:16.373472  9381 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:16.373857  9398 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.374903  9266 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:16.377836  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:16.379992  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.383286  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:16.385236  3102 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:16.368857  9354 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:16.397382  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:16.398486  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:16.375699  3202 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:16.402882  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 2501) took 1493 ms. Trace:
I20260709 13:18:16.403193  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:16.403949  3840 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:18:16.404563  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.403324  3132 rpcz_store.cc:276] 0709 13:18:14.909817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.909932 (+   115us) service_pool.cc:224] Handling call
0709 13:18:16.402716 (+1492784us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400074c54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:16.402824 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2772821888}
W20260709 13:18:16.364231  9427 consensus_meta.cc:287] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.894s	user 0.011s	sys 0.005s
I20260709 13:18:16.409032  3833 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:16.406014  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 411128us
I20260709 13:18:16.414830  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.420717  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:16.418433  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.421403  3835 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:16.419574  3209 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:16.294013  9413 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.426698  3130 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:16.469817  3133 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:16.429061  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:16.429541  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:16.429921  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:16.473050  3135 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.473069  3131 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:16.475394  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:16.475479  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:16.432796  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:16.476243  3131 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:16.416203  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:16.406239  9336 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.478858  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:16.479602  3134 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 21.
I20260709 13:18:16.481009  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:16.476423  3284 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 19.
I20260709 13:18:16.482362  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:16.482812  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.482969  3133 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:16.467489  3205 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:16.473755  3132 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.485255  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:16.407874  9407 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:16.485956  3282 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:16.408037  9435 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.483654  3203 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:16.488629  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:16.410624  9266 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.420359  9437 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.080s
I20260709 13:18:16.493059  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:16.494236  3251 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:18:16.693517  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 220723us
W20260709 13:18:16.647637  3101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.015s	sys 0.010s
I20260709 13:18:16.694876  3132 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:16.652745  3130 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:16.597425  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:18:16.487516  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 73115.8us
I20260709 13:18:16.699597  3838 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:16.700021  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:16.701042  3101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.018s	sys 0.010s
W20260709 13:18:16.701948  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 207791us
I20260709 13:18:16.472159  9427 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:16.521798  3102 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:16.524721  3100 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:16.501556  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:16.703306  3251 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:18:16.635931  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 465894us
I20260709 13:18:16.475144  9309 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:16.472573  8876 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:16.715874  3134 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:16.718120  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.729507  3211 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
W20260709 13:18:16.729646  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 207950us
W20260709 13:18:16.718323  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 193675us
I20260709 13:18:16.721199  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.724452  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:18:16.701584  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 737430us
W20260709 13:18:16.527935  9462 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:18:16.478790  9106 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:16.522336  9260 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.674396  9385 raft_consensus.cc:476] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 13:18:16.540071  9161 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:16.737356  3806 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:16.739161  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:16.475016  9434 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:16.738417  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:16.717212  9400 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:16.734844  3100 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:16.728484  9296 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:16.740155  3209 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:16.786639  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:16.739687  3135 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:16.591365  9262 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:16.674497  9355 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:16.736966  9265 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:16.494042  9398 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:16.514191  9450 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.806345  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:16.510421  9379 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.522094  9407 raft_consensus.cc:697] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:16.615818  9444 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:16.689699  9373 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.596599  9413 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:16.701567  9428 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.763976  3250 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:16.540372  9457 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:16.486147  9239 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.765487  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.606174  9374 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:16.881433  3208 raft_consensus.cc:2410] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:18:16.806703  9399 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:16.775153  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:16.776057  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:16.778220  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:16.781594  3284 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 20: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:16.779568  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:16.775579  3280 raft_consensus.cc:1240] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:18:16.774961  3276 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 18: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:16.538465  9451 raft_consensus.cc:3055] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:18:16.787030  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 52276.6us
I20260709 13:18:16.892942  3100 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:18:16.735921  3020 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f4a8a614fca4531aab11f5963396f62 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc48eecc27554cb58b15193cd442b1d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:16.499809  9435 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.823103  3838 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:18:16.489989  9336 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.826494  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:16.826005  3134 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:16.763841  8876 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:16.807222  3283 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:16.902040  3177 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:16.729539  9427 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.781451  9395 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:16.739943  9309 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.701114  9266 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:16.898845  9462 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:18:16.879993  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 141795us
I20260709 13:18:16.774550  3833 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:16.771668  9106 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.765194  9260 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.887663  3203 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:16.888417  3279 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:16.809780  3209 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:18:16.893914  3020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 158038us
I20260709 13:18:16.780769  9161 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.785840  9396 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.830468  9355 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.896620  3281 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:18:16.874369  9398 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:16.808261  9381 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:16.770679  9345 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 13:18:16.830647  9372 consensus_queue.cc:1059] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:18:16.883546  9194 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:16.830111  9379 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.871663  9255 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:18:16.786172  9434 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.892529  9294 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.942062  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:16.920192  3206 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 22.
I20260709 13:18:16.945587  3841 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
I20260709 13:18:16.910034  9437 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:16.879778  9373 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.950335  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:16.951288  3282 raft_consensus.cc:2393] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 16: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:16.891865  9451 raft_consensus.cc:740] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:16.902112  9464 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.943053  3279 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:16.953460  3806 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:16.970256  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:16.886821  9457 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.970021  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:16.826757  9265 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:16.970002  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 206154us
I20260709 13:18:16.936932  9381 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.881275  9428 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.969313  9276 raft_consensus.cc:3055] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:16.965657  8874 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.973876  9255 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
W20260709 13:18:16.979712  9354 consensus_meta.cc:287] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.573s	user 0.013s	sys 0.000s
I20260709 13:18:16.920435  9395 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.980227  9443 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.974778  3136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 875) took 1766 ms. Trace:
I20260709 13:18:16.890753  9374 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.970327  9459 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:16.987002  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:16.829510  9450 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.948894  9394 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:16.897396  9239 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:16.948730  9294 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.990944  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:16.980922  9359 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:17.015955  3128 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:16.998188  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:18:16.994609  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 294667us
I20260709 13:18:16.981609  3806 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:16.912333  8876 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.001259  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:16.966796  9460 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.003059  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.006407  3133 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:16.970177  9446 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:16.948331  9198 raft_consensus.cc:3055] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:16.974059  9448 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:16.966939  9461 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:17.053735  3127 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 18: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:16.945235  9194 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.054095  9461 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.054616  9461 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.017623  9359 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.055156  9359 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:17.011483  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 118636us
I20260709 13:18:17.013110  3283 raft_consensus.cc:2393] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 18: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:16.988637  9381 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:17.057116  9452 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:17.057926  9395 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.045658  9198 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:17.059707  9198 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.949344  9398 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.060973  9198 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.996493  9372 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.024065  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:17.000512  9276 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:18:17.083562  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 59608.6us
I20260709 13:18:17.084671  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:17.014889  9394 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.991443  9437 raft_consensus.cc:697] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:18:17.064388  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 82847.1us
I20260709 13:18:16.905908  9444 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.004067  9106 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:17.025485  3129 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:17.005210  9458 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:17.002357  9296 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:17.008143  3136 rpcz_store.cc:276] 0709 13:18:15.208851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.209021 (+   170us) service_pool.cc:224] Handling call
0709 13:18:15.240928 (+ 31907us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.247355 (+  6427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.247388 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.498698 (+251310us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b2c000014c8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:18:15.508351 (+  9653us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.641878 (+133527us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b18004bee60. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b9102522 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:18:16.349382 (+707504us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:16.349665 (+   283us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.367963 (+ 18298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.368047 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.974493 (+606446us) raft_consensus.cc:1685] finished
0709 13:18:16.974522 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.974697 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18065,"prepare.queue_time_us":1277,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":25857,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":1511,"spinlock_wait_cycles":10105344,"thread_start_us":840650,"threads_started":1,"wal-append.queue_time_us":866663}
I20260709 13:18:16.971266  9464 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.048766  3281 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
W20260709 13:18:17.050418  9475 log.cc:927] Time spent T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:18:17.013103  9443 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:17.053612  9471 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:18:16.941833  9396 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:16.975203  9407 consensus_queue.cc:237] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.127506  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:17.103705  9478 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:17.062222  3100 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:17.069764  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:17.101549  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 103544us
I20260709 13:18:17.043649  9354 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.107141  3282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e805018f85b41fc88644215be011084"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:17.005026  8874 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.135412  3282 raft_consensus.cc:606] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:17.061825  9484 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.127691  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:16.981216  9454 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:17.013219  9262 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.086314  9452 raft_consensus.cc:697] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:17.099252  9394 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:17.098837  9479 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:17.104053  9445 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:17.110404  9413 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:17.135875  3282 raft_consensus.cc:614] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:17.114265  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:17.136559  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 74426.6us
I20260709 13:18:17.015359  9459 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.148886  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:17.134596  9472 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:18:17.143023  3129 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:17.158833  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:17.152945  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:17.169631  3131 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 17: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:17.102401  9372 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.146687  9403 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:17.111534  9296 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.156757  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:17.089320  9448 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.171680  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.172248  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.134492  9266 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:17.027009  9451 consensus_queue.cc:260] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.145728  9454 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.154712  9260 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.150919  9478 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:17.194072  3101 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:17.153515  9336 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.212575  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.046252  9460 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.214116  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.152356  9479 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:17.152623  9427 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.148504  9276 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.166437  9385 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:17.154994  9435 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.148820  9354 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.178194  9255 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:17.173338  9379 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.177445  9413 raft_consensus.cc:697] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:17.150614  9484 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.194787  9374 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.152196  9262 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:17.242564  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 48565.3us
I20260709 13:18:17.283361  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:17.199076  9161 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.212129  9355 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.253425  3209 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:18:17.221642  9309 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.197924  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:17.220142  9454 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:17.235230  9451 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:17.255354  9479 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:17.264205  8876 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.264663  9436 raft_consensus.cc:3055] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:17.234958  9373 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.305609  9478 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.306067  9482 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:17.306941  9482 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.193239  9403 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.308207  9403 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:17.240020  9481 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.309284  9481 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.244915  9398 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.278611  3285 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:17.265297  9477 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.092s
I20260709 13:18:17.196033  9490 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 13:18:17.280887  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.178108  9445 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:18:17.291858  3101 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:17.294159  3129 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:17.273792  9265 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.273204  9255 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.167630  9437 consensus_queue.cc:237] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.303153  9436 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:17.278504  9452 consensus_queue.cc:237] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.280469  9457 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.259581  9260 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:17.291070  9276 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:17.299660  9374 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:17.342585  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 50806us
W20260709 13:18:17.345742  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 189043us
I20260709 13:18:17.283617  9359 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.354353  9482 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.342242  9458 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:17.342924  9444 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:17.348157  9255 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:17.358572  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:17.347669  9398 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:17.355806  9413 consensus_queue.cc:237] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.355039  9260 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:17.357769  9449 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:17.377559  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:17.377950  9400 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:17.375275  9464 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.373631  9296 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:17.374616  9487 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 13:18:17.370321  9492 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:18:17.397058  9400 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:17.399698  9400 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:17.381601  9260 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.400887  8874 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:17.401437  9296 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:17.401999  9296 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.402851  9460 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:17.404405  9296 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.363044  9443 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:17.406165  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:17.391083  9491 log.cc:927] Time spent T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:18:17.407723  9354 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.369427  9372 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.409327  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:17.417455  9458 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.419651  9354 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:17.420183  9354 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:17.421861  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 57105.3us
I20260709 13:18:17.423148  9457 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:17.423599  9352 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:17.395421  9359 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.394209  9381 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.428947  9381 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.429273  9504 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:17.429738  9504 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:17.430084  9504 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:17.396718  9449 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:17.422624  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:17.412418  9478 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:17.445959  9481 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.446273  9354 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:17.446631  3805 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.66:42299 timed out after 2.007s (SENT) [suppressed 10 similar messages]
I20260709 13:18:17.447916  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:17.448562  9478 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:17.453408  9352 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:17.453599  9478 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:17.453989  9352 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:17.454959  9352 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.457324  9374 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:17.458142  9434 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:17.459030  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 798) took 1104 ms. Trace:
I20260709 13:18:17.457358  9058 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:17.459417  3204 rpcz_store.cc:276] 0709 13:18:16.354901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.355880 (+   979us) service_pool.cc:224] Handling call
0709 13:18:16.356162 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.356514 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.356538 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:16.357029 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.712313 (+355284us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:16.712373 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.712472 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.429071 (+716599us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b24001b7868. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b8f889c4 00007fb3b8f86acb 00007fb3b9141dc9 00007fb3b9141a55 00007fb3b9140fb0 00007fb3bbdb7488 00007fb3bbdb7be8 00007fb3bbd8f398 00007fb3bbd8a76a 00007fb3bbd89bb6
0709 13:18:17.447572 (+ 18501us) raft_consensus.cc:1685] finished
0709 13:18:17.447598 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.458914 (+ 11316us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5415,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":25168640,"thread_start_us":349604,"threads_started":1,"wal-append.queue_time_us":510848}
I20260709 13:18:17.460840  9058 raft_consensus.cc:697] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 18 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:17.467501  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:17.471491  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:17.472150  3211 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:17.472761  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.473261  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.477608  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.478771  3210 raft_consensus.cc:2393] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 22: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:17.480276  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:17.481055  3207 raft_consensus.cc:3060] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.518675  3204 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 19: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:17.518271  9413 consensus_queue.cc:1059] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:18:17.522652  9413 raft_consensus.cc:3055] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:17.523193  9413 raft_consensus.cc:740] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:17.525617  3203 raft_consensus.cc:1240] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:17.524137  9413 consensus_queue.cc:260] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.527897  9413 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:17.518527  9477 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:17.529593  9477 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:17.530057  9477 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:17.535341  3837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 1350) took 1135 ms. Trace:
I20260709 13:18:17.447806  9449 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:17.526842  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.383378  9497 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:18:17.538844  3209 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:18:17.544902  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.550467  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:17.548224  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 101618us
I20260709 13:18:17.549881  3211 raft_consensus.cc:2468] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:18:17.546031  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.535866  3837 rpcz_store.cc:276] 0709 13:18:16.399597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.489888 (+ 90291us) service_pool.cc:224] Handling call
0709 13:18:16.523125 (+ 33237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.981550 (+458425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.981580 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.012850 (+ 31270us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.125462 (+112612us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:18:17.125505 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.473475 (+347970us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54005c8854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:17.473522 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.473565 (+    43us) raft_consensus.cc:1685] finished
0709 13:18:17.473582 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.535144 (+ 61562us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10382,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":13161,"spinlock_wait_cycles":1029302016,"thread_start_us":75283,"threads_started":1,"wal-append.queue_time_us":178732}
I20260709 13:18:17.392733  9436 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.560138  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 2061) took 1123 ms. Trace:
I20260709 13:18:17.461813  9058 consensus_queue.cc:237] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.565385  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.565688  9255 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.567587  9260 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:17.569303  9509 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:18:17.447296  9461 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.573309  9484 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:17.574419  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.578794  3204 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:17.578677  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.578573  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:17.582710  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:17.591907  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.592913  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:17.593504  3130 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 22.
I20260709 13:18:17.594592  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:17.595492  3130 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
I20260709 13:18:17.596356  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:17.577737  3127 rpcz_store.cc:276] 0709 13:18:16.436862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.473807 (+ 36945us) service_pool.cc:224] Handling call
0709 13:18:17.559946 (+1086139us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54002da354. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:17.560076 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315963136}
I20260709 13:18:17.548542  9457 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.586282  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:17.587006  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:17.587723  3207 raft_consensus.cc:2468] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:18:17.587222  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.599166  3832 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:18:17.590339  9335 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:18:17.600380  9457 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.602864  9457 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.597028  3130 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 21: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:17.603955  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:17.604430  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:17.604800  3837 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:18:17.605186  3131 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:17.605202  3805 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:17.606259  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:17.606559  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.608114  3208 raft_consensus.cc:2410] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:18:17.611903  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:17.613880  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:17.614522  3127 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:18:17.613626  3250 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:17.618111  3177 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:17.618860  9457 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:17.619442  9457 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:17.619975  9457 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:17.627943  3832 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:17.627804  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.554411  9394 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.629503  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:17.631738  3136 raft_consensus.cc:2393] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 20: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:17.587721  9434 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:17.634018  3100 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:17.636865  9255 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:17.577219  9403 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.649686  9434 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.654776  9479 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.656527  9434 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.633337  9394 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.616097  9335 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:17.638690  9437 consensus_queue.cc:1059] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:18:17.613634  9106 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:17.646813  9381 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:17.635011  9002 consensus_queue.cc:1059] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:18:17.675940  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:17.662653  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:17.682595  3250 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:17.659890  9400 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.692071  9359 raft_consensus.cc:3055] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:17.690595  3250 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:17.616261  9460 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:18:17.665357  9198 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:17.658564  9403 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.665887  9381 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.682991  9352 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:17.692510  9359 raft_consensus.cc:740] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:17.658891  9260 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.657037  9479 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.695240  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:17.679723  9413 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:17.661686  9437 consensus_queue.cc:1243] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer 0930e3e7657c43bcaaa5b0778f3e08cf log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:17.631189  9454 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.685209  9106 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:17.719619  3283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37a53418fbf14b998493923afc272c3c"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:17.693360  9345 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:17.667026  9478 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.704838  9198 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.694000  9434 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:17.717025  9352 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.710053  9381 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:17.794062  9434 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.794620  9434 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:17.795707  9352 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.660604  9477 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.798825  9477 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.659112  9504 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.800650  9504 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.801332  9489 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:17.801797  9489 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.802135  9489 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:17.802407  9381 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.804486  9381 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.698907  9255 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:17.781172  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:17.805070  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:17.805459  3128 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:17.722875  9413 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.806494  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:17.806557  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:17.808336  9413 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.808923  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:17.810333  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:17.810642  9478 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:17.811527  9495 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:18:17.811941  9496 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.530s	user 0.002s	sys 0.000s
I20260709 13:18:17.812654  9198 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:17.808369  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:17.814206  9396 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.717945  9276 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:17.817340  9276 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.818135  9461 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.787653  3283 raft_consensus.cc:606] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:17.788790  9345 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.823374  9345 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:17.823571  9450 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.825909  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:17.827220  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.827809  3211 raft_consensus.cc:2376] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17. Re-sending same reply.
I20260709 13:18:17.829419  3805 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:17.829949  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:17.830546  3209 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:17.830737  3805 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:17.831662  3805 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:17.832392  9336 raft_consensus.cc:2804] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:17.832928  9493 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:17.833292  9488 raft_consensus.cc:2804] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:17.833510  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58470 (request call id 1353) took 1353 ms. Trace:
I20260709 13:18:17.833901  9488 raft_consensus.cc:697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:17.834797  9488 consensus_queue.cc:237] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.836611  9459 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.832940  9336 raft_consensus.cc:697] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:17.837834  9336 consensus_queue.cc:237] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.838500  9461 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:17.839109  9461 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.839537  9448 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:17.812831  9449 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.841131  3204 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:17.841427  9461 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:17.833901  3841 rpcz_store.cc:276] 0709 13:18:16.479980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.488273 (+  8293us) service_pool.cc:224] Handling call
0709 13:18:17.833319 (+1345046us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400603e54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:17.833433 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571679616}
I20260709 13:18:17.844631  3283 raft_consensus.cc:614] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:17.845387  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:17.846150  9276 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.833441  9493 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.847110  9493 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:17.850628  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:17.805146  9255 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.851408  3208 raft_consensus.cc:2393] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 19: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:17.851375  9255 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:17.850921  9449 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.848511  9345 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.856773  3205 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:17.859165  9345 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:17.861506  9455 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:17.862058  9455 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.862347  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:17.862939  3284 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:18:17.864174  3136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:18:17.864743  3136 raft_consensus.cc:606] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:17.865113  3136 raft_consensus.cc:614] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:17.866938  9455 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:17.867234  9255 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.714656  8874 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.870362  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.894430  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.895097  3282 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 22.
I20260709 13:18:17.870728  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.874166  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:17.876402  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:17.878401  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:17.879088  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.898072  3277 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 13: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:17.828914  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:17.899122  3211 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:17.789247  9106 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.909507  3204 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 21.
I20260709 13:18:17.913070  3211 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:17.916657  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:17.893847  3279 raft_consensus.cc:1240] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:18:17.917888  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.918726  3211 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:17.908234  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:18:17.883541  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 66594.1us
I20260709 13:18:17.906533  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:17.919729  3285 raft_consensus.cc:2368] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:17.920079  3205 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:17.914361  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.915283  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.889835  3128 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:17.921366  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.921813  3280 raft_consensus.cc:2410] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:18:17.923270  3842 raft_consensus.cc:2368] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13.
I20260709 13:18:17.923472  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:17.924197  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.924266  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:17.933014  3283 raft_consensus.cc:1240] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:17.928665  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:17.893682  9302 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:17.956432  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:18:17.958019  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.958149  3251 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:17.961997  3285 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 20: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:17.916818  9461 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:17.953711  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:17.964722  3251 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:17.959496  3205 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:17.940208  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:17.968811  3211 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:17.931613  9413 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.964563  3102 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:17.926481  9276 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:17.981061  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.981362  3101 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:17.982079  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.914222  8874 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.984056  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.984731  3279 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:18:17.985687  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.978643  3209 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:17.988989  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.989724  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.916898  9416 consensus_queue.cc:1059] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:18:17.993032  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:17.959962  9302 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.999306  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:18.006752  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.015220  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:18.016269  3276 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:17.931345  9359 consensus_queue.cc:260] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:18.021814  9518 log.cc:927] Time spent T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:18.022598  9359 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:17.957484  9198 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.980676  9490 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:18.064888  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.036931  3284 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:18:18.065810  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:17.988444  9460 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:17.988947  9459 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:17.989005  9400 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:18.029341  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:18.072407  3285 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:18.032534  9517 log.cc:927] Time spent T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
I20260709 13:18:18.043020  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2755) took 1316 ms. Trace:
I20260709 13:18:18.027098  9345 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.045601  9443 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:18.005656  9262 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:18.047996  9457 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.049546  9493 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:17.993794  9455 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:17.978883  9461 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.051131  9489 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:17.994114  9450 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:18.054431  9302 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:17.990391  9276 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.056648  9106 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:17.983553  9413 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.057454  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.058151  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.058483  9434 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.036965  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.062453  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.114912  3130 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:18:18.115947  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.066521  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:18.023351  9488 raft_consensus.cc:3055] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:18.075461  3202 rpcz_store.cc:276] 0709 13:18:16.726103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.781713 (+ 55610us) service_pool.cc:224] Handling call
0709 13:18:16.825718 (+ 44005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.943152 (+117434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.943198 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.943254 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:16.943299 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.042730 (+1099431us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540019ee54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:18.042788 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.042936 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269547904}
I20260709 13:18:18.081140  3209 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:18.121706  3277 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:18.068516  9460 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.085718  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:18.123994  3132 raft_consensus.cc:2368] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 19. Current term is 20.
I20260709 13:18:18.124315  3282 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:18.102124  9262 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.127146  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:18.127863  3127 raft_consensus.cc:2368] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:18.119524  3836 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:18.118702  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:18.120448  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.129634  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.069180  9490 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.131835  3280 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:18.133288  9490 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:18.081336  9443 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.134196  9443 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:18.118362  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.138374  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.141526  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:18.131006  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:18.143776  3284 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:18.144631  3285 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:18.145711  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.146611  3285 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 19: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:18:18.154120  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.158913  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.159871  3132 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
W20260709 13:18:18.170042  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.188017  9194 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:18.193912  9276 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:18.195251  3135 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.011s	sys 0.027s
I20260709 13:18:18.195165  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:18.195761  3135 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.011s	sys 0.027s
W20260709 13:18:18.202245  3281 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 3459) took 1404 ms (client timeout 1820 ms). Trace:
I20260709 13:18:18.203233  3211 raft_consensus.cc:1240] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 21. Current term is 22. Ops: []
W20260709 13:18:18.202828  3281 rpcz_store.cc:269] 0709 13:18:16.797642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.972228 (+174586us) service_pool.cc:224] Handling call
0709 13:18:18.201950 (+1229722us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b5400037d54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:18.202133 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8368384}
I20260709 13:18:18.207880  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.208532  3206 raft_consensus.cc:3055] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:18.210131  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:18.210558  9493 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:18.213304  9407 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:18.214872  9489 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:18.215431  3100 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:18.216863  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:18.218547  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.218709  3100 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:18.208830  3281 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 22: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:18.219719  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:18.220077  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.222710  9413 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:18.224552  9198 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:18.148419  9255 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:18.226735  9436 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:18.228314  3100 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:18.229220  9374 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:18.229586  9434 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:18.229713  9374 raft_consensus.cc:697] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:18.230906  9374 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.232990  9457 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:18.233297  9385 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:18.234011  9385 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.234760  9461 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:18.125517  9460 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:18.236541  9385 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:18.149869  9262 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.240669  9262 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:18.220283  3131 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:18.235268  3100 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:18.183416  9477 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:18.256027  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:18.255159  3100 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:18.256825  3209 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:18.121345  9488 raft_consensus.cc:740] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:18.220709  9450 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:18.196985  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:18.245312  3206 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:18.217300  9428 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:18.221311  9396 raft_consensus.cc:2764] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:18:18.250641  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.250550  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:18.251044  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:18.082340  9345 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.262354  3206 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.266803  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:18.253466  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 324866us
I20260709 13:18:18.253362  9336 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:18.263913  3127 raft_consensus.cc:2368] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 20. Current term is 21.
I20260709 13:18:18.268707  3249 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:18.274514  3132 raft_consensus.cc:2368] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:18.280232  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.279012  3284 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 21.
I20260709 13:18:18.288834  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.267712  9398 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:18.267897  9450 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:18.305351  3131 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 22.
I20260709 13:18:18.259971  9488 consensus_queue.cc:260] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.276132  9336 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.323886  3250 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:18.326584  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.327764  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.328279  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.328884  3211 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:18.329138  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.329704  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.330497  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.300357  9372 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.342762  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.277305  9481 consensus_queue.cc:1059] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:18:18.345686  9481 raft_consensus.cc:3055] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:18.346124  9481 raft_consensus.cc:740] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:18.347111  9481 consensus_queue.cc:260] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.348277  9481 raft_consensus.cc:3060] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.349541  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:18.350132  3127 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:18.350828  9345 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:18.351202  3837 raft_consensus.cc:1217] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Deduplicated request from leader. Original: 11.11->[13.12-14.13]   Dedup: 13.12->[14.13-14.13]
I20260709 13:18:18.351586  3842 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:18:18.351727  3837 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15. Ops: [13.12-14.13]
I20260709 13:18:18.345955  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:18.354031  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:18.355135  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:18.355738  3133 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:18.358603  9336 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:18.359053  9477 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:18.362200  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.363343  3211 raft_consensus.cc:2410] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:18:18.365039  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:18.366003  3205 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:18.355751  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:18.371124  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.371677  3209 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:18.372340  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.373525  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.311465  9381 raft_consensus.cc:2764] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:18:18.365063  3133 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
W20260709 13:18:18.377290  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 53515.9us
I20260709 13:18:18.376561  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:18.377343  3208 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: [16.8-17.9]
I20260709 13:18:18.380648  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.321807  9398 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 20 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:18.384197  3127 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:18.380874  3250 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:18.394233  3250 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:18.383224  3209 raft_consensus.cc:2393] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:18.364074  9198 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.363896  9477 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:18.390193  3205 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:18.391243  3202 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 13:18:18.384692  3101 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:18.397652  3202 pending_rounds.cc:85] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 14
I20260709 13:18:18.397475  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:18.409263  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:18.409471  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.412202  3202 pending_rounds.cc:107] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:18:18.397468  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:18.412595  3202 raft_consensus.cc:2889] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:18.410274  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.410851  3176 leader_election.cc:400] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:18.410859  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:18.413836  3208 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:18:18.413559  3176 leader_election.cc:403] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:18:18.376369  9385 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:18.416779  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:18.364910  9457 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:18:18.418768  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:18.419550  3832 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:18:18.420096  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:18.421072  3101 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:18.385763  9489 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:18.424510  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.425496  3205 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:18:18.425275  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:18.426430  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.427372  3127 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:18.428609  3250 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:18.429257  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.429430  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:18.429868  3133 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:18.408573  9452 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:18.429790  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:18.429771  3250 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:18.438460  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.408326  9477 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.439416  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:18.433115  3251 leader_election.cc:400] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13.
I20260709 13:18:18.422431  9436 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:18.449296  3205 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:18.449137  3251 leader_election.cc:403] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:18.427125  9374 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:18.439440  9461 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:18.451043  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:18:18.440258  9530 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:18:18.455265  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.474949  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:18.430238  9494 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:18.450242  9489 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:18.461949  9396 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:18.460649  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:18.452991  9477 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:18.432847  9434 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:18:18.443388  9527 log.cc:927] Time spent T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:18:18.439618  9464 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:18.469062  3208 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 22.
I20260709 13:18:18.469153  3133 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:18.460543  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:18.484604  3279 raft_consensus.cc:2368] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 19. Current term is 20.
I20260709 13:18:18.412739  9198 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.513522  9198 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:18.468484  9345 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 12. Current term is 13.
I20260709 13:18:18.489733  3205 raft_consensus.cc:2410] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:18:18.490260  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.516131  3249 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:18.516498  3203 raft_consensus.cc:2410] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 13:18:18.485486  9523 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:18:18.497251  9489 raft_consensus.cc:697] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:18.456318  9398 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.498378  8874 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:18.498790  3127 raft_consensus.cc:1240] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:18:18.521649  9460 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.524600  3127 raft_consensus.cc:1240] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:18:18.525617  3281 raft_consensus.cc:2368] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 22. Current term is 23.
I20260709 13:18:18.527349  9488 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:18.527557  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.529469  3249 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:18.531352  9255 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:18.531867  9428 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:18.417325  9450 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.501533  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:18.533619  3278 raft_consensus.cc:2393] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:18.486459  9461 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 22 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:18.536666  9461 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.503334  9494 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:18.541888  9494 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.507302  9434 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:18.543671  9434 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:18.502367  9294 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:18.462827  9374 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:18:18.506011  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 76563.4us
W20260709 13:18:18.508338  9520 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.188s	user 0.002s	sys 0.000s
I20260709 13:18:18.533454  3283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:18.531569  3249 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:18.546083  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:18:18.503633  9531 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:18:18.560338  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.568629  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:18.561443  3101 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:18.566516  3283 raft_consensus.cc:606] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:18.570343  3283 raft_consensus.cc:614] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:18.567093  3281 raft_consensus.cc:2368] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 19. Current term is 20.
I20260709 13:18:18.573040  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:18.573522  3101 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:18.574818  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:18.575197  3249 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:18.519634  9372 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:18.578102  3133 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:18:18.583318  3133 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:18.567003  9374 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.585014  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.560496  9460 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:18.599263  3127 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:18.560413  9449 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.577041  9436 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.584291  9464 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:18.571947  9459 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:18.589298  9428 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:18:18.593649  9537 log.cc:927] Time spent T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:18:18.587332  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:18.572810  9528 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:18.569196  9379 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.631705  9379 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.616519  9459 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.634142  9379 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:18.581326  9294 consensus_queue.cc:1059] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:18:18.600718  3282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:18.572523  9403 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.576469  9345 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:18.641189  9403 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.642531  3134 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:18.643492  9403 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:18.576294  9262 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:18.580674  9529 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:18.581112  9396 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:18.609704  3128 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:18.637646  3282 raft_consensus.cc:606] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:18.648669  3282 raft_consensus.cc:614] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:18.644598  3136 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:18.603551  9450 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:18.650619  9294 raft_consensus.cc:3055] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:18.650408  9262 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.653580  3133 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:18:18.656183  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 73749.1us
I20260709 13:18:18.657042  3133 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:18:18.655351  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 68123.8us
I20260709 13:18:18.658283  3282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:18.659054  3282 raft_consensus.cc:606] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:18.659394  3282 raft_consensus.cc:614] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:18.662482  9262 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:18.637043  9459 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:18.601794  9443 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.658288  3101 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:18.607087  9436 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.668305  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:18.685248  3206 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.670688  3127 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:18.675397  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:18.677172  3202 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:18.677446  3203 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:18.678064  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.688588  3251 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:18.656322  9529 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:18.696761  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:18.607085  9449 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.681619  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.667071  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.720741  3207 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 19: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:18.656483  9294 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:18.721310  9449 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:18.721980  9294 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.723291  9294 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:18.682705  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:18.683851  9239 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:18.727715  3206 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:18:18.728137  3206 pending_rounds.cc:85] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 12
I20260709 13:18:18.692866  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:18.680828  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.699265  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:18.699932  9400 consensus_queue.cc:1059] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:18.700541  9345 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:18.702987  9443 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:18.703615  3285 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:18.613269  9489 consensus_queue.cc:237] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.710496  9436 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:18.712641  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.738502  3132 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
W20260709 13:18:18.714788  9532 log.cc:927] Time spent T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.290s	user 0.002s	sys 0.000s
I20260709 13:18:18.717478  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 3958) took 1146 ms. Trace:
I20260709 13:18:18.728679  3206 pending_rounds.cc:107] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:18:18.732717  3805 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:18.741430  3805 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:18.733549  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:18.734715  3282 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:18.736495  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.736632  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:18.742558  3131 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
W20260709 13:18:18.738997  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 46229.2us
I20260709 13:18:18.739930  3204 rpcz_store.cc:276] 0709 13:18:17.570925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.629243 (+ 58318us) service_pool.cc:224] Handling call
0709 13:18:18.717301 (+1088058us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400225e54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:18.717416 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485262592}
I20260709 13:18:18.740644  3206 raft_consensus.cc:2889] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:18.743911  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:18.744040  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 806) took 1269 ms. Trace:
I20260709 13:18:18.692552  9481 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.744761  3206 rpcz_store.cc:276] 0709 13:18:17.475130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.475277 (+   147us) service_pool.cc:224] Handling call
0709 13:18:17.475679 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.208403 (+732724us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b5400209f20. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc166dc0 00007fb3bc1f11c0 00007fb3bc1f2231 00007fb3bc1eed8f 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c
0709 13:18:18.684998 (+476595us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b58004388d0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc14b0aa 00007fb3bc1cd447 00007fb3bc1e5fe7 00007fb3bc1e77de 00007fb3bc1f1b49 00007fb3bc1f2416 00007fb3bc1eed8f 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4
0709 13:18:18.743809 (+ 58811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.743985 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142390912}
I20260709 13:18:18.750213  3276 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:18:18.693635  9198 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:18.757813  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:18.758575  3208 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 14: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:18.698374  9459 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:18.759547  9481 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.759976  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:18.760563  3836 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:18:18.680068  9374 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.766265  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.760949  9354 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:18.767822  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.768492  3282 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:18.756826  9503 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:18:18.769871  9479 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:18.770795  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:18.771814  9379 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:18.732570  9345 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:18.754068  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:18.732260  8874 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.781644  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 893) took 1208 ms. Trace:
I20260709 13:18:18.772926  3276 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:18.762931  3281 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
W20260709 13:18:18.761458  9161 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:18:18.756098  9498 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:18.789716  3134 raft_consensus.cc:1240] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:18.791759  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:18.794523  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.780475  3033 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55102 (request call id 141) took 10525 ms. Trace:
I20260709 13:18:18.781037  9454 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:18.782644  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:18.783602  3806 leader_election.cc:400] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 22 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 22. Current term is 23.
I20260709 13:18:18.783533  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.776213  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:18.767478  9478 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:18:18.750555  9540 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:18.756148  9336 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:18.795190  3276 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:18:18.795558  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:18.756068  9359 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:18:18.766387  9400 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:18:18.755872  9302 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:18:18.782081  3129 rpcz_store.cc:276] 0709 13:18:17.579687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.587231 (+  7544us) service_pool.cc:224] Handling call
0709 13:18:17.610056 (+ 22825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.618217 (+  8161us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:17.711443 (+ 93226us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.743500 (+ 32057us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.787807 (+ 44307us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.787858 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:17.787912 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.463198 (+675286us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b1800437140. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90d02a6 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419
0709 13:18:18.781393 (+318195us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b540036a6d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:18.781452 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.781577 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144654,"prepare.queue_time_us":883498,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":75,"raft.queue_time_us":6749,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":19839,"spinlock_wait_cycles":21990016,"thread_start_us":92748,"threads_started":1}
I20260709 13:18:18.776867  9436 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:18:18.798760  3102 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:18.781589  8874 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:18.861864  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 63236.4us
I20260709 13:18:18.782323  9345 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:18.800284  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:18.876858  3281 raft_consensus.cc:2393] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:18.861896  3806 leader_election.cc:403] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:18.807312  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:18.806802  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:18:18.867998  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 85442.4us
W20260709 13:18:18.869452  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 73996.6us
I20260709 13:18:18.795192  3033 rpcz_store.cc:276] 0709 13:18:08.255466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.256261 (+   795us) service_pool.cc:224] Handling call
0709 13:18:18.780372 (+10524111us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:14.801343 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:14.801961 (+   618us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:14.801997 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:18:14.802015 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:14.803022 (+  1007us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:14.803082 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:14.803114 (+    32us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:18:14.803887 (+   773us) tablet.cc:701] Row locks acquired
0709 13:18:14.803910 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:18:14.804065 (+   155us) write_op.cc:270] Start()
0709 13:18:14.804171 (+   106us) write_op.cc:276] Timestamp: P: 1783603094804017 usec, L: 0
0709 13:18:14.804186 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:18:14.804812 (+   626us) log.cc:844] Serialized 3950 byte log entry
0709 13:18:14.856137 (+ 51325us) op_driver.cc:464] REPLICATION: finished
0709 13:18:14.923893 (+ 67756us) write_op.cc:301] APPLY: starting
0709 13:18:14.923991 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:15.378892 (+454901us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:15.402439 (+ 23547us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:16.266843 (+864404us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:16.285865 (+ 19022us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:18:16.285936 (+    71us) write_op.cc:312] APPLY: finished
0709 13:18:16.286351 (+   415us) log.cc:844] Serialized 97 byte log entry
0709 13:18:16.554340 (+267989us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:16.555274 (+   934us) write_op.cc:454] Released schema lock
0709 13:18:16.555877 (+   603us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:16.578155 (+ 22278us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:16.578205 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":83754,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":67433,"apply.run_cpu_time_us":33469,"apply.run_wall_time_us":1650827,"cfile_cache_hit":42,"cfile_cache_hit_bytes":46007,"num_ops":10,"prepare.queue_time_us":226652,"prepare.run_cpu_time_us":3771,"prepare.run_wall_time_us":3771,"replication_time_us":51756,"thread_start_us":470249,"threads_started":3,"wal-append.queue_time_us":298065,"wal-append.run_cpu_time_us":1150,"wal-append.run_wall_time_us":1014886}]]}
W20260709 13:18:18.906805  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 123324us
I20260709 13:18:18.911938  3204 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:18.914338  3176 leader_election.cc:400] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 19. Current term is 20.
I20260709 13:18:18.913763  3833 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:18.914717  3176 leader_election.cc:403] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:18:18.918128  3806 leader_election.cc:400] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 19. Current term is 20.
I20260709 13:18:18.922720  3806 leader_election.cc:403] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:18:18.924554  3283 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:18.800208  9354 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.929421  3176 leader_election.cc:400] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:18.929792  3176 leader_election.cc:403] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:18:18.878274  9239 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.867269  9459 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:18.877435  9262 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:18.877625  9450 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:18.935487  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:18.947804  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:18.948853  3101 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:18.867561  9336 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:18.877885  9372 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:18.823868  9498 raft_consensus.cc:697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:18:18.924952  9535 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:18.878165  9399 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:18.950563  9385 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:18.960047  9396 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:18.950785  9457 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:18.927644  9434 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:18.799186  9477 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.968514  3833 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:18.944207  9504 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 19. Current term is 20.
I20260709 13:18:18.975443  3278 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:18.965466  9336 raft_consensus.cc:3060] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.980572  3204 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:18.978013  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:18.985049  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:18.990558  3282 raft_consensus.cc:1240] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:18.980894  3806 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:18.975481  3836 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 23.
I20260709 13:18:18.992074  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.992479  3209 raft_consensus.cc:2393] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 23: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:18.992748  3276 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:18.994510  3250 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:18.976696  9379 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 19. Current term is 20.
I20260709 13:18:18.946484  9354 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:18.996994  3020 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f4a8a614fca4531aab11f5963396f62 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc48eecc27554cb58b15193cd442b1d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:18.998000  9493 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:18.997952  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.998596  9493 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.999027  9493 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:19.001053  9498 consensus_queue.cc:237] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.002566  3841 raft_consensus.cc:1240] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: []
W20260709 13:18:19.004685  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.005336  9374 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:18.991590  9309 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 22. Current term is 23.
I20260709 13:18:19.007040  9434 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:19.009140  9477 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:19.013514  9494 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:19.014169  9494 raft_consensus.cc:697] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:19.015048  9494 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.019734  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:19.019404  9493 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.952663  9239 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.023613  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:19.025874  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:19.028990  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:18.993122  9540 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:19.034767  9540 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:19.035193  9540 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:19.035356  9479 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:18.972096  9372 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:18.981889  9396 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 21 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:19.042703  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33906 (request call id 3476) took 1052 ms. Trace:
I20260709 13:18:19.054203  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:18.983711  9400 raft_consensus.cc:2764] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:18:19.042860  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:19.049285  9434 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:18:19.050343  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 102688us
I20260709 13:18:19.054352  3277 rpcz_store.cc:276] 0709 13:18:17.989914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.057163 (+ 67249us) service_pool.cc:224] Handling call
0709 13:18:19.042515 (+985352us) spinlock_profiling.cc:243] Waited 7.63 ms on lock 0x7b5400319554. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:19.042645 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17547648}
I20260709 13:18:19.058220  3250 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:19.059391  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:19.062266  3281 raft_consensus.cc:1275] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:19.063916  3250 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:19.067241  3176 leader_election.cc:400] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 20. Current term is 21.
I20260709 13:18:19.067763  3176 leader_election.cc:403] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:18:19.041764  9198 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:19.068406  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:19.080454  9396 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:19.074081  9489 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:19.085412  9489 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:19.085301  9477 consensus_queue.cc:1059] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:19.086054  9489 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:19.069416  9550 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:19.087124  9550 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:19.087471  9550 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:19.069722  9002 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:18:19.078585  9335 consensus_queue.cc:1048] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:18:19.075012  9161 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:19.070043  9460 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:19.079828  9434 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:19.078059  9478 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 20. Current term is 21.
I20260709 13:18:19.108457  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:19.122084  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 43831.9us
I20260709 13:18:19.105008  9198 raft_consensus.cc:697] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:19.128711  9354 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:19.129122  8874 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:19.124441  9239 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:19.135191  9198 consensus_queue.cc:237] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:19.120890  9381 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:19.137709  9381 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.114517  9477 consensus_queue.cc:1059] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:18:19.153333  9479 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:19.154042  9481 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:19.153985  9479 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.156454  9479 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:19.160202  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 51829.5us
I20260709 13:18:19.162741  8874 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.163352  8874 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.164789  9493 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:19.165635  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 023c1461b69c46bdb3c42ee16f303ea2 with delete_type TABLET_DATA_TOMBSTONED (TS 48080cf0460346769ab046a4f9457aa5 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:35176
I20260709 13:18:19.168257  9449 raft_consensus.cc:3055] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:19.124428  9434 raft_consensus.cc:697] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:19.169759  8874 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:19.170162  9434 consensus_queue.cc:237] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:19.173367  9372 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:19.174701  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:19.175609  9478 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:19.168815  9449 raft_consensus.cc:740] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:19.176123  9478 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:19.176573  9478 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:19.176682  9449 consensus_queue.cc:260] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:19.178215  9449 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:19.179553  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:19.180125  3284 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:19.180728  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:19.180209  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:19.198524  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:19.199271  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:19.197752  3284 raft_consensus.cc:2468] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:19.202493  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:19.203704  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:19.204449  3133 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:19.199865  3136 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:19.212327  3135 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:18:19.202999  3806 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:19.214272  3177 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:19.214737  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:19.215085  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:19.215385  3279 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:19.215852  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:19.216612  3278 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
W20260709 13:18:19.217922  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 57018.9us
I20260709 13:18:19.219221  3250 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:19.219802  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:19.220338  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:19.220921  3208 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:19.221900  3203 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:19.224754  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:19.225000  3100 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:19.227304  3136 raft_consensus.cc:1275] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:18:19.227697  3136 pending_rounds.cc:85] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 11
I20260709 13:18:19.227911  3136 pending_rounds.cc:107] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:18:19.228157  3136 raft_consensus.cc:2889] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:19.230262  3101 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:18:19.232281  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.233125  3210 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:18:19.233655  8874 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:19.222942  3250 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:19.236178  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:19.238090  3176 leader_election.cc:400] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:19.238234  8874 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:19.239120  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:19.238751  3250 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:19.241564  3285 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:19.240511  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:19.244910  3134 raft_consensus.cc:2410] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:18:19.246031  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:19.246112  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:19.251130  3176 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:19.232208  9398 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:19.243804  9407 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:19.240898  9379 raft_consensus.cc:2804] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:19.243647  9352 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:19.242846  9381 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:19.248358  9454 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:19.217751  9336 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.251739  9161 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.106s
I20260709 13:18:19.332762  9407 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:19.256644  9477 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:19.247044  9399 consensus_queue.cc:1059] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 13:18:19.371799  3251 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:19.375327  3285 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:19.248065  9479 consensus_queue.cc:1059] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:18:19.252763  9504 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.105s
I20260709 13:18:19.332893  9398 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.293994  9239 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:18:19.391047  3251 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:19.348193  9262 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:19.356679  9454 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.249490  9400 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
W20260709 13:18:19.403697  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 170770us
I20260709 13:18:19.359124  9379 raft_consensus.cc:697] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:19.402406  3841 raft_consensus.cc:2410] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:18:19.381937  9407 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:19.382122  9477 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.385128  9457 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:19.382835  9450 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:19.390921  9461 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:19.407408  9454 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:19.443512  9557 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 13:18:19.445606  9556 log.cc:927] Time spent T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:18:19.446091  9345 consensus_meta.cc:287] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.005s
I20260709 13:18:19.446682  9345 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.413045  9477 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:19.413924  9450 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:19.427877  9294 consensus_meta.cc:287] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.704s	user 0.015s	sys 0.000s
I20260709 13:18:19.474879  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:19.479681  3833 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:19.476855  3834 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:19.413851  9457 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.453850  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:19.486236  3283 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:18:19.409823  9544 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:18:19.409513  9262 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.492197  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:19.422204  9567 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:19.486850  3283 pending_rounds.cc:85] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 8
I20260709 13:18:19.599995  3283 pending_rounds.cc:107] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:18:19.592566  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:19.600293  3283 raft_consensus.cc:2889] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:19.597317  3836 raft_consensus.cc:2393] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 23: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:19.474453  9399 raft_consensus.cc:3055] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:19.450878  9564 tablet_replica.cc:333] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:19.433161  9461 raft_consensus.cc:697] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 23 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:19.424142  9354 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.168s
I20260709 13:18:19.482256  9457 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:19.478986  9450 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:19.482311  9002 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.635890  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:19.641633  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:19.618988  9550 consensus_meta.cc:287] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.005s
I20260709 13:18:19.606053  9570 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:19.606367  9399 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:19.708510  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:19.710919  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:19.595503  9528 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.100s
I20260709 13:18:19.486269  9540 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.732962  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:19.736302  3204 raft_consensus.cc:2410] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
W20260709 13:18:19.709312  9558 log.cc:927] Time spent T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.457s	user 0.000s	sys 0.001s
W20260709 13:18:19.742877  9562 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:18:19.743439  9553 raft_consensus.cc:3055] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:18:19.746954  9561 log.cc:927] Time spent T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.344s	user 0.000s	sys 0.004s
I20260709 13:18:19.686391  9002 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.750180  9262 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:19.751674  9478 consensus_meta.cc:287] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
I20260709 13:18:19.717175  9550 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:19.707762  9489 consensus_meta.cc:287] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.621s	user 0.012s	sys 0.000s
W20260709 13:18:19.728991  9434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.027s	sys 0.039s
W20260709 13:18:19.780926  3101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.035s	sys 0.033s
I20260709 13:18:19.753803  9564 raft_consensus.cc:2243] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:19.778481  9520 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:18:19.795883  3101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.035s	sys 0.034s
W20260709 13:18:19.799906  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 569684us
I20260709 13:18:19.801007  3101 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:19.641726  9379 consensus_queue.cc:237] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.778474  9553 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:18:19.794253  9434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.028s	sys 0.039s
I20260709 13:18:19.794607  9336 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:19.731313  9570 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:19.790174  9444 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:19.822216  9345 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:19.828373  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 146845us
I20260709 13:18:19.803551  9398 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:19.826144  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 197190us
I20260709 13:18:19.834939  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 825) took 1057 ms. Trace:
I20260709 13:18:19.835320  3206 rpcz_store.cc:276] 0709 13:18:18.777751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.777894 (+   143us) service_pool.cc:224] Handling call
0709 13:18:18.778185 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:18.778501 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.778530 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:18.784817 (+  6287us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.117867 (+333050us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b1800302980. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:18:19.163191 (+ 45324us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:19.163237 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.186944 (+ 23707us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.746399 (+559455us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:18:19.834701 (+ 88302us) raft_consensus.cc:1685] finished
0709 13:18:19.834724 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.834878 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":435,"raft.queue_time_us":549,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6883,"spinlock_wait_cycles":14256896,"thread_start_us":45124,"threads_started":1,"wal-append.queue_time_us":464056}
I20260709 13:18:19.837517  3177 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:19.846453  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 2085) took 1094 ms. Trace:
I20260709 13:18:19.738943  9461 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.847000  3282 rpcz_store.cc:276] 0709 13:18:18.741563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.769123 (+ 27560us) service_pool.cc:224] Handling call
0709 13:18:18.769485 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.992815 (+223330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.835392 (+842577us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54002f8fd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:19.835624 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":507831168}
I20260709 13:18:19.797622  9478 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:19.796905  9489 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:19.850111  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 595438us
I20260709 13:18:19.851930  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:19.827381  9385 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:19.855104  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:19.857278  3277 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:19.860658  3278 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:19.816829  9573 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:19.846402  9564 raft_consensus.cc:2272] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.864888  3101 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:19.870055  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:19.870273  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:19.803972  9399 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:19.874927  3282 raft_consensus.cc:2393] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:19.848238  9400 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:19.873898  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:19.876854  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:19.877759  3208 raft_consensus.cc:2393] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 22: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:19.876986  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:19.881224  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:18:19.874809  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 253099us
I20260709 13:18:19.879463  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:19.882782  3101 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:19.834055  9444 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.889725  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:19.888963  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:19.867517  9464 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:19.894752  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:19.895984  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:19.902660  3285 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:19.896848  3842 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:19.878429  9565 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:19.878512  9400 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.886962  9399 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:19.877866  9577 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:19.887241  9262 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:19.915055  9449 consensus_meta.cc:287] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.002s
I20260709 13:18:19.891726  9526 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.892078  9464 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:19.898200  9459 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:19.868067  9385 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.916792  3282 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:19.916869  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:19.913928  9565 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.944229  9565 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:19.953989  9478 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:19.955199  9302 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:19.911909  9434 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:19.958747  9570 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:19.960459  9555 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.602s	user 0.028s	sys 0.023s
I20260709 13:18:19.911635  9398 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:18:19.962211  9336 consensus_queue.cc:1048] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:19.918068  9400 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:19.916220  9579 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:19.964660  9579 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.918196  9488 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:18:19.921867  9262 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.969070  9262 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:19.969316  9526 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:19.971254  9309 raft_consensus.cc:3055] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:19.971717  3836 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 22.
I20260709 13:18:19.971774  9309 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:18:20.046602  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.923295  9540 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:19.976261  9464 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:20.026090  9449 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:20.038045  9354 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.077857  3130 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:20.077847  3136 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:18:20.069388  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 205607us
I20260709 13:18:20.072544  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:18:20.074488  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.086506  3136 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:20.072744  3205 raft_consensus.cc:2468] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:18:20.090508  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:20.138557  3132 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:20.139233  3128 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:18:20.135707  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45349.6us
I20260709 13:18:20.077714  9550 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:20.079057  9540 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:20.057765  9457 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:20.148065  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 254597us
I20260709 13:18:20.088573  9444 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:20.154080  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 221691us
I20260709 13:18:20.042124  9309 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:20.149828  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 234960us
W20260709 13:18:20.168424  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 278761us
W20260709 13:18:20.230718  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 331235us
I20260709 13:18:20.206049  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:20.139019  9002 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:20.135396  9588 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:20.207151  3210 raft_consensus.cc:1275] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:18:20.236204  3210 pending_rounds.cc:85] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 7
I20260709 13:18:20.236501  3210 pending_rounds.cc:107] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:18:20.236742  3210 raft_consensus.cc:2889] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:20.208531  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:20.208885  3206 raft_consensus.cc:1240] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 18. Current term is 19. Ops: [18.15-18.15]
W20260709 13:18:20.212436  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 75932.5us
I20260709 13:18:20.088280  9354 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:20.240513  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:20.154549  3205 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:18:20.241277  3205 pending_rounds.cc:85] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 10
I20260709 13:18:20.241547  3205 pending_rounds.cc:107] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:18:20.241854  3176 leader_election.cc:400] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 19. Current term is 20.
I20260709 13:18:20.241787  3205 raft_consensus.cc:2889] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:20.245304  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:20.206933  9444 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:20.221701  9489 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:20.155407  9540 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:20.290685  9407 consensus_meta.cc:287] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.871s	user 0.012s	sys 0.005s
I20260709 13:18:20.291344  9407 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.292541  3131 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:18:20.257301  9385 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:20.250090  9161 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
W20260709 13:18:20.300140  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 49940.2us
I20260709 13:18:20.249553  9239 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
W20260709 13:18:20.296335  9477 consensus_meta.cc:287] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.704s	user 0.008s	sys 0.012s
I20260709 13:18:20.302039  3281 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:20.284082  9309 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:20.301628  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:20.278945  9579 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:20.322199  3128 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
W20260709 13:18:20.325328  9587 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 13:18:20.278795  9600 consensus_queue.cc:1175] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fc48eecc27554cb58b15193cd442b1d3" responder_term: 17 status { last_received { term: 17 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 17 index: 14 } }
I20260709 13:18:20.257143  9588 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:20.312356  9454 consensus_meta.cc:287] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.838s	user 0.010s	sys 0.009s
I20260709 13:18:20.341663  9454 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.345713  9597 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.364600  9494 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:18:20.364544  9591 log.cc:927] Time spent T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:18:20.317037  9489 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:18:20.375263  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 128161us
I20260709 13:18:20.311594  9582 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 13:18:20.371466  9578 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
W20260709 13:18:20.374150  9450 consensus_meta.cc:287] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.692s	user 0.012s	sys 0.007s
I20260709 13:18:20.324128  9477 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:20.384661  3020 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f4a8a614fca4531aab11f5963396f62 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc48eecc27554cb58b15193cd442b1d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:20.390321  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:20.398082  3135 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 21.
I20260709 13:18:20.399391  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:20.390682  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:20.400704  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:20.366108  9564 ts_tablet_manager.cc:1916] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:20.397272  3133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57442 (request call id 904) took 1170 ms. Trace:
I20260709 13:18:20.376641  9457 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:20.407109  3136 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 17: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:20.359189  9454 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:20.407766  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:20.409499  3135 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:20.409938  3128 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:18:20.401763  3133 rpcz_store.cc:276] 0709 13:18:19.226772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.227499 (+   727us) service_pool.cc:224] Handling call
0709 13:18:19.227778 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:19.362571 (+134793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:19.362604 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:19.385689 (+ 23085us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.875609 (+489920us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:19.875651 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.875728 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:20.396976 (+521248us) raft_consensus.cc:1685] finished
0709 13:18:20.397007 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.397193 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13164,"raft.queue_time_us":128294,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":4090,"thread_start_us":582877,"threads_started":2,"wal-append.queue_time_us":654421}
I20260709 13:18:20.367311  9604 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:18:20.365520  9494 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.394239  9606 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:20.458663  9477 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:20.446705  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:20.403535  9450 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.529794  3129 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:18:20.404904  9444 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:20.457551  9553 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.510574  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:18:20.532799  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 86195.1us
I20260709 13:18:20.534158  9461 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:20.534246  9444 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.535730  3250 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:20.466977  9575 log.cc:927] Time spent T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.637s	user 0.001s	sys 0.000s
I20260709 13:18:20.379376  9489 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:20.454332  9612 consensus_queue.cc:1059] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:20.464437  9407 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:20.365052  9597 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.519099  9540 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:20.519266  9592 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.519572  9606 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.534672  9461 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.470018  9607 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:20.538683  3250 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:20.465062  9399 consensus_meta.cc:287] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.006s
I20260709 13:18:20.564188  9606 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:20.564672  9444 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:20.559736  9461 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:20.555248  9553 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:20.559522  9592 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.567515  9526 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:20.569653  9588 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:20.536084  9450 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:20.541406  9428 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:18:20.576845  9565 consensus_meta.cc:287] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.632s	user 0.014s	sys 0.013s
I20260709 13:18:20.581344  3833 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:20.549158  9354 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:20.556802  9262 consensus_meta.cc:287] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.008s
I20260709 13:18:20.586514  3203 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:18:20.602142  3203 pending_rounds.cc:85] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 9
I20260709 13:18:20.591774  9604 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.598384  3806 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:20.599850  3128 raft_consensus.cc:1240] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:20.602494  3203 pending_rounds.cc:107] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:18:20.601862  9526 consensus_queue.cc:1059] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:18:20.614921  3203 raft_consensus.cc:2889] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:20.614993  3806 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:20.603833  9262 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.579723  9381 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:20.607478  9452 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:20.608798  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:20.613487  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:20.617070  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:20.579900  9309 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:20.628938  3276 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 23: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:20.590306  9612 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.642060  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:20.643123  3285 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:20.629145  9479 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:20.647887  3136 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 19: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:20.580120  9607 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:20.688081  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 59014.5us
I20260709 13:18:20.686520  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:20.685328  9379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.015s	sys 0.067s
I20260709 13:18:20.612852  9550 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:20.621464  9565 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.692775  3132 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:18:20.600963  9529 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:18:20.672057  9498 raft_consensus.cc:3055] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:20.686123  9479 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.707379  3285 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:20.638738  9309 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:20.628613  9381 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.722203  9262 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:20.716516  9498 raft_consensus.cc:740] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:20.731027  9381 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:20.693759  9379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.015s	sys 0.067s
I20260709 13:18:20.732115  9607 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:20.739751  3834 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:18:20.629379  9604 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.705974  9565 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:20.693650  9622 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:20.693948  9574 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:20.693935  9609 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:20.725184  9479 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:20.760452  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 71619.4us
I20260709 13:18:20.694579  9592 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:20.663223  9612 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.722657  9481 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.695158  9567 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:20.741070  9452 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:20.693450  9608 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.143s
I20260709 13:18:20.740172  9582 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:20.802524  9582 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:20.754707  9622 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.705835  9550 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.755745  9607 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:20.805496  9597 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:20.805927  9607 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.808120  9607 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:20.693920  9615 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.168s
I20260709 13:18:20.791527  9452 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:20.809971  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 556850us
I20260709 13:18:20.778116  9381 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:20.811509  9381 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:20.778031  9574 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:20.813417  9550 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:20.813733  9381 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:20.813524  9599 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:20.815335  9599 consensus_queue.cc:1059] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:20.815828  9596 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.816646  9599 raft_consensus.cc:3055] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:20.816469  9596 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.815039  9612 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:20.818678  9309 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:20.819295  9464 consensus_meta.cc:287] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.738s	user 0.012s	sys 0.002s
I20260709 13:18:20.819821  3130 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:20.900019  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:20.901648  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:20.821285  9239 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:20.821566  9574 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.822633  9457 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.823084  9580 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:20.823316  9603 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:20.826187  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.825675  9567 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:20.828356  9582 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:20.813521  9400 consensus_meta.cc:287] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.849s	user 0.011s	sys 0.010s
I20260709 13:18:20.903483  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:20.903235  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:20.930063  3208 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:20.930255  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:20.933557  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:20.938302  3205 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 22.
I20260709 13:18:20.899026  9489 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:20.805581  9622 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:20.899793  9488 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:20.789831  9481 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.897228  9599 raft_consensus.cc:740] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:20.926057  9239 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:20.934335  9457 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.945658  9603 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:20.946735  9400 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:20.952401  9567 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:20.953907  9610 consensus_queue.cc:1059] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:20.925307  9464 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:20.957890  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:20.958177  9580 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:20.933465  9385 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:20.961045  9631 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:18:21.009778  3211 raft_consensus.cc:2368] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:20.961776  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:20.965338  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 62018.8us
I20260709 13:18:20.996234  3285 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 13:18:21.011808  9626 log.cc:927] Time spent T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.179s	user 0.001s	sys 0.001s
I20260709 13:18:20.991456  3284 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:18:21.012315  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.013370  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:21.014430  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:20.991662  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:20.987700  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.015378  3209 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 19.
I20260709 13:18:21.004611  3134 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.007473  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:21.012961  3130 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:18:21.016964  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:21.017634  3285 raft_consensus.cc:3060] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.017971  3805 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:21.018932  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:20.986819  9574 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:21.021274  9604 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.043479  3134 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:21.020246  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:21.024128  9526 raft_consensus.cc:2804] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:21.055625  3101 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:21.027761  3834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54908 (request call id 955) took 1130 ms. Trace:
I20260709 13:18:21.057243  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.028563  3279 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:18:21.028633  9630 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:21.031090  3209 raft_consensus.cc:1240] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:21.057971  3136 raft_consensus.cc:2393] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:21.031190  9457 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.032835  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:21.036794  3210 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:20.988608  9372 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:21.007416  9161 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.983516  9596 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:21.052150  3285 raft_consensus.cc:2468] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:21.051307  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.075022  3134 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:21.013478  9385 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.076066  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:20.984599  9461 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.007596  9570 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.970571  9488 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.060623  9580 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:20.993927  9599 consensus_queue.cc:260] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:20.972218  9639 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:21.057245  3834 rpcz_store.cc:276] 0709 13:18:19.897573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.897737 (+   164us) service_pool.cc:224] Handling call
0709 13:18:19.898076 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.742220 (+844144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.027476 (+285256us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b54002175d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:21.027692 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919558912}
I20260709 13:18:21.066267  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:20.985435  9564 ts_tablet_manager.cc:1929] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 13:18:21.064584  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.093262  3284 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:18:21.057706  9579 consensus_queue.cc:1059] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:18:21.094504  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.077380  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.078089  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.052297  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:21.058037  9612 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:21.057967  9553 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:21.084440  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.069952  9574 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.982132  9239 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.104023  3130 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:21.104254  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.073328  9372 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.060962  3805 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:21.069561  9526 raft_consensus.cc:697] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:21.095865  3209 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:18:21.080567  9379 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:21.057489  9588 consensus_queue.cc:1059] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:18:21.112744  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.097858  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.098075  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:21.100970  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 48804.7us
I20260709 13:18:21.102849  9603 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:21.114357  3208 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:21.071647  9450 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:18:21.108964  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 47923.7us
I20260709 13:18:21.073990  9161 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.088276  9570 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.116683  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:21.203922  3102 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:18:21.282691  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 166062us
W20260709 13:18:21.283532  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 79742.1us
I20260709 13:18:21.283771  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:21.109495  9564 log.cc:1199] T 023c1461b69c46bdb3c42ee16f303ea2 P 48080cf0460346769ab046a4f9457aa5: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root/wals/023c1461b69c46bdb3c42ee16f303ea2
I20260709 13:18:21.255162  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.153116  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.116684  3205 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:21.153093  3280 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:21.116670  3208 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:18:21.099511  9553 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:21.297660  3102 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:21.298822  3176 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:21.304041  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:21.110443  9580 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:21.184139  9640 log.cc:927] Time spent T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:18:21.115579  9239 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:21.354610  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 57062.9us
I20260709 13:18:21.305827  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:21.182011  9599 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:21.218770  9481 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.115922  9598 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:21.161005  9399 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.218935  9576 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:21.185920  9461 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:21.105229  9612 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.356318  9459 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:21.184911  9488 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.234390  9372 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:21.228768  9622 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.229316  9385 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:21.362265  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.378427  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.379309  9570 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.379822  9161 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.359205  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.385640  9564 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35176 (request call id 0) took 2222 ms. Trace:
I20260709 13:18:21.386121  9564 rpcz_store.cc:276] 0709 13:18:19.163395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.165249 (+  1854us) service_pool.cc:224] Handling call
0709 13:18:19.389812 (+224563us) ts_tablet_manager.cc:1151] Deleting tablet 023c1461b69c46bdb3c42ee16f303ea2
0709 13:18:19.409304 (+ 19492us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:18:20.583328 (+1174024us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:20.985234 (+401906us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:21.385543 (+400309us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":189800,"thread_start_us":64689,"threads_started":1}
I20260709 13:18:21.211218  9498 consensus_queue.cc:260] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.388561  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 023c1461b69c46bdb3c42ee16f303ea2 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:18:21.389238  9498 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:21.390136  9639 consensus_queue.cc:1175] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fc48eecc27554cb58b15193cd442b1d3" responder_term: 15 status { last_received { term: 14 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:21.373644  9459 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:21.391444  9459 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:21.367156  9399 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.396118  9399 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.211740  9464 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:21.296334  9603 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:21.404489  9457 raft_consensus.cc:3055] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:21.405015  9457 raft_consensus.cc:740] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:21.405460  9461 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:21.363608  9598 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:21.406502  9598 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:21.406038  9457 consensus_queue.cc:260] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:21.407511  9638 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.459s	user 0.002s	sys 0.000s
I20260709 13:18:21.407570  9457 raft_consensus.cc:3060] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:21.367439  9580 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:21.409313  9580 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.409672  9580 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:21.107282  9574 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.411789  3279 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:18:21.412801  9574 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:21.413756  9612 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.413990  9385 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:21.385640  3133 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 23.
I20260709 13:18:21.302012  9569 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:21.303172  9553 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:21.357409  9584 raft_consensus.cc:2804] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:21.162235  9450 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:21.115669  9596 consensus_queue.cc:1059] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.246s
I20260709 13:18:21.181725  9479 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.287042  9577 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:21.118261  9379 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.358213  9528 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:21.368357  9576 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:21.444821  3211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34332 (request call id 3997) took 1565 ms (client timeout 1858 ms). Trace:
W20260709 13:18:21.415896  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 115200us
I20260709 13:18:21.217589  9400 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:21.432672  3833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58470 (request call id 1384) took 1224 ms (client timeout 1557 ms). Trace:
I20260709 13:18:21.438917  9622 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:21.424642  9399 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:21.444752  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:21.446776  3833 rpcz_store.cc:269] 0709 13:18:20.207910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.208067 (+   157us) service_pool.cc:224] Handling call
0709 13:18:21.432442 (+1224375us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400541ad4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:21.432592 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":738782592}
W20260709 13:18:21.445662  3211 rpcz_store.cc:269] 0709 13:18:19.879078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.879211 (+   133us) service_pool.cc:224] Handling call
0709 13:18:21.444602 (+1565391us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400195d54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:21.444756 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2590636928}
I20260709 13:18:21.406068  9461 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.457639  3133 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:21.414750  9385 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.441162  9577 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:21.439913  9584 raft_consensus.cc:697] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:21.233250  9526 consensus_queue.cc:237] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.460410  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:21.448766  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:21.450091  9336 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.480247  3132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 2090) took 1195 ms. Trace:
I20260709 13:18:21.480669  3132 rpcz_store.cc:276] 0709 13:18:20.284461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.287743 (+  3282us) service_pool.cc:224] Handling call
0709 13:18:20.308055 (+ 20312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.693177 (+385122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.479959 (+786782us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54000e2ed4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:21.480164 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884207360}
I20260709 13:18:21.480739  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:21.465967  9577 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.453310  9528 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.489415  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:21.457479  9399 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.492781  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:21.496497  3841 raft_consensus.cc:2393] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 18: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:21.492774  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:21.493669  3102 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:21.500259  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:21.483364  9255 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:21.497614  9400 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:21.473759  9336 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.490787  9359 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:21.464520  9450 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.498070  9488 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:18:21.529838  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 224108us
I20260709 13:18:21.517930  9464 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:18:21.591717  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 104058us
I20260709 13:18:21.537971  9488 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:21.527634  9255 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.531191  9400 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.581517  9477 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:18:21.593813  9649 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:18:21.581835  9588 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:21.599603  9579 raft_consensus.cc:3055] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:21.619673  3204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 828) took 1751 ms. Trace:
W20260709 13:18:21.595999  9628 log.cc:927] Time spent T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:21.620350  9579 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:21.621620  9579 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.622627  9579 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:21.539448  9359 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.612246  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.620175  3204 rpcz_store.cc:276] 0709 13:18:19.868695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.868814 (+   119us) service_pool.cc:224] Handling call
0709 13:18:19.884337 (+ 15523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.942433 (+ 58096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:19.942479 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:19.942546 (+    67us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:19.942585 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.619363 (+1676778us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b54003746d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:21.619423 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.619592 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133082880}
W20260709 13:18:21.613231  9651 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:18:21.618084  9654 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:18:21.619879  9652 log.cc:927] Time spent T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:18:21.626528  9477 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.533613  9584 consensus_queue.cc:237] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.604166  9488 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:21.640247  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:21.642589  3131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 2095) took 1348 ms. Trace:
I20260709 13:18:21.625758  9479 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 23 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:21.663122  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 141457us
I20260709 13:18:21.627974  9379 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.671538  9576 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:21.686177  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.668781  9336 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.639264  9610 consensus_queue.cc:1059] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:18:21.692178  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.632222  9588 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.679031  9461 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:21.683960  9658 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:21.693358  9385 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.708175  9477 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.700686  9528 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:21.709808  9359 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:21.710196  9255 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:21.704679  9459 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.730643  3135 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:21.711076  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.704849  9658 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.713959  9588 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:21.714471  3203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2810) took 2074 ms. Trace:
I20260709 13:18:21.684221  9657 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:18:21.705154  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.719488  3281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3514) took 1102 ms. Trace:
I20260709 13:18:21.737257  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.739001  3203 rpcz_store.cc:276] 0709 13:18:19.640171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.640363 (+   192us) service_pool.cc:224] Handling call
0709 13:18:19.640767 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.615517 (+974750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.714225 (+1098708us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b54001d6854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:21.714412 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173623168}
I20260709 13:18:21.746122  3128 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:18:21.746856  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:21.746949  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.747537  3203 raft_consensus.cc:3060] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:21.749505  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.750506  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.751137  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.747699  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:21.741791  3281 rpcz_store.cc:276] 0709 13:18:20.616584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.617840 (+  1256us) service_pool.cc:224] Handling call
0709 13:18:20.618297 (+   457us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:20.630034 (+ 11737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.630081 (+    47us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:20.635502 (+  5421us) log.cc:844] Serialized 78 byte log entry
0709 13:18:21.207603 (+572101us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b18003e4fa0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:18:21.437745 (+230142us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:21.630735 (+192990us) log.cc:844] Serialized 14 byte log entry
0709 13:18:21.635312 (+  4577us) log.cc:844] Serialized 14 byte log entry
0709 13:18:21.718963 (+ 83651us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b18003e4fa0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b907cc0a 00007fb3c27bc219 00007fb3b9104a40 00007fb3b90ff4e4 00007fb3b90ff455 00007fb3bc1e7060 00007fb3bc1f9716 00007fb3bc20a287 00007fb3bc20a208
0709 13:18:21.719172 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.719246 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.719283 (+    37us) raft_consensus.cc:1685] finished
0709 13:18:21.719297 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.719430 (+   133us) inbound_call.cc:177] Queueing success response
0709 13:18:21.727556 (+  8126us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b4800130158. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1118aa1 00007fb3c110fb37 00007fb3c110f9ca 00007fb3c120726f 00007fb3c1206f37 00007fb3c121b55c 00007fb3c121b508 00007fb3c121b488 00007fb3c121b443 00007fb3c121a6ec 00007fb3c0144a96
Metrics: {"mutex_wait_us":101298,"prepare.queue_time_us":181653,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":122,"raft.queue_time_us":110588,"raft.run_cpu_time_us":18641,"raft.run_wall_time_us":1114045,"spinlock_wait_cycles":46137472,"thread_start_us":408748,"threads_started":2,"wal-append.queue_time_us":827033}
I20260709 13:18:21.756148  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:21.731225  9385 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:21.759796  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:21.763952  3132 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:21.760830  9385 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.767581  9385 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.769169  9588 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:21.769603  9588 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:21.769942  9588 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:21.770165  9459 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:21.772472  3207 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:18:21.772853  3207 pending_rounds.cc:85] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 11
I20260709 13:18:21.773095  3207 pending_rounds.cc:107] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:18:21.773145  3203 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 23.
I20260709 13:18:21.773422  3207 raft_consensus.cc:2889] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:21.774150  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.774853  3203 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 13.
I20260709 13:18:21.774307  9658 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.775724  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:21.778890  3203 raft_consensus.cc:2393] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 18: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:21.781519  9452 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:21.778167  3135 raft_consensus.cc:2468] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 23.
I20260709 13:18:21.742528  9598 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.784107  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.785740  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 827) took 1917 ms. Trace:
I20260709 13:18:21.807747  3206 rpcz_store.cc:276] 0709 13:18:19.868371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.868520 (+   149us) service_pool.cc:224] Handling call
0709 13:18:19.868967 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.237931 (+368964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.785493 (+1547562us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b5400225454. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:21.785677 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781110656}
I20260709 13:18:21.788967  9407 raft_consensus.cc:3055] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:21.796660  3277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3517) took 1176 ms. Trace:
I20260709 13:18:21.810910  3277 rpcz_store.cc:276] 0709 13:18:20.620538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.630557 (+ 10019us) service_pool.cc:224] Handling call
0709 13:18:20.630977 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.831016 (+200039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.831066 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.831124 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:20.831171 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.796413 (+965242us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b5400038c54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:21.796466 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.796598 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459363712}
I20260709 13:18:21.799877  9580 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.803566  3210 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:18:21.804123  9598 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.804855  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
W20260709 13:18:21.806027  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 123278us
I20260709 13:18:21.810021  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:21.810123  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.818025  3204 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:21.812105  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:21.819591  3834 raft_consensus.cc:2368] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 22. Current term is 23.
I20260709 13:18:21.818300  3206 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 23.
I20260709 13:18:21.822839  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:21.823341  3102 leader_election.cc:400] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 22. Current term is 23.
I20260709 13:18:21.823822  3102 leader_election.cc:403] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:18:21.823764  3837 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:18:21.824530  3841 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:18:21.826426  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:21.828850  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:21.833545  3276 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:21.836727  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:21.837910  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:21.839264  3281 raft_consensus.cc:1275] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:21.840451  3204 raft_consensus.cc:2468] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 20.
I20260709 13:18:21.812270  9381 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:21.810774  9407 raft_consensus.cc:740] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:21.842396  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:21.844830  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:21.843436  3279 raft_consensus.cc:2393] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:18:21.847065  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.847293  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:21.850080  9407 consensus_queue.cc:260] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.851933  9588 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.855381  9588 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:21.855659  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:21.857184  9381 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.859449  9381 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:21.859925  3806 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:21.837546  9452 consensus_queue.cc:1059] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:18:21.860034  9459 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 22. Current term is 23.
I20260709 13:18:21.864660  9494 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:21.867148  9488 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.873179  9526 raft_consensus.cc:2804] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:21.873888  9526 raft_consensus.cc:697] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:21.875869  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:21.876197  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:21.877467  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:21.878614  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
W20260709 13:18:21.880234  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.877233  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:21.882907  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:21.885856  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:21.886521  3281 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 21: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:21.888185  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:21.891242  9553 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.892568  9488 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.893217  9457 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:21.893769  9457 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.896119  9457 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.896598  9457 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:21.896651  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:21.887028  9588 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.897677  3279 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 19: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:21.897683  9588 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:21.898747  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.899153  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.900020  9588 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:21.900666  9577 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.901206  9457 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.901721  3133 raft_consensus.cc:3060] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:21.902889  9577 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:21.903188  9457 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.903844  3127 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:18:21.904505  3127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 2091) took 1616 ms. Trace:
I20260709 13:18:21.905010  9580 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.905320  9588 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.905613  9580 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:21.905714  9335 raft_consensus.cc:3055] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:21.906260  9335 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:21.907330  3209 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:21.907126  9335 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:21.905812  9588 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.904798  3127 rpcz_store.cc:276] 0709 13:18:20.287973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.288158 (+   185us) service_pool.cc:224] Handling call
0709 13:18:21.903443 (+1615285us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b5800002798. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:18:21.903629 (+   186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:21.904259 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.904453 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6095744}
I20260709 13:18:21.911463  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:21.911986  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:21.912288  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.912705  3133 raft_consensus.cc:2468] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 18.
I20260709 13:18:21.913455  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.908188  9335 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.914064  3211 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 23.
I20260709 13:18:21.917510  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:21.917524  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:21.918648  3203 raft_consensus.cc:2410] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:21.918838  3279 raft_consensus.cc:2393] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 14: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:21.919915  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.920607  3211 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:21.925762  9457 consensus_queue.cc:1059] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:18:21.928711  9457 raft_consensus.cc:3055] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:21.929069  9457 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:21.927186  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:21.929769  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.930281  3127 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:21.931944  3203 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 22.
I20260709 13:18:21.933117  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:21.937341  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:21.937508  9588 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:21.938552  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.939818  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:21.940514  3837 raft_consensus.cc:2393] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 18: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:21.940703  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.941305  3204 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:21.944161  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:21.944516  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.944890  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:21.946170  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.946607  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:21.947484  3211 raft_consensus.cc:2393] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 16: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:21.947435  3279 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:18:21.958125  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:21.915022  9580 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:21.993129  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:21.996462  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.950966  9553 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:21.950709  9255 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:22.015311  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:22.021037  3284 raft_consensus.cc:1240] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:22.036900  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:22.029806  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:22.037729  3211 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:18:21.644550  3131 rpcz_store.cc:276] 0709 13:18:20.294055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.295031 (+   976us) service_pool.cc:224] Handling call
0709 13:18:21.042613 (+747582us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800002798. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b90cab71 00007fb3b90caa22 00007fb3c1fe3c09 00007fb3c113dee0 00007fb3c12070ab 00007fb3c1207131 00007fb3c11c8fc0 00007fb3c11b3929 00007fb3c11b33d2 00007fb3ba72abd4
0709 13:18:21.042821 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.043030 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:21.431624 (+388594us) log.cc:844] Serialized 14 byte log entry
0709 13:18:21.641753 (+210129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.642261 (+   508us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:21.642321 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.642391 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.642529 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19211,"prepare.queue_time_us":56697,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1499,"spinlock_wait_cycles":3974912,"thread_start_us":562280,"threads_started":2}
I20260709 13:18:22.029922  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:22.040076  3209 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 20: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:22.039980  3208 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:22.031703  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49676 (request call id 2092) took 1743 ms. Trace:
I20260709 13:18:22.040532  3129 rpcz_store.cc:276] 0709 13:18:20.288305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.288417 (+   112us) service_pool.cc:224] Handling call
0709 13:18:20.302466 (+ 14049us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.530253 (+227787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.031426 (+1501173us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540039e254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:22.031635 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522146560}
I20260709 13:18:22.042477  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:22.042820  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:22.043596  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:22.043756  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:22.044023  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:22.005162  9457 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:22.045439  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:22.046443  3841 raft_consensus.cc:2368] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:21.933940  9526 consensus_queue.cc:237] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:22.046661  3805 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:22.050838  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.054131  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:22.054529  3805 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:22.055462  3277 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:22.057788  3211 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:22.059049  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:22.059734  3208 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:22.059049  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:22.061163  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:22.061846  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:22.062594  3208 raft_consensus.cc:2368] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:22.064059  9309 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:22.063697  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:22.066295  9580 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:22.067600  9676 log.cc:927] Time spent T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:18:22.067767  3284 raft_consensus.cc:2393] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 18: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:22.067085  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:22.068645  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:22.069039  3206 raft_consensus.cc:2368] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:22.072887  9614 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:22.017062  9255 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:22.073354  9614 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.073732  9614 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:22.073976  3280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33896 (request call id 2098) took 1056 ms. Trace:
I20260709 13:18:22.074357  3280 rpcz_store.cc:276] 0709 13:18:21.017663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.018702 (+  1039us) service_pool.cc:224] Handling call
0709 13:18:22.073797 (+1055095us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54001b80d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:22.073899 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306841472}
I20260709 13:18:22.075227  3805 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:22.075974  9309 raft_consensus.cc:2804] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:22.076268  9255 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:22.076825  9309 raft_consensus.cc:697] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:22.078011  9400 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:22.077805  9309 consensus_queue.cc:237] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:22.070786  9493 consensus_queue.cc:1059] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:18:22.082656  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:22.083058  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:22.083413  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:22.083705  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:22.090077  3203 raft_consensus.cc:2410] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:18:22.069878  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:22.095808  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:22.098593  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:22.100412  3205 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:22.029834  9399 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:22.108280  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:22.111056  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:22.230962  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34342 (request call id 2828) took 1173 ms. Trace:
I20260709 13:18:22.107162  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:22.208346  3082 auto_rebalancer.cc:629] Failed to schedule move for tablet cd9bf15d386d49f0977913d9628e22af: Illegal state: Replica fc48eecc27554cb58b15193cd442b1d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:22.232051  3177 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:22.234957  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 127767us
W20260709 13:18:22.214860  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.237552  3177 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:22.218328  3102 leader_election.cc:400] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:22.148343  9622 raft_consensus.cc:3055] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:22.265475  9622 raft_consensus.cc:740] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:22.223752  3202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 840) took 1280 ms. Trace:
I20260709 13:18:22.267494  9622 consensus_queue.cc:260] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:22.215924  3100 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:22.242656  3251 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:22.242807  3020 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f4a8a614fca4531aab11f5963396f62 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc48eecc27554cb58b15193cd442b1d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:22.247581  3134 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:22.231596  3210 rpcz_store.cc:276] 0709 13:18:21.057065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.065932 (+  8867us) service_pool.cc:224] Handling call
0709 13:18:22.230456 (+1164524us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b54002a76d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:22.230697 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1635226880}
I20260709 13:18:22.117187  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:22.275960  9612 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:22.117409  9255 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:22.279160  9255 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:22.280404  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.087004  9335 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:22.281206  9302 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:22.282347  9335 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:22.115381  9436 consensus_queue.cc:1059] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:18:22.109223  9457 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:22.071678  9488 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:22.292268  3806 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:22.294380  3842 raft_consensus.cc:2410] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
W20260709 13:18:22.295675  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 53602.2us
I20260709 13:18:22.218744  3026 catalog_manager.cc:5697] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:22.297271  3251 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:22.298085  8874 raft_consensus.cc:3055] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:22.298610  8874 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:22.299604  9255 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:22.300640  9255 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:22.149514  9614 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:22.078706  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:22.343900  3209 raft_consensus.cc:2368] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 22. Current term is 23.
I20260709 13:18:22.344105  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:22.261037  3102 leader_election.cc:403] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:22.271783  9478 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:22.272747  9553 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:22.267086  3202 rpcz_store.cc:276] 0709 13:18:20.963095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.963245 (+   150us) service_pool.cc:224] Handling call
0709 13:18:20.973967 (+ 10722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.019281 (+ 45314us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:21.085824 (+ 66543us) log.cc:844] Serialized 14 byte log entry
0709 13:18:21.571669 (+485845us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.571741 (+    72us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:21.571810 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.223107 (+651297us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b5400247f54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:22.223181 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.223487 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":595639,"prepare.queue_time_us":138074,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":6130,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"spinlock_wait_cycles":103646080,"thread_start_us":544154,"threads_started":3,"wal-append.queue_time_us":351308}
I20260709 13:18:22.273811  9481 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.295845  9529 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:22.300093  3251 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:22.300087  8874 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:22.263720  9239 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.303022  9667 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:22.138006  9407 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:22.313294  9477 raft_consensus.cc:3055] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:22.313724  9335 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:22.292778  9488 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:22.314544  9589 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:22.313326  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 219845us
I20260709 13:18:22.340982  3132 raft_consensus.cc:1240] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:22.346573  9436 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:22.350569  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 132729us
I20260709 13:18:22.347609  9478 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:22.358335  8874 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:22.360193  9583 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:22.371959  9478 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:22.383565  9614 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:22.384778  9503 raft_consensus.cc:2804] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:18:22.386130  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 148875us
I20260709 13:18:22.385825  3026 catalog_manager.cc:5697] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:22.389210  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:22.371821  9488 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:22.393874  9622 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:22.396829  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 181385us
W20260709 13:18:22.398669  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.399109  9478 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:22.400244  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:22.402092  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:22.405407  9666 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:22.406878  9255 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:18:22.407287  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 107460us
I20260709 13:18:22.364239  9477 raft_consensus.cc:740] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:22.409925  3177 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:22.372718  9239 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:22.425725  9481 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:22.426652  9503 raft_consensus.cc:697] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:22.428587  9481 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:22.428414  9503 consensus_queue.cc:237] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:22.425264  9683 log.cc:927] Time spent T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:18:22.433957  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 61686.1us
I20260709 13:18:22.458724  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:22.458824  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:22.460814  9436 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:22.461553  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 63789.8us
I20260709 13:18:22.462620  3100 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:22.476801  9577 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:22.478156  9239 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:22.480314  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 91493.8us
I20260709 13:18:22.482360  3177 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:22.482690  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:22.488006  9567 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:22.488041  9454 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:18:22.501220  9400 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:22.502362  3129 raft_consensus.cc:1240] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:18:22.454330  9583 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:22.508459  9529 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:22.509416  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 68166.9us
W20260709 13:18:22.515365  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 223649us
I20260709 13:18:22.532639  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:22.535401  3251 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:22.535614  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:22.470656  9589 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:22.544766  9434 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:22.545637  3100 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:22.546458  9526 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.527098  9255 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:22.554544  9255 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:22.538475  9477 consensus_queue.cc:260] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:22.553468  9526 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:22.553730  9434 raft_consensus.cc:697] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:18:22.559742  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 77575.8us
I20260709 13:18:22.565784  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:22.569202  3202 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:18:22.434063  3026 catalog_manager.cc:5697] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 15 to 16, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 16 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:22.570096  9526 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:22.571194  3026 catalog_manager.cc:5697] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:22.572654  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:22.576424  3100 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:22.578733  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:22.579087  3100 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:22.579562  3210 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 20.
I20260709 13:18:22.550684  9436 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:22.571872  9477 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:22.589229  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:22.564319  9478 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:22.583835  9667 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:22.594139  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:22.570133  9255 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:22.583693  9407 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:18:22.607491  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 95946.8us
I20260709 13:18:22.589349  9398 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:22.601297  3177 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:22.605659  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:22.585695  9589 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:22.594265  9667 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:18:22.619848  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.615320  3842 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:18:22.623068  3211 raft_consensus.cc:1240] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:22.638607  9614 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:22.639595  9614 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:22.603353  9407 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:22.640978  9407 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:22.642580  9614 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:22.613857  9398 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:22.653772  9398 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:22.657692  9667 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:22.661649  3251 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:22.662958  3251 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:22.664223  9255 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:22.609948  9436 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:22.667599  9436 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:22.669512  9594 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:22.670008  9594 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:22.670146  3100 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:22.670426  9594 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:22.671998  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:22.672835  9481 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:22.673233  9481 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:22.673314  9255 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:18:22.674103  3102 consensus_peers.cc:597] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ae5c762a7f347f4a2de941d47ed1903. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:22.674548  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 56720.4us
I20260709 13:18:22.675515  3102 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:22.675700  9450 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:22.676503  9621 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:22.673743  9481 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:22.677115  9621 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.677314  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:22.677652  9621 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:22.682686  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 92378.6us
I20260709 13:18:22.690665  9436 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:22.691516  9436 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:22.705436  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:22.711014  3202 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:22.688710  9583 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:22.700781  9666 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:22.717650  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:22.725375  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:22.725616  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 48478.5us
W20260709 13:18:22.723951  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 237907us
I20260709 13:18:22.735572  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:22.741678  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:22.737742  3134 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 18.
I20260709 13:18:22.749306  9457 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:22.754876  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.751449  3176 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.67:41801 timed out after 1.626s (SENT) [suppressed 2 similar messages]
I20260709 13:18:22.748373  9583 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:22.714807  9434 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:22.765285  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:22.766460  3136 raft_consensus.cc:2393] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 18: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:22.767468  9436 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:22.765378  3805 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:22.772864  9309 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:22.747474  9335 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
W20260709 13:18:22.774775  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 74950.6us
I20260709 13:18:22.785741  3128 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:22.773434  9309 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:22.794124  3249 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:22.797691  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.790771  9309 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:22.788671  9503 consensus_queue.cc:1059] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:18:22.812914  9589 raft_consensus.cc:3055] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:22.813418  9589 raft_consensus.cc:740] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:22.814651  9589 consensus_queue.cc:260] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:22.816067  9589 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:22.813258  3100 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:22.785732  9461 consensus_queue.cc:1059] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:18:22.826993  9460 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:22.827998  3100 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:22.830466  9666 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:22.830943  9666 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.831295  9666 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:22.842192  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 49110.8us
I20260709 13:18:22.845163  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:22.775307  3026 catalog_manager.cc:5697] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:22.847002  9436 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.871635  3026 catalog_manager.cc:5697] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 14 to 17, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 17 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:22.852836  9667 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:22.868240  9436 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:22.878489  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.880913  9460 raft_consensus.cc:3055] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:22.893476  9460 raft_consensus.cc:740] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:22.870342  9577 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:22.887868  3202 raft_consensus.cc:2468] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 24.
I20260709 13:18:22.893404  9461 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:22.882649  3249 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:22.864392  9481 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:22.874565  9407 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:22.896198  9577 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:22.914147  9577 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:22.905295  9667 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:22.933970  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.933861  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 182454us
I20260709 13:18:22.925520  9434 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:22.935174  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 175527us
I20260709 13:18:22.927500  9457 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:18:22.944788  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 116936us
I20260709 13:18:22.938830  9434 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:22.948341  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:22.950050  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 67586.1us
I20260709 13:18:22.945925  9450 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:22.914410  9460 consensus_queue.cc:260] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:22.946126  9477 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:22.939435  9621 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:22.952513  9434 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:22.969272  9698 log.cc:927] Time spent T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:18:22.975191  9478 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:22.947311  9457 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:22.980558  3131 raft_consensus.cc:2393] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 16: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:22.981869  9614 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:22.982475  9614 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:22.985287  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 84064us
I20260709 13:18:22.974234  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:22.961593  9477 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:22.991704  9436 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:22.981401  9594 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.001588  3135 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:23.000252  3127 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:18:23.000011  9450 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:23.000727  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:23.006220  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:23.010093  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.005738  9481 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:22.997040  9461 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:23.036847  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:23.036979  9335 consensus_queue.cc:1048] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:18:23.049651  9503 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:23.039009  9457 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:23.038054  9477 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:23.033392  9460 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:23.054189  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 87642us
I20260709 13:18:23.055115  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:23.057118  9586 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:23.057994  9586 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:23.058389  9586 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:23.045778  9594 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:23.046437  9488 consensus_meta.cc:287] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent flushing consensus metadata: real 0.653s	user 0.016s	sys 0.002s
I20260709 13:18:23.065950  9701 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:23.065863  9488 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.067390  3841 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:23.068276  9488 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:23.068598  9614 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:23.064807  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:23.069638  9309 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.071914  9309 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 21 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:23.072475  9436 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:23.073716  9436 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:23.075093  9577 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:22.973542  3026 catalog_manager.cc:5697] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 15 to 17, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 17 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:23.076975  3805 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:23.076530  3026 catalog_manager.cc:5697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 14 to 17, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 17 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:23.077440  9407 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:23.078405  3026 catalog_manager.cc:5697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 13 to 14, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:23.079219  9335 raft_consensus.cc:2804] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:23.079757  9335 raft_consensus.cc:697] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:23.081596  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:23.081753  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:23.082319  3837 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:23.080583  9335 consensus_queue.cc:237] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.086846  3836 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:23.085047  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:23.088166  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:23.089840  9621 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:23.091346  3833 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:23.095878  3834 raft_consensus.cc:1240] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:23.100201  9667 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.103897  3249 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:23.104743  9407 consensus_queue.cc:1059] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:23.106680  9398 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.112296  9503 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:23.113613  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:23.116127  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:23.094630  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:18:23.117447  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 128083us
I20260709 13:18:23.080287  3026 catalog_manager.cc:5697] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 8 to 10, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 10 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
W20260709 13:18:23.138590  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 44046.7us
I20260709 13:18:23.143122  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.143959  3280 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:18:23.144359  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:23.144523  9666 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.158334  9666 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:23.158579  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.158655  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.160236  9398 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:23.160667  3202 raft_consensus.cc:1275] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:18:23.161623  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 57894.9us
I20260709 13:18:23.162371  3100 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:23.162859  9461 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:23.163050  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:23.163501  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:23.158354  3207 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:18:23.155503  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 149359us
I20260709 13:18:23.163380  9666 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:23.165603  9666 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:23.165710  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.166111  9666 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:23.166473  3280 raft_consensus.cc:3055] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:23.166891  3280 raft_consensus.cc:740] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:23.167340  9586 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.168081  9436 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.167830  3280 consensus_queue.cc:260] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.141414  9309 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:23.169266  3837 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:23.169835  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.170830  3100 leader_election.cc:400] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:23.169348  9309 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.168622  9436 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.169003  3280 raft_consensus.cc:3060] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:23.165787  3281 raft_consensus.cc:1275] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:18:23.176030  3100 leader_election.cc:400] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:23.176179  3836 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:18:23.147616  9594 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:23.134917  9667 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.182844  3102 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:23.192888  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:23.193594  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.174605  9450 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:23.174822  9309 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:23.199079  3207 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:23.202129  9434 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.204627  9434 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:23.206099  9594 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:23.206416  9667 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:23.207008  9436 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:23.207595  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:23.210248  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.196092  9621 raft_consensus.cc:3055] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:23.213502  9621 raft_consensus.cc:740] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:23.214509  9567 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:23.214730  3249 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:23.216187  9567 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:23.216395  3249 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:23.217236  9586 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:23.218755  3026 catalog_manager.cc:5697] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 13 to 16, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 16 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:23.225170  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:23.225891  3209 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:23.227316  3280 raft_consensus.cc:1275] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:23.193099  9703 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:23.230171  9577 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:23.235306  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:23.240291  3207 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:23.241194  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:23.214766  9621 consensus_queue.cc:260] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.235308  9434 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:23.236187  9407 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:18:23.255016  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 69393us
I20260709 13:18:23.256551  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.259001  3281 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:18:23.261173  3277 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:18:23.265486  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 49201.3us
I20260709 13:18:23.258394  3026 catalog_manager.cc:5697] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 12 to 13, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 13 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:23.266424  3249 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:23.267122  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:23.267472  3100 leader_election.cc:400] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 22. Current term is 23.
I20260709 13:18:23.248616  9703 raft_consensus.cc:697] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:18:23.270996  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.273276  9703 consensus_queue.cc:237] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.277784  3276 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:23.278491  3249 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:23.276800  3209 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:23.280171  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:23.281198  9614 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:23.281927  9503 consensus_queue.cc:1059] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:23.283927  9434 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:23.284051  9488 raft_consensus.cc:3055] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:23.284458  9488 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:23.268694  9621 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:23.285578  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:23.285405  9488 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.286232  3135 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:23.286866  9488 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:23.286893  9460 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:23.309370  3207 raft_consensus.cc:2468] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 21.
I20260709 13:18:23.292373  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:23.312340  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:23.281209  9589 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:18:23.326952  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:23.330744  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.319792  9614 raft_consensus.cc:2764] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:18:23.338793  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 58689.8us
I20260709 13:18:23.325532  9460 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.339471  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:23.319092  9398 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:23.345813  9477 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:23.327171  9450 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:18:23.349812  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 71402.1us
I20260709 13:18:23.350320  3202 raft_consensus.cc:1275] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:23.347381  9477 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:23.351780  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 95120.7us
I20260709 13:18:23.357172  3251 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:23.359130  3805 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:23.352800  9526 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:23.364995  9335 raft_consensus.cc:2804] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:23.365589  9335 raft_consensus.cc:697] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:23.366464  9335 consensus_queue.cc:237] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.373111  3206 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:23.373200  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:23.362629  9450 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.365015  3805 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:23.376058  9526 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:23.376564  9450 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:23.376725  9526 raft_consensus.cc:697] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:23.378123  9526 consensus_queue.cc:237] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.374624  3211 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:23.357967  9477 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:23.395413  3207 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:18:23.395972  3207 pending_rounds.cc:85] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 9
I20260709 13:18:23.405462  3207 pending_rounds.cc:107] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:18:23.407936  3207 raft_consensus.cc:2889] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:23.408569  3101 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:23.362071  9460 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:23.411584  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.414248  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 52120.4us
I20260709 13:18:23.407348  9434 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:23.417440  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:23.418031  9309 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.418478  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:23.418591  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:23.419162  3204 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:23.420025  9705 ts_tablet_manager.cc:933] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323)
I20260709 13:18:23.420322  3836 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:23.420411  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:23.418064  3205 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:23.417325  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:23.422622  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:23.423221  3208 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:23.423616  3249 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:23.424525  3206 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:23.432317  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 75258.8us
I20260709 13:18:23.406234  9594 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:23.435978  9567 consensus_queue.cc:1059] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:23.371129  9583 consensus_queue.cc:1059] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.053s
I20260709 13:18:23.451531  3204 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 23.
I20260709 13:18:23.445591  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.453727  3202 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:23.437683  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:23.454715  3207 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:23.445587  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.451828  3205 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:23.413914  9586 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:23.458072  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.459764  3281 raft_consensus.cc:1240] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:18:23.458333  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.464202  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.461585  3277 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 21.
I20260709 13:18:23.437402  9703 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:23.437019  9434 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:23.428404  9478 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:23.469038  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 69335.6us
W20260709 13:18:23.470080  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 107358us
I20260709 13:18:23.440001  9667 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:23.456796  9398 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.456586  9461 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:23.441120  9577 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:18:23.441246  9407 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:18:23.441228  9493 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:18:23.485729  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.487522  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.490586  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.491248  3207 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:23.479760  9461 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.478101  9436 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.467609  9586 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.473786  9594 consensus_queue.cc:1059] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:18:23.512432  9614 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.489681  9309 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:23.513031  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.475160  9478 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.504312  9503 consensus_queue.cc:1048] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:23.517031  3211 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 23.
I20260709 13:18:23.513238  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.517588  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.502630  9461 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:23.517565  9701 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:18:23.518756  3128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:18:23.517202  9436 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.517710  9460 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:23.478554  9622 consensus_queue.cc:1048] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:18:23.570987  3128 raft_consensus.cc:606] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:23.571509  3128 raft_consensus.cc:614] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:23.516426  3284 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 13:18:23.550971  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 114900us
I20260709 13:18:23.411556  3026 catalog_manager.cc:5697] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 17 to 18, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 18 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:23.556047  3208 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:23.557451  3101 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:23.530788  3206 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:23.562860  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.570317  9720 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.496259  9398 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.594509  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:23.493891  9667 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.600343  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.549371  9705 tablet_copy_client.cc:323] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.65:41323
I20260709 13:18:23.603574  3100 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:18:23.593376  9716 log.cc:927] Time spent T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:18:23.601291  3277 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 21.
I20260709 13:18:23.562865  9594 consensus_queue.cc:1243] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer 0930e3e7657c43bcaaa5b0778f3e08cf log is divergent from this leader: its last log entry 24.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
W20260709 13:18:23.612082  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 65587.2us
I20260709 13:18:23.560065  9614 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.616297  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.599757  9703 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:23.620651  9407 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:23.649614  3026 catalog_manager.cc:5697] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 12 to 17, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 17 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:23.661222  9436 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:23.661839  3277 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:23.663825  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.664307  9614 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:23.669803  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 66358.6us
I20260709 13:18:23.670538  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:23.609803  9577 consensus_queue.cc:1059] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:18:23.684053  3100 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:23.675542  9703 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:23.684653  3207 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:18:23.598026  9720 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.691313  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:23.693372  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 94632.5us
I20260709 13:18:23.685585  9725 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.698796  3280 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:18:23.642021  9724 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.068s
I20260709 13:18:23.702610  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:23.707765  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:23.705848  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:23.710374  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:18:23.716818  9708 log.cc:927] Time spent T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:23.707772  9481 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:23.721359  9481 raft_consensus.cc:697] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:23.698463  9407 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 23 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:23.730340  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.706367  9725 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.709318  9488 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.732667  3135 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:18:23.730479  3026 catalog_manager.cc:5697] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 10 to 13, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 13 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:23.748129  3026 catalog_manager.cc:5697] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:23.749874  3281 raft_consensus.cc:1275] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:23.750869  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.751929  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.754097  9481 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.754746  9477 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.759608  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.756809  9477 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:23.733668  9478 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:23.757296  9717 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:23.765342  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.765646  3207 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:18:23.766127  3284 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
W20260709 13:18:23.743289  9666 consensus_meta.cc:287] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.577s	user 0.013s	sys 0.001s
I20260709 13:18:23.765555  9717 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.769269  9434 raft_consensus.cc:3055] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:23.770391  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:23.774570  3207 raft_consensus.cc:2368] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 19. Current term is 20.
I20260709 13:18:23.775115  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:23.778999  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:23.779263  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.780017  3277 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:23.765518  9667 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:23.800357  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 78596.8us
I20260709 13:18:23.800793  9723 consensus_queue.cc:1059] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:23.802872  3204 raft_consensus.cc:1240] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:23.818403  9743 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:23.819089  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:23.819104  9493 consensus_queue.cc:1048] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:23.777786  9724 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:23.777987  9717 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:23.742547  9488 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:23.822921  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.777642  9434 raft_consensus.cc:740] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:18:23.823905  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 121187us
I20260709 13:18:23.827678  3100 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:23.781946  9398 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:23.790409  9586 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:23.846096  3204 raft_consensus.cc:1240] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:18:23.821265  9255 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:23.782377  9666 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.820709  9743 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:18:23.824457  9503 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:23.858191  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:23.826594  9460 raft_consensus.cc:3055] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:23.859535  3207 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:23.838688  9398 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:23.865804  3204 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:18:23.766140  9407 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.877518  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:23.821029  9735 consensus_queue.cc:1048] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:18:23.890138  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:23.888540  9753 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:23.889325  3131 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:23.889449  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:23.850981  9255 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:23.865861  9460 raft_consensus.cc:740] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:23.883937  9481 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:23.839466  9724 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:23.922730  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 95185.3us
I20260709 13:18:23.891911  9720 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:23.926026  3127 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:18:23.923723  3100 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:23.958367  3100 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:23.959631  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:23.922188  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:23.959035  3100 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:23.911587  9701 raft_consensus.cc:3055] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:23.959374  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:23.977365  3282 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:23.978663  9733 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:23.979527  9733 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.981143  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:23.983359  9741 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:23.984551  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:23.891584  9398 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:23.987206  3206 raft_consensus.cc:2368] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16.
I20260709 13:18:23.955442  9477 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.964425  9583 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.022706  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:24.023602  3249 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:23.954490  9481 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:24.000294  9594 raft_consensus.cc:3055] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:23.977396  9701 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:23.999621  9255 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.000810  9745 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:24.002638  3206 raft_consensus.cc:1240] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:18:24.003281  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:24.004349  3207 raft_consensus.cc:1240] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:18:24.005426  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:24.008486  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:18:24.012542  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 53062.9us
I20260709 13:18:24.013173  9730 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:24.013345  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:24.013875  9586 raft_consensus.cc:3055] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:24.041916  3837 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:24.005419  9460 consensus_queue.cc:260] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.017030  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:24.019260  9737 log.cc:927] Time spent T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.194s	user 0.002s	sys 0.000s
I20260709 13:18:23.972191  9720 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.990536  9621 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:24.021265  9725 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:24.026520  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.026652  3249 leader_election.cc:400] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 19. Current term is 20.
I20260709 13:18:23.985889  9667 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:18:24.027872  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 68880us
I20260709 13:18:24.030378  3203 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:18:24.033397  3836 raft_consensus.cc:1240] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:18:24.036748  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:24.038514  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:24.043854  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:24.044425  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:24.042323  9586 raft_consensus.cc:740] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:24.045590  9255 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:23.927590  9753 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:24.045881  9742 log.cc:927] Time spent T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:24.045987  9733 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:24.094914  9745 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 23 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:24.046983  9666 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:24.095943  9745 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.030175  9567 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:24.097537  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:24.097648  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:24.098479  3276 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:18:24.098970  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:24.047220  9724 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:23.988530  9434 consensus_queue.cc:260] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.099642  3284 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:24.100212  9434 raft_consensus.cc:3060] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:24.101576  3135 raft_consensus.cc:1240] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 23 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:24.048691  9701 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.050313  9398 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:24.050424  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:24.051689  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:24.052721  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:24.053292  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:24.119285  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:24.053639  3136 raft_consensus.cc:1240] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:24.054085  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:24.054299  3176 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.028399  9594 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:24.022622  9477 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.055455  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:24.055720  9488 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:24.027601  9583 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.056227  9720 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:24.130897  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 76699.8us
I20260709 13:18:24.057255  9460 raft_consensus.cc:3060] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:24.056945  9481 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.131950  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.058828  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:24.133255  9457 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.133689  3279 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:24.133956  9457 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:24.137156  3285 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:24.045745  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:24.060807  3145 tablet_copy_service.cc:140] P fc48eecc27554cb58b15193cd442b1d3: Received BeginTabletCopySession request for tablet 2ae5c762a7f347f4a2de941d47ed1903 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:57442)
I20260709 13:18:24.139449  3145 tablet_copy_service.cc:161] P fc48eecc27554cb58b15193cd442b1d3: Beginning new tablet copy session on tablet 2ae5c762a7f347f4a2de941d47ed1903 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:57442: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-2ae5c762a7f347f4a2de941d47ed1903
I20260709 13:18:24.141690  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:24.142841  3285 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 18: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:24.143616  3100 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:24.146849  3279 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:24.147508  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:24.076496  3282 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:24.082427  3281 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 21.
I20260709 13:18:24.148638  9398 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:24.149070  9398 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:24.083287  3833 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:24.092971  9747 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:24.149649  9398 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:24.093781  9586 consensus_queue.cc:260] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.153766  9586 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:24.085675  9621 raft_consensus.cc:697] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 20 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:24.156548  3280 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 23: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:24.099743  9717 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.100617  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:24.099292  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:18:24.105747  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.107265  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 80738.2us
I20260709 13:18:24.077426  9577 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.109772  9667 raft_consensus.cc:697] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:24.111462  9567 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.092556  9723 consensus_queue.cc:1059] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:18:24.115752  9461 consensus_meta.cc:287] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 13:18:24.116720  9733 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.120240  3130 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.125947  3132 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 19.
I20260709 13:18:24.147822  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:24.148998  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:24.178583  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:24.178939  3281 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:24.172679  9720 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:24.179905  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:24.049782  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:24.180738  3277 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.180496  9734 raft_consensus.cc:2955] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:24.182224  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:24.182912  3136 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 18.
I20260709 13:18:24.182974  3128 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:24.185047  3276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37a53418fbf14b998493923afc272c3c"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:24.158100  3833 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:18:24.185774  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:24.186520  3211 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 17: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:24.185492  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:24.180500  3281 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.187960  3276 raft_consensus.cc:606] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:24.188424  3276 raft_consensus.cc:614] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:24.188834  9747 raft_consensus.cc:3055] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:24.189244  9583 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:24.189262  9747 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:24.190519  9747 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.162552  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:24.158977  3102 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:24.165516  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:24.128793  9477 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:24.167452  9478 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.167373  9461 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.169806  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:24.173897  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:24.218164  3277 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:24.176170  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:24.179921  9753 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:24.160873  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.187610  3280 raft_consensus.cc:1240] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:24.193167  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45755us
I20260709 13:18:24.194689  9733 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.224653  3283 raft_consensus.cc:2393] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:24.219980  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:18:24.220712  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 63934.3us
I20260709 13:18:24.225297  3132 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:24.226540  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.226467  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:24.227254  3131 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:24.187544  9621 consensus_queue.cc:237] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.228600  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.230326  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.230680  9733 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:24.191229  9717 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:24.232574  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 71826.4us
I20260709 13:18:24.235247  3205 raft_consensus.cc:2393] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 19: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:24.236433  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:24.236994  3282 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.185393  9577 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.223506  9743 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:24.233561  9457 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:24.234239  9747 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:24.241714  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.242763  3285 raft_consensus.cc:1275] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
I20260709 13:18:24.281725  3285 pending_rounds.cc:85] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 15
I20260709 13:18:24.282019  3285 pending_rounds.cc:107] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 13:18:24.282279  3285 raft_consensus.cc:2889] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:24.246711  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:24.247010  9701 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:24.271000  3249 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:24.275774  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:24.287694  3129 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:24.288596  3833 raft_consensus.cc:2410] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:18:24.277660  3130 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 19.
I20260709 13:18:24.281752  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:24.291137  3806 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:24.156898  9594 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.235460  9478 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:24.293632  3134 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:18:24.294564  3249 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.301486  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:24.302141  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:24.269735  9743 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:24.303651  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.191740  9567 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.237432  9724 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:24.293365  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:24.303171  3127 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:18:24.293368  9583 consensus_queue.cc:1059] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:18:24.324554  9583 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:24.301755  9755 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:24.325632  9755 raft_consensus.cc:3055] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:24.326110  9755 raft_consensus.cc:740] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:24.327168  9755 consensus_queue.cc:260] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.329237  3280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:24.329907  3280 raft_consensus.cc:606] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:24.330272  3280 raft_consensus.cc:614] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:24.314975  3284 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:18:24.309849  9503 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:24.316221  3282 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 18.
I20260709 13:18:24.310078  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:24.322315  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:24.322949  9733 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:24.310038  9460 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:18:24.347774  3279 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:24.286859  9720 consensus_queue.cc:1059] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:18:24.328884  9755 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:24.344759  9754 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:24.293691  9723 consensus_queue.cc:1059] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:18:24.318257  9743 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.348850  3100 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:24.309252  9302 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:18:24.356164  9461 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:24.352463  9477 consensus_queue.cc:1059] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:18:24.361050  9751 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:24.361464  9477 raft_consensus.cc:3055] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:24.362659  9751 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.363281  9477 raft_consensus.cc:740] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:24.364212  9477 consensus_queue.cc:260] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.319962  9667 consensus_queue.cc:237] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.365856  9477 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:24.366035  9567 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:24.357039  9754 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:24.369526  9754 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:24.345804  9526 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:18:24.370074  9586 raft_consensus.cc:3055] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:24.370625  9586 raft_consensus.cc:740] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:24.339921  9503 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.345265  9457 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:24.378336  9749 consensus_queue.cc:1059] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:24.385502  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.386454  9725 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:24.387012  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.387804  9725 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:24.388257  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.389107  9725 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:24.389379  9503 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:24.347680  9733 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:24.391242  9733 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:24.394002  9756 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.371652  9586 consensus_queue.cc:260] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.404834  3132 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:24.409505  3176 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.419850  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:24.434129  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 132369us
I20260709 13:18:24.365000  9751 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:24.422129  9725 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:24.484462  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 189952us
I20260709 13:18:24.434273  9730 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.486022  3249 leader_election.cc:400] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16.
I20260709 13:18:24.486339  3249 leader_election.cc:403] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:18:24.463773  9666 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:24.489892  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 141109us
I20260709 13:18:24.418879  9457 consensus_queue.cc:1048] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:18:24.518724  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:24.519550  3205 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:24.522863  3279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:24.523577  3279 raft_consensus.cc:606] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:24.524344  3279 raft_consensus.cc:614] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:24.520910  3100 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:18:24.527815  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 98267.2us
I20260709 13:18:24.491145  9755 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 15. Current term is 16.
W20260709 13:18:24.530405  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 243804us
I20260709 13:18:24.521202  3249 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.534468  3101 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:24.514644  9586 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.520547  9745 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:24.550679  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.554225  3207 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:24.555456  3249 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.528430  9734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50230 (request call id 1) took 2276 ms. Trace:
I20260709 13:18:24.564627  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:24.555948  9621 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:24.566651  9621 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:24.567031  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:24.568079  9724 raft_consensus.cc:3055] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:24.568485  9724 raft_consensus.cc:740] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:24.570432  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.573218  3281 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:24.548511  9567 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:24.576094  9774 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:24.577505  9747 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.586539  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:24.587493  3205 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:24.577657  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:24.593420  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:24.595561  9614 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:24.556907  9745 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.612167  9745 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:24.612902  9757 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.613710  9757 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.567045  9621 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.616413  9757 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:24.584652  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:24.617254  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 63514.7us
I20260709 13:18:24.618110  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.599290  3207 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:24.619673  9457 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:24.565580  9734 rpcz_store.cc:276] 0709 13:18:22.242293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.242560 (+   267us) service_pool.cc:224] Handling call
0709 13:18:22.372024 (+129464us) log.cc:844] Serialized 499 byte log entry
0709 13:18:22.572262 (+200238us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b18001d3440. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b907cc0a 00007fb3c27bc219 00007fb3b9104a40 00007fb3b90ff4e4 00007fb3b90ff455 00007fb3bc148b0b 00007fb3bc1cdb63 00007fb3bc1f5752 00007fb3c11b5d29
0709 13:18:24.518507 (+1946245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29890,"raft.queue_time_us":34003,"raft.run_cpu_time_us":1933,"raft.run_wall_time_us":3939,"spinlock_wait_cycles":4867968,"thread_start_us":110767,"threads_started":1,"wal-append.queue_time_us":310078,"wal-append.run_cpu_time_us":3365,"wal-append.run_wall_time_us":1154734}
I20260709 13:18:24.556640  9255 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.622279  9398 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.625524  9407 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:24.626009  9407 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.626382  9407 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:24.571190  9755 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:24.578027  9450 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:18:24.630736  9738 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:24.631294  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.631333  9738 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.634924  9738 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:24.644901  3249 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:24.650597  9755 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:24.651073  9755 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.651409  9755 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.650609  3145 tablet_copy_source_session.cc:215] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:24.653395  9594 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.625548  9398 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:24.600924  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:24.664093  3205 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:24.579074  9477 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:24.665014  9477 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:24.665483  9477 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:24.670351  3833 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:24.671190  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:24.579080  9724 consensus_queue.cc:260] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.608747  9614 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.674165  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:24.674549  9614 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:24.578509  9765 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:18:24.675125  3834 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 18: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:24.578070  9753 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.677740  9577 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:24.676370  9753 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.679891  3282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:24.680493  3282 raft_consensus.cc:606] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:24.680820  3282 raft_consensus.cc:614] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:24.681171  9753 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:24.600005  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:24.683380  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 83422.3us
I20260709 13:18:24.684056  9703 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:24.685106  9756 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:24.685778  9756 consensus_queue.cc:1059] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:24.686269  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:24.686916  9666 raft_consensus.cc:3055] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:24.687080  9738 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.687340  9666 raft_consensus.cc:740] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:24.687624  9738 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.688217  9666 consensus_queue.cc:260] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.689767  9589 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:24.690414  9589 raft_consensus.cc:697] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:24.691289  9589 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.689849  9738 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:24.695034  3249 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:24.696112  9434 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:24.696614  9434 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.696723  9724 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:24.697057  9434 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.701617  9717 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:24.662024  3207 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:18:24.710474  3249 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:24.711714  9769 raft_consensus.cc:2804] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:24.712348  9769 raft_consensus.cc:697] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:24.712392  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:24.713244  3834 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:24.713871  9769 consensus_queue.cc:237] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.720400  9666 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.723868  3276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:24.724454  3276 raft_consensus.cc:606] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:24.724853  3276 raft_consensus.cc:614] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:24.636585  9733 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:24.733006  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:24.726354  3102 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:24.734913  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:18:24.773434  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.743562  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:24.785674  3203 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:24.777635  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:24.787462  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.778052  9577 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:24.789681  9577 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.779574  9614 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.732707  9503 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.791939  9733 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:24.734117  9621 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.648034  9743 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.820250  9621 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:24.820380  9743 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:24.825244  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:24.774456  9747 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.813649  9577 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:24.817538  9614 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.800138  9477 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.778486  9703 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:24.741816  9753 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:24.739122  9754 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.799392  9407 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:24.837826  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 218564us
W20260709 13:18:24.851622  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 277216us
I20260709 13:18:24.857733  3176 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:24.859028  3834 raft_consensus.cc:2368] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 19. Current term is 20.
I20260709 13:18:24.859472  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.861575  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:24.870395  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:24.871170  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:24.871801  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:24.873775  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.874609  3205 raft_consensus.cc:2410] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:18:24.833477  9703 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:24.880355  3836 raft_consensus.cc:1240] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:24.880909  3203 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:24.884549  3102 leader_election.cc:400] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 19. Current term is 20.
I20260709 13:18:24.884958  3102 leader_election.cc:403] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:18:24.880386  3211 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:24.890563  3208 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:24.890774  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:24.891376  3205 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:24.891497  3204 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:24.858414  9733 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:24.893601  3203 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:24.873096  9730 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.876228  9725 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:24.897912  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:24.877511  9478 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:24.833251  9755 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.886096  9703 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:24.902913  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 126219us
I20260709 13:18:24.859349  9747 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.911414  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:24.915020  3128 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.905763  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:24.914294  3100 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:24.919343  3203 raft_consensus.cc:2393] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 19: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
W20260709 13:18:24.919764  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 46096.6us
I20260709 13:18:24.920761  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:24.898789  9667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.011s	sys 0.026s
I20260709 13:18:24.922475  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:24.925951  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:24.926802  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.898788  9725 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:24.932251  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:24.928928  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:24.933693  3134 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:18:24.931713  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:24.936971  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:24.929672  3250 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.938076  3282 raft_consensus.cc:2393] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 18: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:24.939262  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:24.941171  3283 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:18:24.928310  9667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.011s	sys 0.026s
I20260709 13:18:24.945509  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:24.899422  9733 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:24.922108  9781 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:24.953466  3281 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:24.949829  3282 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 21.
I20260709 13:18:24.936290  9725 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.913352  9743 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:18:24.936776  9730 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:24.959852  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:24.941425  9567 raft_consensus.cc:2749] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.964437  3285 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:24.967008  3284 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:24.945592  9589 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:24.965881  3277 raft_consensus.cc:2955] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:24.948093  9778 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:24.950369  9767 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:24.972738  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:24.953922  9781 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:24.961314  9481 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.952898  9434 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:24.990120  9589 raft_consensus.cc:697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:18:25.033375  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 119168us
W20260709 13:18:25.038168  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 111475us
I20260709 13:18:25.039125  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:25.039469  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:25.039762  3834 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.012072  9781 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:25.043429  3128 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 18.
I20260709 13:18:25.043642  9792 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:25.031708  9477 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:25.031967  9773 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:25.054248  9773 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:25.056457  9773 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:25.058701  9754 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:25.060361  3834 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:18:25.062131  9481 consensus_queue.cc:1059] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:25.062873  9757 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:25.063211  9481 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:25.064405  9757 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:18:25.064664  9782 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:18:25.064986  9481 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:25.065215  9785 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:25.066144  9755 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:25.036650  9503 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:25.067422  9747 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:25.071529  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:25.032344  9478 raft_consensus.cc:697] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
W20260709 13:18:25.035396  9780 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:18:25.079416  3102 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:25.064806  9757 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:25.047441  9407 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:25.080399  9481 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:25.086946  9614 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:25.113940  9753 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:25.138890  9477 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:25.181310  9792 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:25.185432  9753 raft_consensus.cc:697] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:25.192284  9589 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:25.217669  9786 log.cc:927] Time spent T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:18:25.219116  9747 consensus_queue.cc:1059] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:18:25.220824  9747 raft_consensus.cc:3055] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:25.221215  9747 raft_consensus.cc:740] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:25.196648  9733 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:25.184252  9757 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:25.222046  9747 consensus_queue.cc:260] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.223367  9747 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:25.224779  9738 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.191520  9477 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.225345  9738 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.227422  9477 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:25.230122  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 190730us
I20260709 13:18:25.233500  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:25.233709  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:25.184616  9481 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:25.262990  3210 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:25.227422  9738 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:25.267979  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:25.270795  9791 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:25.271121  9783 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:18:25.228714  9794 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:18:25.271903  9789 log.cc:927] Time spent T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:18:25.272394  9779 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791: Append to log took a long time: real 0.322s	user 0.000s	sys 0.002s
I20260709 13:18:25.272943  9753 consensus_queue.cc:237] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.273957  9503 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:25.273890  9725 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:25.271286  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:25.285239  9778 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 19. Current term is 20.
I20260709 13:18:25.234923  9795 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:18:25.293877  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.200441  9478 consensus_queue.cc:237] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:25.265498  9798 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.206622  9792 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.312253  9705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae5c762a7f347f4a2de941d47ed1903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:25.319864  9434 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:25.390697  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 157319us
I20260709 13:18:25.296608  9503 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.323040  9733 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.290410  9794 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.298792  9795 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.415306  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:25.409278  9526 consensus_queue.cc:1048] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 13:18:25.416448  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:25.435140  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:25.436218  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:25.451733  3277 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 24.
I20260709 13:18:25.440961  9457 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:25.453032  9457 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.454806  9769 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.455343  9769 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.459717  3279 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 14.
I20260709 13:18:25.461977  9769 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:25.465044  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:25.465476  9733 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:25.467141  9733 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.466120  3842 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 24.
I20260709 13:18:25.396224  9477 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:25.489511  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:25.490492  3128 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 21.
I20260709 13:18:25.496619  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:25.499941  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:25.501804  3133 raft_consensus.cc:2410] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:18:25.320812  9798 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.412575  9791 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:25.394387  9787 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.197s
I20260709 13:18:25.512010  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:25.512341  3251 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:25.512526  3129 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:25.494808  9808 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.068s	user 0.001s	sys 0.005s
I20260709 13:18:25.518504  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:25.519119  3129 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:25.519807  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:25.522370  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:25.523645  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:25.526014  3131 raft_consensus.cc:3060] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.499723  9477 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.529386  9477 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:25.529906  9577 consensus_meta.cc:287] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.004s
I20260709 13:18:25.530368  9577 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.532596  9577 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:25.533473  9767 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:25.533929  9767 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.534312  9767 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:25.534986  3127 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:25.536116  3127 raft_consensus.cc:1240] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:25.537665  9725 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:25.540753  9788 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.412s	user 0.003s	sys 0.000s
I20260709 13:18:25.544324  3135 raft_consensus.cc:2393] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 17: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:25.576150  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:25.576879  3132 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
I20260709 13:18:25.584410  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:25.512180  9791 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:25.591722  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:25.598017  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:25.598845  3285 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.599654  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:25.600208  3836 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.597913  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:25.603247  3132 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 23.
I20260709 13:18:25.605258  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:25.610648  3129 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:25.577489  9795 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:25.614257  9804 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:18:25.604200  9756 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:25.617415  9798 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:25.584816  9805 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:25.617915  9807 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.620848  9733 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:25.621413  9755 consensus_queue.cc:1059] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:25.621997  9577 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:25.631258  9477 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:25.543576  9781 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:25.593235  9701 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:25.654661  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:25.627439  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:25.665671  9794 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:25.665844  9503 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:25.655754  9805 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.645776  9756 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.673861  9792 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:25.631213  9778 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.629696  9743 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:25.689189  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:25.691432  3210 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 21. Current term is 22. Ops: []
W20260709 13:18:25.692696  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 65378us
I20260709 13:18:25.693163  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:25.662837  9730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.020s	sys 0.023s
I20260709 13:18:25.723534  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:25.655711  9407 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.699263  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:25.727869  3208 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.727954  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:25.699411  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:25.706514  9703 consensus_meta.cc:287] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.778s	user 0.014s	sys 0.000s
I20260709 13:18:25.696554  9725 raft_consensus.cc:2764] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:18:25.707446  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 198375us
I20260709 13:18:25.710865  9745 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:25.653645  9769 consensus_queue.cc:1059] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:18:25.712755  3205 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:25.650960  9434 consensus_queue.cc:1059] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:18:25.725785  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:25.690706  9797 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:25.724403  3833 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:25.732159  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:25.661271  9807 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.739941  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:25.681900  9577 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.738847  3176 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:25.747658  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 93100.5us
W20260709 13:18:25.728165  9730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.020s	sys 0.023s
I20260709 13:18:25.751153  3177 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:25.693984  9701 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.759019  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:25.759836  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:25.760699  3204 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:25.757274  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:25.766366  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 71764.1us
I20260709 13:18:25.777537  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:25.781361  3836 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:25.784631  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:25.737376  9745 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:25.789101  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:25.790717  3205 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:25.794481  3208 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:25.796464  3100 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:25.752629  9792 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:25.725675  9778 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:25.753767  9503 raft_consensus.cc:2764] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:18:25.727077  9743 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:25.725342  9767 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:25.755084  9730 raft_consensus.cc:697] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:25.776633  9798 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:25.820148  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:25.737848  9407 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:25.753779  9816 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:25.808720  3211 raft_consensus.cc:1275] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:18:25.786908  9795 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:25.740758  9703 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:25.834275  3204 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:25.805385  9792 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.747634  9797 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:25.843760  3205 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:25.820729  9798 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.831203  9816 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.852138  3130 raft_consensus.cc:2468] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:25.850632  9434 raft_consensus.cc:3055] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:25.854132  9577 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:25.855291  9407 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:25.856063  9743 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:25.842206  9792 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:25.867702  3285 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:18:25.868250  3204 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:25.872655  9769 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.849751  9798 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.884884  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:25.873643  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 77168.2us
W20260709 13:18:25.937379  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.886287  3101 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:25.887233  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:25.947806  3136 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 23.
I20260709 13:18:25.887277  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:25.891665  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:25.955498  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:25.859962  9816 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:25.958504  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 54090.4us
I20260709 13:18:25.959167  3131 raft_consensus.cc:2468] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:18:25.867168  9434 raft_consensus.cc:740] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:25.884836  9781 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:25.966741  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 80561.2us
I20260709 13:18:25.969215  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:25.969956  3285 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 12.
I20260709 13:18:25.971483  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:25.972517  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:25.973923  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:25.976045  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:25.977566  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:25.980029  3280 raft_consensus.cc:2393] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 18: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:25.983683  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:25.841123  9745 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:25.992466  9807 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:25.983541  9577 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:25.993674  9778 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:25.994877  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:25.994879  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:25.997416  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:25.999858  3283 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:26.000320  3205 raft_consensus.cc:2393] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 17: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:25.998008  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:25.956884  9769 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.002583  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:25.971127  9755 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:25.978777  9743 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.976975  9756 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:26.007025  3249 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:25.969188  9398 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:18:26.017136  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:26.018329  9703 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:26.018621  3134 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:26.013967  9734 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:18:25.983703  9805 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:26.015162  9747 consensus_meta.cc:287] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.791s	user 0.013s	sys 0.003s
I20260709 13:18:26.039508  3101 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:26.041741  3249 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:26.043002  9743 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:25.964808  9730 consensus_queue.cc:237] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.053859  3101 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:26.014770  9755 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.043394  9813 raft_consensus.cc:3060] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:26.071797  9814 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:18:26.072016  9830 raft_consensus.cc:3055] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:26.072682  9830 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:26.073048  9824 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:26.073561  9824 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.073892  9830 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.075958  9830 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:26.071847  9825 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:26.076861  9829 raft_consensus.cc:2804] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:26.077234  9836 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
I20260709 13:18:26.079282  9827 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.226s
W20260709 13:18:26.081243  9812 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 13:18:26.082180  9821 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 13:18:26.083051  9811 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:18:26.086179  9701 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:26.086786  9701 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.087335  9701 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.087680  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:26.052013  9743 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.090499  3283 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:26.096905  3135 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 20.
I20260709 13:18:26.015491  9434 consensus_queue.cc:260] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.065913  9751 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:26.058295  9767 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:26.069824  9747 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:18:26.111207  3020 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f4a8a614fca4531aab11f5963396f62 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc48eecc27554cb58b15193cd442b1d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:26.098037  9743 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:26.073900  9824 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:26.119403  3135 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:26.104837  9838 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:18:26.120335  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 78869.5us
I20260709 13:18:26.100346  9829 raft_consensus.cc:697] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:26.100515  9825 raft_consensus.cc:697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:26.132696  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:26.155748  3206 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:18:26.158193  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:26.164243  3136 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:18:26.099771  9792 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.160306  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:26.160877  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:26.161434  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:26.162582  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:26.163129  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:26.128823  9747 raft_consensus.cc:697] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:26.171121  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:26.174801  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:26.159822  9767 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.185750  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:26.191977  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:26.179672  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:26.197960  3135 raft_consensus.cc:2368] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
W20260709 13:18:26.202152  9791 consensus_meta.cc:287] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.001s
I20260709 13:18:26.202651  9791 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.172919  9848 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.203930  9848 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.206187  9848 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:26.206912  9755 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:26.208088  9477 consensus_meta.cc:287] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.002s
I20260709 13:18:26.208503  9477 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:26.209281  9781 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:26.200429  9767 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.209547  9847 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.210323  9847 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.211208  9767 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:26.176859  9835 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.212046  9835 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.212230  9816 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.157164  9834 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:18:26.213292  9825 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.214229  9835 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:26.216048  9784 log.cc:927] Time spent T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 1.079s	user 0.000s	sys 0.003s
I20260709 13:18:26.209707  9781 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:26.217279  9781 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:26.216885  9829 consensus_queue.cc:237] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.218973  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:26.176687  9826 log.cc:927] Time spent T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:18:26.217391  3276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 1114) took 1481 ms. Trace:
I20260709 13:18:26.220289  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:26.220531  3276 rpcz_store.cc:276] 0709 13:18:24.736041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.736242 (+   201us) service_pool.cc:224] Handling call
0709 13:18:24.736552 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.736860 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.736885 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.743784 (+  6899us) log.cc:844] Serialized 26 byte log entry
0709 13:18:24.921559 (+177775us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:24.921602 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.921668 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.215414 (+1293746us) spinlock_profiling.cc:243] Waited 9.66 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:18:26.217051 (+  1637us) raft_consensus.cc:1685] finished
0709 13:18:26.217099 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.217314 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1872,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":32265,"spinlock_wait_cycles":23358080,"thread_start_us":177460,"threads_started":1,"wal-append.queue_time_us":293755}
I20260709 13:18:26.176844  9831 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.217s
I20260709 13:18:26.223448  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:26.224123  3131 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:18:26.216899  3203 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 22: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:26.212579  9847 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:26.238037  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 63305.2us
I20260709 13:18:26.239096  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:26.227380  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:26.227634  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:26.225069  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:26.230281  3136 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 25.
I20260709 13:18:26.240615  3211 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:26.249861  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:26.253051  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:26.263940  3250 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:26.264525  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:26.265193  3131 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:26.262863  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:26.268358  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:26.275080  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:26.275411  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:26.275594  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:26.275071  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:26.277321  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:26.277676  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:26.279464  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:26.278451  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:26.279410  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:26.258785  9769 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:26.291927  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:26.266736  9805 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:26.297266  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:26.298071  3211 raft_consensus.cc:2368] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
W20260709 13:18:26.298410  9846 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:18:26.299362  9743 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.302626  3209 raft_consensus.cc:1275] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:26.271584  9847 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:26.283842  9795 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:26.287043  3249 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:26.287724  9793 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.017s	sys 0.005s
I20260709 13:18:26.307422  9847 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 25 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:18:26.334460  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 47531.5us
I20260709 13:18:26.309933  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:26.310606  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:26.311293  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:26.311738  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 4096) took 1003 ms. Trace:
I20260709 13:18:26.312470  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:26.313114  9743 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:26.322180  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:26.326293  9855 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:18:26.327795  9860 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:18:26.328603  9457 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:26.328720  9859 log.cc:927] Time spent T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:18:26.328863  9843 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 13:18:26.347407  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.355599  3834 raft_consensus.cc:2368] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 24. Current term is 25.
I20260709 13:18:26.334939  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:26.356585  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:26.355618  3210 rpcz_store.cc:276] 0709 13:18:25.308559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.308718 (+   159us) service_pool.cc:224] Handling call
0709 13:18:25.309102 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.720744 (+411642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.311491 (+590747us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400225e54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:26.311680 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878658816}
I20260709 13:18:26.381247  3202 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:26.304948  9745 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:26.361655  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 88364.1us
I20260709 13:18:26.381338  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:26.385995  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:26.337021  9850 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:26.351809  9793 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.017s	sys 0.005s
I20260709 13:18:26.392827  3206 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:26.388756  3102 leader_election.cc:400] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 24. Current term is 25.
I20260709 13:18:26.383922  9792 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:26.389813  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:26.289173  9747 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.361416  9769 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:26.382818  9829 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:26.394016  3100 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:26.402804  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:26.403079  3100 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:26.403820  9773 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:26.403983  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:26.404243  9773 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.404776  9773 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:26.392961  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:26.393368  3102 leader_election.cc:403] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:26.362186  9813 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:26.409608  3100 leader_election.cc:400] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:26.358111  9798 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.411482  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:18:26.398416  9861 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:18:26.413902  3208 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 20.
I20260709 13:18:26.417737  9816 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 25 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:26.411989  3100 leader_election.cc:403] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:26.416345  9852 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:26.411679  9769 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.417048  3204 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 17: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:26.413367  9807 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:26.417294  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.394234  9767 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:26.423501  9798 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:26.424288  9730 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:26.414820  9756 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 24. Current term is 25.
I20260709 13:18:26.413703  9836 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:26.426178  9786 log.cc:927] Time spent T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.893s	user 0.001s	sys 0.003s
W20260709 13:18:26.431174  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.422706  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:26.410203  9824 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.437394  9398 raft_consensus.cc:3060] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:26.441789  3284 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 22: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:26.438140  9730 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:26.445998  9434 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:26.445765  9730 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.446890  9769 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:26.415524  9847 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.450228  9781 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:26.451476  9857 log.cc:927] Time spent T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
I20260709 13:18:26.452664  9781 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:26.454432  3806 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:26.454780  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:26.433943  9850 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.457790  9743 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:26.459039  9791 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:26.460016  9756 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:26.463862  9769 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:26.466126  3100 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:18:26.474715  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 52088.7us
I20260709 13:18:26.479640  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:26.478035  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.482631  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:26.477458  3806 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:26.486729  9793 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:26.484416  9769 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.492728  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:26.485985  3100 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:26.494972  9769 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:26.469739  9705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54892 (request call id 1264) took 3376 ms. Trace:
I20260709 13:18:26.497216  9787 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:26.497841  9787 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.498400  9787 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:26.499280  9757 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:26.510808  9819 consensus_queue.cc:1059] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:26.512514  9778 raft_consensus.cc:3055] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:26.512981  9778 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:26.482255  9743 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.514375  9778 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.515969  9743 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:26.516526  9798 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:26.478601  9807 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:26.517071  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:26.482543  9816 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:26.517944  9816 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.518281  9816 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:26.520946  9667 consensus_queue.cc:1059] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:26.485131  9756 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.522450  9743 raft_consensus.cc:3055] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:26.523197  9743 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:26.524693  9756 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:26.524323  9743 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.525837  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:26.530122  9820 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:26.528374  3806 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:26.532925  3134 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:26.482076  9850 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.535552  9797 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:26.540576  9787 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.542762  9398 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:26.546188  9798 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:26.546955  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 64417.5us
I20260709 13:18:26.590019  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:26.591537  3176 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:26.552722  9701 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:26.590997  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:26.593008  3134 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 25: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:26.557133  3136 raft_consensus.cc:1240] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:26.576874  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.578934  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:26.590236  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:26.590133  3133 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:26.602985  3130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 2145) took 1189 ms. Trace:
I20260709 13:18:26.606675  3176 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:26.603490  3130 rpcz_store.cc:276] 0709 13:18:25.397693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.397881 (+   188us) service_pool.cc:224] Handling call
0709 13:18:26.587253 (+1189372us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b5400074c54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:26.587412 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922215168}
I20260709 13:18:26.566612  9830 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.473632  9773 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.620582  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:26.621351  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:26.571180  9743 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:26.568048  9767 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.568688  9503 raft_consensus.cc:2804] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:26.627818  3279 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:26.568324  9829 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:26.568944  9769 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:26.570621  9755 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:26.650202  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:26.570180  9842 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:26.601384  9434 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:26.589895  9848 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:26.641638  3285 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:26.648541  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:26.621236  9797 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:26.623919  9781 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:26.652186  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:26.650789  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:26.657892  3133 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:26.654431  3130 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 22: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:26.655146  3836 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:26.655939  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:26.661337  3281 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 16.
I20260709 13:18:26.663056  3280 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 22: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:18:26.576133  9745 consensus_queue.cc:1175] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "48080cf0460346769ab046a4f9457aa5" responder_term: 21 status { last_received { term: 21 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 21 index: 12 } }
I20260709 13:18:26.669512  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:26.672425  3285 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:26.674374  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:26.649201  9503 raft_consensus.cc:697] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
W20260709 13:18:26.682790  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 102351us
I20260709 13:18:26.684486  3279 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:26.685741  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:26.630656  9830 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.691562  9823 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.692174  9823 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.653131  9769 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.694192  9773 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:26.695644  9769 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:26.651057  9829 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.701133  9829 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:26.678718  9848 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.703773  9850 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:26.703997  9848 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:26.706112  9830 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:26.707322  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:26.708570  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:26.678637  9820 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:18:26.712073  3284 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:26.717729  3279 raft_consensus.cc:2393] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 12: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:26.640182  9767 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.497654  9705 rpcz_store.cc:276] 0709 13:18:23.080627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.081805 (+  1178us) service_pool.cc:224] Handling call
0709 13:18:23.420394 (+338589us) ts_tablet_manager.cc:934] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323)
0709 13:18:24.963638 (+1543244us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:26.015647 (+1052009us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:26.037602 (+ 21955us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:26.456268 (+418666us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:26.456610 (+   342us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:26.456977 (+   367us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:26.457046 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":69872,"tablet-copy.queue_time_us":235535,"thread_start_us":208854,"threads_started":2}
I20260709 13:18:26.754809  3285 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:26.658274  9755 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.659119  9434 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.715590  9787 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:26.764482  3283 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:26.660120  9842 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:26.787177  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 891) took 1020 ms. Trace:
I20260709 13:18:26.787779  3208 rpcz_store.cc:276] 0709 13:18:25.766784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.804957 (+ 38173us) service_pool.cc:224] Handling call
0709 13:18:26.786944 (+981987us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b5400225454. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:26.787094 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1363481984}
I20260709 13:18:26.819614  3285 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:26.773873  9791 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:26.825460  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:26.829588  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:26.832518  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:26.835268  3133 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:26.763525  9503 consensus_queue.cc:237] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.829699  9705 tablet_copy_client.cc:806] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
W20260709 13:18:26.887367  3099 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.836440  9398 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:26.841607  9701 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:26.835357  9791 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:26.842450  9827 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:18:26.897603  9701 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.900054  9847 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.895524  9488 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:18:26.888028  9816 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.893589  9830 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:26.917701  9705 tablet_copy_client.cc:670] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:26.937539  3128 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:26.923300  9701 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:26.953754  9872 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:26.955240  9767 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:26.969332  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.938192  9820 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.930539  9847 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:27.000727  9876 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:18:27.010903  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.006351  9824 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:27.014279  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:27.026417  3127 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 22: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:26.989794  9823 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.029546  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:26.941757  9830 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:26.993693  9842 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:27.037310  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:27.037940  3834 raft_consensus.cc:2393] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 25: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:27.041961  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.043016  3127 raft_consensus.cc:2393] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 19: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:18:27.043211  3100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.995625  9820 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.034694  9824 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.045151  3842 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:18:27.041950  9869 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:27.054023  9869 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.056249  9869 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:27.058573  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.061932  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.057631  9824 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.069962  9847 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.076148  3127 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:18:27.073364  9790 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:27.071623  9870 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:18:27.071600  9824 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.080324  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.080781  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.081408  3285 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:18:27.081794  3285 pending_rounds.cc:85] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 14
I20260709 13:18:27.081938  3127 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 21: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:27.082203  3285 pending_rounds.cc:107] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:18:27.079074  9790 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.083706  3285 raft_consensus.cc:2889] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:27.085219  9816 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:27.079289  9791 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:27.088768  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.089283  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.090878  3127 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 22.
I20260709 13:18:27.094560  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.095005  9724 raft_consensus.cc:3055] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:27.095357  9724 raft_consensus.cc:740] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:27.098119  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.099486  9790 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:27.100452  3127 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:27.101420  9724 consensus_queue.cc:260] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.102501  9724 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.106455  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.111588  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33896 (request call id 2144) took 1138 ms. Trace:
I20260709 13:18:27.113510  3837 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 11.
I20260709 13:18:27.115763  9717 consensus_queue.cc:1048] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:27.115779  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.120131  3135 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:27.112059  3282 rpcz_store.cc:276] 0709 13:18:25.972757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.972868 (+   111us) service_pool.cc:224] Handling call
0709 13:18:25.973182 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:26.005986 (+ 32804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.006041 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:26.014401 (+  8360us) log.cc:844] Serialized 52 byte log entry
0709 13:18:26.546871 (+532470us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b18004930c0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:18:26.820943 (+274072us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:26.917145 (+ 96202us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.917602 (+   457us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.917855 (+   253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.917948 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.109230 (+191282us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b18004930c0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b91023f3 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd 000000000038f354 000000000038f199 00007fb3b90e583a
0709 13:18:27.111306 (+  2076us) raft_consensus.cc:1685] finished
0709 13:18:27.111335 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.111515 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44354,"prepare.queue_time_us":357867,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1490,"raft.queue_time_us":28316,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":13008,"spinlock_wait_cycles":39097728,"thread_start_us":290857,"threads_started":2,"wal-append.queue_time_us":905141}
I20260709 13:18:27.120154  9701 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.106531  9755 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.123539  9701 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:27.127313  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.126672  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:27.125047  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:27.129302  3283 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 22: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:27.129205  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.129972  3207 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:27.130741  9767 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:27.132634  9767 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.133101  9767 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.133277  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.133986  3135 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:27.134797  9798 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.135015  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:27.135419  9798 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.135821  3280 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:27.130807  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:27.137508  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.137714  9830 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.138378  9824 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:27.138322  9869 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:27.139776  3282 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:27.142297  9450 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:27.144001  9481 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:27.147212  9767 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.151228  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.151738  9824 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:27.153405  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.152956  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.154609  3206 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:18:27.155368  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:27.155877  3206 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:27.128631  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.157769  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:27.158280  3202 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:27.159787  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:27.160313  3277 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:27.160784  3176 leader_election.cc:400] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:27.161126  3176 leader_election.cc:403] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:18:27.161151  3805 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.161614  9733 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:27.162547  9847 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:27.163028  9847 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.163810  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.157027  9824 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.165365  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:27.167268  3209 raft_consensus.cc:1240] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:27.167594  3805 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.170297  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.171021  3205 raft_consensus.cc:2393] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 22: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:27.171865  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.172808  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:27.173302  3281 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:27.176518  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:27.180756  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.182356  3250 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:27.184136  3133 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:18:27.180227  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:27.185947  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:27.186662  3205 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 22: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:27.188205  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.188807  3208 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 12.
I20260709 13:18:27.189613  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.192320  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:27.193289  3834 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 17: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:27.189808  3250 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:27.187253  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.162168  9733 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.184470  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.208316  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:27.211249  3136 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.209964  3203 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:18:27.213975  3277 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 21.
I20260709 13:18:27.195693  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:27.215353  3206 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 21.
I20260709 13:18:27.217430  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.215585  3285 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 21.
I20260709 13:18:27.219017  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:27.219751  3285 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.220014  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.215721  3281 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:27.221855  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:27.174875  9730 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:27.174779  9848 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.184870  9886 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:27.175958  9842 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:27.229437  3136 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:27.232858  3100 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:27.234622  3100 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:27.185191  9877 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:27.242643  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 70878us
I20260709 13:18:27.188056  9781 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
W20260709 13:18:27.243466  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.250382  3209 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:18:27.178650  9749 consensus_queue.cc:1048] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:18:27.208684  9883 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:27.254983  3202 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:27.194573  9755 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:18:27.238206  9791 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:27.241798  9747 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:27.262197  9701 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:27.271437  9888 log.cc:927] Time spent T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:18:27.246284  9823 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:27.243798  9842 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.321988  3100 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:27.241492  9852 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:18:27.241720  9825 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:27.274919  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.241744  9767 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.276701  9787 consensus_queue.cc:1059] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:18:27.312193  9747 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:27.256551  9724 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:27.313336  9791 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:18:27.309128  9872 log.cc:927] Time spent T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:18:27.340758  9791 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:27.342530  9840 log.cc:927] Time spent T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 1.252s	user 0.003s	sys 0.003s
I20260709 13:18:27.343499  9791 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:27.344005  9450 raft_consensus.cc:3055] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:27.344456  9791 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:27.345501  9791 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.244208  9848 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.348206  9848 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:27.329020  3100 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:27.275840  9829 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:18:27.340013  9871 log.cc:927] Time spent T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.404s	user 0.002s	sys 0.000s
I20260709 13:18:27.344513  9450 raft_consensus.cc:740] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:27.260623  9883 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:27.273007  3285 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:27.330327  9785 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:27.332734  9817 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.352850  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.330367  9825 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:27.331871  9823 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.350208  9730 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:27.331141  9398 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
W20260709 13:18:27.365103  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 188613us
W20260709 13:18:27.369985  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 149633us
I20260709 13:18:27.339215  9747 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:27.353261  9829 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.378027  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.357024  9824 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:27.377884  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 128083us
I20260709 13:18:27.353375  9798 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.364534  9757 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:27.380622  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:27.382050  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.368166  9825 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:27.362294  9883 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:27.392247  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.369158  9785 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 21 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:27.417258  9785 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.418035  9450 consensus_queue.cc:260] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:27.419451  3128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 2151) took 1927 ms (client timeout 2218 ms). Trace:
W20260709 13:18:27.419821  3128 rpcz_store.cc:269] 0709 13:18:25.491723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.502994 (+ 11271us) service_pool.cc:224] Handling call
0709 13:18:27.419275 (+1916281us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54003b79d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:27.419398 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3213788032}
I20260709 13:18:27.381810  9829 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:27.387928  9824 raft_consensus.cc:2764] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:18:27.378458  9730 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.419828  9733 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:27.424669  9730 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:27.394563  9755 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:27.395663  9790 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.368095  9817 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.426592  9790 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.428390  9817 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:27.401391  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.429322  9790 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:27.430912  9823 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.401546  9791 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.309147  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:27.392099  9797 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:27.432632  9797 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.434063  9820 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:27.435797  9797 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:27.410467  9842 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:27.392654  9847 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.414454  9886 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:27.416031  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.396557  9757 raft_consensus.cc:697] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:27.438944  9757 consensus_queue.cc:237] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.442857  9886 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:18:27.443563  9886 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:27.450104  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:27.450001  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.451015  3133 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 17: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:27.395581  3249 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.453428  9778 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:27.453850  9847 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:18:27.454794  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 59318.3us
I20260709 13:18:27.458452  3249 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:18:27.459359  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 269646us
I20260709 13:18:27.460441  3250 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:18:27.466753  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 222223us
I20260709 13:18:27.469547  9724 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:27.472599  3249 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.471613  3251 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:27.484687  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.482436  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:27.459683  9807 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.496937  3251 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:27.500115  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.500706  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.500555  9883 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.501523  3206 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:27.501608  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.502614  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.503396  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.504141  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.504766  3210 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:18:27.506943  3136 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:27.471987  9705 tablet_copy_client.cc:538] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:27.465289  9896 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:27.516253  3128 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:18:27.472711  9724 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.483242  9847 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:27.520579  3251 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:27.518570  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.495872  9823 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:27.520398  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:27.527895  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.509666  9824 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:27.485004  9899 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:27.512461  9852 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:18:27.540010  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 162046us
I20260709 13:18:27.483902  9842 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:18:27.520815  9791 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:27.525628  9798 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:27.516562  9807 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.523083  9724 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:27.540844  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.542017  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.548200  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:27.535394  9848 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.537981  9899 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.537473  9847 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:27.516206  9747 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:27.533661  9883 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:27.535589  9900 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:27.546307  9852 raft_consensus.cc:697] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:27.566566  3176 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:27.549633  9902 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:27.568784  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 48295.1us
I20260709 13:18:27.567536  3250 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:27.572616  9903 raft_consensus.cc:2764] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:18:27.575789  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:27.576612  9730 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:27.577209  9730 raft_consensus.cc:697] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:27.578060  9730 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.589653  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.561033  9899 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:27.557971  9894 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:27.566211  9823 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:27.594712  3285 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:27.623723  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66614160a1bf4bb49ea02007f6679b0f" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.623740  3280 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:27.564034  9824 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:27.603703  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.605350  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.605778  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.627336  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:27.607885  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:27.495687  9769 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 13:18:27.593626  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:27.630519  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.601773  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.615710  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.616110  3128 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:27.616326  3136 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:27.632048  3129 raft_consensus.cc:2393] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 21: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:27.632387  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3596) took 1029 ms. Trace:
I20260709 13:18:27.593919  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:27.618386  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:27.567726  9896 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:27.552511  9798 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.551090  9791 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.569689  9797 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:18:27.564492  9847 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.632942  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:27.558611  9848 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.624750  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:27.645692  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.632696  3131 raft_consensus.cc:2393] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:27.651683  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:27.652627  3280 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:27.632812  3278 rpcz_store.cc:276] 0709 13:18:26.603265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.613363 (+ 10098us) service_pool.cc:224] Handling call
0709 13:18:26.628468 (+ 15105us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.635503 (+  7035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.635550 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.442112 (+806562us) spinlock_profiling.cc:243] Waited 8.65 ms on lock 0x7b2c00138fe8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:18:27.442487 (+   375us) log.cc:844] Serialized 26 byte log entry
0709 13:18:27.535781 (+ 93294us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:27.549121 (+ 13340us) log.cc:844] Serialized 14 byte log entry
0709 13:18:27.613543 (+ 64422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.613618 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.613660 (+    42us) raft_consensus.cc:1685] finished
0709 13:18:27.632168 (+ 18508us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.632325 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51853,"prepare.queue_time_us":13161,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":2864,"raft.queue_time_us":13818,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":10693,"spinlock_wait_cycles":30176896,"thread_start_us":150521,"threads_started":2,"wal-append.queue_time_us":130838}
I20260709 13:18:27.647691  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:27.655223  9791 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.657023  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.623945  9823 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:27.659940  9848 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:27.687784  9847 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:27.684298  9398 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:27.689580  9398 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.690503  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.626760  9824 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:27.691673  9398 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:27.691852  9824 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:27.692639  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47079.6us
I20260709 13:18:27.693219  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:27.693781  3280 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:27.693948  9908 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:27.694638  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:27.695199  3280 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 21.
I20260709 13:18:27.696125  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.662461  9747 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:27.663286  9829 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.664085  9705 tablet_bootstrap.cc:492] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:18:27.659956  9852 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.666376  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.706374  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.668182  9450 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:27.682814  3211 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 12.
I20260709 13:18:27.685235  9807 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.686030  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:27.687031  9823 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:27.696590  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:27.697162  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 129712us
I20260709 13:18:27.697362  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.588348  9902 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.701540  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:27.666568  3281 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:18:27.706305  3209 raft_consensus.cc:2468] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 20.
I20260709 13:18:27.738816  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:27.730356  3250 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.732573  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:27.702100  9908 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:27.746709  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 49457us
I20260709 13:18:27.747838  3176 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:27.760609  3128 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 22.
I20260709 13:18:27.745589  9908 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:27.768301  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:27.770593  9798 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.772282  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.774539  9434 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.776230  9825 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.776800  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.749457  9733 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:18:27.778457  3129 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:18:27.787465  9829 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:27.789287  3082 auto_rebalancer.cc:629] Failed to schedule move for tablet a455058d628f40fc9d810a0d764560dd: Illegal state: Replica 48080cf0460346769ab046a4f9457aa5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:27.791069  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.791687  3836 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:27.791507  9724 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.791883  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.792754  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.792915  9797 consensus_queue.cc:1059] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:27.793351  3282 raft_consensus.cc:2368] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 12. Current term is 13.
I20260709 13:18:27.790946  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.794150  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.794642  9902 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:27.794173  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.795465  9908 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:27.795640  9825 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.796615  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:27.801720  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.802428  3130 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:27.804903  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:27.805531  3128 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:18:27.755959  9807 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:27.806665  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:27.809815  3251 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:27.748438  9917 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:27.814742  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:27.815618  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:27.817492  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:27.819279  9920 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:18:27.813880  9778 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:27.839571  9724 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:27.841720  3082 auto_rebalancer.cc:629] Failed to schedule move for tablet 2e805018f85b41fc88644215be011084: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:27.824009  9825 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:27.824868  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:27.853376  3838 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:27.861795  3838 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
I20260709 13:18:27.823781  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:18:27.831961  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 63875.3us
I20260709 13:18:27.837383  9733 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:27.828689  9790 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:18:27.837220  9807 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 19 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:27.819090  9824 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.868896  9807 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.852200  9899 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.879040  3805 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.881712  9916 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:27.885382  9918 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:27.885558  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 155333us
W20260709 13:18:27.886348  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 62689.2us
I20260709 13:18:27.826236  9797 raft_consensus.cc:3055] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:18:27.896745  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 86999us
I20260709 13:18:27.904460  3250 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.907104  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:27.902909  3278 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:18:27.907512  3251 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:27.907739  3805 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:27.909189  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:27.911288  3209 raft_consensus.cc:1275] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:18:27.911649  3277 raft_consensus.cc:2393] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 18: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:27.913450  9488 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:27.917780  3251 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:27.898829  9825 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:27.902591  9724 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:27.903911  9916 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.908934  9816 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:27.901412  9899 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.931982  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:27.933543  3251 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:27.927627  3250 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:27.906512  9797 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:27.935962  9850 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:27.917626  9819 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:27.921056  9852 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:27.942018  9922 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:27.926628  9825 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.954226  9825 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:27.926662  9757 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:27.938598  9916 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:27.927420  9488 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:27.958743  9908 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.946460  9434 raft_consensus.cc:2804] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:27.953722  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:27.962054  3208 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:27.926816  9756 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:18:27.965142  9434 raft_consensus.cc:697] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:27.964610  9488 raft_consensus.cc:697] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:27.950016  9755 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:27.966255  9755 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 22 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:27.966077  9434 consensus_queue.cc:237] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.967133  9824 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:27.967736  9827 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:27.955062  9820 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:27.967202  9755 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:27.968830  9820 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.969290  9820 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:27.970893  9908 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:27.966748  9797 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.972710  3101 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:27.954702  9819 raft_consensus.cc:697] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:18:27.974398  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 57810.2us
I20260709 13:18:27.961318  9757 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:27.972370  9827 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.972404  9823 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.982626  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:27.984072  9797 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.986119  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:27.987030  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:27.987866  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:27.974196  9756 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:28.007829  3280 raft_consensus.cc:1240] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:27.966362  9488 consensus_queue.cc:237] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:27.990322  9827 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:28.000561  9852 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:28.025427  9852 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:28.033600  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 123454us
I20260709 13:18:28.019160  9886 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:18:28.030412  9852 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:28.057111  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:28.057843  3127 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 22.
I20260709 13:18:28.058174  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:28.066424  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:28.067106  3135 raft_consensus.cc:3060] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:18:28.024551  9819 consensus_queue.cc:237] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:28.061328  3250 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:28.069248  3250 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:28.056401  9908 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.075258  9755 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:28.078523  9829 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:28.071638  9816 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:18:28.132473  3135 raft_consensus.cc:2468] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
I20260709 13:18:28.145278  9823 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:28.134595  9820 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:28.146555  3176 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.250.65:41323 timed out after 1.505s (SENT) [suppressed 11 similar messages]
I20260709 13:18:28.148561  9820 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:28.133200  9922 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:28.155090  9922 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:28.167948  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:28.099547  9755 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:28.082249  9908 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:18:28.172685  9928 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:18:28.191823  9935 log.cc:927] Time spent T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:18:28.185784  9929 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:18:28.188196  9824 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:28.193820  9824 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:28.195919  9824 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:28.196918  9922 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:28.201007  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:28.171170  9755 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:28.209148  9926 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:18:28.213001  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:28.215430  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:28.239289  9909 log.cc:927] Time spent T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.483s	user 0.005s	sys 0.000s
I20260709 13:18:28.239784  9908 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:28.241102  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3614) took 1056 ms. Trace:
I20260709 13:18:28.241500  3283 rpcz_store.cc:276] 0709 13:18:27.184797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.184933 (+   136us) service_pool.cc:224] Handling call
0709 13:18:27.222049 (+ 37116us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.457879 (+235830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.457933 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.458390 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:18:27.564775 (+106385us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:27.613296 (+ 48521us) log.cc:844] Serialized 14 byte log entry
0709 13:18:27.881107 (+267811us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b180047ce00. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b907cc0a 00007fb3c27bc219 00007fb3b9104a40 00007fb3b90ff4e4 00007fb3b90ff455 00007fb3bc1e7060 00007fb3bc1f9716 00007fb3bc20a287 00007fb3bc20a208
0709 13:18:27.881297 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.881372 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:28.238622 (+357250us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3bbd8a86e 00007fb3bbd89bb6 00007fb3bbd897d8 00007fb3bbd93221 00007fb3bbd931d9 00007fb3bbd93169
0709 13:18:28.240829 (+  2207us) raft_consensus.cc:1685] finished
0709 13:18:28.240884 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.241021 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53661,"prepare.queue_time_us":53027,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":2973,"raft.queue_time_us":292967,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":5945,"spinlock_wait_cycles":24849536,"thread_start_us":266419,"threads_started":2,"wal-append.queue_time_us":220901}
W20260709 13:18:28.266284  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 205748us
W20260709 13:18:28.277225  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 130668us
I20260709 13:18:28.182473  9916 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:28.293663  3280 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 20. Current term is 21. Ops: [18.11-20.12]
I20260709 13:18:28.262360  9825 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:28.302874  9825 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:28.306238  9827 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:28.308655  9827 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:28.318111  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:28.325350  9916 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:28.335088  3130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49676 (request call id 2167) took 1681 ms (client timeout 1505 ms). Trace:
I20260709 13:18:28.335343  3276 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:18:28.335569  3130 rpcz_store.cc:269] 0709 13:18:26.653537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.674047 (+ 20510us) service_pool.cc:224] Handling call
0709 13:18:28.334928 (+1660881us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540039e254. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:28.335019 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2544511872}
I20260709 13:18:28.339625  3834 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:28.341781  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:28.346170  9894 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:28.351639  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:28.353165  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:28.353927  3211 raft_consensus.cc:2393] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 22: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:28.360513  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:28.363036  3281 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:28.315593  9941 consensus_queue.cc:1059] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:18:28.320161  9940 consensus_queue.cc:1048] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.068s
I20260709 13:18:28.315405  9877 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:18:28.346704  9894 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:28.365872  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:28.368114  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:28.408018  3204 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:28.369164  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:28.409543  3131 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 20. Current term is 21. Ops: [18.11-20.12]
I20260709 13:18:28.409821  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:28.410588  3211 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:18:28.376585  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:28.322062  9852 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:28.411369  3210 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:18:28.404302  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:28.412547  3128 raft_consensus.cc:2376] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19. Re-sending same reply.
I20260709 13:18:28.405208  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:28.397020  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:28.399098  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:28.415545  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:28.370074  3249 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:28.417670  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 47775.3us
I20260709 13:18:28.418921  3249 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:28.400275  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:18:28.400882  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 106879us
I20260709 13:18:28.366384  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:28.401684  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:28.431200  3203 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 22: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:28.366681  9778 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.420751  3132 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 22.
I20260709 13:18:28.392596  9816 raft_consensus.cc:3055] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:28.389568  9757 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:28.368374  9807 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
W20260709 13:18:28.437338  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 77734us
I20260709 13:18:28.448729  3176 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:28.445962  3279 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 19. Current term is 20. Ops: [19.15-19.15]
W20260709 13:18:28.451128  3174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.452035  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:28.451342  9842 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.453801  9755 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:28.454476  9842 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:28.456243  9755 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:28.437121  9922 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:28.456597  9842 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:28.464363  3204 raft_consensus.cc:2468] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:18:28.465929  3208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2900) took 1269 ms. Trace:
I20260709 13:18:28.466316  3208 rpcz_store.cc:276] 0709 13:18:27.196107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.257681 (+ 61574us) service_pool.cc:224] Handling call
0709 13:18:27.257949 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.964233 (+706284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.465689 (+501456us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b540019ee54. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:28.465873 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1618516224}
I20260709 13:18:28.469902  3208 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:28.465242  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:28.430737  9733 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:28.438692  9816 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:28.466703  3204 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:28.474547  9816 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:28.475775  9816 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:28.477355  9894 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:28.438817  9916 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:28.478190  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:28.479036  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:28.440766  9778 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:28.482014  9450 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:28.483395  9778 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:28.452869  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:28.491547  3176 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:28.492420  9797 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:28.496160  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:28.500560  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:28.502152  3208 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:28.502743  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:28.503532  3208 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:28.503350  3249 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:28.506481  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:28.509543  3211 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 22.
I20260709 13:18:28.510576  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:28.523013  3205 raft_consensus.cc:2393] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 22: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:28.526759  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:28.535836  3284 raft_consensus.cc:1240] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:28.539407  9450 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:28.540097  9450 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:28.541294  9925 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:28.543927  9925 consensus_queue.cc:1059] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:28.544232  3100 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:28.545538  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:28.545871  9825 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:28.548645  9753 consensus_queue.cc:1059] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:28.547612  9757 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:28.511916  9903 raft_consensus.cc:2764] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:18:28.557333  3134 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:28.564035  3278 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:28.564158  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:28.516604  9834 raft_consensus.cc:2804] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:28.570791  3280 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 21: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:28.550437  9733 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:28.583735  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:28.584589  3280 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:28.586225  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 59595.9us
I20260709 13:18:28.521786  9823 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:18:28.526044  9916 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:18:28.569248  9819 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:28.597349  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 231096us
I20260709 13:18:28.568954  9937 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:28.616807  3838 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:18:28.576824  9834 raft_consensus.cc:697] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:28.587755  9733 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:28.593945  9842 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:28.642071  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:28.595067  9829 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:28.687027  3280 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 22.
I20260709 13:18:28.722105  9852 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:28.631279  9830 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.729319  9830 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:28.732076  9705 tablet_bootstrap.cc:492] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:28.734215  9450 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:28.638504  9937 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 22 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:28.737289  9937 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:28.742144  9705 tablet_bootstrap.cc:492] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:18:28.746380  9705 ts_tablet_manager.cc:1403] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 1.083s	user 0.055s	sys 0.012s
I20260709 13:18:28.762236  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:28.641244  9733 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:28.625605  9819 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:28.771263  9819 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:28.760280  9829 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:28.773901  9829 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:28.774243  9733 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:28.789901  3207 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:28.791821  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:28.808955  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:28.817423  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:28.818497  3278 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
W20260709 13:18:28.896551  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 49653.7us
W20260709 13:18:28.901641  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 64143.3us
I20260709 13:18:28.783618  9829 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.732133  9830 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:28.910058  3251 consensus_peers.cc:597] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:28.922480  9733 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:28.923468  9733 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:28.732960  9834 consensus_queue.cc:237] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:28.901669  9902 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.037s
I20260709 13:18:28.914348  9829 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:28.928267  9936 consensus_queue.cc:1059] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
W20260709 13:18:28.955849  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 385447us
I20260709 13:18:28.961841  9824 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:28.962508  9824 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:28.977491  3842 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:18:28.977897  3842 pending_rounds.cc:85] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 14
I20260709 13:18:28.978256  3842 pending_rounds.cc:107] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:18:28.978909  3842 raft_consensus.cc:2889] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:28.981943  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:28.965018  9824 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:28.992389  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:28.999217  9705 raft_consensus.cc:359] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:28.991628  9785 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:28.977041  9819 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:18:28.985855  9450 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
W20260709 13:18:29.022773  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 477270us
W20260709 13:18:29.029420  3806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.007s	sys 0.018s
W20260709 13:18:29.032205  3806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.007s	sys 0.018s
I20260709 13:18:29.033782  3176 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:29.019774  9705 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
W20260709 13:18:29.041982  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.027900  9753 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:29.062844  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:29.063165  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:29.063899  3833 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:29.065277  3806 leader_election.cc:400] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 12 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 12. Current term is 13.
I20260709 13:18:29.070775  3102 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:29.078708  3101 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:29.052243  9971 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:29.089771  9953 consensus_queue.cc:1059] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:18:29.089309  3101 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:29.092437  9797 raft_consensus.cc:3055] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:29.093093  9797 raft_consensus.cc:740] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:29.094082  9797 consensus_queue.cc:260] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:29.095245  9797 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:29.101519  9916 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.102207  9916 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:29.104014  9877 raft_consensus.cc:3055] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:29.104472  9877 raft_consensus.cc:740] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:29.104568  9916 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:29.105535  9954 log.cc:927] Time spent T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:18:29.105475  9877 consensus_queue.cc:260] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:29.108460  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 57034us
W20260709 13:18:29.110075  9943 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.007s	sys 0.027s
W20260709 13:18:29.110491  9943 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.007s	sys 0.027s
W20260709 13:18:29.110718  9957 log.cc:927] Time spent T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:18:29.114653  9961 raft_consensus.cc:493] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:29.115334  9961 raft_consensus.cc:515] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:29.117990  9961 leader_election.cc:290] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:29.118567  9961 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:18:29.125955  9960 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:29.127624  3284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 1143) took 1463 ms. Trace:
I20260709 13:18:29.128175  3284 rpcz_store.cc:276] 0709 13:18:27.664500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.878799 (+214299us) service_pool.cc:224] Handling call
0709 13:18:28.535579 (+656780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.551517 (+ 15938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.127412 (+575895us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b5400038750. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1ee8ad 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:29.127559 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1509676416}
I20260709 13:18:29.178395  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:29.197482  3282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3626) took 1205 ms. Trace:
W20260709 13:18:29.198005  3202 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.006s	sys 0.026s
I20260709 13:18:29.197940  3282 rpcz_store.cc:276] 0709 13:18:27.991757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.334102 (+342345us) service_pool.cc:224] Handling call
0709 13:18:28.334417 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:28.334794 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.334823 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:28.335380 (+   557us) log.cc:844] Serialized 52 byte log entry
0709 13:18:28.570844 (+235464us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:28.576895 (+  6051us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.125915 (+549020us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b18003b7ac0. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b907cc0a 00007fb3c27bc219 00007fb3c00c358f 00007fb3b9102571 00007fb3b91047c1 00007fb3b9104779 00007fb3b9104709 00007fb3b91046d1 00007fb3b91039cd
0709 13:18:29.175255 (+ 49340us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.175584 (+   329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.175659 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.197222 (+ 21563us) raft_consensus.cc:1685] finished
0709 13:18:29.197247 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.197412 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":624542,"prepare.queue_time_us":5612,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":19518,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":6621,"spinlock_wait_cycles":60236160,"thread_start_us":235052,"threads_started":1,"wal-append.queue_time_us":429604}
I20260709 13:18:29.086038  9819 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:29.204737  3176 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:29.200433  9797 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:29.088344  9753 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:29.222097  3176 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:29.246950  9962 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.254681  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 165456us
I20260709 13:18:29.255267  9398 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:29.255388  9963 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.256027  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 165907us
W20260709 13:18:29.291823  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 69844.2us
I20260709 13:18:29.330278  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:29.200971  9908 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:29.205389  9903 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:29.343151  9903 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:29.270735  9829 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:29.083338  9705 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:29.347886  9961 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:29.348057  9705 ts_tablet_manager.cc:1434] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.598s	user 0.006s	sys 0.003s
W20260709 13:18:29.348565  9705 ts_tablet_manager.cc:1467] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: Tablet startup took 598ms
I20260709 13:18:29.348673  9961 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.269807  9925 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:29.215548  9781 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:29.214210  9971 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:29.337528  9963 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:29.206187  9819 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:29.381026  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 51212.8us
W20260709 13:18:29.351141  9952 log.cc:927] Time spent T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:18:29.324012  9398 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.407701  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:29.396008  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:29.400890  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:29.394048  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:29.463145  3202 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:29.323565  9797 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:29.398574  9819 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:29.397595  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:29.408221  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:29.397632  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:29.403707  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:29.402908  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:18:29.452455  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 51725.9us
I20260709 13:18:29.500254  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:29.501091  3135 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 21: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:29.373409  9962 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:29.456380  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 60494.4us
I20260709 13:18:29.461972  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:29.399859  9925 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:29.511478  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:29.514792  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:29.515446  3135 raft_consensus.cc:3060] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:29.493168  3279 raft_consensus.cc:1240] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:18:29.393740  9787 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:29.398932  9902 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:29.399092  9767 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:29.452970  9398 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:29.398738  9937 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:29.375980  9961 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:29.522324  3837 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 LEARNER]: Advancing to term 22
I20260709 13:18:29.454169  9830 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:29.524683  3131 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:29.389434  9781 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:29.534350  3127 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:18:29.545897  3202 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:29.394719  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:29.497025  9971 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:29.546613  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:29.595026  3132 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:29.477025  9973 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:29.513240  9756 raft_consensus.cc:3055] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:29.509894  9925 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.611177  3135 raft_consensus.cc:2468] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
W20260709 13:18:29.619740  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 289568us
I20260709 13:18:29.627521  3207 raft_consensus.cc:2410] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:29.667224  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:29.615015  9966 log.cc:927] Time spent T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.537s	user 0.001s	sys 0.001s
I20260709 13:18:29.536976  9787 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:29.536707  9767 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:29.693420  9967 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
I20260709 13:18:29.695156  9962 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:29.705632  9974 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260709 13:18:29.725747  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:29.562147  9902 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:29.567581  9937 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:29.728485  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:29.615547  9903 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:29.623745  9756 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:29.597383  9830 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:29.629690  9931 raft_consensus.cc:3055] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:18:29.725703  9970 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.525s	user 0.000s	sys 0.001s
I20260709 13:18:29.633411  9925 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:29.616595  9717 consensus_queue.cc:1059] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.117s
I20260709 13:18:29.630208  9824 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.116s
I20260709 13:18:29.727118  9980 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:29.760108  9961 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:29.740993  9968 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.391s	user 0.002s	sys 0.000s
I20260709 13:18:29.616902  9971 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:29.766784  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 244548us
I20260709 13:18:29.628937  9973 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:29.775873  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.743923  9931 raft_consensus.cc:740] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:29.752617  9981 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:29.750524  9903 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:29.765756  9911 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.811954  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.777429  9961 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.815032  3209 raft_consensus.cc:1240] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:29.821815  3283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3624) took 1830 ms. Trace:
I20260709 13:18:29.817222  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:29.828163  3209 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 13.
I20260709 13:18:29.823424  3283 rpcz_store.cc:276] 0709 13:18:27.991279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.322812 (+331533us) service_pool.cc:224] Handling call
0709 13:18:28.323155 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:28.357191 (+ 34036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.357226 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:28.375143 (+ 17917us) log.cc:844] Serialized 26 byte log entry
0709 13:18:28.784526 (+409383us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:29.821035 (+1036509us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.821404 (+   369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.821522 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.821562 (+    40us) raft_consensus.cc:1685] finished
0709 13:18:29.821578 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.821736 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":429491,"prepare.queue_time_us":660664,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":218,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":830425,"threads_started":2,"wal-append.queue_time_us":555869}
I20260709 13:18:29.829443  3129 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 22.
I20260709 13:18:29.800452  9963 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:29.809298  9781 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:29.846235  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 390362us
I20260709 13:18:29.807512  9827 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:29.810917  9785 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:18:29.871654  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 86175.1us
I20260709 13:18:29.774159  9980 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:29.988409  3206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2908) took 1638 ms. Trace:
I20260709 13:18:30.003497  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:30.002401  3206 rpcz_store.cc:276] 0709 13:18:28.350316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.356649 (+  6333us) service_pool.cc:224] Handling call
0709 13:18:28.356878 (+   229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:28.369482 (+ 12604us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:28.478796 (+109314us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b48002727d8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1118aa1 00007fb3c110fb37 00007fb3c110f9ca 00007fb3c120726f 00007fb3c1206f37 00007fb3c121b55c 00007fb3c121b508 00007fb3c121b488 00007fb3c121b443 00007fb3c121a6ec 00007fb3c0144a96
0709 13:18:28.604215 (+125419us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.000504 (+396289us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.000949 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.001101 (+   152us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:29.001131 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.001200 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.866042 (+864842us) raft_consensus.cc:1685] finished
0709 13:18:29.988167 (+122125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.988336 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9156,"prepare.queue_time_us":32461,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":42717,"raft.run_cpu_time_us":2469,"raft.run_wall_time_us":107585,"spinlock_wait_cycles":11628288,"thread_start_us":501064,"threads_started":2,"wal-append.queue_time_us":444134}
I20260709 13:18:30.004367  3279 raft_consensus.cc:2368] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16.
I20260709 13:18:30.004454  3277 raft_consensus.cc:1240] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 20. Current term is 21. Ops: [18.11-20.12]
I20260709 13:18:30.005048  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7eb1bec1634d2784b28588ef1161c0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:29.835175  9823 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:29.810216  9903 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:29.374330  9705 ts_tablet_manager.cc:1469] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: Trace:
0709 13:18:23.080627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.081805 (+  1178us) service_pool.cc:224] Handling call
0709 13:18:23.420394 (+338589us) ts_tablet_manager.cc:934] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323)
0709 13:18:24.963638 (+1543244us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:26.015647 (+1052009us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:26.037602 (+ 21955us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:26.456268 (+418666us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:26.456610 (+   342us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:26.456977 (+   367us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:26.457046 (+    69us) inbound_call.cc:177] Queueing success response
0709 13:18:27.663661 (+1206615us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:18:28.749771 (+1086110us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:18:28.996589 (+246818us) tablet_replica.cc:261] Starting instrumentation
0709 13:18:28.997241 (+   652us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":69872,"raft.queue_time_us":24056,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":14182,"tablet-copy.queue_time_us":235535,"tablet-download-pool.queue_time_us":19303,"tablet-download-pool.run_cpu_time_us":1184,"tablet-download-pool.run_wall_time_us":511799,"thread_start_us":208854,"threads_started":2}
I20260709 13:18:29.781865  9756 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:30.029656  9957 log.cc:927] Time spent T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:18:29.877194  9827 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:30.038240  9978 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:18:29.865393  9900 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:29.870738  9963 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.081739  9963 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.082026  9997 consensus_queue.cc:1059] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:30.039054  3210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 4177) took 1261 ms. Trace:
I20260709 13:18:29.835902  9797 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:29.809257  9981 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.084234  9963 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:29.872164  9781 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:30.085094  9781 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.086458  9981 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.087827  9797 raft_consensus.cc:493] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:30.083550  3210 rpcz_store.cc:276] 0709 13:18:28.777931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.778090 (+   159us) service_pool.cc:224] Handling call
0709 13:18:28.906023 (+127933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.178860 (+272837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.178893 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.215360 (+ 36467us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.775571 (+560211us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:29.775614 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.775684 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.038813 (+263129us) raft_consensus.cc:1685] finished
0709 13:18:30.038835 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.038993 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66083,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":648453,"threads_started":2,"wal-append.queue_time_us":648960}
I20260709 13:18:29.811179  9911 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.088534  9797 raft_consensus.cc:515] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:29.829129  9961 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.093206  9781 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.093907  9781 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:30.090592  9797 leader_election.cc:290] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.092762  9961 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.040062  9767 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:30.042026  9830 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:30.039573  9902 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.030194  9987 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:30.094566  9781 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.038754  9787 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.052141  9733 raft_consensus.cc:493] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:29.876734  9785 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:30.122042  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 292172us
I20260709 13:18:30.097735  9986 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:30.094210  9911 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:30.083483  9756 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:30.131987  3129 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:18:30.044435  9823 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:30.125569  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 246050us
I20260709 13:18:29.870088  9931 consensus_queue.cc:260] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.153597  3100 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:30.154304  9931 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:30.157194  9450 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:30.157706  9973 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.159438  9903 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.160822  9911 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.161362  9911 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.163522  9911 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.166571  9717 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:30.144984  9781 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.146024  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:30.168239  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.168454  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.168779  3133 raft_consensus.cc:2368] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16.
W20260709 13:18:30.149809  9988 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:18:30.149960  3136 raft_consensus.cc:1240] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:18:30.173061  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:30.137889  9940 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.001s	sys 0.015s
W20260709 13:18:30.200760  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.167824  3250 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:30.123453  9767 raft_consensus.cc:493] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:18:30.246608  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 78859.9us
I20260709 13:18:30.238184  3206 raft_consensus.cc:2410] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 23 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:18:30.247495  3250 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:30.212606  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.167236  9717 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.248626  3250 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:30.157660  9450 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.252375  3250 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:30.212128  3210 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:18:30.253687  3210 pending_rounds.cc:85] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928: Aborting all ops after (but not including) 9
I20260709 13:18:30.254087  3210 pending_rounds.cc:107] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:18:30.254453  3210 raft_consensus.cc:2889] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.110790  9900 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.256248  3129 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:30.256928  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.260488  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:30.246342  9940 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.001s	sys 0.016s
I20260709 13:18:30.170168  9937 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.210938  9903 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:30.171789  9787 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:18:30.263007  3176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.002s	sys 0.018s
W20260709 13:18:30.269259  3176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.002s	sys 0.018s
I20260709 13:18:30.210975  9990 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.261140  3207 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:30.245795  9830 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:30.262753  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 85382.6us
I20260709 13:18:30.246515  9911 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.267514  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 130231us
I20260709 13:18:30.245886  9781 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:30.246731  9973 raft_consensus.cc:493] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:30.271890  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.141368  9733 raft_consensus.cc:515] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.257483  9450 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:30.274232  3251 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.029s	sys 0.037s
W20260709 13:18:30.282116  3251 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.029s	sys 0.037s
W20260709 13:18:30.296815  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 761503us
I20260709 13:18:30.268728  9940 raft_consensus.cc:3055] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:18:30.335254  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 54886.4us
I20260709 13:18:30.336615  3100 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:30.336853  3833 raft_consensus.cc:3055] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:30.331478  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.341590  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.341956  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.342563  3834 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 14.
I20260709 13:18:30.337417  3833 raft_consensus.cc:740] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:30.344995  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.270570  9807 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:30.133890  9987 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.256992  9767 raft_consensus.cc:515] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.347569  3210 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:30.348210  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.141170  9986 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.274923 10004 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:30.345671  3833 consensus_queue.cc:260] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.363303  3833 raft_consensus.cc:3060] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:30.364420  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.330061  9961 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.317512  9829 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:30.281426 10005 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:30.366578  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.281942  9797 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:30.294837  9992 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.283766  9971 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.283645  9830 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.334777  9940 raft_consensus.cc:740] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:30.273849  9903 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:30.391150  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 76453us
I20260709 13:18:30.276351  9787 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.295800  9911 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.317272  9781 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.373126  9963 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:30.402818  3177 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:30.361814  9807 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.397747  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.296411  9973 raft_consensus.cc:515] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.417827  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.277441  9990 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:30.406809  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.377131  9979 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:30.400866  9829 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:30.368351  9820 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:18:30.393659  9992 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.379549 10005 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.472539  9900 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:30.473239 10005 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.474046  9717 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:30.475217  9973 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.475757  9900 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:30.478644 10015 log.cc:927] Time spent T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:30.480178  9785 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.482693  9990 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.383523  9797 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.422152  9807 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.412550 10014 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:30.489903  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.491266  3205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34332 (request call id 4171) took 1890 ms. Trace:
I20260709 13:18:30.491638  3205 rpcz_store.cc:276] 0709 13:18:28.601020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.601202 (+   182us) service_pool.cc:224] Handling call
0709 13:18:28.601534 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:28.603772 (+  2238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.603803 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:28.638341 (+ 34538us) log.cc:844] Serialized 52 byte log entry
0709 13:18:29.111445 (+473104us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:29.113669 (+  2224us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.120407 (+  6738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.120498 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.467892 (+1347394us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b24001b76b8. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b8f889c4 00007fb3b8f86acb 00007fb3b9141dc9 00007fb3b9141a55 00007fb3b9140fb0 00007fb3bbdb7488 00007fb3bbdb7be8 00007fb3bbd8f398 00007fb3bbd8a76a 00007fb3bbd89bb6
0709 13:18:30.484259 (+ 16367us) raft_consensus.cc:1685] finished
0709 13:18:30.491060 (+  6801us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.491207 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1866,"prepare.queue_time_us":540,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":328747,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":227,"spinlock_wait_cycles":37804288,"thread_start_us":388438,"threads_started":1,"wal-append.queue_time_us":628544}
I20260709 13:18:30.493000  9797 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.494410  9781 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.418113  9994 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:30.495093  9994 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:30.495513  9994 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:30.496546  9925 consensus_meta.cc:287] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.000s
I20260709 13:18:30.476469  9900 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.379365  9961 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:30.425602 10002 log.cc:927] Time spent T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:18:30.428681  3833 raft_consensus.cc:1275] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:18:30.499329  3833 pending_rounds.cc:85] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 11
I20260709 13:18:30.499661  3833 pending_rounds.cc:107] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:18:30.499970  3833 raft_consensus.cc:2889] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.370178  3834 raft_consensus.cc:1275] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:18:30.500748  9961 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.502470  9911 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.510310  9900 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:30.448354  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.400697 10008 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:30.425623 10006 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:18:30.412334  9827 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.461277  9940 consensus_queue.cc:260] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:30.521792 10013 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:18:30.523169  9767 leader_election.cc:290] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.467350  9992 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:30.471235  9819 consensus_meta.cc:287] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.948s	user 0.010s	sys 0.000s
I20260709 13:18:30.368510 10004 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.511487  3841 raft_consensus.cc:2410] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:18:30.510353  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.530215 10004 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.526600  9819 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:30.530814  3804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.459522  9979 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:30.516072  9925 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:30.531706  9979 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:30.533038  9819 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.531314  3131 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:30.533702  9925 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.533740  3211 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:18:30.537274  3211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34342 (request call id 2926) took 1143 ms. Trace:
I20260709 13:18:30.537760  9931 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:30.538830  9931 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.541400  9931 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.542503  9823 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.547327  9994 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.550348  9940 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:30.551719  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.419392  9963 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.554927  9963 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.558218  9830 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:30.558378  9980 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.566265  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:30.568275  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.569125  3285 raft_consensus.cc:1240] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:30.576143  9987 leader_election.cc:290] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:30.487919  9398 consensus_meta.cc:287] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.920s	user 0.011s	sys 0.002s
I20260709 13:18:30.577504  9398 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.578707  3128 raft_consensus.cc:2393] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 19: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:30.580828  9398 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.582886  9733 leader_election.cc:290] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.585191  3027 catalog_manager.cc:5697] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.589535  9903 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.592555  9503 raft_consensus.cc:3055] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:30.592985  9503 raft_consensus.cc:740] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:30.594070  9986 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:30.593880  9503 consensus_queue.cc:260] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.595225  9503 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:30.537601  3211 rpcz_store.cc:276] 0709 13:18:29.393701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.394953 (+  1252us) service_pool.cc:224] Handling call
0709 13:18:29.471777 (+ 76824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.536542 (+1064765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.537032 (+   490us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400195854. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:30.537217 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2441667968}
W20260709 13:18:30.608214  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 355903us
I20260709 13:18:30.608624  3285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52014 (request call id 1151) took 1526 ms. Trace:
I20260709 13:18:30.609319  9450 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.610805  3128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49692 (request call id 2720) took 1138 ms. Trace:
I20260709 13:18:30.610921  3837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58470 (request call id 1445) took 1131 ms. Trace:
I20260709 13:18:30.611176  3128 rpcz_store.cc:276] 0709 13:18:29.472900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.473300 (+   400us) service_pool.cc:224] Handling call
0709 13:18:30.610568 (+1137268us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400075654. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1f32fa 00007fb3c11b4b17 00007fb3ba72f6d4 00007fb3ba72f662 00007fb3ba72f591 00007fb3ba72f50c 00007fb3ba72e7c2 00007fb3ba52a48c 00007fb3ba5298c6 00007fb3ba52926f
0709 13:18:30.610733 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2452106496}
I20260709 13:18:30.611657  3837 rpcz_store.cc:276] 0709 13:18:29.480038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.480345 (+   307us) service_pool.cc:224] Handling call
0709 13:18:29.522152 (+ 41807us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.851870 (+329718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.851915 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.166798 (+314883us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b2c00047a38. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3baae8a11 00007fb3baaf8372 00007fb3bc22aa01 00007fb3bc1ef43a 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2
0709 13:18:30.167316 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:18:30.610332 (+443016us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:30.610380 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.610462 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.610518 (+    56us) raft_consensus.cc:1685] finished
0709 13:18:30.610544 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.610834 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":243794,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":13033,"spinlock_wait_cycles":34084224,"thread_start_us":467720,"threads_started":2,"wal-append.queue_time_us":439471}
I20260709 13:18:30.609128  3285 rpcz_store.cc:276] 0709 13:18:29.082591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.085857 (+  3266us) service_pool.cc:224] Handling call
0709 13:18:29.086158 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.569569 (+1483411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.608387 (+ 38818us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400296dd4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1efe01 00007fb3bc1ee83e 00007fb3c11b3419 00007fb3ba72abd4 00007fb3ba72ab62 00007fb3ba72aa91 00007fb3ba72aa0c 00007fb3ba729cc2 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:30.608563 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3410003328}
I20260709 13:18:30.609655 10027 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
W20260709 13:18:30.632128  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.615844  9962 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:30.633014  9962 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.635203  9962 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.616122  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.595769  9787 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.617700  9877 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:30.620152 10017 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:30.616773  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.623688  3027 catalog_manager.cc:5697] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 12 to 14, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 14 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:30.641016 10017 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.643486 10017 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.629284 10028 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.629577  9825 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.646476  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 309930us
I20260709 13:18:30.647063  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.647140  9825 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.647069 10028 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:30.648427  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.649426  9825 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.649887  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.650211 10028 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.650774 10028 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:30.651296  3135 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:30.651579 10028 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.654040  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.654660  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.655365  3135 raft_consensus.cc:2368] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14.
I20260709 13:18:30.656065  9994 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.656584  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.656857  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.657207  3135 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:30.658793  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.659619  3135 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:30.660871  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.665359  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.666389  3207 raft_consensus.cc:2393] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 15: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:30.667726  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:30.669265  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:30.669552  3838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.715301  3840 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:30.434926  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 414299us
I20260709 13:18:30.671185  3207 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:30.672426  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:30.716387  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 48756.8us
I20260709 13:18:30.673276 10028 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.673497  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:30.674613  3205 raft_consensus.cc:1240] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:30.675473  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.676407  3836 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:18:30.677433  3282 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:30.682207  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.685118  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:30.720613  3209 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:30.686779  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.689844  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.690996  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.721131  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.721407  3280 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 12.
I20260709 13:18:30.691286  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.722295  3278 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 22.
I20260709 13:18:30.696128  3281 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:30.698899  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.699529  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.700103  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.700205  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.702229  9979 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.704320  9450 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:30.704248  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:30.706838  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.707036 10017 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:30.708331 10024 consensus_queue.cc:1048] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:30.708721 10023 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:18:30.734000  3145 tablet_copy_service.cc:342] P fc48eecc27554cb58b15193cd442b1d3: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-2ae5c762a7f347f4a2de941d47ed1903 received from {username='slave'} at 127.0.0.1:57442
I20260709 13:18:30.734169  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.734619  3145 tablet_copy_service.cc:434] P fc48eecc27554cb58b15193cd442b1d3: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-2ae5c762a7f347f4a2de941d47ed1903 on tablet 2ae5c762a7f347f4a2de941d47ed1903 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:30.735574  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:30.712261  3026 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38226 (request call id 255) took 28890 ms (client timeout 15000 ms). Trace:
I20260709 13:18:30.712854  9825 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.714360  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.742790  3135 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 22.
I20260709 13:18:30.717448  3249 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:30.743714  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.744283  3133 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 22.
I20260709 13:18:30.744827  3209 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:30.609629  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:30.718175  9994 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:30.747983 10024 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:30.748363  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.729229  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.748951  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.731923  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.728562  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.750097  3128 raft_consensus.cc:2393] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:18:30.733206  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.738911 10017 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.742003  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.721947  3100 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:30.747129  3840 raft_consensus.cc:2468] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:18:30.747639  9825 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.739971  3177 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:30.752640  3132 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 20.
W20260709 13:18:30.756433  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.753252  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 143716us
I20260709 13:18:30.757037  3177 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:30.760517  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.761291  3133 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 22.
I20260709 13:18:30.762231  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.763002  3136 raft_consensus.cc:2368] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:30.766585  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.766801  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:30.767879  3020 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f4a8a614fca4531aab11f5963396f62 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc48eecc27554cb58b15193cd442b1d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:30.768200  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:30.769467  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.770766  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.771921  3133 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:30.772622 10017 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.773140 10024 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:30.773533  9962 raft_consensus.cc:2804] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:30.773892  9903 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:30.799109  3130 raft_consensus.cc:2393] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:30.764617  3250 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:30.739454  9979 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:30.777633  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 55795.8us
I20260709 13:18:30.818252  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.818949  3836 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 15.
I20260709 13:18:30.819150  3100 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:30.778981  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.780432  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.781133  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.781881  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:30.782387  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.822248  3282 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:30.783288  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:30.789582  3176 leader_election.cc:400] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16.
I20260709 13:18:30.823150  3176 leader_election.cc:403] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:18:30.790213  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
W20260709 13:18:30.791761  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 47122.8us
I20260709 13:18:30.792738  3133 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 23.
I20260709 13:18:30.795008  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:30.796346  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:30.825773  3285 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:18:30.820251  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:30.806411  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.790045  9450 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:30.833643  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:30.835268  3128 raft_consensus.cc:1240] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:30.808894  9825 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:30.809494  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.810148  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023c1461b69c46bdb3c42ee16f303ea2" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:30.776026 10023 consensus_queue.cc:1048] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.040s
I20260709 13:18:30.816165  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:30.827817  3176 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:30.840969  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.843796  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.844615  3208 raft_consensus.cc:2393] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 13: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:30.790904 10024 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:30.847941  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:30.847500  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.800760  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:30.845561  3176 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:30.849648  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:30.849730  3805 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:30.798650  9903 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:30.850811  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.829797 10017 raft_consensus.cc:2804] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:30.860718  3209 raft_consensus.cc:2410] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for term 23 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:18:30.851090  3176 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:30.862372  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.827733  9962 raft_consensus.cc:697] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:30.862988  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.864563  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:30.837404  9733 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16.
I20260709 13:18:30.866700  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.852823  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.870422  3176 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:30.886345  3101 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:30.873682  3285 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:18:30.881740  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.858961  3282 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:30.840279  9981 consensus_queue.cc:1059] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:18:30.844223  9938 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:30.887648  3278 raft_consensus.cc:2468] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:18:30.848150  9972 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:30.891836  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.895874  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.894340  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:30.893443  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f37f97e44445a8978d2cde7a9c9c58" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.863519  9943 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:30.906200  9943 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:30.906651  9943 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:30.909922  9962 consensus_queue.cc:237] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:30.901467  9797 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:30.863400  9990 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:30.850395  9925 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:18:30.915033  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.915807  3276 raft_consensus.cc:2393] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 14: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:30.915977  9787 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:30.916402  9787 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.916764  9787 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:30.863530  9961 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:30.863689  9903 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:30.901135  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.924594  3284 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:30.859916  9992 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:30.903476  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.859231 10012 consensus_queue.cc:1059] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:18:30.932138  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7177cc3a5e547a3b1bef3c6c3c3a368" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.903777  9807 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:18:30.742623  3026 rpcz_store.cc:269] 0709 13:18:01.821842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.827953 (+  6111us) service_pool.cc:224] Handling call
0709 13:18:30.712130 (+28884177us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:24.396635 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:24.405428 (+  8793us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:24.405496 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:18:24.405555 (+    59us) tablet.cc:662] Decoding operations
0709 13:18:24.460927 (+ 55372us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:24.483405 (+ 22478us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:24.485622 (+  2217us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:18:24.588236 (+102614us) tablet.cc:701] Row locks acquired
0709 13:18:24.588291 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:18:24.588505 (+   214us) write_op.cc:270] Start()
0709 13:18:24.588667 (+   162us) write_op.cc:276] Timestamp: P: 1783603104588437 usec, L: 0
0709 13:18:24.588705 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:18:24.589699 (+   994us) log.cc:844] Serialized 6310 byte log entry
0709 13:18:25.814800 (+1225101us) op_driver.cc:464] REPLICATION: finished
0709 13:18:26.105692 (+290892us) write_op.cc:301] APPLY: starting
0709 13:18:26.115731 (+ 10039us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:26.449040 (+333309us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:26.449205 (+   165us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:26.696699 (+247494us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:26.697091 (+   392us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:18:26.697136 (+    45us) write_op.cc:312] APPLY: finished
0709 13:18:26.697628 (+   492us) log.cc:844] Serialized 148 byte log entry
0709 13:18:26.697803 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:26.697972 (+   169us) write_op.cc:454] Released schema lock
0709 13:18:26.698058 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:26.698471 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:26.698506 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14053,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":231795,"apply.run_cpu_time_us":26303,"apply.run_wall_time_us":630883,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71135,"num_ops":16,"prepare.queue_time_us":213396,"prepare.run_cpu_time_us":20708,"prepare.run_wall_time_us":479668,"raft.queue_time_us":224404,"raft.run_cpu_time_us":5064,"raft.run_wall_time_us":261265,"replication_time_us":1188078,"thread_start_us":586252,"threads_started":4,"wal-append.queue_time_us":313157,"wal-append.run_cpu_time_us":19457,"wal-append.run_wall_time_us":2793033}]]}
I20260709 13:18:30.840785  9986 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:18:30.850464 10024 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:30.864421  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 63782.5us
W20260709 13:18:30.914933  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 94739.9us
I20260709 13:18:30.903225  3176 leader_election.cc:400] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:30.859750  9958 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:30.918643  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:30.865332  9987 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:30.939997  3176 leader_election.cc:403] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:30.920266  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.921994  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.940780  3278 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 22.
I20260709 13:18:30.885385  9781 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:30.860282  9979 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:30.929620  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.930629  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.930886  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.947013  3285 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:30.947078  3277 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 22.
I20260709 13:18:30.931319  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.933461  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ab044361f54dae84978720aac3998c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.948278  3283 raft_consensus.cc:2368] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:30.892586 10017 raft_consensus.cc:697] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:30.936795  9807 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.938522  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:30.941771  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 92186.3us
I20260709 13:18:30.950802  9807 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:30.951165  3280 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 23.
W20260709 13:18:30.942286  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 56026.7us
I20260709 13:18:30.924702  9961 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.943364  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.944762  9936 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:30.947432  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:30.962388  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d700b048349bf9547efac6befb60d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.962741  3250 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:30.949747 10017 consensus_queue.cc:237] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:30.947558  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:30.941345  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:30.959400  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 56390.6us
I20260709 13:18:30.964092  3282 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 22.
I20260709 13:18:30.964648  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.967118  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:30.968629  3250 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:30.939733  9986 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:30.958570  9961 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:30.976263  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:30.983204  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:30.984844  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:30.985675 10012 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:30.961566  9781 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:30.988054  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:30.969851 10008 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:30.984786  3249 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:30.992411  9823 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:30.986552  9994 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:30.974931  9755 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:31.009866  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:30.982100  9938 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:18:31.010685  9823 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:30.994024  9925 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:31.011319  3249 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:31.012657  3249 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:31.013244  9916 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:31.013401  9773 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:30.996515  9980 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:31.014504  9980 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.014858  9980 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:30.996582 10001 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:30.990492  9830 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:31.008910  9824 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:31.022930  9733 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:30.999634  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:31.001626  9989 consensus_queue.cc:1059] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:30.969568  9986 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:31.006315  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:30.972268 10027 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:31.008077  3250 leader_election.cc:400] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14.
I20260709 13:18:31.030072  3250 leader_election.cc:403] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:31.023394  9733 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:31.025027 10012 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 23 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:31.031976  9733 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.032243 10012 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:31.027786  3249 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:31.030588  3176 leader_election.cc:304] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.035565  3250 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:31.042735  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.052886  3250 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:31.055886  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:31.021633  9755 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 22 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:31.059906  3176 leader_election.cc:400] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 15. Current term is 16.
I20260709 13:18:31.025425  9992 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.029626  9823 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:31.069314  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.038256  9936 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:31.050935  9824 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 13. Current term is 14.
W20260709 13:18:31.089839  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 47160.7us
I20260709 13:18:31.055896  9834 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:31.052603  9781 raft_consensus.cc:2749] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:31.038889  9733 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:31.118458  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 55310.7us
I20260709 13:18:31.096107  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.058444 10028 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:31.062266 10008 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:31.147308  3100 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:31.073730  9830 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:31.126030  9972 raft_consensus.cc:3055] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:31.167164  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:31.168097  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:31.168984  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:31.155259 10008 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:18:31.179966  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 84051.2us
I20260709 13:18:31.182626  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:31.182799  3101 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.182147  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:31.148665  9797 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:31.180212  9450 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:31.123493  9938 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:31.190019  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.191463  3100 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.189392 10028 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:31.087579  9992 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.162956  9830 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:31.193888  9825 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:31.139127  9986 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:31.203218  3128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:18:31.180585  9972 raft_consensus.cc:740] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:31.211673  3100 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:31.167992  9819 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:31.220299  3101 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:31.185173 10008 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:31.086333  9916 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:31.204283  9990 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.204612  9450 raft_consensus.cc:697] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:31.228514  9830 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:31.227293  9827 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:31.227452  9963 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:18:31.317402  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 248167us
I20260709 13:18:31.318509  3176 leader_election.cc:304] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.258610  9916 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.198567  9755 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.322136  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:31.323127  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 111540us
I20260709 13:18:31.323951  3176 leader_election.cc:304] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:31.307466  9978 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:18:31.306305  9398 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:31.324419  3100 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.219247 10028 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.306691  9986 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:31.304996  9990 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:31.347582  3208 raft_consensus.cc:1240] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:31.350409  9990 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:31.323262  9916 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:31.355572  3128 raft_consensus.cc:606] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:31.355986  3128 raft_consensus.cc:614] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:31.357167  3176 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.323443  9962 raft_consensus.cc:2749] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:31.326808  9963 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:31.324748  9925 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:31.372200  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:31.350414 10028 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:31.390277  9962 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:31.393144  9450 consensus_queue.cc:237] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.395041  3842 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:31.363715 10052 raft_consensus.cc:2749] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:31.376397  9999 consensus_queue.cc:1059] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:31.331626  9773 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:31.375978 10024 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:31.376271 10054 log.cc:927] Time spent T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:31.339506  9398 raft_consensus.cc:697] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:31.322288  9943 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:31.406705  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.360685  9989 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:31.435899  9989 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.437052  9943 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 21 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:31.399986  9925 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:18:31.363051  9834 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.437765  3833 raft_consensus.cc:1240] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:31.437988  9834 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:31.440531  9834 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:31.415376  9979 raft_consensus.cc:3055] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:31.441111  9979 raft_consensus.cc:740] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:31.441679  9992 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:31.356843  9972 consensus_queue.cc:260] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:31.446820  3282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:31.447521  3282 raft_consensus.cc:606] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:31.406647  9781 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:31.424683 10044 log.cc:927] Time spent T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:31.446866  9398 consensus_queue.cc:237] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.450747  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:31.452158  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:31.467072  3836 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:31.460608  3208 raft_consensus.cc:1275] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:18:31.461927  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 104848us
I20260709 13:18:31.470292  3251 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:18:31.445017  9903 consensus_meta.cc:287] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
I20260709 13:18:31.471630  3176 leader_election.cc:304] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:31.473675  9807 consensus_meta.cc:287] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.004s
I20260709 13:18:31.474130  9807 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.449563  9999 consensus_queue.cc:1243] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:31.481824  3282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:31.482686  3282 raft_consensus.cc:606] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 25 LEADER]: Received request to transfer leadership to TS 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:31.408481  9787 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:31.491425 10005 raft_consensus.cc:2749] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:31.492221  3176 leader_election.cc:400] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:31.493216  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.479461  9900 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:31.476609  9807 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:31.478205  9911 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:18:31.499974  9961 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.478430  9903 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:31.537380  9903 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:31.538300  9834 raft_consensus.cc:993] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:18:31.540596  9961 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:31.524663  9830 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:31.541682  9834 raft_consensus.cc:1081] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:18:31.543431  9830 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:31.546039  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:31.547703  3205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34342
I20260709 13:18:31.548285  3205 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:18:31.548416  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.548669  3205 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:31.540400  9979 consensus_queue.cc:260] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:31.550071  9979 raft_consensus.cc:3060] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:31.514182  9992 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:31.552448  9992 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:31.552863  9992 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:31.553107  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:31.553712  3285 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 19.
I20260709 13:18:31.554677  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:31.556633  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:31.518213 10024 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:31.520076  9787 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:31.497901  9980 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.527298 10008 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.560141 10008 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:31.500321  9900 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.560752  9900 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:31.530367  9916 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.565686 10004 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.566212 10004 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:31.567152  9916 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:31.569814  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:31.531134  9797 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:31.550933  3276 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Rejecting Update request from peer 0930e3e7657c43bcaaa5b0778f3e08cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:31.572358  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:31.573518  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:31.575042  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:31.576128  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:31.577282  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:31.579289  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:31.581022  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:31.579231  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:31.583227  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:31.586046  3208 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 23: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:31.513530  3176 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.594271  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:31.596378  3205 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.602787 10004 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:31.603219  9958 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:31.604470  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 91045.6us
I20260709 13:18:31.611652  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.616322  3176 leader_election.cc:304] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.617118  3206 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 14.
I20260709 13:18:31.620517  3129 raft_consensus.cc:1240] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:31.609431  9958 raft_consensus.cc:493] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.624696  9958 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:31.622085  3205 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:31.629958  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.623622  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.584586  9900 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:31.638685  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:31.639074  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.613104  9807 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:31.642726  3176 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.647059  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:31.651373  3129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:31.640226  9925 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:31.653442  9925 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:31.653820  9925 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:31.653841  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:31.654982  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:31.655138  3131 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 23: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:31.655638  3127 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 18.
I20260709 13:18:31.656455  9903 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:31.660107  9900 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:31.660863  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:31.661791  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:31.666916  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.629545  9797 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:31.668818  9900 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:31.671108  3250 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.673032  9900 raft_consensus.cc:2749] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:31.675519  3250 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.677276  9900 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:31.678912  3135 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:18:31.681529  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:31.681808  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:31.682255  3836 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:31.682515  3250 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.630815  9733 raft_consensus.cc:2749] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:18:31.686280 10031 log.cc:927] Time spent T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:31.619819  9953 consensus_queue.cc:1059] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:18:31.687131  9979 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.687676  9979 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.689725  9979 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:31.691094  9979 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.691545  9979 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.693601  9961 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:31.694064  9979 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:31.684230  9900 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:31.694545  9980 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:31.697813  9959 raft_consensus.cc:3055] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:31.696753  3250 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.698240  9959 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:31.699059  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:31.699728  9900 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:31.699858  9959 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:31.701155  9959 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:31.702685  3250 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.681617  9989 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:31.705647  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:31.706187  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:31.706732  3136 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 21.
I20260709 13:18:31.707146  3134 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 23: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:31.707149  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.710472 10004 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.710948 10004 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.711444  9717 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:31.713168 10004 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:31.713706  3836 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 16.
I20260709 13:18:31.714419 10008 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:31.716940  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:31.722275  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:31.723001  3281 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:31.723578  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:31.724395  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:31.725134  3282 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 21.
I20260709 13:18:31.724841  3283 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 23: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:31.727177  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:31.727981  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:31.692378  9992 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.719998  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:31.731751  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:31.729468  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:31.734864  3134 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:31.735095  3283 raft_consensus.cc:3055] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:31.735213  3135 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:31.735487  3283 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:31.733836  3284 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:31.738233  3250 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.738706  3282 raft_consensus.cc:2393] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 15: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:31.709501  9958 raft_consensus.cc:515] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:31.738441  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.751758  9819 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:31.759435  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:31.759925  3135 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 23.
I20260709 13:18:31.761735  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:31.737383  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:31.736310  3283 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.743155 10008 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:31.733927  9980 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:31.729192  9902 consensus_queue.cc:1059] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:18:31.736443  9824 consensus_queue.cc:1059] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:18:31.748397  3250 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.770627  3283 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:31.762601  3282 raft_consensus.cc:2410] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:18:31.777552  9797 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:31.778541  9992 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:31.780078  9958 leader_election.cc:290] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:31.807868 10004 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.833870 10004 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.821801  9797 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.837870  9797 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:31.782811  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:31.824970  3842 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 15.
I20260709 13:18:31.842429  3281 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 21.
I20260709 13:18:31.784235  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:31.844468  3284 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 23: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:31.791932  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:31.793118  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:31.793733  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:31.845170  3840 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:31.797469  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:31.846312  3202 raft_consensus.cc:2410] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
W20260709 13:18:31.786623  9916 consensus_queue.cc:1175] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fc48eecc27554cb58b15193cd442b1d3" responder_term: 19 status { last_received { term: 19 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 19 index: 11 } }
I20260709 13:18:31.797794  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:31.799898  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:31.848407  3211 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 23: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:31.802762  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:31.813496  3176 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:31.848978  3206 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:31.816610  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:31.849808  3280 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:31.849890  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 101615us
I20260709 13:18:31.850677  3250 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.836709 10004 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:31.817764  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:31.824905  3134 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:31.791324  3205 raft_consensus.cc:1240] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:31.846652  3177 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:31.856199  3134 raft_consensus.cc:1275] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:31.853991  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.861666  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:31.862501  3280 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 20.
I20260709 13:18:31.864187  3806 leader_election.cc:304] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:31.864341  3840 raft_consensus.cc:2468] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:31.865849  3251 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:31.866246  3283 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:31.848048  9980 raft_consensus.cc:697] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:31.871693  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:31.858134  9992 raft_consensus.cc:2804] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:31.870362  3250 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.859059  9986 raft_consensus.cc:3055] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:31.871512  9823 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:31.882048  9823 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:31.864681  9903 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:31.865053 10023 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:31.872776  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:31.869369  9717 raft_consensus.cc:2804] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:31.887259  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.867403  9781 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:31.879217  9911 raft_consensus.cc:2804] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:31.893761  9781 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:31.896979  9980 consensus_queue.cc:237] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:31.906875  3248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.885422  9753 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:31.900117  9925 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.909992  3209 raft_consensus.cc:1240] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:31.914693  9925 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:31.926147  9911 raft_consensus.cc:697] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:31.927160  9787 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:31.927289  9911 consensus_queue.cc:237] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:31.884117  9986 raft_consensus.cc:740] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:31.929721  9986 consensus_queue.cc:260] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:31.930956  9986 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:31.932060  9717 raft_consensus.cc:697] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:31.933138  9717 consensus_queue.cc:237] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:31.934202  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.935874  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:31.889596  9903 raft_consensus.cc:697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:31.941920  9903 consensus_queue.cc:237] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:31.944741  9398 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:31.883742  9807 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:18:31.946815  9807 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:31.947180  9807 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:31.948115  9807 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.949431  9936 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:31.954205  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:31.954567  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aded29f2cce84c3c8e2a5337dce77bde" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:31.956167  3134 raft_consensus.cc:3060] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:18:31.960193  3100 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:31.925347  9992 raft_consensus.cc:697] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 23 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:31.960495  9757 consensus_queue.cc:1059] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:18:31.966463  9757 raft_consensus.cc:3055] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:31.966857  9757 raft_consensus.cc:740] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:31.966882  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:31.967881  9757 consensus_queue.cc:260] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.968523  3208 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:31.969682  9979 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:31.970129  9979 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.970479  9979 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:31.964877  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 92205.3us
I20260709 13:18:31.977458  3134 raft_consensus.cc:2468] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 20.
I20260709 13:18:31.957278  9936 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.963694  9925 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:31.958110  9797 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:31.991816  9936 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:31.998132  9757 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:32.003367  9807 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:31.993396 10005 consensus_queue.cc:1059] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:18:32.021160  3210 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 22: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:32.014459  9902 raft_consensus.cc:3055] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:32.026564  9992 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:32.058089  9781 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:32.033026  9925 raft_consensus.cc:3055] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:32.065740  9925 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:32.067040  9925 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:32.071087  9797 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:32.030771  9902 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:18:32.102609  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 121706us
I20260709 13:18:32.103893  3176 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:32.068858  9925 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:32.113238  3205 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:32.125474  3100 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:32.126853  3100 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:32.141944  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.154685  9797 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:32.155408  9797 raft_consensus.cc:697] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:32.157420  9820 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:32.159056 10069 log.cc:927] Time spent T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.129s	user 0.004s	sys 0.001s
I20260709 13:18:32.144511  9827 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:32.145920 10001 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:32.189042  3280 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:32.195117  9916 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.195996  9916 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:32.139118  9902 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:32.225823  9450 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:32.229015  9938 consensus_queue.cc:1059] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:32.139356  9781 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:32.234079  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:32.156406  9797 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:32.286317  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 182527us
W20260709 13:18:32.294418  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.274415  9902 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:32.264288  9916 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:32.307303  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:32.325011  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:32.326359  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:32.327785  3202 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 23 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:32.333062  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:32.335606  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:32.337517  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:32.338209  3283 raft_consensus.cc:3060] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:32.309558  9781 consensus_queue.cc:1048] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:18:32.322292 10005 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:32.350148  3283 raft_consensus.cc:2468] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 22.
I20260709 13:18:32.355165  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:32.369884  3176 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:32.373767  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:32.379287  3135 raft_consensus.cc:1240] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:18:32.401116  9767 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:32.401883  9961 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:32.402060  9767 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:32.379019  9903 raft_consensus.cc:2804] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:32.428156  9767 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:32.428169  9900 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:32.429446 10024 consensus_queue.cc:1059] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:18:32.440907  9903 raft_consensus.cc:697] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 22 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:32.449339 10024 consensus_queue.cc:1243] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer 43b01d5a97e149008d543a6615219928 log is divergent from this leader: its last log entry 23.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:18:32.449965 10024 raft_consensus.cc:3055] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:32.433570  9936 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:32.450316 10024 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:32.451583  9979 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:32.452276  9936 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:32.452028 10024 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:32.453675  9979 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:32.453872 10024 raft_consensus.cc:3060] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:32.487780  3134 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 22: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
W20260709 13:18:32.495093  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 121343us
I20260709 13:18:32.505944  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:32.507416  3206 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
I20260709 13:18:32.511828  3206 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:32.515588  3130 raft_consensus.cc:1240] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:32.516916  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:32.517581  3249 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:32.520150  3136 raft_consensus.cc:1275] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:32.522292  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:32.523346  3136 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 23.
I20260709 13:18:32.530104  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:32.533130  3283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37a53418fbf14b998493923afc272c3c"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:32.534010  3284 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:32.534083  3283 raft_consensus.cc:606] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:32.534644  3283 raft_consensus.cc:614] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:32.530277  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:32.540160  3280 raft_consensus.cc:2393] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 22: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:32.541065  3836 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:32.541124  3208 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:32.544310  3280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:32.545140  3280 raft_consensus.cc:606] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:32.545775  3280 raft_consensus.cc:614] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:32.551350  3283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:32.553246  3836 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:32.554622  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:32.559732  3205 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:32.564217  3280 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 13:18:32.564674  3280 pending_rounds.cc:85] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 13
I20260709 13:18:32.564949  3280 pending_rounds.cc:107] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:18:32.565356  3280 raft_consensus.cc:2889] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:32.557979  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:32.570798  9398 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:32.574019  3130 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:32.575006  9781 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:32.583787  9767 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:32.584389  9767 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:32.587863  9398 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:32.584869  9767 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:32.633455  3205 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:32.653213  9940 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:32.654196 10082 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.654263  9940 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:32.655179 10082 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:32.664925  9820 raft_consensus.cc:3055] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:32.666441  9820 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:32.670135  9916 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:32.665215  3251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.672210  9820 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:32.675827  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 59779.7us
I20260709 13:18:32.446045  9900 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:32.677178  9820 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:32.678185  3276 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:18:32.685812  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 307520us
I20260709 13:18:32.450295  9903 consensus_queue.cc:237] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:32.694118  9940 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:32.711175  3206 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:18:32.712729  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 142067us
W20260709 13:18:32.722244  9911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.069s	sys 0.098s
W20260709 13:18:32.722831  9911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.069s	sys 0.098s
I20260709 13:18:32.723294  9900 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:32.725245  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 82300.8us
I20260709 13:18:32.730357 10082 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:32.732343  3177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.745173  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 72532us
I20260709 13:18:32.751127  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:32.752388  3833 raft_consensus.cc:2410] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:18:32.753597  3278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33906 (request call id 3674) took 1178 ms. Trace:
I20260709 13:18:32.754534  9911 raft_consensus.cc:993] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: : Instructing follower 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:18:32.755169  9911 raft_consensus.cc:1081] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 25 LEADER]: Signalling peer 0930e3e7657c43bcaaa5b0778f3e08cf to start an election
I20260709 13:18:32.756943 10012 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:32.760159 10082 consensus_queue.cc:1059] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:32.760615  9994 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:32.761309 10082 raft_consensus.cc:3055] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:32.724866 10083 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.761783 10082 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:32.775166  3833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81"
dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
 from {username='slave'} at 127.0.0.1:58470
I20260709 13:18:32.775290  3100 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:32.819491  3833 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:32.754153  3278 rpcz_store.cc:276] 0709 13:18:31.575283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.575882 (+   599us) service_pool.cc:224] Handling call
0709 13:18:31.576172 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.576487 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.576519 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.588577 (+ 12058us) log.cc:844] Serialized 26 byte log entry
0709 13:18:32.427641 (+839064us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b1800483100. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3c1fcade1 00007fb3c1fd75b1 00007fb3b90e4e07 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bbd8920b 00007fb3bbd8ed23 00007fb3bbd8f0d1 00007fb3bc1aaa0f
0709 13:18:32.729433 (+301792us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:32.729529 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.729632 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.752865 (+ 23233us) raft_consensus.cc:1685] finished
0709 13:18:32.752892 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.753369 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2261,"raft.queue_time_us":1363,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":8992,"spinlock_wait_cycles":4865408,"thread_start_us":282261,"threads_started":1,"wal-append.queue_time_us":1141926}
I20260709 13:18:32.820114  9936 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:32.739989 10093 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:18:32.820896  9936 raft_consensus.cc:697] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:32.822445  9936 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:32.777776  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.819833  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 48537us
I20260709 13:18:32.778751 10083 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:32.782423 10090 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:18:32.790156  9900 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.799261  3280 raft_consensus.cc:1275] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:32.805586  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:32.811726  3134 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:18:32.812639  9807 consensus_meta.cc:287] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: Time spent flushing consensus metadata: real 0.787s	user 0.013s	sys 0.006s
I20260709 13:18:32.820066  3833 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:32.843647  3202 raft_consensus.cc:2368] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18.
I20260709 13:18:32.829491  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:32.855849 10083 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:32.858201  9753 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:32.864089  3249 leader_election.cc:400] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18.
I20260709 13:18:32.864642  3249 leader_election.cc:403] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:32.864804  3205 raft_consensus.cc:3060] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:32.870913  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:32.820079 10082 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:32.874187 10082 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:32.876260  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:32.762413  9916 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:32.849414  9900 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:32.932379  3276 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:32.939747  9767 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:32.940937  9972 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:32.943555  3204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:32.951726 10023 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 17. Current term is 18.
I20260709 13:18:32.949805  9953 consensus_queue.cc:1048] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.010s
W20260709 13:18:32.951792  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 189182us
I20260709 13:18:32.958225  3833 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:32.967089  3282 raft_consensus.cc:1275] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:32.968526  9819 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:32.969901  9900 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:32.974378  9916 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:32.982637  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:32.984061  9986 consensus_queue.cc:1048] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:32.985713  3250 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:32.987991  9824 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:32.988416  9824 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:32.988801  9824 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:32.998550 10024 consensus_meta.cc:287] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.544s	user 0.019s	sys 0.003s
W20260709 13:18:33.006444  9757 consensus_meta.cc:287] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.985s	user 0.009s	sys 0.016s
I20260709 13:18:33.009646  3284 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 13:18:33.010113  3284 pending_rounds.cc:85] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 12
I20260709 13:18:33.010377  3284 pending_rounds.cc:107] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:18:33.010654  3284 raft_consensus.cc:2889] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:33.013849  9902 consensus_meta.cc:287] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.010s
I20260709 13:18:33.014559  3283 raft_consensus.cc:606] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:33.015030  3283 raft_consensus.cc:614] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:33.018198  3840 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 LEARNER]: Advancing to term 23
W20260709 13:18:33.019488 10086 log.cc:927] Time spent T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.241s	user 0.002s	sys 0.000s
I20260709 13:18:32.988440  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:33.033816  3101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.968564 10095 log.cc:927] Time spent T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:18:33.042877  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de07cb03de034f1bae53ef08d27db7a7" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:33.045585  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:32.991140 10057 raft_consensus.cc:2955] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 23 LEADER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
W20260709 13:18:33.077293 10096 log.cc:927] Time spent T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.118s	user 0.002s	sys 0.000s
I20260709 13:18:33.083159  9807 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:33.110126  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 59645.6us
I20260709 13:18:33.112243 10091 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:33.112969 10091 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:33.115196 10091 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:33.119416  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:33.127579  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:33.128710  3130 raft_consensus.cc:2393] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0930e3e7657c43bcaaa5b0778f3e08cf in current term 18: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:33.134073  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:33.135016  3835 raft_consensus.cc:2393] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 21: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:33.137312  9767 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:33.146806  3030 catalog_manager.cc:5697] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 18 to 19, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 19 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:33.148823  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:33.149974  3128 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 21: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:33.151626  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:33.156831  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:33.160027  9790 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:33.160797  9790 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:33.148945  3030 catalog_manager.cc:5697] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 18 to 23, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 23 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.162427  3030 catalog_manager.cc:5697] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 21 to 24, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 24 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.163293  9790 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:33.179272  3027 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38234 (request call id 263) took 39116 ms (client timeout 15000 ms). Trace:
I20260709 13:18:33.182986  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:33.191859  3203 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 21.
I20260709 13:18:33.164527  3030 catalog_manager.cc:5697] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.185272 10093 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:33.193468 10093 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:33.195832 10093 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:33.198331  3176 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:33.199450 10005 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:33.203451  3030 catalog_manager.cc:5697] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 12 to 17, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 17 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.214308  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:33.215075  3835 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:33.218150  3030 catalog_manager.cc:5697] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 15 to 18, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 18 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.224998  3030 catalog_manager.cc:5697] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 17 to 20, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 20 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:33.205137  3027 rpcz_store.cc:269] 0709 13:17:54.062653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.064142 (+  1489us) service_pool.cc:224] Handling call
0709 13:18:33.179000 (+39114858us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:30.687393 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:30.691769 (+  4376us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:30.691813 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:18:30.691833 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:30.692286 (+   453us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:30.692393 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:30.692424 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:30.692768 (+   344us) tablet.cc:701] Row locks acquired
0709 13:18:30.692788 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:18:30.693613 (+   825us) write_op.cc:270] Start()
0709 13:18:30.693769 (+   156us) write_op.cc:276] Timestamp: P: 1783603110693541 usec, L: 0
0709 13:18:30.693807 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:18:30.701569 (+  7762us) log.cc:844] Serialized 923 byte log entry
0709 13:18:30.807159 (+105590us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b54000a87d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc158571 00007fb3bc1eae28 00007fb3bfc25581 00007fb3bfc24d58 00007fb3bfc299f1 00007fb3bfc299a9 00007fb3bfc29939 00007fb3bfc29901 00007fb3bfc28b2d 000000000038f354 000000000038f199
0709 13:18:30.899983 (+ 92824us) op_driver.cc:464] REPLICATION: finished
0709 13:18:31.000700 (+100717us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4400022b4c. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3b8f8adb1 00007fb3b9028c85 00007fb3b90296a2 00007fb3bbd9b1db 00007fb3bbd96aaf 00007fb3b90e50ac 00007fb3c1f3fab9 00007fb3b910169b 00007fb3b90ff93f 00007fb3b9101c02 00007fb3bfc25ef0
0709 13:18:31.342825 (+342125us) write_op.cc:301] APPLY: starting
0709 13:18:31.354963 (+ 12138us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:31.391854 (+ 36891us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:31.391873 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:31.399955 (+  8082us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:31.418561 (+ 18606us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:18:31.418615 (+    54us) write_op.cc:312] APPLY: finished
0709 13:18:31.418814 (+   199us) log.cc:844] Serialized 33 byte log entry
0709 13:18:31.419156 (+   342us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:31.419266 (+   110us) write_op.cc:454] Released schema lock
0709 13:18:31.419317 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:31.419807 (+   490us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:31.419851 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2745251,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":422138,"apply.run_cpu_time_us":4863,"apply.run_wall_time_us":90579,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12503,"num_ops":2,"prepare.queue_time_us":3120,"prepare.run_cpu_time_us":15599,"prepare.run_wall_time_us":119981,"raft.queue_time_us":102789,"raft.run_cpu_time_us":33371,"raft.run_wall_time_us":329283,"replication_time_us":205937,"spinlock_wait_cycles":20604928,"thread_start_us":438001,"threads_started":4,"wal-append.queue_time_us":92686,"wal-append.run_cpu_time_us":24472,"wal-append.run_wall_time_us":1626737}]]}
I20260709 13:18:33.237679  3100 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:33.258340  3206 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:33.249783 10083 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:18:33.237483 10005 consensus_queue.cc:1048] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:18:33.269161  3840 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 LEARNER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 13:18:33.270066  3833 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 26 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:33.268698  3209 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
W20260709 13:18:33.362947  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 82198.9us
W20260709 13:18:33.363402  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 86997.2us
I20260709 13:18:33.276561  9819 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:33.359117  3840 pending_rounds.cc:85] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting all ops after (but not including) 13
I20260709 13:18:33.278780  3030 catalog_manager.cc:5697] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 11 to 12, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 12 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.366885  3840 pending_rounds.cc:107] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:18:33.369818  3840 raft_consensus.cc:2889] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:33.366314  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 86732.8us
I20260709 13:18:33.364308  9733 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:33.276150  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:33.378136  3211 raft_consensus.cc:2410] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:18:33.379227  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:33.382513  3136 raft_consensus.cc:2393] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 21: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:33.385823  9827 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:18:33.385527  9733 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:33.388129  9733 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:33.388959  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 023c1461b69c46bdb3c42ee16f303ea2 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:35176
I20260709 13:18:33.391757  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:33.269819  9902 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:33.385923  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:33.366701  9819 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:33.410558  3133 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:33.397905  3249 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:33.416805  9963 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:33.421960  3030 catalog_manager.cc:5697] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 10 to 14, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 14 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.424063  3030 catalog_manager.cc:5697] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.425112  9972 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:33.428819  9824 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:33.435750  9824 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:33.436724  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:33.380555  9994 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:33.401677 10082 consensus_meta.cc:287] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.527s	user 0.012s	sys 0.000s
W20260709 13:18:33.443614  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 46134.6us
I20260709 13:18:33.445632  9824 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:33.446488  9824 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:33.446305  3806 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:33.447623  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 80495.1us
I20260709 13:18:33.449302  9940 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:33.453256  9902 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:33.467231  3280 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:33.439580  9819 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:33.479104  3276 raft_consensus.cc:1240] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Rejecting Update request from peer 43b01d5a97e149008d543a6615219928 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:33.475430  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:33.488643  3030 catalog_manager.cc:5697] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 10 to 11, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 11 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:33.490161  3102 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:18:33.503996  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 233399us
I20260709 13:18:33.458110  9994 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:33.524549  3030 catalog_manager.cc:5697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.512445  9953 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.512509 10082 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:33.550567  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 101946us
W20260709 13:18:33.586525  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 214919us
I20260709 13:18:33.587423  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:33.593101  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 54788.5us
I20260709 13:18:33.596016  3134 raft_consensus.cc:1275] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:33.546407  3030 catalog_manager.cc:5697] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 12 to 15, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 15 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.599188  3030 catalog_manager.cc:5697] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.600744 10023 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:33.601358 10080 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:33.601857 10107 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:18:33.602253  9916 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.602453  9830 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:33.593611  9807 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:33.602963  9916 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:33.603173  9830 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:33.603865  9807 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:33.605738  9916 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:33.606469  9807 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:33.606595  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:33.608182 10028 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:33.608806 10028 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:33.610443  9733 consensus_queue.cc:1059] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:33.611230 10028 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:33.601497  9767 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:33.613673 10102 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:18:33.614426  9963 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:33.615271 10105 log.cc:927] Time spent T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:18:33.615052  9963 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:33.595908  9972 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:18:33.601989 10080 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:33.601485 10023 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:33.589473 10082 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:33.494292  9824 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:33.646461  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:33.649384  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:33.639333 10082 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:33.688441  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:33.689359  3285 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 21: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:33.690443  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:33.691210  3205 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 19: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:33.692049  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:33.692766  3135 raft_consensus.cc:2393] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 18: Already voted for candidate fc48eecc27554cb58b15193cd442b1d3 in this term.
I20260709 13:18:33.697650  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:33.701251  9997 raft_consensus.cc:493] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:33.686676  3284 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:33.701155  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:33.705179  3281 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 21.
I20260709 13:18:33.623395  9953 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:33.766849  3102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 58044.9us
W20260709 13:18:33.769546 10106 log.cc:927] Time spent T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:18:33.772713  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:33.773572  3134 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:33.792040  9830 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:33.649405  9963 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:33.803100  9997 raft_consensus.cc:515] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:33.805410  9997 leader_election.cc:290] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:33.806074  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 97890.9us
I20260709 13:18:33.807575  9994 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:33.808892 10023 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:33.809248  9894 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:33.809959  9894 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:33.811702  9902 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:33.813403  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:33.814245  3209 raft_consensus.cc:2393] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 24: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:33.814328  9994 consensus_queue.cc:1048] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:33.814600  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:33.815524 10005 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:33.818594 10080 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:33.812395  9894 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:33.824179  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:33.825503  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:33.833312  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:33.834008  3205 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 24.
I20260709 13:18:33.835150  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:33.832726  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:33.838836  3133 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 26.
I20260709 13:18:33.844993  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:33.846227  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:33.846143  3130 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:33.843659  3208 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:33.848840  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:33.850270  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:33.847074  3128 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 24.
I20260709 13:18:33.855504  3250 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:33.856954  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:33.863994  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:33.860680  9940 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.872445  3284 raft_consensus.cc:2393] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 17: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:33.878407  9953 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:33.878723  3203 raft_consensus.cc:2393] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 23: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:33.879740  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:33.879953  3835 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:33.886785  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:33.887706  3284 raft_consensus.cc:2393] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 20: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:33.887945  3285 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:33.889226 10110 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:33.889775 10110 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:33.889719  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:33.890470 10110 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:33.890759  3277 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:33.864847  3127 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:33.896739  3176 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:18:33.909422  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 54020.8us
I20260709 13:18:33.908448  3806 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:33.913885  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:33.915242  3100 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:33.922955  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:33.923121  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:33.907295  9994 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:33.923728  3281 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 23.
I20260709 13:18:33.922026 10024 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:33.936211  3100 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:33.917582  9767 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:33.930673  9994 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.930583  9943 raft_consensus.cc:2804] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:33.936949  9790 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:33.937469 10024 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:33.982240 10024 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:33.941025 10023 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:33.957605  3251 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
W20260709 13:18:33.985183  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 48964.6us
I20260709 13:18:33.977689  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97b7c75c06648e2b8f08f69dcb106af" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:33.990702  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:33.991439  3285 raft_consensus.cc:3055] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:18:33.991820  3285 raft_consensus.cc:740] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:33.990840  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:33.950459  9830 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.995247  3284 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 21.
I20260709 13:18:33.970703  9994 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:34.003556  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 48528.6us
I20260709 13:18:33.969533  9773 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:33.979384  9790 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.990931 10023 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:33.990300  9943 raft_consensus.cc:697] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 26 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:34.006297  9916 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:34.026924  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:34.019153  3285 consensus_queue.cc:260] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:34.036140  3285 raft_consensus.cc:3060] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:34.011157  9773 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:34.013104  9790 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:34.023074 10023 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:34.054165  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 64347.4us
I20260709 13:18:34.040297  9773 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:34.060884  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:34.061182  9797 raft_consensus.cc:3055] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:34.061666  9797 raft_consensus.cc:740] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:34.062677  9797 consensus_queue.cc:260] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:34.064226  9797 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:34.072341  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 023c1461b69c46bdb3c42ee16f303ea2 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:18:34.082297  3805 leader_election.cc:304] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:34.083032  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.027217  9830 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:34.104169  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 85874.1us
I20260709 13:18:34.104394  9733 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.159530 10119 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:34.160117 10119 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.160470 10119 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:34.162454 10129 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:18:34.116109  9943 consensus_queue.cc:237] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:34.167315  9503 raft_consensus.cc:2749] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:34.118420 10137 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:34.178156  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 67156.2us
I20260709 13:18:34.188767  3285 raft_consensus.cc:2468] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 26.
W20260709 13:18:34.196130  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 86216.5us
I20260709 13:18:34.208238  9830 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:34.213656  9819 consensus_meta.cc:287] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.704s	user 0.013s	sys 0.002s
I20260709 13:18:34.168223 10137 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.177614  9733 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.235945  9819 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.241663  9819 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:34.254997  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 50287.3us
I20260709 13:18:34.257267  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:34.258021  3836 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:34.260605  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:34.261404  9900 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:34.261788  9900 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.262131  9900 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.262291  9994 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:34.265596  9994 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:34.265826  3836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:34.266547  3836 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:34.260800  9773 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.268630  9773 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:34.270772  9733 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:34.271124  9790 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:34.272466 10082 consensus_meta.cc:287] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.004s
I20260709 13:18:34.272881 10082 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:34.274922 10082 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:34.276163  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:34.275027  3836 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:34.279959  3177 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:34.244359 10110 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.283720  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:34.284504  3128 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 23.
W20260709 13:18:34.298125  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 186537us
I20260709 13:18:34.303076  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:34.303706  3101 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:34.303735  3127 raft_consensus.cc:3060] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:34.305153  3203 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 18.
I20260709 13:18:34.288174 10005 raft_consensus.cc:2804] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:34.307559  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:34.320058  3842 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 26 LEADER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:34.318179  3282 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 22.
I20260709 13:18:34.326284  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:34.332237  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:34.325950 10150 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.331199  9916 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.330129 10005 raft_consensus.cc:697] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 19 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:34.322276 10024 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.349213  9773 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:34.332026 10148 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:34.357534  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:34.324715 10119 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:34.369729 10148 raft_consensus.cc:493] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:34.390213 10148 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:34.382385  3837 raft_consensus.cc:2393] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 22: Already voted for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in this term.
I20260709 13:18:34.383819  3209 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 21.
I20260709 13:18:34.385481 10005 consensus_queue.cc:237] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:34.393671  3127 raft_consensus.cc:2468] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:34.384923  9900 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:34.395951  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:34.366271  9916 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:34.396871 10123 log.cc:927] Time spent T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.362s	user 0.001s	sys 0.003s
I20260709 13:18:34.398353  9916 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:34.399350 10142 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:34.399816 10142 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.400207 10142 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:34.402034  9900 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:34.352577 10150 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.410156 10119 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 22 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:34.411154 10126 log.cc:927] Time spent T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.377s	user 0.000s	sys 0.002s
I20260709 13:18:34.413122 10024 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:34.424456  3841 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 17.
I20260709 13:18:34.427857  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:34.428588  3281 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:34.435374  3102 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:34.438256  9963 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:18:34.452286  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 131048us
I20260709 13:18:34.452490  3281 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 22.
I20260709 13:18:34.434501  3208 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 20.
I20260709 13:18:34.453687  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:34.454421  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:34.455083  3207 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:34.460644  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:34.460855  3202 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:34.461498  3208 raft_consensus.cc:2393] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 19: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:34.465059  3249 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:34.455583  9963 raft_consensus.cc:697] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
W20260709 13:18:34.509163  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 44168.8us
I20260709 13:18:34.511272  9900 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:34.511775  9900 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.512138  9900 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:34.512984  9773 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:34.513633  9773 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:34.515992  9773 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:34.516085 10150 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:34.517313 10137 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:34.517926  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:34.524235 10023 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.526876 10110 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:34.502287  3250 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:34.529668  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:34.530078 10136 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:34.539760  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.501925 10024 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:34.574007  3249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.598820 10142 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.600438  9963 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:34.537526  9916 raft_consensus.cc:2764] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:18:34.607190  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:34.631845  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:34.634357  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:34.635923  3127 raft_consensus.cc:1240] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 26 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:34.632611  3128 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 23.
I20260709 13:18:34.638108 10148 raft_consensus.cc:515] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:34.640141  3134 raft_consensus.cc:2468] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 21.
I20260709 13:18:34.640404 10148 leader_election.cc:290] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:34.648039  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:34.648263  9894 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.648860  9894 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.651090  9894 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:34.651818  3131 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:34.652232  9790 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 25 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:34.654940  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:34.655917  9900 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.656680  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:34.657501  3131 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:34.659421  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:34.660046 10023 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:34.662940  3250 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:34.665663  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:34.666647  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:34.667634  3250 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:34.669293  3136 raft_consensus.cc:2368] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 24. Current term is 25.
I20260709 13:18:34.666307  9916 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:34.630126 10024 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.677186  9767 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:34.674065  9830 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:18:34.690094  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 332236us
I20260709 13:18:34.691141  3100 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:34.691895  9827 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:34.692224  9830 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:34.692404  9827 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 21 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:34.692701  9830 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:34.693394  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:34.694026  3207 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 23.
I20260709 13:18:34.694260  9827 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.694651  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:34.695277  3206 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:34.698276  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 244686us
I20260709 13:18:34.698527  9807 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:34.698935  9807 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.699258  9807 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:34.701399 10162 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.702103  9900 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:34.701948 10162 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.704046 10162 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:34.706058  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:34.706487 10024 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:34.708036  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:34.709398  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:34.709990  3211 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:34.710057  3176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.711458  3131 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:34.712558  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:34.714560  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:34.715530  3131 raft_consensus.cc:2368] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:34.723086  3206 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 25.
I20260709 13:18:34.698093  3100 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:34.744050  9830 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.746719  9830 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:34.747398  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:34.760756  3207 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
I20260709 13:18:34.749209  9900 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:34.750892  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:34.756680  3211 raft_consensus.cc:2468] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
I20260709 13:18:34.748558  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:34.740880 10150 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:34.763474  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:34.777403  3249 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:18:34.778802  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 102753us
I20260709 13:18:34.781059  3250 leader_election.cc:400] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 24. Current term is 25.
I20260709 13:18:34.781577  3250 leader_election.cc:403] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:18:34.794751  3281 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 18.
I20260709 13:18:34.783514  9894 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:34.784996  9916 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:34.783095 10150 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 20 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:34.790288  9830 raft_consensus.cc:2804] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:34.766076  9900 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.815186  9900 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:34.826380  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:34.826910  9916 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 24. Current term is 25.
I20260709 13:18:34.827164  3276 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:34.828972  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:34.829644  3207 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:34.811826  3176 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:34.807600  9894 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.833338  3100 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:34.845012  3100 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:34.847484  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:34.847906  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:34.852456  3250 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:34.858023  3176 leader_election.cc:400] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 18. Current term is 19.
I20260709 13:18:34.859722 10141 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:34.859874  3127 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 26 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:18:34.861493  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:34.854770  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:34.844489  9963 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:34.866077  9963 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.866446  9963 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:34.866742  3840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:34.867440  3840 raft_consensus.cc:2368] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 21. Current term is 22.
I20260709 13:18:34.871677 10150 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.876559 10141 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 25 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:34.877727 10141 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:34.884101  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 358445us
I20260709 13:18:34.889801 10084 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:18:34.894484 10167 log.cc:927] Time spent T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:18:34.843426  9894 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:34.922019  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:34.930681  3837 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.947827  3207 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:34.949182  3100 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:34.910959  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:34.950493  3132 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:34.949331 10005 raft_consensus.cc:2764] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:18:34.828935  9807 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:34.960130  3102 leader_election.cc:400] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 21. Current term is 22.
I20260709 13:18:34.966060  3102 leader_election.cc:403] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:18:34.958215  3806 leader_election.cc:304] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:34.963955 10091 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:34.989185  9807 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:34.972448  9940 raft_consensus.cc:2804] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:34.990190  9940 raft_consensus.cc:697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:34.991142  9940 consensus_queue.cc:237] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:34.993228 10093 raft_consensus.cc:3060] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:34.997336 10091 raft_consensus.cc:697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:34.998448 10091 consensus_queue.cc:237] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:35.002671  3210 raft_consensus.cc:2368] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 23. Current term is 24.
W20260709 13:18:35.017220  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 164833us
I20260709 13:18:35.018250  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:35.021351 10024 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:35.022042 10024 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:35.022501 10024 raft_consensus.cc:697] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:35.023200  9767 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:35.023591  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:35.023402 10024 consensus_queue.cc:237] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:35.023762  9767 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:35.027349  9767 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:35.027937  9767 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:35.029065  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:35.029404  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:35.030459  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:35.031850  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:35.033442  3130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:35.033612  9767 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:35.034996  3276 raft_consensus.cc:1275] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 26 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:18:35.035933  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:35.036564  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:35.033458  3279 raft_consensus.cc:2368] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:35.037178  3285 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 23.
I20260709 13:18:35.038288  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:35.041193  3250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.066802  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 89184.8us
I20260709 13:18:35.066726  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5212495b02454ba6ddf4c62cf58b04" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:35.075291  3282 raft_consensus.cc:2368] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 21. Current term is 22.
I20260709 13:18:35.078814  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:35.062252 10005 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:35.126106  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:35.126767  3279 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:35.074635  9807 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.128141  3836 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:35.148753  3132 raft_consensus.cc:1275] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:35.089785 10005 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.151129  9807 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:35.154692 10093 raft_consensus.cc:2749] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703) with higher term. Message: Invalid argument: T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 21. Current term is 22.
I20260709 13:18:35.133291  9894 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:35.162346  3210 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:35.170645  9767 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:35.171801  3279 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 19.
I20260709 13:18:35.181460  3837 raft_consensus.cc:2468] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:35.190040  3278 raft_consensus.cc:2368] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 21. Current term is 22.
I20260709 13:18:35.180109 10005 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:35.183070 10154 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:18:35.127804  9830 raft_consensus.cc:697] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:35.229423  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:35.222965 10142 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:35.218695  9963 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:35.278707  9963 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:35.281527  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:35.282199  3284 raft_consensus.cc:3060] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:35.285463  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:35.285856  3128 raft_consensus.cc:2368] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 23. Current term is 24.
I20260709 13:18:35.286209  3280 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 23.
I20260709 13:18:35.247138  9807 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:35.254106  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:35.257153  9903 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:35.259208 10181 log.cc:927] Time spent T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:18:35.260166  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 115106us
W20260709 13:18:35.260663  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 115206us
I20260709 13:18:35.261879  9894 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:35.293637  9903 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:35.295225  3251 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:35.296584  9903 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:35.273377  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:35.267477  9830 consensus_queue.cc:237] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:35.274416  3249 leader_election.cc:400] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 election: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 23. Current term is 24.
I20260709 13:18:35.297724  9902 raft_consensus.cc:2804] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:18:35.272229  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 102749us
I20260709 13:18:35.302903  3249 leader_election.cc:403] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:18:35.309234  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:35.309973  3206 raft_consensus.cc:2393] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 24: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:35.318585  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
W20260709 13:18:35.334594  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 44920.4us
I20260709 13:18:35.336971  3283 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 25.
I20260709 13:18:35.340981  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:35.341246  9894 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:35.343931  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 69683.9us
I20260709 13:18:35.350036  3284 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 24.
I20260709 13:18:35.348042  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:35.371560  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:35.375197  9753 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:18:35.378466 10192 log.cc:927] Time spent T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:18:35.380875  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:35.341884  9894 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:35.382438  3249 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:35.392585  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:35.399891  3101 leader_election.cc:400] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18.
I20260709 13:18:35.400498  3280 raft_consensus.cc:1240] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:35.365550  9902 raft_consensus.cc:697] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:35.406603  3281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:35.409941  3281 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 24.
I20260709 13:18:35.403344  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:35.365350 10171 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299) with higher term. Message: Invalid argument: T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 23. Current term is 24.
I20260709 13:18:35.415791  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:35.383230 10194 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:35.401353  9900 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:35.425886  3836 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:35.399503  9753 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:35.430508  3285 raft_consensus.cc:2393] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 24: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:35.407060 10136 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:35.433593 10154 consensus_queue.cc:1048] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:18:35.457226 10172 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:35.473548 10172 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.474015 10172 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:35.483168 10005 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:35.484086  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 94565.4us
W20260709 13:18:35.485633  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 73649.3us
W20260709 13:18:35.515429  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 106959us
I20260709 13:18:35.516659  3101 leader_election.cc:400] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 21. Current term is 22.
I20260709 13:18:35.524899  3101 leader_election.cc:400] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 election: Vote denied by peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801) with higher term. Message: Invalid argument: T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 for earlier term 21. Current term is 22.
I20260709 13:18:35.465914  9902 consensus_queue.cc:237] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:35.560688 10137 consensus_queue.cc:1059] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:35.561772  9790 raft_consensus.cc:3055] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:35.563406  9790 raft_consensus.cc:740] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:35.564268  9790 consensus_queue.cc:260] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:35.565488  9790 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:35.516644 10203 consensus_queue.cc:1048] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.080s
I20260709 13:18:35.580751  3278 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:35.594081  3280 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 13:18:35.593936  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 168304us
I20260709 13:18:35.594967  3176 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:35.596686  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:35.597568 10157 raft_consensus.cc:2804] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:35.600459 10157 raft_consensus.cc:697] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 24 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:35.601408 10157 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:35.602196  3131 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:18:35.607381  3208 raft_consensus.cc:1240] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Rejecting Update request from peer 48080cf0460346769ab046a4f9457aa5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:35.616225 10121 consensus_queue.cc:1059] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:35.617209 10121 raft_consensus.cc:3055] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:35.617542 10121 raft_consensus.cc:740] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:35.617825 10005 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:35.618325 10121 consensus_queue.cc:260] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:35.619707 10121 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:35.647146  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:35.640267 10005 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:35.657562 10005 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.657982 10005 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:35.658133  3280 raft_consensus.cc:1275] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:18:35.665328  3250 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:35.666747  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 65313.8us
I20260709 13:18:35.667928  3208 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:35.670285  9894 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:35.660301 10158 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 13:18:35.672214 10200 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.673988  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:35.679776  3250 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:35.682430 10104 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:35.685635 10200 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:35.691049  3250 leader_election.cc:400] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 for earlier term 23. Current term is 24.
I20260709 13:18:35.676229  3284 raft_consensus.cc:1240] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:35.677413  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:35.693825  3131 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 23.
I20260709 13:18:35.728596  3281 raft_consensus.cc:1240] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Rejecting Update request from peer fc48eecc27554cb58b15193cd442b1d3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:35.729748  9819 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:35.730733  3209 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 25 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:18:35.731294 10204 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:35.733309  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:35.734086  3133 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 23.
I20260709 13:18:35.736399 10207 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:35.738392  9790 consensus_queue.cc:1059] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:35.739542  9790 raft_consensus.cc:3055] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:35.649009 10172 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:35.739908  9790 raft_consensus.cc:740] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:35.741437  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:35.740911  9790 consensus_queue.cc:260] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:35.742004  3132 raft_consensus.cc:3060] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:35.742708  9790 raft_consensus.cc:3060] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:35.744473 10200 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:35.747289  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:35.753160  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:35.753820  3278 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:35.758710  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:35.759473  3208 raft_consensus.cc:2393] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc48eecc27554cb58b15193cd442b1d3 in current term 24: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:35.741879 10172 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:35.765913  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:35.783200  3133 raft_consensus.cc:3060] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:35.767876 10150 consensus_queue.cc:1059] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:35.785566 10150 raft_consensus.cc:3055] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:35.785943 10150 raft_consensus.cc:740] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:35.786734 10150 consensus_queue.cc:260] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:35.787900 10150 raft_consensus.cc:3060] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:35.788305  3285 raft_consensus.cc:2410] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:18:35.757666 10194 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:35.771214  9753 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:35.777526  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:35.781383  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:35.803133  3133 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 24.
I20260709 13:18:35.792414 10005 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:35.810758 10005 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 25 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:35.815132  3278 raft_consensus.cc:2468] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 24.
I20260709 13:18:35.823750  3132 raft_consensus.cc:2468] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:35.826380  3208 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:35.826264  3250 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:35.833674  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 76594.6us
I20260709 13:18:35.828557  3176 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
W20260709 13:18:35.836212  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 63868.4us
I20260709 13:18:35.838593 10204 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:35.838734 10203 consensus_queue.cc:1048] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:35.837402  3176 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:35.855607  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:35.856261  3131 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:18:35.859268  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:35.860067  3285 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:35.845741 10005 raft_consensus.cc:2804] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:35.851337  9994 raft_consensus.cc:2804] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:35.885949  9994 raft_consensus.cc:697] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:35.887269  9994 consensus_queue.cc:237] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:35.889197  3030 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55102 (request call id 142) took 12382 ms (client timeout 15000 ms). Trace:
I20260709 13:18:35.894687  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:35.897264 10207 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:35.901261 10137 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:35.913439  3131 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 25.
W20260709 13:18:35.889861  3030 rpcz_store.cc:269] 0709 13:18:23.509317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.509627 (+   310us) service_pool.cc:224] Handling call
0709 13:18:35.875883 (+12366256us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:34.265433 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:34.266118 (+   685us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:34.266170 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:18:34.266193 (+    23us) tablet.cc:662] Decoding operations
0709 13:18:34.267354 (+  1161us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:34.267483 (+   129us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:34.267511 (+    28us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:18:34.268786 (+  1275us) tablet.cc:701] Row locks acquired
0709 13:18:34.268829 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:18:34.269014 (+   185us) write_op.cc:270] Start()
0709 13:18:34.288910 (+ 19896us) write_op.cc:276] Timestamp: P: 1783603114268948 usec, L: 0
0709 13:18:34.300025 (+ 11115us) op_driver.cc:348] REPLICATION: starting
0709 13:18:34.300796 (+   771us) log.cc:844] Serialized 5536 byte log entry
0709 13:18:34.649520 (+348724us) op_driver.cc:464] REPLICATION: finished
0709 13:18:34.889866 (+240346us) write_op.cc:301] APPLY: starting
0709 13:18:34.889973 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:35.135731 (+245758us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:35.135867 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:35.283649 (+147782us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:35.284129 (+   480us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:18:35.284216 (+    87us) write_op.cc:312] APPLY: finished
0709 13:18:35.284775 (+   559us) log.cc:844] Serialized 129 byte log entry
0709 13:18:35.285042 (+   267us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:35.346259 (+ 61217us) write_op.cc:454] Released schema lock
0709 13:18:35.373936 (+ 27677us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:35.374445 (+   509us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:35.374488 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":240054,"apply.run_cpu_time_us":24707,"apply.run_wall_time_us":484545,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62759,"num_ops":14,"prepare.queue_time_us":191907,"prepare.run_cpu_time_us":16139,"prepare.run_wall_time_us":125916,"raft.queue_time_us":216137,"raft.run_cpu_time_us":52972,"raft.run_wall_time_us":135415,"replication_time_us":349322,"thread_start_us":362784,"threads_started":4,"wal-append.queue_time_us":75384}]]}
I20260709 13:18:35.922564  3285 raft_consensus.cc:2468] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 25.
I20260709 13:18:35.919667  3176 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:35.877640 10005 raft_consensus.cc:697] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 24 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:35.935326  9903 raft_consensus.cc:2804] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:36.013576 10005 consensus_queue.cc:237] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:36.031144 10218 log.cc:927] Time spent T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:35.975610  9903 raft_consensus.cc:697] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 25 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:36.033695  9903 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:36.034516  3128 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:18:36.034931  3128 pending_rounds.cc:85] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 11
I20260709 13:18:36.035144  3128 pending_rounds.cc:107] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:18:36.035372  3128 raft_consensus.cc:2889] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.066615  3837 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:36.075899  3133 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:18:36.055528 10204 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:18:36.074323  9894 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:18:36.121459 10172 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 13:18:36.304595  3203 raft_consensus.cc:1275] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:36.311575 10121 consensus_queue.cc:1048] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:18:36.334559  3279 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:18:36.353303 10208 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:36.386638  3133 raft_consensus.cc:1275] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:18:36.387205  3133 pending_rounds.cc:85] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: Aborting all ops after (but not including) 12
I20260709 13:18:36.387492  3133 pending_rounds.cc:107] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:18:36.387801  3133 raft_consensus.cc:2889] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.429381  9900 consensus_queue.cc:1048] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:36.469238  3279 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:18:36.472939 10057 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:36.587518  3282 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:18:36.597687 10208 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:36.601519  3282 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:18:36.601982  3282 pending_rounds.cc:85] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5: Aborting all ops after (but not including) 10
I20260709 13:18:36.602311  3282 pending_rounds.cc:107] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:18:36.602669  3282 raft_consensus.cc:2889] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.604981 10209 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:36.612538  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 66795.1us
W20260709 13:18:36.614581  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 73357.9us
I20260709 13:18:36.637142  3132 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:18:36.662014  3130 raft_consensus.cc:1275] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:18:36.666375  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 46832.7us
I20260709 13:18:36.655714 10057 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
W20260709 13:18:36.674366 10236 log.cc:927] Time spent T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:36.675433 10057 consensus_queue.cc:1048] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:36.700369  3133 raft_consensus.cc:1275] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:18:36.759414  9903 consensus_queue.cc:1048] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:18:36.814553 10194 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.815132 10194 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:36.822070 10194 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:36.824796  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:36.825573  3280 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 22.
I20260709 13:18:36.826953  3101 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:36.828907  9773 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:36.829391  9773 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.832263  3837 raft_consensus.cc:3060] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 LEARNER]: Advancing to term 25
I20260709 13:18:36.834829  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:36.851791  3030 catalog_manager.cc:5697] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:36.861382  3837 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 LEARNER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:18:36.854727  3030 catalog_manager.cc:5697] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 14 to 20, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 20 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.850360  9773 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:36.870903 10157 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:18:36.947482  3030 catalog_manager.cc:5697] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 14 to 15, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 15 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:36.934890 10157 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:36.960503 10157 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:37.076258  3030 catalog_manager.cc:5697] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.078496  3030 catalog_manager.cc:5697] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 18 to 21, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 21 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.080693  3030 catalog_manager.cc:5697] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 17 to 19, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 19 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:37.109602 10251 raft_consensus.cc:1064] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:18:37.110558 10157 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:37.094105  9773 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:37.132184  9773 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:37.135658  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:37.136530  3206 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Advancing to term 23
W20260709 13:18:37.150213  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 191933us
I20260709 13:18:37.155449  3030 catalog_manager.cc:5697] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 21 to 26, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 26 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.178589 10251 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 14, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:37.182883  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "fc48eecc27554cb58b15193cd442b1d3" is_pre_election: true
I20260709 13:18:37.183761  3132 raft_consensus.cc:2368] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 22. Current term is 23.
I20260709 13:18:37.192325  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:37.193156  3278 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 22: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:37.222592  3842 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 LEARNER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 13:18:37.224980  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 63677.1us
I20260709 13:18:37.225363 10254 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:37.229351  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:37.229972  3278 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:37.208848  3206 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 23.
I20260709 13:18:37.233860  3100 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:37.234709 10207 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:37.241462 10207 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 23 LEADER]: Becoming Leader. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:37.242337 10207 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:37.257827  3030 catalog_manager.cc:5697] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 15 to 19, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 19 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:37.259912  3030 catalog_manager.cc:5697] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 15 to 20, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 20 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.264304  3278 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 23.
I20260709 13:18:37.265600  3030 catalog_manager.cc:5697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 14 to 17, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 17 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:37.270138  3280 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:18:37.280221 10005 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:18:37.291451  3176 leader_election.cc:400] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 22. Current term is 23.
I20260709 13:18:37.291860  3176 leader_election.cc:403] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:37.296324 10005 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323) with higher term. Message: Invalid argument: T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 for earlier term 22. Current term is 23.
I20260709 13:18:37.291636  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:37.325996  3030 catalog_manager.cc:5697] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 11 to 13, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 13 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:37.326891  3133 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:18:37.327567  3030 catalog_manager.cc:5697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 14 to 15, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 15 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:37.328910  3030 catalog_manager.cc:5697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 12 to 15, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 15 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:37.330207  3030 catalog_manager.cc:5697] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 14 to 16, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 16 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:37.331943  3030 catalog_manager.cc:5697] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:37.357743  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 023c1461b69c46bdb3c42ee16f303ea2 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:35176
I20260709 13:18:37.357792  3030 catalog_manager.cc:5697] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index -1 to 13, term changed from 17 to 23, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66), NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 23 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:37.365958 10251 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:37.370719 10209 raft_consensus.cc:2955] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 25 LEADER]: Committing config change with OpId 25.16: config changed from index 13 to 16, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:18:37.377876  3028 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38234 (request call id 262) took 66357 ms (client timeout 15000 ms). Trace:
W20260709 13:18:37.378383  3028 rpcz_store.cc:269] 0709 13:17:31.020842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.021245 (+   403us) service_pool.cc:224] Handling call
0709 13:18:37.377774 (+66356529us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7884,"reported_tablets":51}
I20260709 13:18:37.385795  3280 raft_consensus.cc:2955] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 13 to 16, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:37.400081  3842 raft_consensus.cc:2955] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 13 to 16, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:37.406322  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 023c1461b69c46bdb3c42ee16f303ea2 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:18:37.418792  3133 raft_consensus.cc:2955] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 13 to 16, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:37.575254  3133 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d682925c4b46799576472fe9f97a07"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:18:37.575913  3133 raft_consensus.cc:606] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:37.576260  3133 raft_consensus.cc:614] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:37.643973  3209 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:18:37.645690 10207 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:37.736709  3280 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:18:37.739092  9819 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:37.761873  3030 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55102 (request call id 143) took 1210 ms. Trace:
I20260709 13:18:37.762450  3030 rpcz_store.cc:276] 0709 13:18:36.551297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.557207 (+  5910us) service_pool.cc:224] Handling call
0709 13:18:37.761784 (+1204577us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:37.418541 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:37.419104 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:37.419135 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:18:37.419154 (+    19us) tablet.cc:662] Decoding operations
0709 13:18:37.440328 (+ 21174us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:37.440419 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:37.440451 (+    32us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:18:37.462701 (+ 22250us) tablet.cc:701] Row locks acquired
0709 13:18:37.462724 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:18:37.462874 (+   150us) write_op.cc:270] Start()
0709 13:18:37.471303 (+  8429us) write_op.cc:276] Timestamp: P: 1783603117462826 usec, L: 0
0709 13:18:37.471541 (+   238us) op_driver.cc:348] REPLICATION: starting
0709 13:18:37.472282 (+   741us) log.cc:844] Serialized 6292 byte log entry
0709 13:18:37.545760 (+ 73478us) op_driver.cc:464] REPLICATION: finished
0709 13:18:37.589553 (+ 43793us) write_op.cc:301] APPLY: starting
0709 13:18:37.589636 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:37.646767 (+ 57131us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:37.646877 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:37.718458 (+ 71581us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:37.723566 (+  5108us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:18:37.723837 (+   271us) write_op.cc:312] APPLY: finished
0709 13:18:37.724271 (+   434us) log.cc:844] Serialized 148 byte log entry
0709 13:18:37.725148 (+   877us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:37.725334 (+   186us) write_op.cc:454] Released schema lock
0709 13:18:37.725397 (+    63us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":396589,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":43528,"apply.run_cpu_time_us":24378,"apply.run_wall_time_us":170798,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71135,"num_ops":16,"prepare.queue_time_us":50132,"prepare.run_cpu_time_us":41296,"prepare.run_wall_time_us":99529,"raft.queue_time_us":18922,"raft.run_cpu_time_us":4928,"raft.run_wall_time_us":23902,"replication_time_us":74057,"thread_start_us":122617,"threads_started":4,"wal-append.queue_time_us":49420}]]}
I20260709 13:18:37.881484  3842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37a53418fbf14b998493923afc272c3c"
dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:39244
I20260709 13:18:37.882148  3842 raft_consensus.cc:606] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:37.887312  3280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:37.887918  3280 raft_consensus.cc:606] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:37.888252  3280 raft_consensus.cc:614] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:37.890967  3280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:37.891502  3280 raft_consensus.cc:606] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:37.893991  3280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da022fb530574c2ba921df0848818f6b"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:35794
I20260709 13:18:37.894425  3280 raft_consensus.cc:606] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:37.894707  3280 raft_consensus.cc:614] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:37.895740  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:37.897612  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:38.022677  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 023c1461b69c46bdb3c42ee16f303ea2 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:35176
I20260709 13:18:38.036800  3030 catalog_manager.cc:5697] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 16 to 18, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 18 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:38.039202  3030 catalog_manager.cc:5697] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 13 to 16, term changed from 23 to 25, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:38.069568 10185 raft_consensus.cc:993] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:18:38.070101 10185 raft_consensus.cc:1081] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:18:38.077255  3209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37a53418fbf14b998493923afc272c3c"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:38892
I20260709 13:18:38.077826  3209 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:38.078209  3209 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:38.101823  3029 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38234 (request call id 260) took 105931 ms (client timeout 15000 ms). Trace:
W20260709 13:18:38.102505  3029 rpcz_store.cc:269] 0709 13:16:52.170195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.170914 (+   719us) service_pool.cc:224] Handling call
0709 13:18:38.101697 (+105930783us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67223,"reported_tablets":49}
I20260709 13:18:38.068171  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 023c1461b69c46bdb3c42ee16f303ea2 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:18:38.195824  3209 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:38.202987  3209 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Requested vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:38.204489  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: true dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:38.205199  3837 raft_consensus.cc:3055] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:38.205509  3837 raft_consensus.cc:740] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:38.206323  3837 consensus_queue.cc:260] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:38.207728  3837 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:38.222968  3837 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:18:38.224404  3177 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: 
I20260709 13:18:38.225478 10274 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:38.226065 10274 raft_consensus.cc:697] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:38.226998 10274 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:38.246480  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:38.247244  3280 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:38.259604  3280 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 13.
I20260709 13:18:38.261610  3034 catalog_manager.cc:5697] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 17 to 19, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 19 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.264577  3034 catalog_manager.cc:5697] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 14 to 18, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 18 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.269374  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 023c1461b69c46bdb3c42ee16f303ea2 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:35176
I20260709 13:18:38.271550  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 023c1461b69c46bdb3c42ee16f303ea2 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:18:38.272328  3034 catalog_manager.cc:5697] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:38.281137  3032 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38234 (request call id 261) took 83557 ms (client timeout 15000 ms). Trace:
W20260709 13:18:38.283164  3032 rpcz_store.cc:269] 0709 13:17:14.723243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.723460 (+   217us) service_pool.cc:224] Handling call
0709 13:18:38.280922 (+83557462us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39873,"reported_tablets":51}
I20260709 13:18:38.282061  3034 catalog_manager.cc:5697] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 12 to 13, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 13 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.292532  3034 catalog_manager.cc:5697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 14 to 18, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 18 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.294546  3034 catalog_manager.cc:5697] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 16 to 18, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 18 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.296495  3034 catalog_manager.cc:5697] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 15 to 19, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 19 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.298739  3034 catalog_manager.cc:5697] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.303447  3034 catalog_manager.cc:5697] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 16 to 17, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 17 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.309496  3034 catalog_manager.cc:5697] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 14 to 17, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 17 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.316356  3034 catalog_manager.cc:5697] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.318001  3034 catalog_manager.cc:5697] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.319491  3034 catalog_manager.cc:5697] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 16 to 19, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 19 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.323909  3034 catalog_manager.cc:5697] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.337710  3034 catalog_manager.cc:5697] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 13 to 14, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 14 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.345595  3034 catalog_manager.cc:5697] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 14 to 19, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 19 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.365119  3034 catalog_manager.cc:5697] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.382506  3034 catalog_manager.cc:5697] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: term changed from 14 to 17, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 17 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.477538 10245 raft_consensus.cc:993] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:18:38.478034 10245 raft_consensus.cc:1081] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:18:38.486536  3209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34342
I20260709 13:18:38.487100  3209 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:38.487435  3209 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:38.527216  3209 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:38.538908  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:38.539556  3132 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:38.542332  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:38.543006  3280 raft_consensus.cc:3055] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:38.543303  3280 raft_consensus.cc:740] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:38.544179  3280 consensus_queue.cc:260] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:38.545341  3280 raft_consensus.cc:3060] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:38.548309  3132 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 22.
I20260709 13:18:38.549532  3209 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:38.552541  3176 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:38.553586 10172 raft_consensus.cc:2804] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:38.554126 10172 raft_consensus.cc:697] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 22 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:38.555080 10172 consensus_queue.cc:237] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:38.571055  3280 raft_consensus.cc:2468] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 22.
I20260709 13:18:38.645942  3028 catalog_manager.cc:5697] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 17 to 24, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 24 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.651636  3028 catalog_manager.cc:5697] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 14 to 22, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 22 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:38.652724  3034 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38218 (request call id 246) took 28878 ms (client timeout 15000 ms). Trace:
W20260709 13:18:38.653565  3034 rpcz_store.cc:269] 0709 13:18:09.774696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.788859 (+ 14163us) service_pool.cc:224] Handling call
0709 13:18:38.652623 (+28863764us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:38.441713 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:38.442285 (+   572us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:38.442322 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:18:38.442341 (+    19us) tablet.cc:662] Decoding operations
0709 13:18:38.443912 (+  1571us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:38.443974 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:38.444006 (+    32us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:18:38.445465 (+  1459us) tablet.cc:701] Row locks acquired
0709 13:18:38.445487 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:18:38.445669 (+   182us) write_op.cc:270] Start()
0709 13:18:38.445794 (+   125us) write_op.cc:276] Timestamp: P: 1783603118445618 usec, L: 0
0709 13:18:38.445820 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:18:38.446610 (+   790us) log.cc:844] Serialized 7080 byte log entry
0709 13:18:38.449037 (+  2427us) op_driver.cc:464] REPLICATION: finished
0709 13:18:38.449533 (+   496us) write_op.cc:301] APPLY: starting
0709 13:18:38.449609 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:38.510710 (+ 61101us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:38.510819 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:38.564243 (+ 53424us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:38.564553 (+   310us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:18:38.564604 (+    51us) write_op.cc:312] APPLY: finished
0709 13:18:38.565032 (+   428us) log.cc:844] Serialized 164 byte log entry
0709 13:18:38.577933 (+ 12901us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.578154 (+   221us) write_op.cc:454] Released schema lock
0709 13:18:38.579999 (+  1845us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:38.580416 (+   417us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.580449 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15831,"reported_tablets":50,"spinlock_wait_cycles":14720,"child_traces":[["op",{"apply.queue_time_us":250,"apply.run_cpu_time_us":23267,"apply.run_wall_time_us":130827,"cfile_cache_hit":72,"cfile_cache_hit_bytes":75384,"num_ops":18,"prepare.queue_time_us":139,"prepare.run_cpu_time_us":5155,"prepare.run_wall_time_us":7273,"replication_time_us":3071,"spinlock_wait_cycles":12672}]]}
I20260709 13:18:38.653944  3028 catalog_manager.cc:5697] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 21 to 25, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 25 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.660584  3028 catalog_manager.cc:5697] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 15 to 18, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 18 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.662366  3028 catalog_manager.cc:5697] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 13 to 15, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 15 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.664197  3028 catalog_manager.cc:5697] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 12 to 20, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 20 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.681985  3028 catalog_manager.cc:5697] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.684106  3028 catalog_manager.cc:5697] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 11 to 16, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 16 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.685672  3028 catalog_manager.cc:5697] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 19 to 23, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 23 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.687352  3028 catalog_manager.cc:5697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 18 to 19, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 19 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.688954  3028 catalog_manager.cc:5697] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 18 to 24, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 24 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.702836  3028 catalog_manager.cc:5697] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 16 to 20, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 20 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.704461  3028 catalog_manager.cc:5697] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 16 to 21, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 21 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.706105  3028 catalog_manager.cc:5697] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 17 to 21, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 21 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.707963  3028 catalog_manager.cc:5697] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 17 to 20, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 20 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.720198  3028 catalog_manager.cc:5697] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.721797  3028 catalog_manager.cc:5697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 17 to 19, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 19 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.741768  3028 catalog_manager.cc:5697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.743386  3028 catalog_manager.cc:5697] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 17 to 21, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 21 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.744839  3028 catalog_manager.cc:5697] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.754549  3028 catalog_manager.cc:5697] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.756392  3028 catalog_manager.cc:5697] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 14 to 18, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 18 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.758411  3028 catalog_manager.cc:5697] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 20 to 23. New cstate: current_term: 23 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.759935  3028 catalog_manager.cc:5697] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.786024  3028 catalog_manager.cc:5697] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.788112  3028 catalog_manager.cc:5697] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 15 to 20, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65). New cstate: current_term: 20 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } }
I20260709 13:18:38.800082  3280 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:18:38.801671  3837 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:18:38.804474 10005 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:38.813174 10172 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:18:38.898574  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:39.005841  3842 consensus_queue.cc:237] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:39.121737  3279 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:39.123967 10280 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:18:39.157779  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 148479us
I20260709 13:18:39.170567  3133 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:18:39.183246 10293 log.cc:927] Time spent T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:18:39.190318 10284 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:39.202550  3278 raft_consensus.cc:1275] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:39.207608 10284 consensus_queue.cc:1048] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:39.217839  3128 raft_consensus.cc:1275] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:39.226909  3285 raft_consensus.cc:2955] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 6 to 12, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:39.252393  3034 catalog_manager.cc:5697] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 12 to 13, leader changed from 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 13 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:39.224426  9940 raft_consensus.cc:2955] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 6 to 12, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:39.302798  3028 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38226 (request call id 257) took 1208 ms. Trace:
I20260709 13:18:39.316576 10290 consensus_queue.cc:1048] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:39.364562  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 57320.7us
I20260709 13:18:39.307619  3028 rpcz_store.cc:276] 0709 13:18:38.094222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.094772 (+   550us) service_pool.cc:224] Handling call
0709 13:18:38.128739 (+ 33967us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b54000a87d4. stack: 00007fb3b90d0343 00007fb3b90d0240 00007fb3b8a5f1d4 00007fb3c279d304 00007fb3c279d299 00007fb3bc159090 00007fb3bc1f7f3a 00007fb3c1fae1cc 00007fb3c20ac37e 00007fb3c056d2a4 00007fb3c056d232 00007fb3c056d161 00007fb3c056d0dc 00007fb3c056c392 00007fb3ba52a48c 00007fb3ba5298c6
0709 13:18:39.302735 (+1173996us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:38.894628 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:38.895169 (+   541us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:38.895205 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:18:38.895218 (+    13us) tablet.cc:662] Decoding operations
0709 13:18:38.896946 (+  1728us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:38.897002 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:38.897040 (+    38us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:18:38.899328 (+  2288us) tablet.cc:701] Row locks acquired
0709 13:18:38.899343 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:18:38.899499 (+   156us) write_op.cc:270] Start()
0709 13:18:38.899621 (+   122us) write_op.cc:276] Timestamp: P: 1783603118899447 usec, L: 0
0709 13:18:38.899642 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:18:38.900975 (+  1333us) log.cc:844] Serialized 10160 byte log entry
0709 13:18:38.919743 (+ 18768us) op_driver.cc:464] REPLICATION: finished
0709 13:18:38.920401 (+   658us) write_op.cc:301] APPLY: starting
0709 13:18:38.920486 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:39.117818 (+197332us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:39.117920 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:39.226633 (+108713us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:39.226979 (+   346us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 13:18:39.227038 (+    59us) write_op.cc:312] APPLY: finished
0709 13:18:39.227551 (+   513us) log.cc:844] Serialized 228 byte log entry
0709 13:18:39.227755 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.227990 (+   235us) write_op.cc:454] Released schema lock
0709 13:18:39.228059 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:39.228491 (+   432us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.228525 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14250,"reported_tablets":51,"spinlock_wait_cycles":17616640,"child_traces":[["op",{"apply.queue_time_us":417,"apply.run_cpu_time_us":36134,"apply.run_wall_time_us":308044,"cfile_cache_hit":104,"cfile_cache_hit_bytes":108888,"num_ops":26,"prepare.queue_time_us":1956,"prepare.run_cpu_time_us":6014,"prepare.run_wall_time_us":6655,"replication_time_us":19923}]]}
W20260709 13:18:39.405534  3100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 91474.9us
W20260709 13:18:39.406157  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 92081.5us
I20260709 13:18:39.429216  3021 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7f4a8a614fca4531aab11f5963396f62 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
W20260709 13:18:39.444765  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 47657.6us
I20260709 13:18:39.470184  3028 catalog_manager.cc:5697] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 21 to 22, leader changed from 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 22 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:39.484361  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 99646.3us
I20260709 13:18:39.520183  3206 consensus_queue.cc:237] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:39.551928  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 023c1461b69c46bdb3c42ee16f303ea2 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:35176
I20260709 13:18:39.567269  3128 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:18:39.570323  3837 raft_consensus.cc:1275] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:18:39.570719 10286 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:18:39.572296 10005 consensus_queue.cc:1048] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:18:39.573577  3132 raft_consensus.cc:2955] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 6 to 12, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:18:39.587558  3031 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38234 (request call id 264) took 26055 ms (client timeout 15000 ms). Trace:
W20260709 13:18:39.598412  3031 rpcz_store.cc:269] 0709 13:18:13.531783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.532911 (+  1128us) service_pool.cc:224] Handling call
0709 13:18:39.587344 (+26054433us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":856,"reported_tablets":51}
I20260709 13:18:39.634909  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 023c1461b69c46bdb3c42ee16f303ea2 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:18:39.654996 10274 raft_consensus.cc:2955] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 25 LEADER]: Committing config change with OpId 25.17: config changed from index 16 to 17, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:39.658641  3837 raft_consensus.cc:2955] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:39.672219  3034 catalog_manager.cc:5697] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 6 to 12, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New cstate: current_term: 15 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.679245  3128 raft_consensus.cc:2955] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:39.706208  3199 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f4a8a614fca4531aab11f5963396f62 with delete_type TABLET_DATA_TOMBSTONED (TS 43b01d5a97e149008d543a6615219928 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:39966
I20260709 13:18:39.748529 10313 tablet_replica.cc:333] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:39.801715  3019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ae5c762a7f347f4a2de941d47ed1903 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:39.810221  3026 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38234 (request call id 265) took 8182 ms. Trace:
I20260709 13:18:39.810763  3026 rpcz_store.cc:276] 0709 13:18:31.627425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.638057 (+ 10632us) service_pool.cc:224] Handling call
0709 13:18:39.810015 (+8171958us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":423305,"reported_tablets":51}
I20260709 13:18:39.858352 10313 raft_consensus.cc:2243] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.862403 10313 raft_consensus.cc:2272] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.870563 10313 ts_tablet_manager.cc:1916] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:39.878638  3034 catalog_manager.cc:5697] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 16 to 17, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New cstate: current_term: 25 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:39.931945 10313 ts_tablet_manager.cc:1929] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:18:39.934399 10313 log.cc:1199] T 7f4a8a614fca4531aab11f5963396f62 P 43b01d5a97e149008d543a6615219928: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root/wals/7f4a8a614fca4531aab11f5963396f62
I20260709 13:18:39.936355  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ae5c762a7f347f4a2de941d47ed1903 with delete_type TABLET_DATA_TOMBSTONED (TS 48080cf0460346769ab046a4f9457aa5 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:35176
I20260709 13:18:39.936859  3019 catalog_manager.cc:5028] TS 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): tablet 7f4a8a614fca4531aab11f5963396f62 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:18:39.937541 10310 tablet_replica.cc:333] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:39.975436 10310 raft_consensus.cc:2243] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.976644 10310 raft_consensus.cc:2272] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.980054 10310 ts_tablet_manager.cc:1916] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:40.044195 10310 ts_tablet_manager.cc:1929] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 25.16
I20260709 13:18:40.044659 10310 log.cc:1199] T 2ae5c762a7f347f4a2de941d47ed1903 P 48080cf0460346769ab046a4f9457aa5: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root/wals/2ae5c762a7f347f4a2de941d47ed1903
I20260709 13:18:40.047523  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 2ae5c762a7f347f4a2de941d47ed1903 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
W20260709 13:18:40.107457  3020 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 59972us
I20260709 13:18:40.174420  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:40.223737  3025 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38218 (request call id 247) took 9279 ms. Trace:
I20260709 13:18:40.226462  3025 rpcz_store.cc:276] 0709 13:18:30.944654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.945424 (+   770us) service_pool.cc:224] Handling call
0709 13:18:40.223643 (+9278219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75129,"reported_tablets":50}
I20260709 13:18:40.294929  3199 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f4a8a614fca4531aab11f5963396f62 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:39966
W20260709 13:18:40.295400  3033 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38226 (request call id 256) took 17312 ms (client timeout 15000 ms). Trace:
I20260709 13:18:40.296996  3019 catalog_manager.cc:5028] TS 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): tablet 7f4a8a614fca4531aab11f5963396f62 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
W20260709 13:18:40.300608  3033 rpcz_store.cc:269] 0709 13:18:22.982860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.983498 (+   638us) service_pool.cc:224] Handling call
0709 13:18:40.295212 (+17311714us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29654,"reported_tablets":51}
I20260709 13:18:40.301115  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ae5c762a7f347f4a2de941d47ed1903 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 16 (current committed config index is 17)) from {username='slave'} at 127.0.0.1:35176
I20260709 13:18:40.303238  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 2ae5c762a7f347f4a2de941d47ed1903 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:18:40.347759  3131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:18:40.348474  3131 raft_consensus.cc:606] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:40.354828  3131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:18:40.355556  3131 raft_consensus.cc:606] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:40.362856  3128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56db43db40f644309c6db08523b1b033"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:18:40.363588  3128 raft_consensus.cc:606] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Received request to transfer leadership to TS 43b01d5a97e149008d543a6615219928
I20260709 13:18:40.372658 10201 raft_consensus.cc:993] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:18:40.373277 10201 raft_consensus.cc:1081] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Signalling peer 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:18:40.376380  3280 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:33906
I20260709 13:18:40.376957  3280 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.377317  3280 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:40.372848  3128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:18:40.382182  3128 raft_consensus.cc:606] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:40.385568  3128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:18:40.386519  3128 raft_consensus.cc:606] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:40.389736  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:40.391615  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:40.395078  3280 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:40.415963  3280 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:40.416574  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:40.416949  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:40.417304  3128 raft_consensus.cc:3055] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:40.417662  3202 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:40.417672  3128 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:40.422107  3128 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:40.423593  3128 raft_consensus.cc:3060] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:40.433005 10201 raft_consensus.cc:993] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:18:40.433627 10201 raft_consensus.cc:1081] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Signalling peer 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:18:40.435678  3278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:33906
I20260709 13:18:40.436215  3278 raft_consensus.cc:493] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.436527  3278 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:40.439400  3202 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:40.445899  3249 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:40.447005 10314 raft_consensus.cc:2804] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:40.447533 10314 raft_consensus.cc:697] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:40.448493 10314 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:40.450907 10299 raft_consensus.cc:993] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:18:40.451442 10299 raft_consensus.cc:1081] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Signalling peer 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:18:40.453146  3279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:33906
I20260709 13:18:40.453725  3279 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.454109  3279 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:40.455936  3278 raft_consensus.cc:515] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:40.458918  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:40.460436  3202 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:40.462698 10285 raft_consensus.cc:993] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:18:40.463765 10285 raft_consensus.cc:1081] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Signalling peer 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:18:40.462699  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104b1eb7d49f449095e30c69e8680096" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:40.465425  3131 raft_consensus.cc:3055] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:40.465760  3131 raft_consensus.cc:740] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:40.466511  3131 consensus_queue.cc:260] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:40.467608  3131 raft_consensus.cc:3060] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:40.471312  3285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:33906
I20260709 13:18:40.471903  3285 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.472234  3285 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:40.472301  3278 leader_election.cc:290] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:40.444321  3128 raft_consensus.cc:2468] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:40.486930  3131 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:40.489531  3250 leader_election.cc:304] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:40.490499 10307 raft_consensus.cc:2804] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:40.491081 10307 raft_consensus.cc:697] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:40.492108 10307 consensus_queue.cc:237] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:40.488860  3279 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:40.489859  3285 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:40.502630  3202 raft_consensus.cc:2468] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:40.504871  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:40.505923  3279 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:40.504796  3033 catalog_manager.cc:5697] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 18 to 19, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 19 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:40.506898  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:40.507429  3209 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:40.510463  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:40.511173  3128 raft_consensus.cc:3055] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:40.511504  3128 raft_consensus.cc:740] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:40.512308  3128 consensus_queue.cc:260] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:40.515992  3128 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:40.505820  3131 raft_consensus.cc:3055] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:40.528841  3131 raft_consensus.cc:740] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:40.533702  3131 consensus_queue.cc:260] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:40.535132  3131 raft_consensus.cc:3060] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:40.535658  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:40.536273  3837 raft_consensus.cc:3060] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:40.527886  3209 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:40.540896  3249 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:40.541894 10307 raft_consensus.cc:2804] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:40.542528 10307 raft_consensus.cc:697] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:40.543535 10307 consensus_queue.cc:237] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:40.545773  3837 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:40.534082  3285 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:40.552871  3251 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:40.553867 10314 raft_consensus.cc:2804] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:40.554383 10314 raft_consensus.cc:697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:40.555306 10314 consensus_queue.cc:237] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:40.561612  3128 raft_consensus.cc:2468] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:40.565611  3131 raft_consensus.cc:2468] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:40.598286  3033 catalog_manager.cc:5697] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 17 to 18, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 18 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:40.600311  3033 catalog_manager.cc:5697] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 19 to 20, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 20 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:40.602147  3033 catalog_manager.cc:5697] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 15 to 16, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 16 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:40.797111 10299 raft_consensus.cc:993] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:18:40.797695 10299 raft_consensus.cc:1081] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Signalling peer 43b01d5a97e149008d543a6615219928 to start an election
I20260709 13:18:40.804168  3206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56db43db40f644309c6db08523b1b033"
dest_uuid: "43b01d5a97e149008d543a6615219928"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:18:40.804762  3206 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.805123  3206 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:40.813517  3206 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:40.815701  3206 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:40.816828  3131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:40.817495  3131 raft_consensus.cc:3055] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:40.817662  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:40.817813  3131 raft_consensus.cc:740] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:40.818351  3842 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:40.818964  3131 consensus_queue.cc:260] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:40.820366  3131 raft_consensus.cc:3060] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:40.827075  3842 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:40.829550  3131 raft_consensus.cc:2468] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 17.
I20260709 13:18:40.842443  3176 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:40.844172 10274 raft_consensus.cc:2804] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:40.844728 10274 raft_consensus.cc:697] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:40.845731 10274 consensus_queue.cc:237] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:40.888762  3033 catalog_manager.cc:5697] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 16 to 17, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 17 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:40.966245  3202 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:40.968747  3131 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:40.969995 10314 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:40.970616 10245 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:41.021440  3131 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:41.023247 10245 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:41.078141  3206 raft_consensus.cc:1275] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:41.080178  3209 raft_consensus.cc:1275] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:41.098759  3842 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:41.175303 10333 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:41.187618  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 85882.2us
I20260709 13:18:41.186244 10333 consensus_queue.cc:1048] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:18:41.186201 10331 consensus_queue.cc:1048] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 13:18:41.247663  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 61518.3us
I20260709 13:18:41.256507  3132 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:41.311157  3837 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:41.313023 10277 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:41.340596 10333 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:18:41.377676  3132 raft_consensus.cc:1275] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:41.392606  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:41.393870 10347 consensus_queue.cc:1048] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:41.494925  3280 consensus_queue.cc:237] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:41.519793  3132 raft_consensus.cc:1275] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:18:41.523262  3251 consensus_peers.cc:597] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01cb424e009f49c2a8944cc68a07dd66. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:41.528096 10349 log.cc:927] Time spent T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:41.528389  3202 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:41.547909  3128 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:41.552390 10343 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:41.553722 10277 consensus_queue.cc:1048] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:41.556216 10347 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:18:41.651455  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 49056.3us
I20260709 13:18:41.682022 10331 raft_consensus.cc:2955] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:41.683869  3131 raft_consensus.cc:2955] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
W20260709 13:18:41.713225 10355 log.cc:927] Time spent T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:18:41.714789  3031 catalog_manager.cc:5697] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index -1 to 10, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 18 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:41.732733  3285 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:41.771517  3206 raft_consensus.cc:2955] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
W20260709 13:18:41.785869  3251 consensus_peers.cc:597] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b205eb6f14c40c88b346e392de18687. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.792866  3208 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:41.806607  3128 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:41.810881 10343 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:41.826905 10331 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:41.860617 10333 raft_consensus.cc:2955] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:41.865111  3202 raft_consensus.cc:2955] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:41.887974  3131 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:41.893170  3025 catalog_manager.cc:5697] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index -1 to 13, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 18 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:41.924885  3132 raft_consensus.cc:2955] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:41.951385  3206 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:41.953532  3279 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:41.953343 10201 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:18:41.954886  3102 consensus_peers.cc:597] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c209ebcbec0e4e4ba79f8473c2f4d39b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.957715 10353 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:42.009904 10353 raft_consensus.cc:2955] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:42.021291  3206 raft_consensus.cc:2955] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:42.098810  3285 raft_consensus.cc:2955] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:42.091396  3033 catalog_manager.cc:5697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index -1 to 10, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 18 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:42.130136 10371 ts_tablet_manager.cc:933] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:42.160555 10371 tablet_copy_client.cc:323] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:18:42.163640  3294 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet 01cb424e009f49c2a8944cc68a07dd66 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:18:42.164302  3294 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet 01cb424e009f49c2a8944cc68a07dd66 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-01cb424e009f49c2a8944cc68a07dd66
I20260709 13:18:42.184818  3294 tablet_copy_source_session.cc:215] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:42.192866 10371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01cb424e009f49c2a8944cc68a07dd66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.218215 10371 tablet_copy_client.cc:806] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:42.218951 10371 tablet_copy_client.cc:670] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:42.223779 10371 tablet_copy_client.cc:538] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:42.234498 10371 tablet_bootstrap.cc:492] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:18:42.239822  3206 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:18:42.247958  3177 consensus_peers.cc:597] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94bb18481fd64fec92315ec868c651f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.252307  3280 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:42.263835 10341 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:42.271855  3128 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:42.273577 10341 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:42.289291 10361 raft_consensus.cc:2955] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:42.297019  3280 raft_consensus.cc:2955] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:42.331262  3132 raft_consensus.cc:2955] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:42.343230 10379 ts_tablet_manager.cc:933] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:42.374981  3025 catalog_manager.cc:5697] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index -1 to 14, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 23 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:42.409866 10379 tablet_copy_client.cc:323] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:18:42.414065  3294 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet 7b205eb6f14c40c88b346e392de18687 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:18:42.414654  3294 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet 7b205eb6f14c40c88b346e392de18687 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-7b205eb6f14c40c88b346e392de18687
I20260709 13:18:42.428045  3294 tablet_copy_source_session.cc:215] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:18:42.430968 10380 log.cc:927] Time spent T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: Append to log took a long time: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:18:42.463371 10379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b205eb6f14c40c88b346e392de18687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.480564 10371 tablet_bootstrap.cc:492] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:42.504347  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:42.505337 10383 ts_tablet_manager.cc:933] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323)
I20260709 13:18:42.548070 10383 tablet_copy_client.cc:323] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.65:41323
I20260709 13:18:42.552861 10371 tablet_bootstrap.cc:492] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:18:42.553930 10371 ts_tablet_manager.cc:1403] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.320s	user 0.045s	sys 0.000s
I20260709 13:18:42.554708  3145 tablet_copy_service.cc:140] P fc48eecc27554cb58b15193cd442b1d3: Received BeginTabletCopySession request for tablet c209ebcbec0e4e4ba79f8473c2f4d39b from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:57442)
I20260709 13:18:42.555282  3145 tablet_copy_service.cc:161] P fc48eecc27554cb58b15193cd442b1d3: Beginning new tablet copy session on tablet c209ebcbec0e4e4ba79f8473c2f4d39b from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:57442: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-c209ebcbec0e4e4ba79f8473c2f4d39b
I20260709 13:18:42.585177 10371 raft_consensus.cc:359] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:42.586336 10371 raft_consensus.cc:740] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:18:42.587051 10371 consensus_queue.cc:260] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:42.598311 10379 tablet_copy_client.cc:806] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:42.598937 10379 tablet_copy_client.cc:670] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:42.611449  3836 raft_consensus.cc:1217] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEARNER]: Deduplicated request from leader. Original: 18.9->[18.10-18.10]   Dedup: 18.10->[]
I20260709 13:18:42.569773  3145 tablet_copy_source_session.cc:215] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:42.624516 10379 tablet_copy_client.cc:538] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:42.631445 10383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c209ebcbec0e4e4ba79f8473c2f4d39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.636624 10371 ts_tablet_manager.cc:1434] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
I20260709 13:18:42.657810  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-01cb424e009f49c2a8944cc68a07dd66 received from {username='slave'} at 127.0.0.1:52014
I20260709 13:18:42.658378  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-01cb424e009f49c2a8944cc68a07dd66 on tablet 01cb424e009f49c2a8944cc68a07dd66 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:42.680612 10379 tablet_bootstrap.cc:492] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:18:42.693856 10371 ts_tablet_manager.cc:933] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:42.703058 10383 tablet_copy_client.cc:806] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:42.704836 10383 tablet_copy_client.cc:670] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:42.712936 10383 tablet_copy_client.cc:538] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:42.740299 10371 tablet_copy_client.cc:323] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.66:42299
I20260709 13:18:42.745606  3221 tablet_copy_service.cc:140] P 43b01d5a97e149008d543a6615219928: Received BeginTabletCopySession request for tablet 94bb18481fd64fec92315ec868c651f4 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:38892)
I20260709 13:18:42.746436  3221 tablet_copy_service.cc:161] P 43b01d5a97e149008d543a6615219928: Beginning new tablet copy session on tablet 94bb18481fd64fec92315ec868c651f4 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:38892: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-94bb18481fd64fec92315ec868c651f4
I20260709 13:18:42.754643 10383 tablet_bootstrap.cc:492] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:18:42.759414  3221 tablet_copy_source_session.cc:215] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:42.762857 10371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bb18481fd64fec92315ec868c651f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:43.101472  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 48328.7us
W20260709 13:18:43.121232 10379 log.cc:927] Time spent T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:18:43.153537  3131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477"
dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
mode: GRACEFUL
new_leader_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:54126
I20260709 13:18:43.154772  3131 raft_consensus.cc:606] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Received request to transfer leadership to TS 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:43.244720  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
W20260709 13:18:43.249408  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 138856us
I20260709 13:18:43.249248  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:43.273855 10201 raft_consensus.cc:993] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3: : Instructing follower 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:18:43.274459 10201 raft_consensus.cc:1081] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Signalling peer 48080cf0460346769ab046a4f9457aa5 to start an election
I20260709 13:18:43.286481  3278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477"
dest_uuid: "48080cf0460346769ab046a4f9457aa5"
 from {username='slave'} at 127.0.0.1:33906
I20260709 13:18:43.287190  3278 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:43.287647  3278 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:43.259455 10371 tablet_copy_client.cc:806] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:43.289476 10371 tablet_copy_client.cc:670] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
W20260709 13:18:43.323568  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 45100.2us
I20260709 13:18:43.326488 10383 tablet_bootstrap.cc:492] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:43.337051 10407 raft_consensus.cc:1064] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:18:43.340505 10383 tablet_bootstrap.cc:492] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:18:43.340654 10407 consensus_queue.cc:237] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 8, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:43.336292  3278 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:43.369251 10383 ts_tablet_manager.cc:1403] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.615s	user 0.056s	sys 0.012s
I20260709 13:18:43.361651 10379 tablet_bootstrap.cc:492] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:43.376339 10371 tablet_copy_client.cc:538] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:43.376595 10379 tablet_bootstrap.cc:492] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:18:43.382965 10379 ts_tablet_manager.cc:1403] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.703s	user 0.060s	sys 0.017s
I20260709 13:18:43.350415  3278 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:43.388532  3128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "fc48eecc27554cb58b15193cd442b1d3"
I20260709 13:18:43.389421  3128 raft_consensus.cc:3055] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:43.389729  3128 raft_consensus.cc:740] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fc48eecc27554cb58b15193cd442b1d3, State: Running, Role: LEADER
I20260709 13:18:43.389822  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:43.390483  3206 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:43.390722  3128 consensus_queue.cc:260] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:43.392076  3128 raft_consensus.cc:3060] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:43.405030  3206 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:43.414052 10383 raft_consensus.cc:359] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:43.415091 10383 raft_consensus.cc:740] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:18:43.415782 10383 consensus_queue.cc:260] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:43.417479 10379 raft_consensus.cc:359] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:43.418505 10379 raft_consensus.cc:740] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:18:43.419540 10379 consensus_queue.cc:260] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:43.433245  3128 raft_consensus.cc:2468] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:43.456502 10379 ts_tablet_manager.cc:1434] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.004s
I20260709 13:18:43.464926  3836 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:43.465432  3250 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3; no voters: 
I20260709 13:18:43.467290 10406 raft_consensus.cc:2804] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:43.467824 10406 raft_consensus.cc:697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:43.467833  3135 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:43.469336 10405 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:43.471632 10406 consensus_queue.cc:237] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:43.487673 10408 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:18:43.495147  3208 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:43.494232  3836 raft_consensus.cc:1217] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEARNER]: Deduplicated request from leader. Original: 18.9->[18.10-18.10]   Dedup: 18.10->[]
I20260709 13:18:43.505573  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-7b205eb6f14c40c88b346e392de18687 received from {username='slave'} at 127.0.0.1:52014
I20260709 13:18:43.506172  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-7b205eb6f14c40c88b346e392de18687 on tablet 7b205eb6f14c40c88b346e392de18687 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:43.518980 10332 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:43.522630 10371 tablet_bootstrap.cc:492] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:18:43.564296 10383 ts_tablet_manager.cc:1434] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.177s	user 0.009s	sys 0.000s
I20260709 13:18:43.571769  3145 tablet_copy_service.cc:342] P fc48eecc27554cb58b15193cd442b1d3: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-c209ebcbec0e4e4ba79f8473c2f4d39b received from {username='slave'} at 127.0.0.1:57442
I20260709 13:18:43.572703  3145 tablet_copy_service.cc:434] P fc48eecc27554cb58b15193cd442b1d3: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-c209ebcbec0e4e4ba79f8473c2f4d39b on tablet c209ebcbec0e4e4ba79f8473c2f4d39b with peer 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:18:43.671216  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 84990.5us
W20260709 13:18:43.680301  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 96847.8us
I20260709 13:18:43.685145  3836 raft_consensus.cc:1217] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 13:18:43.802647  3033 catalog_manager.cc:5697] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 19 to 20, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 20 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:43.843303 10371 tablet_bootstrap.cc:700] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent opening tablet: real 0.140s	user 0.001s	sys 0.001s
W20260709 13:18:43.852952  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 106588us
I20260709 13:18:44.003309  3209 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:44.006186 10405 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
W20260709 13:18:44.036722  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 163078us
I20260709 13:18:44.024850  3209 raft_consensus.cc:2955] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:44.046320 10402 raft_consensus.cc:2955] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:44.164191  3132 raft_consensus.cc:1275] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:44.168586  3131 raft_consensus.cc:2955] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:44.203289  3837 raft_consensus.cc:2955] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:44.243636 10406 raft_consensus.cc:1064] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
W20260709 13:18:44.262178  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 140847us
I20260709 13:18:44.271749 10371 tablet_bootstrap.cc:492] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=2 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:44.281064  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:44.282166 10406 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:44.246085 10408 consensus_queue.cc:1048] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 13:18:44.317937  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 59319.8us
I20260709 13:18:44.334589 10371 tablet_bootstrap.cc:492] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:18:44.335424 10371 ts_tablet_manager.cc:1403] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.813s	user 0.055s	sys 0.014s
W20260709 13:18:44.329720 10425 log.cc:927] Time spent T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:18:44.353682  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 83436.7us
I20260709 13:18:44.368343 10371 raft_consensus.cc:359] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:44.380517 10371 raft_consensus.cc:740] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:18:44.381492 10371 consensus_queue.cc:260] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:44.422061  3025 catalog_manager.cc:5697] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 reported cstate change: config changed from index 10 to 11, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:18:44.463594  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 129009us
W20260709 13:18:44.467136  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 135862us
I20260709 13:18:44.473940 10371 ts_tablet_manager.cc:1434] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.138s	user 0.008s	sys 0.000s
I20260709 13:18:44.511291  3135 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:44.517732 10347 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:44.549918  3841 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:44.557462  3221 tablet_copy_service.cc:342] P 43b01d5a97e149008d543a6615219928: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-94bb18481fd64fec92315ec868c651f4 received from {username='slave'} at 127.0.0.1:38892
I20260709 13:18:44.558049  3221 tablet_copy_service.cc:434] P 43b01d5a97e149008d543a6615219928: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-94bb18481fd64fec92315ec868c651f4 on tablet 94bb18481fd64fec92315ec868c651f4 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:44.592664  3204 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:44.603107 10439 raft_consensus.cc:1064] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:18:44.619130 10434 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:44.612777 10439 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 8, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:44.652088  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 62297.3us
I20260709 13:18:44.683687 10405 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:18:44.712338  3278 consensus_queue.cc:237] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:44.714114  3841 raft_consensus.cc:1217] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 LEARNER]: Deduplicated request from leader. Original: 23.13->[23.14-23.14]   Dedup: 23.14->[]
I20260709 13:18:44.755987  3842 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:44.767532 10402 raft_consensus.cc:2955] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:44.771445 10405 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:44.787577  3842 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEARNER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:44.805302 10421 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:18:44.811043  3206 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:44.812813 10406 raft_consensus.cc:2955] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:44.814937 10420 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:44.831825  3127 raft_consensus.cc:1275] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:44.824374  3836 raft_consensus.cc:2955] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:44.838555  3130 raft_consensus.cc:2955] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:44.839148  3841 raft_consensus.cc:2955] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:44.841264  3285 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:44.842260 10347 consensus_queue.cc:1048] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:44.896720  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 01cb424e009f49c2a8944cc68a07dd66 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:44.860049 10421 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:18:44.891553  3127 raft_consensus.cc:2955] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:44.920269  3204 raft_consensus.cc:2955] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:44.935068  3842 raft_consensus.cc:2955] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:44.932387 10421 raft_consensus.cc:2955] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:44.979210  3033 catalog_manager.cc:5697] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 11 to 12, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New cstate: current_term: 18 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:44.981210  3033 catalog_manager.cc:5697] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 13 to 14, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:45.004717  3199 tablet_service.cc:1558] Processing DeleteTablet for tablet 01cb424e009f49c2a8944cc68a07dd66 with delete_type TABLET_DATA_TOMBSTONED (TS 43b01d5a97e149008d543a6615219928 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:39966
I20260709 13:18:45.080178  3285 consensus_queue.cc:237] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:45.083326 10456 tablet_replica.cc:333] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:45.103148  3279 raft_consensus.cc:2955] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:45.116869  3033 catalog_manager.cc:5697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 10 to 11, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:45.132083 10456 raft_consensus.cc:2243] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.138653 10430 raft_consensus.cc:1064] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:18:45.148242 10430 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 12, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:45.153641 10456 raft_consensus.cc:2272] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.205291 10456 ts_tablet_manager.cc:1916] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:45.208696  3206 raft_consensus.cc:2955] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:45.240446  3836 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:18:45.246305 10402 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:45.262910  3208 raft_consensus.cc:1275] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:18:45.264578 10347 consensus_queue.cc:1048] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:45.300810  3836 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 LEARNER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:18:45.319638 10361 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:45.340590  3285 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:18:45.342401 10430 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:45.345600 10406 raft_consensus.cc:2955] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:45.352170  3131 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:18:45.355437 10430 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:45.361110  3842 raft_consensus.cc:2955] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:45.361910  3127 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:45.378966  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7b205eb6f14c40c88b346e392de18687 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:45.389995 10456 ts_tablet_manager.cc:1929] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.11
I20260709 13:18:45.392915 10456 log.cc:1199] T 01cb424e009f49c2a8944cc68a07dd66 P 43b01d5a97e149008d543a6615219928: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root/wals/01cb424e009f49c2a8944cc68a07dd66
I20260709 13:18:45.397738  3019 catalog_manager.cc:5028] TS 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): tablet 01cb424e009f49c2a8944cc68a07dd66 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:18:45.412593  3837 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:45.415290 10439 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:45.437538  2025 tablet_server.cc:179] TabletServer@127.1.250.65:0 shutting down...
I20260709 13:18:45.451433  3841 raft_consensus.cc:2955] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:45.455658  3033 catalog_manager.cc:5697] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 14 to 15, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New cstate: current_term: 18 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:45.458199  3208 raft_consensus.cc:2955] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:45.451634 10393 raft_consensus.cc:2955] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:45.467247  3285 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Refusing update from remote peer fc48eecc27554cb58b15193cd442b1d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:45.468459 10430 raft_consensus.cc:2955] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:45.494798 10439 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:45.511595  3279 raft_consensus.cc:2955] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:45.474581  3130 raft_consensus.cc:2955] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:18:45.520875  3020 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:18:45.499960  3285 raft_consensus.cc:2955] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:45.473767  3842 raft_consensus.cc:2955] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:18:45.580912  3020 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 60030.3us
W20260709 13:18:45.585785  3020 catalog_manager.cc:4755] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7b205eb6f14c40c88b346e392de18687: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 13:18:45.603271  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 81113.6us
W20260709 13:18:45.605684  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 75195.2us
W20260709 13:18:45.642776  3250 consensus_peers.cc:597] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.656482  3250 consensus_peers.cc:597] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.673234  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 61672.2us
I20260709 13:18:45.730233  3025 catalog_manager.cc:5697] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index 14 to 15, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:45.734912  3020 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c209ebcbec0e4e4ba79f8473c2f4d39b with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:18:45.776881  3806 consensus_peers.cc:597] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.795389  3206 consensus_queue.cc:237] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:45.827028  3026 catalog_manager.cc:5697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index 11 to 12, VOTER 43b01d5a97e149008d543a6615219928 (127.1.250.66) evicted. New cstate: current_term: 18 leader_uuid: "fc48eecc27554cb58b15193cd442b1d3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:45.852744  3836 raft_consensus.cc:1275] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:18:45.893196  3176 consensus_peers.cc:597] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.898041  3250 consensus_peers.cc:597] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.898765  3250 consensus_peers.cc:597] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.901803 10446 consensus_queue.cc:1048] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:18:45.929765  3176 consensus_peers.cc:597] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.935611  3176 consensus_peers.cc:597] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.940058  3176 consensus_peers.cc:597] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.940722  3176 consensus_peers.cc:597] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.941500  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 107611us
W20260709 13:18:45.941237  3176 consensus_peers.cc:597] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.942584  3176 consensus_peers.cc:597] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.943167  3176 consensus_peers.cc:597] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.946781  3176 consensus_peers.cc:597] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.947436  3176 consensus_peers.cc:597] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.948050  3176 consensus_peers.cc:597] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.963347  3250 consensus_peers.cc:597] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.963949  3250 consensus_peers.cc:597] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.964412  3250 consensus_peers.cc:597] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.964913  3250 consensus_peers.cc:597] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.978555  3199 tablet_service.cc:1558] Processing DeleteTablet for tablet c209ebcbec0e4e4ba79f8473c2f4d39b with delete_type TABLET_DATA_TOMBSTONED (TS 43b01d5a97e149008d543a6615219928 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:39966
W20260709 13:18:45.980424  3175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.985455  3176 consensus_peers.cc:597] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.056849  3841 raft_consensus.cc:2955] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:18:46.062742  3250 consensus_peers.cc:597] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.067560  3250 consensus_peers.cc:597] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.069099 10472 tablet_replica.cc:333] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:46.070209 10472 raft_consensus.cc:2243] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.069768 10430 raft_consensus.cc:2955] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:18:46.062471  3806 consensus_peers.cc:597] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.068024  3250 consensus_peers.cc:597] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.084607  3806 consensus_peers.cc:597] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.091154  3176 consensus_peers.cc:597] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.094861  3806 consensus_peers.cc:597] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.162596 10472 raft_consensus.cc:2272] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:46.170817  3250 consensus_peers.cc:597] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.200872 10472 ts_tablet_manager.cc:1916] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:46.225792  3019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 94bb18481fd64fec92315ec868c651f4 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:46.257858  3033 catalog_manager.cc:5697] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 15 to 16, VOTER 48080cf0460346769ab046a4f9457aa5 (127.1.250.67) evicted. New cstate: current_term: 23 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:46.344937 10421 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:46.345825 10421 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:46.352547 10421 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:46.353255  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:46.393777  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 258328us
I20260709 13:18:46.398800  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:46.399498  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 264301us
I20260709 13:18:46.407608  3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 94bb18481fd64fec92315ec868c651f4 with delete_type TABLET_DATA_TOMBSTONED (TS 48080cf0460346769ab046a4f9457aa5 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:35176
I20260709 13:18:46.438824  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b205eb6f14c40c88b346e392de18687" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:46.456161  3806 consensus_peers.cc:597] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.458880  3806 consensus_peers.cc:597] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.468246  3100 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:46.470664 10471 raft_consensus.cc:2749] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:46.508829 10467 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:46.510293 10467 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:46.514833  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:46.515928 10467 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:46.526042  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7a98c6990948fab7c20936964c4d3e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.541320  3100 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:46.548038 10440 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:18:46.544847  3806 consensus_peers.cc:597] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.548659 10440 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:46.550954 10440 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:46.551187 10487 tablet_replica.cc:333] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:46.582391 10487 raft_consensus.cc:2243] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.541949 10472 ts_tablet_manager.cc:1929] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.11
I20260709 13:18:46.557812 10478 raft_consensus.cc:493] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:46.585295 10472 log.cc:1199] T c209ebcbec0e4e4ba79f8473c2f4d39b P 43b01d5a97e149008d543a6615219928: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-1-root/wals/c209ebcbec0e4e4ba79f8473c2f4d39b
I20260709 13:18:46.585481 10478 raft_consensus.cc:515] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:46.586301 10487 raft_consensus.cc:2272] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.587517 10440 raft_consensus.cc:493] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:46.557953  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:46.559644 10393 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:46.571913 10421 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:46.575956  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d682925c4b46799576472fe9f97a07" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.587842  3019 catalog_manager.cc:5028] TS 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): tablet c209ebcbec0e4e4ba79f8473c2f4d39b (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:18:46.589356 10440 raft_consensus.cc:515] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:46.593665  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.595604 10478 leader_election.cc:290] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:46.601959 10487 ts_tablet_manager.cc:1916] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:46.594482 10421 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:46.642016  3101 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:46.649812  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.653035 10436 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:46.654529 10439 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:46.655177 10439 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:46.657641 10420 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:46.658243 10420 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:46.660308 10420 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:46.660199 10439 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:46.660274 10440 leader_election.cc:290] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:46.664163  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:46.675760  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed81e18346d4bb3a9f0b77ae5ca8477" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:46.679472  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a8a614fca4531aab11f5963396f62" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:46.682164  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:46.666550 10421 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:46.684975  3282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:46.685943  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:46.686038 10420 raft_consensus.cc:493] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:46.686722 10420 raft_consensus.cc:515] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:46.690475  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85d4a2b8cd74bd69285c748e4453e24" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.693830  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.699759 10421 raft_consensus.cc:493] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:46.703398 10436 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:46.711278  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:18:46.713164  3806 consensus_peers.cc:597] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.712406 10436 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:46.715919  2025 tablet_replica.cc:333] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:46.719630  2025 raft_consensus.cc:2243] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.720512 10436 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:46.718174 10420 leader_election.cc:290] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:46.708803 10421 raft_consensus.cc:515] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:46.734088 10421 leader_election.cc:290] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:46.734683 10421 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:46.735136  2025 raft_consensus.cc:2272] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.735272 10421 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:46.735911  3099 raft_consensus.cc:687] T 023c1461b69c46bdb3c42ee16f303ea2 P fc48eecc27554cb58b15193cd442b1d3: failed to submit failure detected task: Service unavailable: Thread pool token was shut down
I20260709 13:18:46.737771 10421 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:46.738278 10420 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:46.739235  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:46.739004 10420 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:46.741214  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:46.738313 10416 raft_consensus.cc:493] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:46.742187 10416 raft_consensus.cc:515] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:46.744447  2025 tablet_replica.cc:333] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:46.744813 10439 raft_consensus.cc:493] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:46.745782  2025 raft_consensus.cc:2243] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.745463 10439 raft_consensus.cc:515] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:46.746563  2025 raft_consensus.cc:2272] T aded29f2cce84c3c8e2a5337dce77bde P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.747985 10439 leader_election.cc:290] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:46.751194  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404209c6105f4945b077c33471d63370" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.751494  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.748908 10416 leader_election.cc:290] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:46.753984  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.754701 10420 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:46.754907  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:46.756206  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.757002 10421 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:46.757591 10421 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:46.759641 10421 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:46.760679  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:46.761946  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.756290  3101 leader_election.cc:304] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:46.766172 10421 raft_consensus.cc:2749] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:46.761848  3100 leader_election.cc:304] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:46.782119 10439 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:46.782833 10439 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:46.785297 10439 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:46.786123 10439 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:46.786196  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.786725 10439 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:46.790031  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.767767 10420 raft_consensus.cc:2749] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:46.792186 10439 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:46.794301  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db43db40f644309c6db08523b1b033" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:46.796123  3102 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:46.797343 10439 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:46.766928  3101 leader_election.cc:304] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:46.799358  3101 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:46.800390 10420 raft_consensus.cc:2749] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:46.801224 10420 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:46.772811  2025 tablet_replica.cc:333] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:46.814713  2025 raft_consensus.cc:2243] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.815446  2025 raft_consensus.cc:2272] T 104b1eb7d49f449095e30c69e8680096 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.819895  2025 tablet_replica.cc:333] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:46.800872  3101 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:46.838805 10439 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:46.840163  3101 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:46.840929 10439 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:46.842996 10439 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:46.843468 10439 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:46.846433  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.846632 10439 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:46.848006 10439 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:46.848485 10439 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:46.851585  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.853880 10439 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:46.855535  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae5c762a7f347f4a2de941d47ed1903" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:46.857285  3102 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:46.858795 10439 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:46.861271  2025 raft_consensus.cc:2243] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.862118  2025 raft_consensus.cc:2272] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.883981  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258b23309c4453b850ba59d3011c806" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:46.884300  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:46.885017  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2222d9a550a4cdaa84c7bf97a7ab954" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:46.886099  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e51511dc4ca4db4817c3216d9d1db6e" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:46.888422  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7276ed9ac0542f885cc824522eb9d58" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:46.889408 10439 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:46.889775  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:46.890208 10439 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:46.893649 10487 ts_tablet_manager.cc:1929] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.15
I20260709 13:18:46.900741  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:46.901652 10487 log.cc:1199] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5: Deleting WAL directory at /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602894180814-2025-0/minicluster-data/ts-2-root/wals/94bb18481fd64fec92315ec868c651f4
I20260709 13:18:46.903468  2025 tablet_replica.cc:333] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:46.904727  2025 raft_consensus.cc:2243] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.905185  3020 catalog_manager.cc:5028] TS 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): tablet 94bb18481fd64fec92315ec868c651f4 (table test-workload [id=2506cbaff7af4e3c93b080aad0c3b58a]) successfully deleted
I20260709 13:18:46.907584  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528677c11f624ca18f75db1e739e29d6" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:46.908982  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c414d51e428042c596cb410c48956c63" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:46.905468  2025 raft_consensus.cc:2272] T 5f5212495b02454ba6ddf4c62cf58b04 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.916687 10420 raft_consensus.cc:493] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:46.917371 10420 raft_consensus.cc:515] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:46.919596 10420 leader_election.cc:290] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:46.897028 10439 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:46.919893  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ed1a03592e491cbb924069df406f18" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:46.922636  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:46.933502  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5881853d6b7b4e038027c4a93fdc0b41" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:46.965277 10421 raft_consensus.cc:493] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:46.965991 10421 raft_consensus.cc:515] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:46.972919 10416 raft_consensus.cc:493] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:46.977720 10416 raft_consensus.cc:515] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:46.976310 10420 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:46.992245 10420 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:46.994175 10421 leader_election.cc:290] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:46.995223 10420 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:46.999754  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:47.011082  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 97120.9us
I20260709 13:18:47.013001  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:47.014647  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:47.010988 10416 leader_election.cc:290] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:47.016673  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d10d3c525b541649db9c882a1398789" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:47.019910  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:47.021420  2025 tablet_replica.cc:333] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.022732  2025 raft_consensus.cc:2243] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.023689 10421 raft_consensus.cc:493] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:47.024039  2025 raft_consensus.cc:2272] T 432d705ff69845aaac398233202f4081 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.024339 10421 raft_consensus.cc:515] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:47.028676  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:47.021946  3102 leader_election.cc:304] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:47.029456 10436 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:47.030248 10439 raft_consensus.cc:2749] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:47.030048 10436 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:47.030580  3102 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:47.031834 10439 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:47.032346 10436 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:47.032989 10421 leader_election.cc:290] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:47.031807  3102 leader_election.cc:304] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:47.035779 10439 raft_consensus.cc:493] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
I20260709 13:18:47.036459 10439 raft_consensus.cc:515] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:47.037607 10436 raft_consensus.cc:2749] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:47.040077 10439 leader_election.cc:290] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:47.034081  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:47.049517  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:47.050689  2025 tablet_replica.cc:333] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.051828  2025 raft_consensus.cc:2243] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.055740  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc7fa450cf74c28bef080a5f5dc8fa8" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:47.056099  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af680172a5440a2bfa7e8a99ea9c1fc" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:47.052467  2025 raft_consensus.cc:2272] T 66614160a1bf4bb49ea02007f6679b0f P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.058143  3102 leader_election.cc:304] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:47.059821 10436 raft_consensus.cc:2749] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:47.061988  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f88ddc17f44a3084db05c84e5e6a81" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:47.062363  2025 tablet_replica.cc:333] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.063391  2025 raft_consensus.cc:2243] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.064070  2025 raft_consensus.cc:2272] T 2d7a98c6990948fab7c20936964c4d3e P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.064308  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bb18481fd64fec92315ec868c651f4" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:47.064857  3278 raft_consensus.cc:1803] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: voting while tombstoned based on last-logged opid 23.15
I20260709 13:18:47.065326  3278 raft_consensus.cc:2468] T 94bb18481fd64fec92315ec868c651f4 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc48eecc27554cb58b15193cd442b1d3 in term 23.
I20260709 13:18:47.079586  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f18d12244c29aac431f7d6786d0b" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:47.082522  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea47b33000a4a0e9cb380dbe716761d" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:47.097170  3020 catalog_manager.cc:4755] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7b205eb6f14c40c88b346e392de18687: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:18:47.102020 10420 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:47.103987 10420 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:47.106338 10420 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:47.109037  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:47.113509  2025 tablet_replica.cc:333] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.114498  2025 raft_consensus.cc:2243] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.115200  2025 raft_consensus.cc:2272] T 3af680172a5440a2bfa7e8a99ea9c1fc P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.118206  3101 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:47.119006 10439 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:47.120291  3101 leader_election.cc:304] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:47.121019 10439 raft_consensus.cc:2749] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:47.122325  3101 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:47.123208 10439 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:47.124632  3101 leader_election.cc:304] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:47.126648  2025 tablet_replica.cc:333] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.127733  2025 raft_consensus.cc:2243] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.128306 10439 raft_consensus.cc:2749] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:47.129827  3101 leader_election.cc:304] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:47.130518 10439 raft_consensus.cc:2749] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:47.130972  3101 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:47.131922 10439 raft_consensus.cc:2749] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:47.132514  3101 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:47.133551 10439 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:47.134074  3101 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:47.134956 10439 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:47.135337  2025 raft_consensus.cc:2272] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.138787  2025 tablet_replica.cc:333] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.139880  2025 raft_consensus.cc:2243] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.142846  3101 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:47.143954  3101 raft_consensus.cc:2686] T a6ed1a03592e491cbb924069df406f18 P fc48eecc27554cb58b15193cd442b1d3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:18:47.144851  3101 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
W20260709 13:18:47.145614  3101 raft_consensus.cc:2686] T ccc7fa450cf74c28bef080a5f5dc8fa8 P fc48eecc27554cb58b15193cd442b1d3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:18:47.148671  3101 leader_election.cc:304] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:47.149526 10436 raft_consensus.cc:2749] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:47.156251  2025 raft_consensus.cc:2272] T 2ae5c762a7f347f4a2de941d47ed1903 P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.165865  3101 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:47.167506  3101 leader_election.cc:304] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:47.166836 10436 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:47.168776 10436 raft_consensus.cc:2749] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:47.178884  2025 tablet_replica.cc:333] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.179883  2025 raft_consensus.cc:2243] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.179776  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cb424e009f49c2a8944cc68a07dd66" candidate_uuid: "fc48eecc27554cb58b15193cd442b1d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:47.180814  2025 raft_consensus.cc:2272] T c414d51e428042c596cb410c48956c63 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.200660  3101 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc48eecc27554cb58b15193cd442b1d3; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:47.201509 10436 raft_consensus.cc:2749] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:47.226321  2025 tablet_replica.cc:333] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.227435  2025 raft_consensus.cc:2243] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.228909  2025 raft_consensus.cc:2272] T 2e805018f85b41fc88644215be011084 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.235996  2025 tablet_replica.cc:333] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.236871  2025 raft_consensus.cc:2243] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.237632  2025 raft_consensus.cc:2272] T 5881853d6b7b4e038027c4a93fdc0b41 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.247085  2025 tablet_replica.cc:333] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.248088  2025 raft_consensus.cc:2243] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.249151  2025 raft_consensus.cc:2272] T 114dd3d94ac84ebb8bff7ff66e92d269 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.252513  2025 tablet_replica.cc:333] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.265214  2025 raft_consensus.cc:2243] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.266057  2025 raft_consensus.cc:2272] T 9d10d3c525b541649db9c882a1398789 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.269414  2025 tablet_replica.cc:333] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.270989  2025 raft_consensus.cc:2243] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.271663  2025 raft_consensus.cc:2272] T 404209c6105f4945b077c33471d63370 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.287168  2025 tablet_replica.cc:333] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.289065  2025 raft_consensus.cc:2243] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.289848  2025 raft_consensus.cc:2272] T d2222d9a550a4cdaa84c7bf97a7ab954 P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.292829  2025 tablet_replica.cc:333] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.293763  2025 raft_consensus.cc:2243] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.294426  2025 raft_consensus.cc:2272] T 30f88ddc17f44a3084db05c84e5e6a81 P fc48eecc27554cb58b15193cd442b1d3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.309300  2025 tablet_replica.cc:333] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.312469  2025 raft_consensus.cc:2243] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.313382  2025 raft_consensus.cc:2272] T c258b23309c4453b850ba59d3011c806 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.316491  2025 tablet_replica.cc:333] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.317412  2025 raft_consensus.cc:2243] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.317996  2025 raft_consensus.cc:2272] T c7276ed9ac0542f885cc824522eb9d58 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.320966  2025 tablet_replica.cc:333] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.321849  2025 raft_consensus.cc:2243] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:18:47.322527  3102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.322813  2025 raft_consensus.cc:2272] T 874b2f5f161c46be919ed69ca338da41 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.326071  2025 tablet_replica.cc:333] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.326973  2025 raft_consensus.cc:2243] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.327677  2025 raft_consensus.cc:2272] T 7f4a8a614fca4531aab11f5963396f62 P fc48eecc27554cb58b15193cd442b1d3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.330626  2025 tablet_replica.cc:333] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.331791  2025 raft_consensus.cc:2243] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.332489  2025 raft_consensus.cc:2272] T 23d682925c4b46799576472fe9f97a07 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.336011  2025 tablet_replica.cc:333] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.336905  2025 raft_consensus.cc:2243] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.337579  2025 raft_consensus.cc:2272] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.340145  2025 tablet_replica.cc:333] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.347520  2025 raft_consensus.cc:2243] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.348800  2025 raft_consensus.cc:2272] T a455058d628f40fc9d810a0d764560dd P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.367839  2025 tablet_replica.cc:333] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.380551  2025 raft_consensus.cc:2243] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.385977  2025 raft_consensus.cc:2272] T bce4572fe1d742f8b02088bc9e1bbbba P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.402140  2025 tablet_replica.cc:333] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.403112  2025 raft_consensus.cc:2243] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.403779  2025 raft_consensus.cc:2272] T 4861cf36e0334e60863d0921b834dd0b P fc48eecc27554cb58b15193cd442b1d3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.425416  2025 tablet_replica.cc:333] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.426527  2025 raft_consensus.cc:2243] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.427389  2025 raft_consensus.cc:2272] T 94bb18481fd64fec92315ec868c651f4 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.430498  2025 tablet_replica.cc:333] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.431429  2025 raft_consensus.cc:2243] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.456059  2025 raft_consensus.cc:2272] T 6b9a3cde8b784484802f97dd03f5d338 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.469914  2025 tablet_replica.cc:333] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.470845  2025 raft_consensus.cc:2243] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.471655  2025 raft_consensus.cc:2272] T 528677c11f624ca18f75db1e739e29d6 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.494606  2025 tablet_replica.cc:333] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.495539  2025 raft_consensus.cc:2243] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.496383  2025 raft_consensus.cc:2272] T 7b205eb6f14c40c88b346e392de18687 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.503010  2025 tablet_replica.cc:333] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.503969  2025 raft_consensus.cc:2243] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.504653  2025 raft_consensus.cc:2272] T 9e51511dc4ca4db4817c3216d9d1db6e P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.509122  2025 tablet_replica.cc:333] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.510133  2025 raft_consensus.cc:2243] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.511082  2025 raft_consensus.cc:2272] T c85d4a2b8cd74bd69285c748e4453e24 P fc48eecc27554cb58b15193cd442b1d3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.514062  2025 tablet_replica.cc:333] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.514986  2025 raft_consensus.cc:2243] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.516232  2025 raft_consensus.cc:2272] T faebd952bf73433d84a3292167ecd165 P fc48eecc27554cb58b15193cd442b1d3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.519870  2025 tablet_replica.cc:333] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.520749  2025 raft_consensus.cc:2243] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.522042  2025 raft_consensus.cc:2272] T c209ebcbec0e4e4ba79f8473c2f4d39b P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.528662  2025 tablet_replica.cc:333] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.529778  2025 raft_consensus.cc:2243] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.531077  2025 raft_consensus.cc:2272] T ce9155778cd542acbbc8b00bd8b7316c P fc48eecc27554cb58b15193cd442b1d3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.534298  2025 tablet_replica.cc:333] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.535308  2025 raft_consensus.cc:2243] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.536609  2025 raft_consensus.cc:2272] T cd9bf15d386d49f0977913d9628e22af P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.540107  2025 tablet_replica.cc:333] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.541285  2025 raft_consensus.cc:2243] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.542717  2025 raft_consensus.cc:2272] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.546365  2025 tablet_replica.cc:333] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.547334  2025 raft_consensus.cc:2243] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.548002  2025 raft_consensus.cc:2272] T d4df8838ab784efd9cfa105ba373b14c P fc48eecc27554cb58b15193cd442b1d3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.550855  2025 tablet_replica.cc:333] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.551736  2025 raft_consensus.cc:2243] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.552652  2025 raft_consensus.cc:2272] T dea47b33000a4a0e9cb380dbe716761d P fc48eecc27554cb58b15193cd442b1d3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.555795  2025 tablet_replica.cc:333] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.556613  2025 raft_consensus.cc:2243] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.557833  2025 raft_consensus.cc:2272] T 812e4fbcaef1473b9c0467dcbbfca8a3 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.562124  2025 tablet_replica.cc:333] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.563004  2025 raft_consensus.cc:2243] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.563786  2025 raft_consensus.cc:2272] T f0e8f18d12244c29aac431f7d6786d0b P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.567289  2025 tablet_replica.cc:333] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.568081  2025 raft_consensus.cc:2243] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.568691  2025 raft_consensus.cc:2272] T 233be522a83f4bea8c48247e49ee33a0 P fc48eecc27554cb58b15193cd442b1d3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.583249  2025 tablet_replica.cc:333] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.584128  2025 raft_consensus.cc:2243] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.584972  2025 raft_consensus.cc:2272] T 2fe9b83583444570807fd6aa3bcc925d P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.588321  2025 tablet_replica.cc:333] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.589244  2025 raft_consensus.cc:2243] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.590545  2025 raft_consensus.cc:2272] T ea9019901d1a42beb5690a4096277f3e P fc48eecc27554cb58b15193cd442b1d3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.594020  2025 tablet_replica.cc:333] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.595118  2025 raft_consensus.cc:2243] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.595851  2025 raft_consensus.cc:2272] T 56db43db40f644309c6db08523b1b033 P fc48eecc27554cb58b15193cd442b1d3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.609134  2025 tablet_replica.cc:333] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.609938  2025 raft_consensus.cc:2243] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.610682  2025 raft_consensus.cc:2272] T 01cb424e009f49c2a8944cc68a07dd66 P fc48eecc27554cb58b15193cd442b1d3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.622128  2025 tablet_replica.cc:333] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3: stopping tablet replica
I20260709 13:18:47.622854  2025 raft_consensus.cc:2243] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.624194  2025 raft_consensus.cc:2272] T da022fb530574c2ba921df0848818f6b P fc48eecc27554cb58b15193cd442b1d3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.687438  3279 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:18:47.738116  3020 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 79039.8us
I20260709 13:18:47.766898  3209 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:18:47.768050  3251 consensus_peers.cc:597] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 233be522a83f4bea8c48247e49ee33a0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.770224 10480 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:47.771437  3250 consensus_peers.cc:597] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.793813 10347 raft_consensus.cc:2955] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:47.804397  3205 raft_consensus.cc:2955] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:47.825716  3209 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:47.831388  3033 catalog_manager.cc:5697] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index -1 to 13, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 19 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:47.913748  3177 consensus_peers.cc:597] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4df8838ab784efd9cfa105ba373b14c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.927115  3279 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:18:47.929663 10477 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:18:47.931030  3176 consensus_peers.cc:597] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:47.942921  3176 consensus_peers.cc:597] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.951577 10005 raft_consensus.cc:2955] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 24 LEADER]: Committing config change with OpId 24.15: config changed from index -1 to 15, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:47.958300  3279 raft_consensus.cc:2955] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index -1 to 15, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:48.019325  3205 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:18:48.053777  3250 consensus_peers.cc:597] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.054289  3250 consensus_peers.cc:597] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.059077  3025 catalog_manager.cc:5697] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index -1 to 15, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 24 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
W20260709 13:18:48.070683  3177 consensus_peers.cc:597] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 -> Peer 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703): Couldn't send request to peer 0930e3e7657c43bcaaa5b0778f3e08cf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2fe9b83583444570807fd6aa3bcc925d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:48.076143 10415 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.076798 10415 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:48.079802 10415 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:48.090583  3279 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:48.099889 10005 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:18:48.113947  3176 consensus_peers.cc:597] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.115096  3176 consensus_peers.cc:597] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:48.114916  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:48.122102  3176 consensus_peers.cc:597] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.123566  3806 leader_election.cc:336] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.124241  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:48.132304 10415 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:48.184862  3176 consensus_peers.cc:597] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.186126 10477 raft_consensus.cc:2955] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:48.187644  3279 raft_consensus.cc:2955] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
W20260709 13:18:48.189141  3176 consensus_peers.cc:597] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.216060 10499 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.216625 10499 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.218858 10499 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:48.220369  3033 catalog_manager.cc:5697] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index -1 to 13, NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) added. New cstate: current_term: 20 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } } }
I20260709 13:18:48.230628  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:48.238027 10504 ts_tablet_manager.cc:933] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:48.260334 10477 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.260965 10477 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.263006 10477 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:48.263623  3250 consensus_peers.cc:597] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.264371  3176 leader_election.cc:336] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.264842  3176 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:48.266533 10477 raft_consensus.cc:2749] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:48.269032 10504 tablet_copy_client.cc:323] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.67:41801
I20260709 13:18:48.273697  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:48.285291  3294 tablet_copy_service.cc:140] P 48080cf0460346769ab046a4f9457aa5: Received BeginTabletCopySession request for tablet 233be522a83f4bea8c48247e49ee33a0 from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:52014)
I20260709 13:18:48.285866  3294 tablet_copy_service.cc:161] P 48080cf0460346769ab046a4f9457aa5: Beginning new tablet copy session on tablet 233be522a83f4bea8c48247e49ee33a0 from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:52014: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-233be522a83f4bea8c48247e49ee33a0
I20260709 13:18:48.306985  3294 tablet_copy_source_session.cc:215] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:48.312232 10504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233be522a83f4bea8c48247e49ee33a0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:48.318054  3082 auto_rebalancer.cc:629] Failed to schedule move for tablet ce9155778cd542acbbc8b00bd8b7316c: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:48.309839  3176 leader_election.cc:336] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:48.343304  3250 consensus_peers.cc:597] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.349771  3176 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:48.350812 10477 raft_consensus.cc:2749] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:48.359282  3176 consensus_peers.cc:597] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.385468  3176 consensus_peers.cc:597] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.385669 10480 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.388690 10480 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.391100 10480 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:48.395841  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:48.396610  3209 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:48.399663  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:48.401400 10347 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:48.401811 10347 raft_consensus.cc:493] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.402223 10347 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:48.404549  3176 consensus_peers.cc:597] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.410801  3250 leader_election.cc:336] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.418738 10480 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.419498 10480 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.427364 10504 tablet_copy_client.cc:806] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:48.435621 10480 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:48.437700  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:48.438366  3250 leader_election.cc:336] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.440864  3249 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:48.441850 10480 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:48.428960 10504 tablet_copy_client.cc:670] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
W20260709 13:18:48.455466  3250 consensus_peers.cc:597] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.458675  3250 consensus_peers.cc:597] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.457790 10347 raft_consensus.cc:515] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.466547 10347 leader_election.cc:290] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:48.468979  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e805018f85b41fc88644215be011084" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:48.469791  3209 raft_consensus.cc:3060] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:48.470252  3250 consensus_peers.cc:597] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.476411  3250 consensus_peers.cc:597] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.476933  3250 leader_election.cc:336] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.480312 10504 tablet_copy_client.cc:538] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:48.480649  3209 raft_consensus.cc:2468] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:48.482719  3249 leader_election.cc:304] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:48.483973 10347 raft_consensus.cc:2804] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:48.484444 10347 raft_consensus.cc:697] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:48.485325 10347 consensus_queue.cc:237] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.520673 10508 ts_tablet_manager.cc:933] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:48.541285  3176 consensus_peers.cc:597] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.540508  3033 catalog_manager.cc:5697] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 19 to 20, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 20 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.543653 10499 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.544269 10499 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.547425 10499 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:48.553609 10499 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.554302 10499 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.555200  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:48.562074 10507 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.563112 10507 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.564618 10504 tablet_bootstrap.cc:492] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:18:48.566692 10507 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:48.569792  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:48.570576  3209 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 23.
I20260709 13:18:48.574509  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:18:48.580883  3250 leader_election.cc:336] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.581324 10408 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:48.581794 10408 raft_consensus.cc:493] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:48.581836  3250 consensus_peers.cc:597] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.575348 10480 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.582701 10347 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.582892 10480 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:48.583357 10347 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.586275 10347 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:48.589020  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:48.589821  3209 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:48.591014  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:48.592600 10507 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:48.593056 10507 raft_consensus.cc:493] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.582309 10408 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:48.593667 10507 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.596417  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:48.597561  3841 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 16.
I20260709 13:18:48.599156  3251 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
W20260709 13:18:48.578848  3176 leader_election.cc:336] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.574524 10499 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:48.601049 10499 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.602749  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:48.602506 10499 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.606909 10480 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:48.607563 10480 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:48.607937 10480 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.608335 10480 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:48.615069  3176 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:48.616034 10005 raft_consensus.cc:2749] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:48.574785 10510 ts_tablet_manager.cc:933] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf: Initiating tablet copy from peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:48.654861 10499 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:48.658001  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:48.665445 10510 tablet_copy_client.cc:323] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.66:42299
I20260709 13:18:48.677731 10347 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.678337 10347 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.680526 10347 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:48.680999 10347 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.681599  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
W20260709 13:18:48.685527  3806 consensus_peers.cc:597] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.686997 10347 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.689018 10347 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:48.689949 10486 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.690506 10486 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:48.692754 10486 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:48.693709  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:48.696506  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:48.698982  3806 leader_election.cc:336] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:48.707543  3176 leader_election.cc:336] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.709393 10347 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.711261  3806 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:48.709944 10347 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.664690 10408 raft_consensus.cc:515] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:48.710747  3250 leader_election.cc:336] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:48.723239  3250 consensus_peers.cc:597] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.724007  3250 leader_election.cc:336] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.726975  3278 raft_consensus.cc:2393] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 24: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:48.729125 10347 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:48.730412  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:48.721565 10415 raft_consensus.cc:2749] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:48.731045  3209 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:48.734266  3249 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:48.738235 10347 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.741263 10347 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.743115 10514 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:48.743557 10514 raft_consensus.cc:493] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.743909 10514 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:48.744594 10408 leader_election.cc:290] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:48.754276 10347 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:48.753770 10514 raft_consensus.cc:515] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.762895 10514 leader_election.cc:290] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:48.763001  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:48.764556  3205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a455058d628f40fc9d810a0d764560dd" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:48.767611  3205 raft_consensus.cc:3060] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:48.764659  3208 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:18:48.765430  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4572fe1d742f8b02088bc9e1bbbba" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:48.773952  3206 raft_consensus.cc:3060] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:48.778970  3176 leader_election.cc:336] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.737380 10477 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.785979  3176 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:48.786157 10477 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:48.787616  3176 consensus_peers.cc:597] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.788656 10477 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:48.779780  3249 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:48.790014 10514 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:48.790366 10514 raft_consensus.cc:493] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.790699 10514 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:48.791746 10499 raft_consensus.cc:2749] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:48.792061 10480 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:48.756923 10507 raft_consensus.cc:515] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.795315 10507 leader_election.cc:290] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:48.762184 10508 tablet_copy_client.cc:323] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.250.66:42299
I20260709 13:18:48.798756 10514 raft_consensus.cc:515] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:48.803920  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 82913.7us
W20260709 13:18:48.804668  3250 consensus_peers.cc:597] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.788470  3176 consensus_peers.cc:597] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.809458  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "874b2f5f161c46be919ed69ca338da41" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:48.814913  3209 raft_consensus.cc:3060] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.805630 10514 leader_election.cc:290] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:48.813913  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9155778cd542acbbc8b00bd8b7316c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:48.815718  3208 raft_consensus.cc:3060] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:48.819523  3806 consensus_peers.cc:597] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.820125  3205 raft_consensus.cc:2468] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 24.
I20260709 13:18:48.820215  3206 raft_consensus.cc:2468] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
W20260709 13:18:48.811352  3250 leader_election.cc:336] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.824446 10477 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.825047 10477 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:48.826822  3806 consensus_peers.cc:597] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.827224 10477 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:48.827343  3806 consensus_peers.cc:597] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.828539  3176 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:48.829057 10477 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.829391 10480 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:48.830256  3209 raft_consensus.cc:2468] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
W20260709 13:18:48.830977  3806 consensus_peers.cc:597] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.822151  3250 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:48.841528  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432d705ff69845aaac398233202f4081" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:48.847273  3842 raft_consensus.cc:3060] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:48.847275  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:48.848130  3279 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:48.841956  3208 raft_consensus.cc:2468] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 15.
I20260709 13:18:48.843338 10005 raft_consensus.cc:2749] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:48.848836 10477 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.855868 10477 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:48.857771  3221 tablet_copy_service.cc:140] P 43b01d5a97e149008d543a6615219928: Received BeginTabletCopySession request for tablet 2fe9b83583444570807fd6aa3bcc925d from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:38892)
I20260709 13:18:48.846634  3249 leader_election.cc:304] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:48.884394  3221 tablet_copy_service.cc:161] P 43b01d5a97e149008d543a6615219928: Beginning new tablet copy session on tablet 2fe9b83583444570807fd6aa3bcc925d from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:38892: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-2fe9b83583444570807fd6aa3bcc925d
I20260709 13:18:48.885576  3249 leader_election.cc:304] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:48.886924  3249 leader_election.cc:304] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:48.890249 10514 raft_consensus.cc:2804] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:48.891031 10514 raft_consensus.cc:697] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 24 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:48.863737  3842 raft_consensus.cc:2468] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 17.
I20260709 13:18:48.865270 10516 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:48.865926  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 54606.8us
I20260709 13:18:48.869541  3220 tablet_copy_service.cc:140] P 43b01d5a97e149008d543a6615219928: Received BeginTabletCopySession request for tablet d4df8838ab784efd9cfa105ba373b14c from peer 0930e3e7657c43bcaaa5b0778f3e08cf ({username='slave'} at 127.0.0.1:38892)
W20260709 13:18:48.877637  3806 consensus_peers.cc:597] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.877671  3176 leader_election.cc:336] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.896396 10480 raft_consensus.cc:2804] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:18:48.897207  3176 leader_election.cc:336] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.897754 10480 raft_consensus.cc:697] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:48.898641 10480 consensus_queue.cc:237] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.901265  3220 tablet_copy_service.cc:161] P 43b01d5a97e149008d543a6615219928: Beginning new tablet copy session on tablet d4df8838ab784efd9cfa105ba373b14c from peer 0930e3e7657c43bcaaa5b0778f3e08cf at {username='slave'} at 127.0.0.1:38892: session id = 0930e3e7657c43bcaaa5b0778f3e08cf-d4df8838ab784efd9cfa105ba373b14c
W20260709 13:18:48.905714  3250 leader_election.cc:336] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.906215 10507 raft_consensus.cc:2804] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:48.907810 10507 raft_consensus.cc:697] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:18:48.908226  3176 leader_election.cc:336] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.910488 10499 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.893803  3249 leader_election.cc:304] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:48.892306 10514 consensus_queue.cc:237] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.911047 10499 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:48.913559  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:48.913823  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:48.914232  3278 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
I20260709 13:18:48.914976 10499 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:48.915241  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:48.906664  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:48.918342  3250 leader_election.cc:336] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.918648 10516 raft_consensus.cc:2804] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:48.919238 10516 raft_consensus.cc:697] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:48.921291 10515 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:48.907021 10347 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.926056 10347 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.928144 10347 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:48.928694 10347 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.908900 10507 consensus_queue.cc:237] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:48.929812  3806 consensus_peers.cc:597] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.920207 10516 consensus_queue.cc:237] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.935585  3251 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:48.937779 10408 raft_consensus.cc:2804] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:48.938339 10408 raft_consensus.cc:697] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:48.938740 10005 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.939224 10005 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:48.939318 10408 consensus_queue.cc:237] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:48.941334 10005 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:48.919808  3250 leader_election.cc:336] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.933372 10347 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:48.944046  3250 leader_election.cc:336] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.949770  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:48.954576 10347 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:48.956327  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:48.959470 10518 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.959856 10477 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:48.960623 10477 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.960285 10518 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:48.963650  3842 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 18.
I20260709 13:18:48.965667  3251 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:48.966511 10347 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:48.966866 10347 raft_consensus.cc:493] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.967203 10347 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:48.975052  3176 leader_election.cc:336] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:48.975737  3176 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:48.981125 10005 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:48.967651 10477 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.981709 10005 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.005852  3220 tablet_copy_source_session.cc:215] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:49.006587 10530 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:49.009220 10530 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.011840 10530 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:49.013823  3221 tablet_copy_source_session.cc:215] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:49.015085 10005 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:49.024048 10005 raft_consensus.cc:2749] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:49.029232  2025 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 3157)
W20260709 13:18:49.032936  3250 leader_election.cc:336] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:49.034271  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:49.036855  3033 catalog_manager.cc:5697] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 23 to 24, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 24 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.036191 10347 raft_consensus.cc:515] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:49.037310  3020 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 103182us
I20260709 13:18:49.038280  3279 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 19.
W20260709 13:18:49.039317  3250 consensus_peers.cc:597] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:49.043345 10480 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:49.061441  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 86387.2us
I20260709 13:18:49.044176 10480 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.061844 10533 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:49.068809 10518 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:49.069020 10533 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.071713 10533 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:49.064940  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:49.072911  3206 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
I20260709 13:18:49.065567  3209 raft_consensus.cc:1275] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:49.076771  3176 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:49.077606  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:49.093346  3209 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 23.
I20260709 13:18:49.065503 10480 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:49.082535 10508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4df8838ab784efd9cfa105ba373b14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:49.086650  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:49.087347 10347 leader_election.cc:290] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:49.091542  3806 leader_election.cc:336] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:49.092214  3250 leader_election.cc:336] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:49.101843  3250 leader_election.cc:336] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:49.103587  3250 leader_election.cc:336] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:49.104352  3250 leader_election.cc:336] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:49.105068  3250 leader_election.cc:336] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:49.098008  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:49.098169  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:49.108352  3279 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 23.
I20260709 13:18:49.098806 10507 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:49.100304  3020 catalog_manager.cc:4755] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7b205eb6f14c40c88b346e392de18687: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:49.109586 10507 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.099259 10499 raft_consensus.cc:2749] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:49.112040 10477 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.112954 10507 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:49.114327 10499 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:49.114886 10499 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
W20260709 13:18:49.114988  3250 leader_election.cc:336] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:49.115504 10499 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:49.115761  3250 leader_election.cc:336] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:49.116747  3250 leader_election.cc:336] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:49.114425 10477 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:49.118929  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c209ebcbec0e4e4ba79f8473c2f4d39b" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:49.121460  3842 raft_consensus.cc:3060] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:49.129297  3250 leader_election.cc:336] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:49.133427  3842 raft_consensus.cc:2468] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 19.
I20260709 13:18:49.134830  3251 leader_election.cc:304] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:49.135980 10480 raft_consensus.cc:2804] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:49.136505 10480 raft_consensus.cc:697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:49.137488 10480 consensus_queue.cc:237] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:49.132462  3033 catalog_manager.cc:5697] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 19 to 20, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 20 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.144272  3033 catalog_manager.cc:5697] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 14 to 15, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 15 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.148696  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:49.149310 10533 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:49.149886 10533 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.151867 10533 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:49.154407 10477 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:49.154877 10477 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:49.155237 10477 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:49.164398 10510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe9b83583444570807fd6aa3bcc925d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:49.177927  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:49.178936 10480 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:49.179359 10480 raft_consensus.cc:493] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:49.179741 10480 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:49.181447  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 82334us
I20260709 13:18:49.182629  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:49.183271 10536 consensus_queue.cc:1048] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:49.201316 10347 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:49.202252 10347 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:49.202677 10347 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:49.194886  3176 leader_election.cc:336] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:49.194116  3033 catalog_manager.cc:5697] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 16 to 17, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 17 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.205961  3033 catalog_manager.cc:5697] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 20 to 21, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 21 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.201982  3249 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:49.192994 10477 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.213522 10480 raft_consensus.cc:515] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.215590 10504 tablet_bootstrap.cc:492] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:49.216583 10504 tablet_bootstrap.cc:492] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:18:49.217319 10504 ts_tablet_manager.cc:1403] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.653s	user 0.048s	sys 0.022s
I20260709 13:18:49.215489 10477 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:49.224195 10480 leader_election.cc:290] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:49.225274 10507 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:49.230720  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:49.231447  3209 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
W20260709 13:18:49.239471  3176 leader_election.cc:336] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:49.240873  3176 leader_election.cc:336] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:49.243471  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:49.244141  3208 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 17.
I20260709 13:18:49.244483  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:49.244848  3806 consensus_peers.cc:597] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:49.245309 10477 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:18:49.245288  3250 leader_election.cc:336] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:49.245887 10477 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:49.246276 10477 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:49.249485  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812e4fbcaef1473b9c0467dcbbfca8a3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:49.250142  3285 raft_consensus.cc:3060] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:49.250771  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:49.253443  3280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:49.253778  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9a3cde8b784484802f97dd03f5d338" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:49.254141  3280 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 25.
I20260709 13:18:49.254390  3277 raft_consensus.cc:3060] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:49.254679 10408 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:49.255148 10408 raft_consensus.cc:493] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:49.255542 10408 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:49.258056  3279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:49.258889  3279 raft_consensus.cc:2393] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 22: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
I20260709 13:18:49.261174 10510 tablet_copy_client.cc:806] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:49.261788 10510 tablet_copy_client.cc:670] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:49.271787  3285 raft_consensus.cc:2468] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:49.273527  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:49.277861  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9bf15d386d49f0977913d9628e22af" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:49.278715  3208 raft_consensus.cc:3060] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:49.278801 10005 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:49.279415 10005 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 25 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:49.279827 10005 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:49.275669  3805 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:49.294564 10347 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.193822 10499 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.305334 10347 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:49.309760  3176 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:49.311640  3208 raft_consensus.cc:2468] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 22.
W20260709 13:18:49.326565  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 51027.6us
I20260709 13:18:49.323841 10005 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.334666 10408 raft_consensus.cc:515] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.337443 10408 leader_election.cc:290] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:49.337121  3277 raft_consensus.cc:2468] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:49.330252 10518 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:49.343307 10518 raft_consensus.cc:493] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting leader election (detected failure of leader fc48eecc27554cb58b15193cd442b1d3)
I20260709 13:18:49.343767 10518 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:49.347081 10005 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 26 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:49.400189  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 90766.5us
I20260709 13:18:49.401832  3176 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:49.348722 10477 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.350325 10499 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:49.405053 10499 raft_consensus.cc:2804] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:49.405380 10477 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:49.405692 10499 raft_consensus.cc:697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:49.350910 10504 raft_consensus.cc:359] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:49.406865 10504 raft_consensus.cc:740] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:18:49.406659 10499 consensus_queue.cc:237] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.407095  3033 catalog_manager.cc:5697] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 18 to 19, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 19 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.407639 10504 consensus_queue.cc:260] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:49.348831 10540 raft_consensus.cc:2749] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:49.410306  3176 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:49.411144 10546 raft_consensus.cc:2804] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:49.411625 10546 raft_consensus.cc:697] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:49.412470 10546 consensus_queue.cc:237] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.359573 10508 tablet_copy_client.cc:806] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 0 data blocks...
W20260709 13:18:49.416152  3176 leader_election.cc:336] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:49.417605  3176 leader_election.cc:336] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:49.418494  3176 leader_election.cc:336] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:49.425107  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da022fb530574c2ba921df0848818f6b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:49.425727  3277 raft_consensus.cc:3060] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:49.425870  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114dd3d94ac84ebb8bff7ff66e92d269" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:49.426712  3285 raft_consensus.cc:3060] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:49.432185  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
W20260709 13:18:49.432893  3250 leader_election.cc:336] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:49.433429  3276 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b01d5a97e149008d543a6615219928 in current term 24: Already voted for candidate 48080cf0460346769ab046a4f9457aa5 in this term.
W20260709 13:18:49.433589  3250 leader_election.cc:336] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:49.439110 10518 raft_consensus.cc:515] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:49.423974 10508 tablet_copy_client.cc:670] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:49.424113 10504 ts_tablet_manager.cc:1434] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.206s	user 0.008s	sys 0.002s
W20260709 13:18:49.455487  3250 consensus_peers.cc:597] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:49.456174  3250 consensus_peers.cc:597] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:49.457341  3285 raft_consensus.cc:2468] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 20.
I20260709 13:18:49.457414  3842 raft_consensus.cc:1217] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 LEARNER]: Deduplicated request from leader. Original: 19.12->[19.13-19.13]   Dedup: 19.13->[]
I20260709 13:18:49.464243  3249 leader_election.cc:304] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:49.472086  3277 raft_consensus.cc:2468] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b01d5a97e149008d543a6615219928 in term 26.
I20260709 13:18:49.472719  3176 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:49.478003 10005 raft_consensus.cc:2804] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:49.478524 10005 raft_consensus.cc:697] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:49.480060  3208 raft_consensus.cc:1275] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:49.480351  3206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:49.481495  3206 raft_consensus.cc:2393] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 48080cf0460346769ab046a4f9457aa5 in current term 24: Already voted for candidate 43b01d5a97e149008d543a6615219928 in this term.
I20260709 13:18:49.482028  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9019901d1a42beb5690a4096277f3e" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:49.482259  3203 raft_consensus.cc:1275] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:49.482666  3202 raft_consensus.cc:3060] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:49.483745 10005 consensus_queue.cc:237] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.488304 10510 tablet_copy_client.cc:538] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:49.477231 10514 raft_consensus.cc:2804] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:49.475942  3294 tablet_copy_service.cc:342] P 48080cf0460346769ab046a4f9457aa5: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-233be522a83f4bea8c48247e49ee33a0 received from {username='slave'} at 127.0.0.1:52014
W20260709 13:18:49.515196  3176 leader_election.cc:336] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:49.515970  3176 leader_election.cc:336] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:49.516953  3176 leader_election.cc:336] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:49.517366  3176 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:49.480317 10518 leader_election.cc:290] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:49.512894  3294 tablet_copy_service.cc:434] P 48080cf0460346769ab046a4f9457aa5: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-233be522a83f4bea8c48247e49ee33a0 on tablet 233be522a83f4bea8c48247e49ee33a0 with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:49.522324 10539 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:49.504674 10514 raft_consensus.cc:697] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 22 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:49.524137  3206 raft_consensus.cc:1275] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:18:49.526247  3250 consensus_peers.cc:597] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:49.523149  3176 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:49.562041 10529 raft_consensus.cc:2804] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:49.562662 10529 raft_consensus.cc:697] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 26 LEADER]: Becoming Leader. State: Replica: 43b01d5a97e149008d543a6615219928, State: Running, Role: LEADER
I20260709 13:18:49.562446 10514 consensus_queue.cc:237] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.563745 10529 consensus_queue.cc:237] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.567509  3206 raft_consensus.cc:1275] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:49.568372 10512 consensus_queue.cc:1048] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:49.567538 10347 consensus_queue.cc:1048] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:18:49.573166  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:49.576892 10347 consensus_queue.cc:1048] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:49.580233 10516 consensus_queue.cc:1048] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:49.588058  3202 raft_consensus.cc:2468] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
W20260709 13:18:49.601312  3806 leader_election.cc:336] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:49.606822  3249 leader_election.cc:304] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:49.612803  3202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6e7e8eeb846ab832cf477e2ba0b35" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:49.614763  3202 raft_consensus.cc:3060] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:49.585331 10512 raft_consensus.cc:2749] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:49.640223  3202 raft_consensus.cc:2468] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 18.
I20260709 13:18:49.630873 10536 raft_consensus.cc:2804] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:18:49.655761  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 121947us
I20260709 13:18:49.653746  3025 catalog_manager.cc:5697] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 19 to 20, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 20 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.655462 10536 raft_consensus.cc:697] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
W20260709 13:18:49.705632  3250 consensus_peers.cc:597] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:49.706300  3250 consensus_peers.cc:597] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:49.717558 10510 tablet_bootstrap.cc:492] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
I20260709 13:18:49.721730 10536 consensus_queue.cc:237] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:49.778033  3805 leader_election.cc:304] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:49.758095 10508 tablet_copy_client.cc:538] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:49.782153 10542 raft_consensus.cc:2804] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:49.807142  3836 raft_consensus.cc:1275] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:49.825485  3842 raft_consensus.cc:1275] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:49.833567 10542 raft_consensus.cc:697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:49.841024 10542 consensus_queue.cc:237] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:49.851596  3250 consensus_peers.cc:597] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:49.865154 10515 consensus_queue.cc:1048] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:49.872884  3033 catalog_manager.cc:5697] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 21 to 22, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 22 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.887192  3025 catalog_manager.cc:5697] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 19 to 20, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 20 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.896150  3025 catalog_manager.cc:5697] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 19 to 20, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 20 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.900478  3025 catalog_manager.cc:5697] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 reported cstate change: term changed from 25 to 26, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 43b01d5a97e149008d543a6615219928 (127.1.250.66). New cstate: current_term: 26 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.881168 10507 consensus_queue.cc:1048] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:18:49.931819 10508 tablet_bootstrap.cc:492] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap starting.
W20260709 13:18:49.969447  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 70799.3us
W20260709 13:18:49.970388  3251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 71807.5us
I20260709 13:18:50.019347  3031 catalog_manager.cc:5697] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 17 to 18, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 18 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:50.027107  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45382.4us
W20260709 13:18:50.032727  2025 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 3157)
W20260709 13:18:50.038811  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 116450us
I20260709 13:18:50.045318  3276 raft_consensus.cc:1275] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:50.048632  3277 raft_consensus.cc:1275] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:50.066172 10005 consensus_queue.cc:1048] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:50.092016  3203 raft_consensus.cc:1275] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:50.102902 10530 raft_consensus.cc:1064] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:18:50.108083 10530 consensus_queue.cc:237] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:50.096112 10529 consensus_queue.cc:1048] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
W20260709 13:18:50.113005  3250 consensus_peers.cc:597] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:50.116436  3279 raft_consensus.cc:1275] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:50.128633 10539 consensus_queue.cc:1048] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:50.140973  3277 raft_consensus.cc:1275] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 26 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:18:50.137254 10566 consensus_queue.cc:1048] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
W20260709 13:18:50.245782  3176 consensus_peers.cc:597] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:50.247888  3176 consensus_peers.cc:597] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:50.261895 10532 consensus_queue.cc:1048] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:18:50.295531  3836 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 LEARNER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:18:50.301168  3207 raft_consensus.cc:1275] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:18:50.309185  3806 consensus_peers.cc:597] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:50.310686  3207 raft_consensus.cc:1275] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:18:50.309039  3033 catalog_manager.cc:5697] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 20 to 21, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 21 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:50.329200 10563 consensus_queue.cc:1048] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:50.337896  3176 consensus_peers.cc:597] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:50.338459  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 68809.8us
W20260709 13:18:50.339617  3176 consensus_peers.cc:597] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:50.326537 10536 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:18:50.356529 10535 consensus_queue.cc:1048] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:50.446955  3204 raft_consensus.cc:1275] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Refusing update from remote peer 0930e3e7657c43bcaaa5b0778f3e08cf: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 13:18:50.475500  3176 consensus_peers.cc:597] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.533223  3176 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111) [suppressed 377 similar messages]
W20260709 13:18:50.541958  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 58104.2us
W20260709 13:18:50.589483  3805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 46737us
I20260709 13:18:50.591022 10589 consensus_queue.cc:1048] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:18:50.601815  3176 consensus_peers.cc:597] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.645000  3250 consensus_peers.cc:597] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:50.646265  3250 consensus_peers.cc:597] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:50.650925 10516 raft_consensus.cc:2955] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:50.657284  3209 raft_consensus.cc:2955] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:18:50.650925  3250 consensus_peers.cc:597] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.668423  3250 consensus_peers.cc:597] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:50.715334  3837 raft_consensus.cc:2955] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:50.707032  3033 catalog_manager.cc:5697] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index 13 to 14, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:18:50.720980 10510 log.cc:927] Time spent T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:18:50.729184 10510 tablet_bootstrap.cc:492] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:50.730182 10510 tablet_bootstrap.cc:492] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:18:50.734462 10510 ts_tablet_manager.cc:1403] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 1.017s	user 0.057s	sys 0.021s
I20260709 13:18:50.743818 10510 raft_consensus.cc:359] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:50.744767 10510 raft_consensus.cc:740] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:18:50.747417 10508 tablet_bootstrap.cc:492] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:50.748441 10508 tablet_bootstrap.cc:492] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf: Bootstrap complete.
I20260709 13:18:50.745503 10510 consensus_queue.cc:260] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:18:50.759330  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 54934.1us
I20260709 13:18:50.760226 10510 ts_tablet_manager.cc:1434] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.003s
I20260709 13:18:50.749261 10508 ts_tablet_manager.cc:1403] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent bootstrapping tablet: real 0.818s	user 0.059s	sys 0.016s
I20260709 13:18:50.777900 10508 raft_consensus.cc:359] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
I20260709 13:18:50.778803 10508 raft_consensus.cc:740] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Initialized, Role: LEARNER
I20260709 13:18:50.779489 10508 consensus_queue.cc:260] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: NON_VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: true } }
W20260709 13:18:50.782635  3250 consensus_peers.cc:597] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:50.785933  3837 raft_consensus.cc:1217] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 LEARNER]: Deduplicated request from leader. Original: 20.12->[20.13-20.13]   Dedup: 20.13->[]
I20260709 13:18:50.787284  3221 tablet_copy_service.cc:342] P 43b01d5a97e149008d543a6615219928: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-2fe9b83583444570807fd6aa3bcc925d received from {username='slave'} at 127.0.0.1:38892
I20260709 13:18:50.787719  3221 tablet_copy_service.cc:434] P 43b01d5a97e149008d543a6615219928: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-2fe9b83583444570807fd6aa3bcc925d on tablet 2fe9b83583444570807fd6aa3bcc925d with peer 0930e3e7657c43bcaaa5b0778f3e08cf
I20260709 13:18:50.797896 10508 ts_tablet_manager.cc:1434] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
W20260709 13:18:50.843551  3176 consensus_peers.cc:597] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:50.855314  3221 tablet_copy_service.cc:342] P 43b01d5a97e149008d543a6615219928: Request end of tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-d4df8838ab784efd9cfa105ba373b14c received from {username='slave'} at 127.0.0.1:38892
I20260709 13:18:50.855754  3221 tablet_copy_service.cc:434] P 43b01d5a97e149008d543a6615219928: ending tablet copy session 0930e3e7657c43bcaaa5b0778f3e08cf-d4df8838ab784efd9cfa105ba373b14c on tablet d4df8838ab784efd9cfa105ba373b14c with peer 0930e3e7657c43bcaaa5b0778f3e08cf
W20260709 13:18:50.859858  3176 consensus_peers.cc:597] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.860338  3176 consensus_peers.cc:597] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.913177  3176 consensus_peers.cc:597] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.913697  3176 consensus_peers.cc:597] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.917295  3176 consensus_peers.cc:597] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.998082  3250 consensus_peers.cc:597] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.033211  2025 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 3157)
W20260709 13:18:51.081696  3250 consensus_peers.cc:597] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.118619  3806 consensus_peers.cc:597] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:51.122695  3837 raft_consensus.cc:1217] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 LEARNER]: Deduplicated request from leader. Original: 24.14->[24.15-24.15]   Dedup: 24.15->[]
W20260709 13:18:51.174466  3176 consensus_peers.cc:597] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.178285  3176 consensus_peers.cc:597] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.182351  3250 consensus_peers.cc:597] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.206871  3250 consensus_peers.cc:597] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.233209  3250 consensus_peers.cc:597] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.242959  3020 catalog_manager.cc:4755] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7b205eb6f14c40c88b346e392de18687: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:51.246737  3250 consensus_peers.cc:597] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.261539  3806 consensus_peers.cc:597] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.268433  3806 consensus_peers.cc:597] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.334180  3250 consensus_peers.cc:597] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.340299  3806 consensus_peers.cc:597] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.343984  3250 consensus_peers.cc:597] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:51.358014 10539 raft_consensus.cc:1064] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:18:51.361052 10539 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:51.389987  3176 consensus_peers.cc:597] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.394104  3250 consensus_peers.cc:597] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:51.405753  3837 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 LEARNER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:18:51.425280  3806 consensus_peers.cc:597] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:51.424515 10499 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:18:51.439291  3176 consensus_peers.cc:597] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.439901  3176 consensus_peers.cc:597] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:51.442653  3277 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:51.445273 10529 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:18:51.467831  3176 consensus_peers.cc:597] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.468704  3806 consensus_peers.cc:597] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.477403 10597 log.cc:927] Time spent T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:18:51.512996 10529 raft_consensus.cc:2955] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:51.525578 10516 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.526209 10516 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:51.528527 10516 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:51.528759  3277 raft_consensus.cc:2955] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:51.534089  3203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928" is_pre_election: true
I20260709 13:18:51.534854  3203 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 24.
I20260709 13:18:51.539983  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:51.542128 10555 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:51.542608 10555 raft_consensus.cc:493] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.542972 10555 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:51.555965  3250 leader_election.cc:336] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:51.556839  3031 catalog_manager.cc:5697] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 reported cstate change: config changed from index 13 to 14, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:51.577273  3835 raft_consensus.cc:2955] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } attrs { replace: true } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:51.600615 10555 raft_consensus.cc:515] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:51.612085 10555 leader_election.cc:290] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 election: Requested vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:51.616127  3806 consensus_peers.cc:597] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.616457  3250 leader_election.cc:336] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:51.619026  3249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:42299, user_credentials={real_user=slave}} blocked reactor thread for 45418.4us
I20260709 13:18:51.621788  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faebd952bf73433d84a3292167ecd165" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "43b01d5a97e149008d543a6615219928"
I20260709 13:18:51.622649  3209 raft_consensus.cc:3060] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:51.654536  3209 raft_consensus.cc:2468] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 25.
I20260709 13:18:51.657155  3249 leader_election.cc:304] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5; no voters: fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:51.658090 10516 raft_consensus.cc:2804] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:51.665529 10516 raft_consensus.cc:697] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 25 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:51.666826 10516 consensus_queue.cc:237] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:51.675009  3209 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:51.681672  3835 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:51.683502 10533 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:51.693552 10499 raft_consensus.cc:2955] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:18:51.702400  3806 consensus_peers.cc:597] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:51.703289  3835 raft_consensus.cc:2955] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:51.758328  3276 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:51.777367 10529 raft_consensus.cc:1064] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: attempting to promote NON_VOTER 0930e3e7657c43bcaaa5b0778f3e08cf to VOTER
I20260709 13:18:51.780177 10529 consensus_queue.cc:237] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 13, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:51.795316 10539 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:51.811718  3276 raft_consensus.cc:2955] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:51.826088  3019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2fe9b83583444570807fd6aa3bcc925d with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:18:51.848316  3176 consensus_peers.cc:597] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:51.848779  3033 catalog_manager.cc:5697] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 23 to 25, leader changed from fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 25 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:51.855476  3177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:40703, user_credentials={real_user=slave}} blocked reactor thread for 80376.3us
I20260709 13:18:51.862197  3276 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:51.873003  3031 catalog_manager.cc:5697] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: config changed from index 14 to 15, VOTER fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65) evicted. New cstate: current_term: 20 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
I20260709 13:18:51.892144 10604 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:51.896384  3841 raft_consensus.cc:1275] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 LEARNER]: Refusing update from remote peer 43b01d5a97e149008d543a6615219928: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:51.901363 10608 consensus_queue.cc:1048] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:18:51.896356  3250 consensus_peers.cc:597] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:52.016923 10604 raft_consensus.cc:2955] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index 15 to 16, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:18:52.022529  3250 consensus_peers.cc:597] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:52.034528  2025 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 3157)
I20260709 13:18:52.040153  3841 raft_consensus.cc:2955] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:18:52.058506  3250 consensus_peers.cc:597] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:52.061455  3033 catalog_manager.cc:5697] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 reported cstate change: config changed from index 15 to 16, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "43b01d5a97e149008d543a6615219928" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:52.067345  3250 consensus_peers.cc:597] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:52.081573  3276 raft_consensus.cc:2955] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } } }
W20260709 13:18:52.086853  3250 consensus_peers.cc:597] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:52.182426  3209 raft_consensus.cc:1275] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 25 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:18:52.184535 10601 consensus_queue.cc:1048] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:18:52.207862  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45315.6us
W20260709 13:18:52.242084  3250 consensus_peers.cc:597] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:52.308220  3020 catalog_manager.cc:4755] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2fe9b83583444570807fd6aa3bcc925d: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:52.401409  3250 consensus_peers.cc:597] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:52.486685  3176 consensus_peers.cc:597] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:52.601332  3176 consensus_peers.cc:597] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:52.628949  3176 consensus_peers.cc:597] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:52.773564  3250 consensus_peers.cc:597] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:52.779034  3176 consensus_peers.cc:597] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:52.862699  3250 consensus_peers.cc:597] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:52.943004  3806 consensus_peers.cc:597] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:52.995054  3250 consensus_peers.cc:597] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:52.989964  3176 consensus_peers.cc:597] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:53.035305  2025 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 3157)
W20260709 13:18:53.135761  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 56399.5us
W20260709 13:18:53.179713  3176 consensus_peers.cc:597] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.224702  3250 consensus_peers.cc:597] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:53.249437  3176 consensus_peers.cc:597] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.254205  3250 consensus_peers.cc:597] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:53.335012  3020 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 142896us
W20260709 13:18:53.337738  3020 catalog_manager.cc:4755] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2fe9b83583444570807fd6aa3bcc925d: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:53.350109  3176 consensus_peers.cc:597] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.361434  3176 consensus_peers.cc:597] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.383232  3250 consensus_peers.cc:597] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.410764  3250 consensus_peers.cc:597] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.588896  3176 consensus_peers.cc:597] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.666262  3176 consensus_peers.cc:597] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.691359  3250 consensus_peers.cc:597] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.718127  3806 consensus_peers.cc:597] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.753592  3806 consensus_peers.cc:597] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.765291  3250 consensus_peers.cc:597] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.780679  3176 consensus_peers.cc:597] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.788170  3250 consensus_peers.cc:597] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.799258  3176 consensus_peers.cc:597] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.815951  3806 consensus_peers.cc:597] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.908777  3806 consensus_peers.cc:597] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.926460  3176 consensus_peers.cc:597] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.937175  3250 consensus_peers.cc:597] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:54.031760  3806 consensus_peers.cc:597] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:54.036392  2025 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 3157)
W20260709 13:18:54.069175  3250 consensus_peers.cc:597] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:54.114843  3250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41323, user_credentials={real_user=slave}} blocked reactor thread for 45709.8us
W20260709 13:18:54.119899  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 46515.7us
W20260709 13:18:54.153059  3806 consensus_peers.cc:597] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:54.191913  3250 consensus_peers.cc:597] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:54.200553  3176 consensus_peers.cc:597] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:54.264565  3806 consensus_peers.cc:597] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:54.272143  3250 consensus_peers.cc:597] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:54.296036  3250 consensus_peers.cc:597] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:54.301872  3250 consensus_peers.cc:597] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:54.298208  3806 consensus_peers.cc:597] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:54.477596  3176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 114799us
W20260709 13:18:54.488168  3020 catalog_manager.cc:4755] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2fe9b83583444570807fd6aa3bcc925d: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:54.495982  3250 consensus_peers.cc:597] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:54.535105  3250 consensus_peers.cc:597] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:54.578336  3250 consensus_peers.cc:597] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.606415  3250 consensus_peers.cc:597] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:54.645478  3176 consensus_peers.cc:597] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.727595  3250 consensus_peers.cc:597] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:54.873515  3176 consensus_peers.cc:597] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:55.014577  3250 consensus_peers.cc:597] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:55.036885  2025 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 3157)
W20260709 13:18:55.063906  3176 consensus_peers.cc:597] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:55.274526  3176 consensus_peers.cc:597] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:55.278038  3250 consensus_peers.cc:597] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:55.319789  3806 consensus_peers.cc:597] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:55.355232  3250 consensus_peers.cc:597] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:55.370425  3250 consensus_peers.cc:597] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:55.417649  3250 consensus_peers.cc:597] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:55.491117  3176 consensus_peers.cc:597] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:55.556144  3250 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111) [suppressed 488 similar messages]
W20260709 13:18:55.593573  3176 consensus_peers.cc:597] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:55.610458  3250 consensus_peers.cc:597] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:55.613281  3176 consensus_peers.cc:597] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:55.661244  3250 consensus_peers.cc:597] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:55.798885  3176 consensus_peers.cc:597] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:55.853719  3176 consensus_peers.cc:597] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:55.864778  3176 consensus_peers.cc:597] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:56.034495  2025 tablet_server.cc:196] TabletServer@127.1.250.65:0 shutdown complete.
W20260709 13:18:56.113098  3250 consensus_peers.cc:597] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.229280  3806 consensus_peers.cc:597] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.292526  3250 consensus_peers.cc:597] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.299144  3250 consensus_peers.cc:597] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.299671  3250 consensus_peers.cc:597] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.293815  3176 consensus_peers.cc:597] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.314019  3250 consensus_peers.cc:597] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.325886  3176 consensus_peers.cc:597] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.333664  3806 consensus_peers.cc:597] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.384132  3250 consensus_peers.cc:597] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.434469  3806 consensus_peers.cc:597] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.456023  3250 consensus_peers.cc:597] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:56.490192  3176 consensus_peers.cc:597] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.514312  3806 consensus_peers.cc:597] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.524147  3806 consensus_peers.cc:597] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.535851  3176 consensus_peers.cc:597] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.584143  3020 catalog_manager.cc:4755] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2fe9b83583444570807fd6aa3bcc925d: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:56.586607  3250 consensus_peers.cc:597] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.590970  3806 consensus_peers.cc:597] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:56.670329  2025 tablet_server.cc:179] TabletServer@127.1.250.66:0 shutting down...
W20260709 13:18:56.672142  3250 consensus_peers.cc:597] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.674391  3250 consensus_peers.cc:597] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:56.700685  3249 consensus_peers.cc:597] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.702262  3176 consensus_peers.cc:597] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.705736  3249 consensus_peers.cc:597] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.736013  3806 consensus_peers.cc:597] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.754737  3805 consensus_peers.cc:597] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.769855  3249 consensus_peers.cc:597] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.778060  3249 consensus_peers.cc:597] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.780404  3805 consensus_peers.cc:597] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.796492  3249 consensus_peers.cc:597] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.801105  3176 consensus_peers.cc:597] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:56.804479  3176 consensus_peers.cc:597] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.819152  3249 consensus_peers.cc:597] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.825178  3805 consensus_peers.cc:597] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.830432  3805 consensus_peers.cc:597] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.833642  3249 consensus_peers.cc:597] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.868780  3249 consensus_peers.cc:597] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.884651  3249 consensus_peers.cc:597] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.886458  3806 consensus_peers.cc:597] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.892606  3805 consensus_peers.cc:597] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.911332  3805 consensus_peers.cc:597] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.927968  3249 consensus_peers.cc:597] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.930656  3805 consensus_peers.cc:597] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.937201  3249 consensus_peers.cc:597] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.941151  3250 consensus_peers.cc:597] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:56.958609  3249 consensus_peers.cc:597] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.973436  3805 consensus_peers.cc:597] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:57.002729  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:18:57.022634  3250 consensus_peers.cc:597] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:57.032732  2025 tablet_replica.cc:333] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.034039  2025 raft_consensus.cc:2243] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.034884  2025 raft_consensus.cc:2272] T 104b1eb7d49f449095e30c69e8680096 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.041193  2025 tablet_replica.cc:333] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.048141  2025 raft_consensus.cc:2243] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.049604  2025 raft_consensus.cc:2272] T 023c1461b69c46bdb3c42ee16f303ea2 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.060036  2025 tablet_replica.cc:333] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.066592  2025 raft_consensus.cc:2243] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.067931  2025 raft_consensus.cc:2272] T a6ed1a03592e491cbb924069df406f18 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:57.064026  3249 consensus_peers.cc:597] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:57.070947  3249 consensus_peers.cc:597] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:57.075700  3805 consensus_peers.cc:597] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:57.079763  2025 tablet_replica.cc:333] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.087659  2025 raft_consensus.cc:2243] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:18:57.093017  3176 consensus_peers.cc:597] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:57.101425  2025 raft_consensus.cc:2272] T 66614160a1bf4bb49ea02007f6679b0f P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:57.102224  3250 consensus_peers.cc:597] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:57.102030  3249 consensus_peers.cc:597] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:57.106835  3249 consensus_peers.cc:597] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:57.111128  3805 consensus_peers.cc:597] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:57.111971  3249 consensus_peers.cc:597] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:57.112638  3249 consensus_peers.cc:597] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:57.118799  2025 tablet_replica.cc:333] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.120092  2025 raft_consensus.cc:2243] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.121685  2025 raft_consensus.cc:2272] T 2d7a98c6990948fab7c20936964c4d3e P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:57.138311  3805 consensus_peers.cc:597] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:57.144253  2025 tablet_replica.cc:333] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.146620  2025 raft_consensus.cc:2243] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.147905  2025 raft_consensus.cc:2272] T 3af680172a5440a2bfa7e8a99ea9c1fc P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:57.188341  3250 consensus_peers.cc:597] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:57.172274  2025 tablet_replica.cc:333] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.203711  2025 raft_consensus.cc:2243] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.205047  2025 raft_consensus.cc:2272] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.208746  2025 tablet_replica.cc:333] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.233614  2025 raft_consensus.cc:2243] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.237015  2025 raft_consensus.cc:2272] T 2ae5c762a7f347f4a2de941d47ed1903 P 43b01d5a97e149008d543a6615219928 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.240680  2025 tablet_replica.cc:333] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.241673  2025 raft_consensus.cc:2243] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.248088  2025 raft_consensus.cc:2272] T c414d51e428042c596cb410c48956c63 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.251475  2025 tablet_replica.cc:333] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.252540  2025 raft_consensus.cc:2243] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.253270  2025 raft_consensus.cc:2272] T 2e805018f85b41fc88644215be011084 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.256070  2025 tablet_replica.cc:333] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.257156  2025 raft_consensus.cc:2243] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.261732  2025 raft_consensus.cc:2272] T 9d10d3c525b541649db9c882a1398789 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.271559  2025 tablet_replica.cc:333] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.272593  2025 raft_consensus.cc:2243] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.274084  2025 raft_consensus.cc:2272] T 8e1a4d71ef0f4287999b5ee60fe02740 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.301605  2025 tablet_replica.cc:333] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.302460  2025 raft_consensus.cc:2243] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.303323  2025 raft_consensus.cc:2272] T b7ab044361f54dae84978720aac3998c P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.314366  2025 tablet_replica.cc:333] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.315462  2025 raft_consensus.cc:2243] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.316174  2025 raft_consensus.cc:2272] T 5881853d6b7b4e038027c4a93fdc0b41 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:57.321825  3250 consensus_peers.cc:597] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:57.326289  2025 tablet_replica.cc:333] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.327567  2025 raft_consensus.cc:2243] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.328686  2025 raft_consensus.cc:2272] T 114dd3d94ac84ebb8bff7ff66e92d269 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.342432  2025 tablet_replica.cc:333] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.343317  2025 raft_consensus.cc:2243] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.344583  2025 raft_consensus.cc:2272] T 37a53418fbf14b998493923afc272c3c P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.347344  2025 tablet_replica.cc:333] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.348635  2025 raft_consensus.cc:2243] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.349481  2025 raft_consensus.cc:2272] T c7276ed9ac0542f885cc824522eb9d58 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.352461  2025 tablet_replica.cc:333] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.369881  2025 raft_consensus.cc:2243] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.370600  2025 raft_consensus.cc:2272] T 874b2f5f161c46be919ed69ca338da41 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.381801  2025 tablet_replica.cc:333] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.382762  2025 raft_consensus.cc:2243] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.383534  2025 raft_consensus.cc:2272] T 404209c6105f4945b077c33471d63370 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.386596  2025 tablet_replica.cc:333] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.387610  2025 raft_consensus.cc:2243] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.388248  2025 raft_consensus.cc:2272] T de07cb03de034f1bae53ef08d27db7a7 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.413842  2025 tablet_replica.cc:333] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.414808  2025 raft_consensus.cc:2243] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.415570  2025 raft_consensus.cc:2272] T c258b23309c4453b850ba59d3011c806 P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.418697  2025 tablet_replica.cc:333] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.419502  2025 raft_consensus.cc:2243] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.420684  2025 raft_consensus.cc:2272] T 23d682925c4b46799576472fe9f97a07 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.426950  2025 tablet_replica.cc:333] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.427733  2025 raft_consensus.cc:2243] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.432489  2025 raft_consensus.cc:2272] T 772d700b048349bf9547efac6befb60d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.435237  2025 tablet_replica.cc:333] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.436111  2025 raft_consensus.cc:2243] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.436751  2025 raft_consensus.cc:2272] T a455058d628f40fc9d810a0d764560dd P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.453245  2025 tablet_replica.cc:333] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.454072  2025 raft_consensus.cc:2243] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.456036  2025 raft_consensus.cc:2272] T 6b9a3cde8b784484802f97dd03f5d338 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.458714  2025 tablet_replica.cc:333] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.465593  2025 raft_consensus.cc:2243] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.466687  2025 raft_consensus.cc:2272] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.471621  2025 tablet_replica.cc:333] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.486732  2025 raft_consensus.cc:2243] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.488664  2025 raft_consensus.cc:2272] T d4df8838ab784efd9cfa105ba373b14c P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.491832  2025 tablet_replica.cc:333] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.494280  2025 raft_consensus.cc:2243] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.495858  2025 raft_consensus.cc:2272] T f0e8f18d12244c29aac431f7d6786d0b P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:57.527956  3806 consensus_peers.cc:597] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:57.542889  2025 tablet_replica.cc:333] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.544392  2025 raft_consensus.cc:2243] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.566582  2025 raft_consensus.cc:2272] T dea47b33000a4a0e9cb380dbe716761d P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.579404  2025 tablet_replica.cc:333] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.580541  2025 raft_consensus.cc:2243] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.586339  2025 raft_consensus.cc:2272] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.590554  2025 tablet_replica.cc:333] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.615254  2025 raft_consensus.cc:2243] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.616523  2025 raft_consensus.cc:2272] T 56db43db40f644309c6db08523b1b033 P 43b01d5a97e149008d543a6615219928 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.619454  2025 tablet_replica.cc:333] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.637609  2025 raft_consensus.cc:2243] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.638886  2025 raft_consensus.cc:2272] T ea9019901d1a42beb5690a4096277f3e P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:57.659515  3250 consensus_peers.cc:597] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:57.670044  2025 tablet_replica.cc:333] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.678900  2025 raft_consensus.cc:2243] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.681293  2025 raft_consensus.cc:2272] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:57.691375 10644 raft_consensus.cc:670] T 7b205eb6f14c40c88b346e392de18687 P 43b01d5a97e149008d543a6615219928: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 13:18:57.705951  2025 tablet_replica.cc:333] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.706888  2025 raft_consensus.cc:2243] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.708649  2025 raft_consensus.cc:2272] T bce4572fe1d742f8b02088bc9e1bbbba P 43b01d5a97e149008d543a6615219928 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.712945  2025 tablet_replica.cc:333] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.721817  2025 raft_consensus.cc:2243] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.725534  2025 raft_consensus.cc:2272] T b4f37f97e44445a8978d2cde7a9c9c58 P 43b01d5a97e149008d543a6615219928 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.735795  2025 tablet_replica.cc:333] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.735934 10644 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:18:57.741231  2025 raft_consensus.cc:2243] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.742715  2025 raft_consensus.cc:2272] T 4d7eb1bec1634d2784b28588ef1161c0 P 43b01d5a97e149008d543a6615219928 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.741047 10644 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:57.747499  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:57.749636  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233be522a83f4bea8c48247e49ee33a0" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:57.751150  3176 leader_election.cc:336] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:57.751896  3177 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:57.753101 10622 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:57.758455 10644 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:57.761094  2025 tablet_replica.cc:333] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.762156  2025 raft_consensus.cc:2243] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.766299  2025 raft_consensus.cc:2272] T 94bb18481fd64fec92315ec868c651f4 P 43b01d5a97e149008d543a6615219928 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.769327  2025 tablet_replica.cc:333] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.771335 10644 raft_consensus.cc:493] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
W20260709 13:18:57.777329  3250 consensus_peers.cc:597] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:57.785578 10644 raft_consensus.cc:515] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:57.786665  2025 raft_consensus.cc:2243] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.787395  2025 raft_consensus.cc:2272] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.787993 10644 leader_election.cc:290] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:57.791364  2025 tablet_replica.cc:333] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.792294  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4861cf36e0334e60863d0921b834dd0b" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:57.794003  2025 raft_consensus.cc:2243] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.794811  2025 raft_consensus.cc:2272] T f97b7c75c06648e2b8f08f69dcb106af P 43b01d5a97e149008d543a6615219928 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.802381 10644 raft_consensus.cc:493] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0930e3e7657c43bcaaa5b0778f3e08cf)
W20260709 13:18:57.803159  3176 leader_election.cc:336] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:57.809485  3176 leader_election.cc:304] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:57.810238  3176 raft_consensus.cc:2686] T 4861cf36e0334e60863d0921b834dd0b P 43b01d5a97e149008d543a6615219928: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:18:57.809512 10644 raft_consensus.cc:515] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:57.813475  2025 tablet_replica.cc:333] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.814246 10644 leader_election.cc:290] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:57.814339  2025 raft_consensus.cc:2243] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.815913  2025 raft_consensus.cc:2272] T c85d4a2b8cd74bd69285c748e4453e24 P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.816486  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:57.818259  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386629ac4b1c40a2973b2650d0165bc3" candidate_uuid: "43b01d5a97e149008d543a6615219928" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:57.824086  3176 leader_election.cc:304] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b01d5a97e149008d543a6615219928; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:57.825379 10644 raft_consensus.cc:2749] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:57.827085  2025 tablet_replica.cc:333] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.840232  2025 raft_consensus.cc:2243] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.841274  2025 raft_consensus.cc:2272] T faebd952bf73433d84a3292167ecd165 P 43b01d5a97e149008d543a6615219928 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.848711  2025 tablet_replica.cc:333] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.849596  2025 raft_consensus.cc:2243] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.858351  2025 raft_consensus.cc:2272] T 386629ac4b1c40a2973b2650d0165bc3 P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.861240  2025 tablet_replica.cc:333] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.869727  2025 raft_consensus.cc:2243] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.870819  2025 raft_consensus.cc:2272] T 233be522a83f4bea8c48247e49ee33a0 P 43b01d5a97e149008d543a6615219928 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.873857  2025 tablet_replica.cc:333] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.881659  2025 raft_consensus.cc:2243] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.883217  2025 raft_consensus.cc:2272] T da022fb530574c2ba921df0848818f6b P 43b01d5a97e149008d543a6615219928 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.886394  2025 tablet_replica.cc:333] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.893766  2025 raft_consensus.cc:2243] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.901842  2025 raft_consensus.cc:2272] T ce9155778cd542acbbc8b00bd8b7316c P 43b01d5a97e149008d543a6615219928 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.905514  2025 tablet_replica.cc:333] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.918099  2025 raft_consensus.cc:2243] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.921850  2025 raft_consensus.cc:2272] T cd9bf15d386d49f0977913d9628e22af P 43b01d5a97e149008d543a6615219928 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.931754  2025 tablet_replica.cc:333] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.932569  2025 raft_consensus.cc:2243] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:57.933813  2025 raft_consensus.cc:2272] T 2fe9b83583444570807fd6aa3bcc925d P 43b01d5a97e149008d543a6615219928 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:57.936910  2025 tablet_replica.cc:333] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928: stopping tablet replica
I20260709 13:18:57.940193  2025 raft_consensus.cc:2243] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:57.940899  2025 raft_consensus.cc:2272] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 43b01d5a97e149008d543a6615219928 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:57.962478  3250 consensus_peers.cc:597] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:57.969305  3250 consensus_peers.cc:597] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:57.989799  3250 consensus_peers.cc:597] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.034746  3250 consensus_peers.cc:597] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:58.113539 10645 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.114161 10645 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:58.116444 10645 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:58.130424  3805 leader_election.cc:336] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:58.130972  3806 leader_election.cc:336] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:58.131561  3806 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:58.132735 10645 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:58.188428 10645 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.189069 10645 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:58.195262 10645 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:58.198192  3805 leader_election.cc:336] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:58.200968  3806 leader_election.cc:336] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:58.201507  3806 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:58.202260 10645 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:58.252278 10649 raft_consensus.cc:493] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.252929 10649 raft_consensus.cc:515] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:58.255178 10649 leader_election.cc:290] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:58.260656  3250 leader_election.cc:336] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:58.281942  3249 leader_election.cc:336] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:58.282442  3249 leader_election.cc:304] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:58.283280 10649 raft_consensus.cc:2749] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:18:58.310168  3250 consensus_peers.cc:597] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:58.417344 10638 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.417963 10638 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:58.424073 10638 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:58.425921  3805 leader_election.cc:336] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:58.436946  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:58.439667  3806 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:58.440596 10645 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:18:58.443958  3806 leader_election.cc:336] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:58.480670 10650 raft_consensus.cc:493] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.481256 10650 raft_consensus.cc:515] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:58.483382 10650 leader_election.cc:290] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:58.488581  3249 leader_election.cc:336] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
W20260709 13:18:58.501149  3250 leader_election.cc:336] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:58.501642  3250 leader_election.cc:304] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:58.502445 10650 raft_consensus.cc:2749] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:58.516007 10645 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.516754 10645 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:58.519106 10645 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:58.527303  3805 leader_election.cc:336] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
W20260709 13:18:58.540091  3806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:41801, user_credentials={real_user=slave}} blocked reactor thread for 45004.6us
W20260709 13:18:58.573483  3806 leader_election.cc:336] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:58.574069  3806 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:58.574844 10638 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:58.586549 10650 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.587169 10650 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:58.591142  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
W20260709 13:18:58.595218  3249 leader_election.cc:336] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:58.595671  3249 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 43b01d5a97e149008d543a6615219928
I20260709 13:18:58.596410 10650 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:58.596937 10649 raft_consensus.cc:2749] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:58.622557 10650 raft_consensus.cc:493] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.623245 10650 raft_consensus.cc:515] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:58.629383 10650 leader_election.cc:290] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:58.630815  3250 leader_election.cc:336] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:58.636268  3249 leader_election.cc:336] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:58.645627  3249 leader_election.cc:304] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:58.647249 10650 raft_consensus.cc:2749] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:58.667685 10638 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.668493 10638 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:58.672598  3250 consensus_peers.cc:597] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:58.674842  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:58.675588  3277 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 15.
I20260709 13:18:58.677634  3806 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:58.678709 10653 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:58.679123 10653 raft_consensus.cc:493] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.679507 10653 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:58.683359  3805 leader_election.cc:336] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:58.688300 10650 raft_consensus.cc:493] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.689145 10650 raft_consensus.cc:515] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:58.691571 10650 leader_election.cc:290] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:58.698969 10637 raft_consensus.cc:493] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.699518 10637 raft_consensus.cc:515] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:58.702746  3250 leader_election.cc:336] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:58.703366  3249 leader_election.cc:336] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:58.703750  3249 leader_election.cc:304] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:58.705667 10649 raft_consensus.cc:2749] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:58.707036 10645 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.707854 10645 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:58.714227 10645 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:58.715588 10638 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:58.718071 10649 raft_consensus.cc:493] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.718675 10649 raft_consensus.cc:515] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:58.721544 10649 leader_election.cc:290] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:58.728777 10637 leader_election.cc:290] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:58.738713  3805 leader_election.cc:336] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:58.749979 10654 raft_consensus.cc:493] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.750590 10654 raft_consensus.cc:515] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:58.753835 10654 leader_election.cc:290] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:58.754660  3249 leader_election.cc:336] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
W20260709 13:18:58.755235  3249 leader_election.cc:336] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:58.757982 10653 raft_consensus.cc:515] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:58.760216 10653 leader_election.cc:290] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:18:58.760524  3806 leader_election.cc:336] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:58.761179  3806 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:58.762107  3806 consensus_peers.cc:597] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.762377  3249 leader_election.cc:336] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:58.762284 10645 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:58.763712  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1a4d71ef0f4287999b5ee60fe02740" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5"
I20260709 13:18:58.770044  3277 raft_consensus.cc:3060] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:58.772859  3805 leader_election.cc:336] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
W20260709 13:18:58.776955  3806 consensus_peers.cc:597] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:58.794239 10655 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.795619 10655 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:58.798134 10655 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:58.798947  3277 raft_consensus.cc:2468] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0930e3e7657c43bcaaa5b0778f3e08cf in term 16.
I20260709 13:18:58.801144  3806 leader_election.cc:304] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:18:58.801879  3250 leader_election.cc:336] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:58.801945 10645 raft_consensus.cc:2804] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:58.802822 10645 raft_consensus.cc:697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Becoming Leader. State: Replica: 0930e3e7657c43bcaaa5b0778f3e08cf, State: Running, Role: LEADER
I20260709 13:18:58.804481  3250 leader_election.cc:304] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:58.804814  3805 leader_election.cc:336] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:58.804406 10645 consensus_queue.cc:237] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:58.806456 10650 raft_consensus.cc:2749] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:58.807391  3250 consensus_peers.cc:597] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.807842  3250 leader_election.cc:336] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:58.808202  3250 leader_election.cc:304] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:18:58.810039  3249 consensus_peers.cc:597] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:58.810233  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
I20260709 13:18:58.810729 10650 raft_consensus.cc:2749] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:58.811909  3250 leader_election.cc:336] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:58.812067  3806 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:58.812330  3250 leader_election.cc:304] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:58.812844 10655 raft_consensus.cc:2749] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:58.812999 10650 raft_consensus.cc:2749] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:58.821323 10650 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.821877 10650 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:58.825973  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:58.826699  3837 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 13.
I20260709 13:18:58.828919  3251 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 
I20260709 13:18:58.829903 10657 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:58.831981 10657 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.832392 10657 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:58.838486 10650 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:58.841220  2025 tablet_server.cc:196] TabletServer@127.1.250.66:0 shutdown complete.
W20260709 13:18:58.844710  3806 consensus_peers.cc:597] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:58.845775 10657 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:58.847990 10657 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:58.849776  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a53418fbf14b998493923afc272c3c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:58.852867  3837 raft_consensus.cc:3060] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:58.849040  3033 catalog_manager.cc:5697] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf reported cstate change: term changed from 15 to 16, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68). New cstate: current_term: 16 leader_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:58.864588  3250 consensus_peers.cc:597] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.850924  3249 leader_election.cc:336] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:58.867245 10656 raft_consensus.cc:493] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.867911 10656 raft_consensus.cc:515] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } attrs { replace: true } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:58.870901 10656 leader_election.cc:290] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:58.873521  3835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df8838ab784efd9cfa105ba373b14c" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:58.874257  3835 raft_consensus.cc:2468] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 24.
W20260709 13:18:58.874855  3249 leader_election.cc:336] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
W20260709 13:18:58.879522  3250 leader_election.cc:336] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:58.879802  3837 raft_consensus.cc:2468] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 14.
I20260709 13:18:58.882607  3251 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
W20260709 13:18:58.883353  3249 leader_election.cc:336] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:58.883862  3249 leader_election.cc:304] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:58.884348 10657 raft_consensus.cc:2804] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:58.884670 10650 raft_consensus.cc:2749] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:58.885349 10657 raft_consensus.cc:697] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:58.886459 10657 consensus_queue.cc:237] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:58.903090 10645 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.903811 10645 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:58.920719  3805 leader_election.cc:336] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:58.920768  3025 catalog_manager.cc:5697] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 13 to 14, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 14 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:58.922318  3806 leader_election.cc:336] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:58.924430  3806 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:58.925310 10655 raft_consensus.cc:2749] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:58.926031 10645 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:58.934293  3806 consensus_peers.cc:597] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.957299  3250 consensus_peers.cc:597] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:58.987429 10657 raft_consensus.cc:493] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:58.988099 10657 raft_consensus.cc:515] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
W20260709 13:18:59.000037  3806 consensus_peers.cc:597] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:59.010581 10657 leader_election.cc:290] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:59.014544  3250 leader_election.cc:336] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:59.016362  3806 consensus_peers.cc:597] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:59.013536  3249 consensus_peers.cc:597] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:59.015120  3250 consensus_peers.cc:597] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:59.031857 10655 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:59.032471 10655 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:59.033902 10645 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
W20260709 13:18:59.034590  3249 leader_election.cc:336] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:59.034432 10645 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:59.035002  3249 leader_election.cc:304] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:59.036089 10657 raft_consensus.cc:2749] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:59.036481 10645 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:18:59.040608 10655 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:59.042251  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "48080cf0460346769ab046a4f9457aa5" is_pre_election: true
W20260709 13:18:59.044441  3806 leader_election.cc:336] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:18:59.057650  3805 leader_election.cc:336] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:59.058264  3805 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:18:59.059240 10655 raft_consensus.cc:2749] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:59.060806  3805 leader_election.cc:336] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:59.061297  3805 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:59.062265 10655 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:59.073256  3805 consensus_peers.cc:597] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:59.085275  3250 consensus_peers.cc:597] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:59.096922 10657 raft_consensus.cc:493] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:59.097527 10657 raft_consensus.cc:515] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } }
I20260709 13:18:59.100325 10657 leader_election.cc:290] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:59.108737  3249 leader_election.cc:336] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:59.109637 10657 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:59.110253 10657 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:59.117883  3249 leader_election.cc:336] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:59.119688 10657 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
W20260709 13:18:59.129557  3805 consensus_peers.cc:597] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:59.129799  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" is_pre_election: true
I20260709 13:18:59.130669  3837 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 20.
I20260709 13:18:59.132793  3251 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:59.134291 10657 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:59.134697 10657 raft_consensus.cc:493] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:59.135097 10657 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:59.149799  3250 leader_election.cc:336] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:59.150285  3250 leader_election.cc:304] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:59.153616 10657 raft_consensus.cc:515] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:59.155329  3806 consensus_peers.cc:597] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:59.156481  3249 consensus_peers.cc:597] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:59.161348  3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe9b83583444570807fd6aa3bcc925d" candidate_uuid: "48080cf0460346769ab046a4f9457aa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf"
I20260709 13:18:59.162019  3837 raft_consensus.cc:3060] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:59.163281  3249 leader_election.cc:336] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:18:59.163681 10650 raft_consensus.cc:2749] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:59.164067 10657 leader_election.cc:290] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Requested vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 0930e3e7657c43bcaaa5b0778f3e08cf (127.1.250.68:40703)
I20260709 13:18:59.169104  2025 tablet_server.cc:179] TabletServer@127.1.250.67:0 shutting down...
I20260709 13:18:59.171898  3837 raft_consensus.cc:2468] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48080cf0460346769ab046a4f9457aa5 in term 21.
I20260709 13:18:59.173601  3251 leader_election.cc:304] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf, 48080cf0460346769ab046a4f9457aa5; no voters: 43b01d5a97e149008d543a6615219928
I20260709 13:18:59.174489 10650 raft_consensus.cc:2804] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:59.175099 10650 raft_consensus.cc:697] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Becoming Leader. State: Replica: 48080cf0460346769ab046a4f9457aa5, State: Running, Role: LEADER
I20260709 13:18:59.177595 10650 consensus_queue.cc:237] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:18:59.201736  3250 consensus_peers.cc:597] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:59.203292  3250 consensus_peers.cc:597] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:59.206935  3806 consensus_peers.cc:597] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Couldn't send request to peer 48080cf0460346769ab046a4f9457aa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:59.214541  3806 consensus_peers.cc:597] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Couldn't send request to peer 48080cf0460346769ab046a4f9457aa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:59.215766  3033 catalog_manager.cc:5697] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 reported cstate change: term changed from 20 to 21, leader changed from 43b01d5a97e149008d543a6615219928 (127.1.250.66) to 48080cf0460346769ab046a4f9457aa5 (127.1.250.67). New cstate: current_term: 21 leader_uuid: "48080cf0460346769ab046a4f9457aa5" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:59.217249  3249 consensus_peers.cc:597] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:59.218482  3249 consensus_peers.cc:597] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:59.236122  3249 consensus_peers.cc:597] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:59.240465  3249 consensus_peers.cc:597] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:59.266726  3250 consensus_peers.cc:597] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:59.277129  3249 consensus_peers.cc:597] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:59.278502  3805 consensus_peers.cc:597] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:59.334131  3837 raft_consensus.cc:1275] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 15. (index mismatch)
I20260709 13:18:59.335669 10650 consensus_queue.cc:1048] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:18:59.340308  3806 consensus_peers.cc:597] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Couldn't send request to peer 48080cf0460346769ab046a4f9457aa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:59.362012  3805 consensus_peers.cc:597] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:59.362985  3806 consensus_peers.cc:597] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Couldn't send request to peer 48080cf0460346769ab046a4f9457aa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:59.364665  3250 consensus_peers.cc:597] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:59.380564  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:59.381887  2025 tablet_replica.cc:333] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.383271  2025 raft_consensus.cc:2243] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.387723  2025 raft_consensus.cc:2272] T a6ed1a03592e491cbb924069df406f18 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.390796  2025 tablet_replica.cc:333] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
W20260709 13:18:59.394037  3806 consensus_peers.cc:597] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Couldn't send request to peer 48080cf0460346769ab046a4f9457aa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:59.397979  3805 consensus_peers.cc:597] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:59.399762  3249 consensus_peers.cc:597] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:59.403012  2025 raft_consensus.cc:2243] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.408481  2025 raft_consensus.cc:2272] T 5f5212495b02454ba6ddf4c62cf58b04 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.411074  3806 consensus_peers.cc:597] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Couldn't send request to peer 48080cf0460346769ab046a4f9457aa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:59.411494  2025 tablet_replica.cc:333] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.412398  2025 raft_consensus.cc:2243] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.413547  2025 raft_consensus.cc:2272] T 104b1eb7d49f449095e30c69e8680096 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.414783  3805 consensus_peers.cc:597] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:59.437732  2025 tablet_replica.cc:333] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.438740  2025 raft_consensus.cc:2243] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.445112  2025 raft_consensus.cc:2272] T 7f4a8a614fca4531aab11f5963396f62 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.448132  3249 consensus_peers.cc:597] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:59.448613  3249 consensus_peers.cc:597] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:59.447073  3806 consensus_peers.cc:597] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Couldn't send request to peer 48080cf0460346769ab046a4f9457aa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:59.452282  2025 tablet_replica.cc:333] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
W20260709 13:18:59.458720  3805 consensus_peers.cc:597] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:59.460194  2025 raft_consensus.cc:2243] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.460934  2025 raft_consensus.cc:2272] T aded29f2cce84c3c8e2a5337dce77bde P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.464193  2025 tablet_replica.cc:333] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.467996  2025 raft_consensus.cc:2243] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:18:59.468727  3249 consensus_peers.cc:597] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:59.470520  2025 raft_consensus.cc:2272] T 432d705ff69845aaac398233202f4081 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.478878  2025 tablet_replica.cc:333] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.479873  2025 raft_consensus.cc:2243] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.480563  2025 raft_consensus.cc:2272] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.483574  2025 tablet_replica.cc:333] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
W20260709 13:18:59.491789  3249 consensus_peers.cc:597] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:59.484637  2025 raft_consensus.cc:2243] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.494630  2025 raft_consensus.cc:2272] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.494601  3806 consensus_peers.cc:597] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Couldn't send request to peer 48080cf0460346769ab046a4f9457aa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:59.498353  2025 tablet_replica.cc:333] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.499478  2025 raft_consensus.cc:2243] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.500273  2025 raft_consensus.cc:2272] T 8e1a4d71ef0f4287999b5ee60fe02740 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.503261  2025 tablet_replica.cc:333] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.504335  2025 raft_consensus.cc:2243] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.505312  2025 raft_consensus.cc:2272] T c414d51e428042c596cb410c48956c63 P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.508255  2025 tablet_replica.cc:333] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
W20260709 13:18:59.512832  3805 consensus_peers.cc:597] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:59.513808  2025 raft_consensus.cc:2243] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.515156  2025 raft_consensus.cc:2272] T 2e805018f85b41fc88644215be011084 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.522190  3805 consensus_peers.cc:597] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:59.524451  2025 tablet_replica.cc:333] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
W20260709 13:18:59.531937  3805 consensus_peers.cc:597] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:59.533145  2025 raft_consensus.cc:2243] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.534441  2025 raft_consensus.cc:2272] T 37a53418fbf14b998493923afc272c3c P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.554893  3805 consensus_peers.cc:597] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:59.539597  2025 tablet_replica.cc:333] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.558552  2025 raft_consensus.cc:2243] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.559929  2025 raft_consensus.cc:2272] T c7276ed9ac0542f885cc824522eb9d58 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.564026  2025 tablet_replica.cc:333] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.564877  2025 raft_consensus.cc:2243] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.566505  2025 raft_consensus.cc:2272] T 874b2f5f161c46be919ed69ca338da41 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.572079  2025 tablet_replica.cc:333] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
W20260709 13:18:59.572515  3250 consensus_peers.cc:597] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:59.574942  2025 raft_consensus.cc:2243] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.576329  2025 raft_consensus.cc:2272] T de07cb03de034f1bae53ef08d27db7a7 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.580065  2025 tablet_replica.cc:333] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.581413  2025 raft_consensus.cc:2243] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:18:59.587723  3806 consensus_peers.cc:597] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Couldn't send request to peer 48080cf0460346769ab046a4f9457aa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:59.583065  2025 raft_consensus.cc:2272] T d2222d9a550a4cdaa84c7bf97a7ab954 P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.591446  2025 tablet_replica.cc:333] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.592437  2025 raft_consensus.cc:2243] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.593681  2025 raft_consensus.cc:2272] T c258b23309c4453b850ba59d3011c806 P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.596836  2025 tablet_replica.cc:333] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.597760  2025 raft_consensus.cc:2243] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.598416  2025 raft_consensus.cc:2272] T 30f88ddc17f44a3084db05c84e5e6a81 P 48080cf0460346769ab046a4f9457aa5 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.602166  2025 tablet_replica.cc:333] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.602964  2025 raft_consensus.cc:2243] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.604772  2025 raft_consensus.cc:2272] T b7ab044361f54dae84978720aac3998c P 48080cf0460346769ab046a4f9457aa5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.609727  2025 tablet_replica.cc:333] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.610626  2025 raft_consensus.cc:2243] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.611336  2025 raft_consensus.cc:2272] T 114dd3d94ac84ebb8bff7ff66e92d269 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.616370  2025 tablet_replica.cc:333] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.617388  2025 raft_consensus.cc:2243] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.618619  2025 raft_consensus.cc:2272] T 01cb424e009f49c2a8944cc68a07dd66 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.624004  2025 tablet_replica.cc:333] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.626385  2025 raft_consensus.cc:2243] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:18:59.627214  3249 consensus_peers.cc:597] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:59.631631  2025 raft_consensus.cc:2272] T ea9019901d1a42beb5690a4096277f3e P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.635432  2025 tablet_replica.cc:333] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.638170  2025 raft_consensus.cc:2243] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.639264  2025 raft_consensus.cc:2272] T d4df8838ab784efd9cfa105ba373b14c P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.642132  2025 tablet_replica.cc:333] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.647886  2025 raft_consensus.cc:2243] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:59.642891  3806 consensus_peers.cc:597] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Couldn't send request to peer 48080cf0460346769ab046a4f9457aa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:59.655529  3249 consensus_peers.cc:597] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:59.658241  3249 consensus_peers.cc:597] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:59.664870  2025 raft_consensus.cc:2272] T f0e8f18d12244c29aac431f7d6786d0b P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.666605  3806 consensus_peers.cc:597] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Couldn't send request to peer 48080cf0460346769ab046a4f9457aa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:59.670418  2025 tablet_replica.cc:333] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.671348  2025 raft_consensus.cc:2243] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.672508  2025 raft_consensus.cc:2272] T dea47b33000a4a0e9cb380dbe716761d P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.675542  2025 tablet_replica.cc:333] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.676343  2025 raft_consensus.cc:2243] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.676990  2025 raft_consensus.cc:2272] T 812e4fbcaef1473b9c0467dcbbfca8a3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.679744  2025 tablet_replica.cc:333] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.680567  2025 raft_consensus.cc:2243] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.682051  2025 raft_consensus.cc:2272] T a455058d628f40fc9d810a0d764560dd P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.685158  2025 tablet_replica.cc:333] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.685961  2025 raft_consensus.cc:2243] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.687170  2025 raft_consensus.cc:2272] T 4861cf36e0334e60863d0921b834dd0b P 48080cf0460346769ab046a4f9457aa5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.690613  2025 tablet_replica.cc:333] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.691412  2025 raft_consensus.cc:2243] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.692015  2025 raft_consensus.cc:2272] T 6b9a3cde8b784484802f97dd03f5d338 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.695127  2025 tablet_replica.cc:333] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.695855  2025 raft_consensus.cc:2243] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.703377  2025 raft_consensus.cc:2272] T 528677c11f624ca18f75db1e739e29d6 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.704586  3806 consensus_peers.cc:597] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:59.714833 10645 raft_consensus.cc:493] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:59.715531 10645 raft_consensus.cc:515] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:59.718089 10645 leader_election.cc:290] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:18:59.723006  2025 tablet_replica.cc:333] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.724571  2025 raft_consensus.cc:2243] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:59.728272  3805 leader_election.cc:336] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
W20260709 13:18:59.730513  3250 consensus_peers.cc:597] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:59.731246  2025 raft_consensus.cc:2272] T 23d682925c4b46799576472fe9f97a07 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.733479  3806 leader_election.cc:336] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:59.733956  3806 leader_election.cc:304] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:59.735946 10670 raft_consensus.cc:2749] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:59.742540  2025 tablet_replica.cc:333] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.743420  2025 raft_consensus.cc:2243] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.744167  2025 raft_consensus.cc:2272] T 772d700b048349bf9547efac6befb60d P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.747125  3249 consensus_peers.cc:597] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:59.753991  2025 tablet_replica.cc:333] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.755079  2025 raft_consensus.cc:2243] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.756239  2025 raft_consensus.cc:2272] T bce4572fe1d742f8b02088bc9e1bbbba P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.758580  3805 consensus_peers.cc:597] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Couldn't send request to peer 43b01d5a97e149008d543a6615219928. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:59.759030  2025 tablet_replica.cc:333] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.769793  2025 raft_consensus.cc:2243] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.770500  2025 raft_consensus.cc:2272] T 386629ac4b1c40a2973b2650d0165bc3 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.773571  2025 tablet_replica.cc:333] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.774384  2025 raft_consensus.cc:2243] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.775810  2025 raft_consensus.cc:2272] T 7b205eb6f14c40c88b346e392de18687 P 48080cf0460346769ab046a4f9457aa5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.778527  2025 tablet_replica.cc:333] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.790513  3841 raft_consensus.cc:1275] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Refusing update from remote peer 48080cf0460346769ab046a4f9457aa5: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:18:59.792590 10657 consensus_queue.cc:1048] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:59.797850  2025 raft_consensus.cc:2243] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.805282  2025 raft_consensus.cc:2272] T 9e51511dc4ca4db4817c3216d9d1db6e P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.809260  2025 tablet_replica.cc:333] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.813544  2025 raft_consensus.cc:2243] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.816139  2025 raft_consensus.cc:2272] T 233be522a83f4bea8c48247e49ee33a0 P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.832201  2025 tablet_replica.cc:333] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.832954  2025 raft_consensus.cc:2243] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.838848  2025 raft_consensus.cc:2272] T ce9155778cd542acbbc8b00bd8b7316c P 48080cf0460346769ab046a4f9457aa5 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.841787  2025 tablet_replica.cc:333] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.842598  2025 raft_consensus.cc:2243] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.843729  2025 raft_consensus.cc:2272] T cd9bf15d386d49f0977913d9628e22af P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.856307  2025 tablet_replica.cc:333] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.859994  2025 raft_consensus.cc:2243] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.860641  2025 raft_consensus.cc:2272] T b4f37f97e44445a8978d2cde7a9c9c58 P 48080cf0460346769ab046a4f9457aa5 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.863423  2025 tablet_replica.cc:333] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.864164  2025 raft_consensus.cc:2243] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.864778  2025 raft_consensus.cc:2272] T 4d7eb1bec1634d2784b28588ef1161c0 P 48080cf0460346769ab046a4f9457aa5 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.892055  3250 consensus_peers.cc:597] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:59.897238  2025 tablet_replica.cc:333] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.898124  2025 raft_consensus.cc:2243] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.899416  2025 raft_consensus.cc:2272] T c209ebcbec0e4e4ba79f8473c2f4d39b P 48080cf0460346769ab046a4f9457aa5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.902331  2025 tablet_replica.cc:333] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.903079  2025 raft_consensus.cc:2243] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.904276  2025 raft_consensus.cc:2272] T faebd952bf73433d84a3292167ecd165 P 48080cf0460346769ab046a4f9457aa5 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.915424  2025 tablet_replica.cc:333] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.916177  2025 raft_consensus.cc:2243] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.917335  2025 raft_consensus.cc:2272] T f97b7c75c06648e2b8f08f69dcb106af P 48080cf0460346769ab046a4f9457aa5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.919957  2025 tablet_replica.cc:333] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.933302  2025 raft_consensus.cc:2243] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.934100  2025 raft_consensus.cc:2272] T c85d4a2b8cd74bd69285c748e4453e24 P 48080cf0460346769ab046a4f9457aa5 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.936226  3806 consensus_peers.cc:597] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:59.936699  2025 tablet_replica.cc:333] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.937630  2025 raft_consensus.cc:2243] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.938778  2025 raft_consensus.cc:2272] T 8ed81e18346d4bb3a9f0b77ae5ca8477 P 48080cf0460346769ab046a4f9457aa5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.941584  2025 tablet_replica.cc:333] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.942371  2025 raft_consensus.cc:2243] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.943871  2025 raft_consensus.cc:2272] T 2fe9b83583444570807fd6aa3bcc925d P 48080cf0460346769ab046a4f9457aa5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.949383  2025 tablet_replica.cc:333] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5: stopping tablet replica
I20260709 13:18:59.950085  2025 raft_consensus.cc:2243] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.950945  2025 raft_consensus.cc:2272] T da022fb530574c2ba921df0848818f6b P 48080cf0460346769ab046a4f9457aa5 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.951437 10671 raft_consensus.cc:493] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:18:59.952059 10671 raft_consensus.cc:515] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:18:59.974678 10671 leader_election.cc:290] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:18:59.976449  3805 leader_election.cc:336] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
W20260709 13:18:59.982983  3806 leader_election.cc:336] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:18:59.983434  3806 leader_election.cc:304] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:18:59.984151 10671 raft_consensus.cc:2749] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:00.181699  3806 connection.cc:573] client connection to 127.1.250.67:41801 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:19:00.403111 10670 raft_consensus.cc:493] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:19:00.403743 10670 raft_consensus.cc:515] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:19:00.406248 10670 leader_election.cc:290] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:19:00.421497  3806 leader_election.cc:336] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:19:00.424338  3805 leader_election.cc:336] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:19:00.424813  3805 leader_election.cc:304] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:19:00.427561 10670 raft_consensus.cc:2749] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:00.510119  2025 tablet_server.cc:196] TabletServer@127.1.250.67:0 shutdown complete.
W20260709 13:19:00.589167  3806 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111) [suppressed 615 similar messages]
I20260709 13:19:00.701050 10670 raft_consensus.cc:493] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:19:00.701814 10670 raft_consensus.cc:515] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:19:00.711349  3805 leader_election.cc:336] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:19:00.713219 10670 leader_election.cc:290] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:19:00.714205  3806 leader_election.cc:336] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:19:00.714851  3806 leader_election.cc:304] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:19:00.716737 10670 raft_consensus.cc:2749] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:00.736481  3020 catalog_manager.cc:4755] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2fe9b83583444570807fd6aa3bcc925d: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:19:00.766520 10670 raft_consensus.cc:493] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:19:00.767146 10670 raft_consensus.cc:515] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
W20260709 13:19:00.774420  3805 leader_election.cc:336] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:19:00.776177 10670 leader_election.cc:290] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:19:00.780638  3806 leader_election.cc:336] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Network error: Client connection negotiation failed: client connection to 127.1.250.67:41801: connect: Connection refused (error 111)
I20260709 13:19:00.781106  3806 leader_election.cc:304] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
I20260709 13:19:00.782465 10670 raft_consensus.cc:2749] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:00.808954  3806 consensus_peers.cc:597] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf -> Peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Couldn't send request to peer fc48eecc27554cb58b15193cd442b1d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:19:00.814461  2025 tablet_server.cc:179] TabletServer@127.1.250.68:0 shutting down...
I20260709 13:19:00.892760 10670 raft_consensus.cc:493] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:19:00.893448 10670 raft_consensus.cc:515] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:19:00.902216 10655 raft_consensus.cc:493] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:19:00.903090 10655 raft_consensus.cc:515] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:19:00.922427  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:00.926017 10670 leader_election.cc:290] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
I20260709 13:19:00.927186 10670 raft_consensus.cc:493] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:19:00.928215  2025 tablet_replica.cc:333] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
W20260709 13:19:00.929049  3805 leader_election.cc:336] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:19:00.927799 10670 raft_consensus.cc:515] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:19:00.930469 10655 leader_election.cc:290] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:19:00.931739 10655 raft_consensus.cc:493] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:19:00.932238 10655 raft_consensus.cc:515] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:19:00.932797 10670 leader_election.cc:290] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:19:00.934197 10670 raft_consensus.cc:493] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:19:00.934388 10655 leader_election.cc:290] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:19:00.930668  2025 raft_consensus.cc:2243] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.934682 10670 raft_consensus.cc:515] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:19:00.953299 10670 leader_election.cc:290] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:19:00.955011 10677 raft_consensus.cc:493] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:19:00.955745 10677 raft_consensus.cc:515] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } attrs { replace: true } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:19:00.961483 10670 raft_consensus.cc:493] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:19:00.962265 10670 raft_consensus.cc:515] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:19:00.965010 10670 leader_election.cc:290] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:19:00.959657 10677 leader_election.cc:290] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:19:00.978819  3806 leader_election.cc:336] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:19:00.970211  2025 raft_consensus.cc:2272] T d4df8838ab784efd9cfa105ba373b14c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.979415  3806 leader_election.cc:304] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:19:00.982128 10677 raft_consensus.cc:2749] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:00.987694  3806 leader_election.cc:336] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Network error: Client connection negotiation failed: client connection to 127.1.250.67:41801: connect: Connection refused (error 111)
I20260709 13:19:00.988267 10677 raft_consensus.cc:493] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:19:00.989938 10677 raft_consensus.cc:515] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:19:00.992509 10677 leader_election.cc:290] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
I20260709 13:19:00.988937 10670 raft_consensus.cc:493] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 48080cf0460346769ab046a4f9457aa5)
I20260709 13:19:00.982412  2025 tablet_replica.cc:333] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:00.993391 10670 raft_consensus.cc:515] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "48080cf0460346769ab046a4f9457aa5" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 41801 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:19:00.993999  2025 raft_consensus.cc:2243] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.994897  2025 raft_consensus.cc:2272] T 2fe9b83583444570807fd6aa3bcc925d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.995702 10670 leader_election.cc:290] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801)
W20260709 13:19:00.996450  3806 leader_election.cc:336] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Network error: Client connection negotiation failed: client connection to 127.1.250.67:41801: connect: Connection refused (error 111)
W20260709 13:19:00.996989  3806 leader_election.cc:336] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Network error: Client connection negotiation failed: client connection to 127.1.250.67:41801: connect: Connection refused (error 111)
I20260709 13:19:00.998226  2025 tablet_replica.cc:333] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:00.999243  2025 raft_consensus.cc:2243] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.000195  2025 raft_consensus.cc:2272] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.000171 10670 raft_consensus.cc:493] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b01d5a97e149008d543a6615219928)
I20260709 13:19:01.000877 10670 raft_consensus.cc:515] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc48eecc27554cb58b15193cd442b1d3" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41323 } } peers { permanent_uuid: "43b01d5a97e149008d543a6615219928" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42299 } } peers { permanent_uuid: "0930e3e7657c43bcaaa5b0778f3e08cf" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 40703 } attrs { promote: false } }
I20260709 13:19:01.004190  2025 tablet_replica.cc:333] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.005213  2025 raft_consensus.cc:2243] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:01.005924  3806 leader_election.cc:336] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:19:01.006928  3806 leader_election.cc:304] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:19:01.007778 10677 raft_consensus.cc:2749] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:01.006014  2025 raft_consensus.cc:2272] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.006474 10670 leader_election.cc:290] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323), 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299)
W20260709 13:19:01.009351  3806 leader_election.cc:336] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:19:01.009840  3806 leader_election.cc:304] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:19:01.011073 10670 raft_consensus.cc:2749] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:01.011487  2025 tablet_replica.cc:333] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.012442  2025 raft_consensus.cc:2243] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.013296  2025 raft_consensus.cc:2272] T 2ae5c762a7f347f4a2de941d47ed1903 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.016799  2025 tablet_replica.cc:333] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.017640  2025 raft_consensus.cc:2243] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.018512  2025 pending_rounds.cc:70] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Trying to abort 1 pending ops.
I20260709 13:19:01.018735  2025 pending_rounds.cc:77] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf: Aborting op as it isn't in flight: id { term: 16 index: 13 } timestamp: 7305638456555331584 op_type: NO_OP noop_request { }
I20260709 13:19:01.019129  2025 raft_consensus.cc:2889] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:01.019490  2025 raft_consensus.cc:2272] T 8e1a4d71ef0f4287999b5ee60fe02740 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:01.025780  3806 leader_election.cc:336] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:19:01.026549  3806 leader_election.cc:336] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:19:01.030622  3806 leader_election.cc:336] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Network error: Client connection negotiation failed: client connection to 127.1.250.67:41801: connect: Connection refused (error 111)
I20260709 13:19:01.031193  3806 leader_election.cc:304] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:19:01.033846  3806 raft_consensus.cc:2686] T 01cb424e009f49c2a8944cc68a07dd66 P 0930e3e7657c43bcaaa5b0778f3e08cf: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:19:01.034503  3806 leader_election.cc:336] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Network error: Client connection negotiation failed: client connection to 127.1.250.67:41801: connect: Connection refused (error 111)
I20260709 13:19:01.034883  2025 tablet_replica.cc:333] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.035246  3806 leader_election.cc:304] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:19:01.035843  2025 raft_consensus.cc:2243] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.035993 10670 raft_consensus.cc:2749] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:01.036912  3806 leader_election.cc:336] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Network error: Client connection negotiation failed: client connection to 127.1.250.67:41801: connect: Connection refused (error 111)
I20260709 13:19:01.037094  2025 raft_consensus.cc:2272] T 7f4a8a614fca4531aab11f5963396f62 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:01.044445  3806 leader_election.cc:336] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Network error: Client connection negotiation failed: client connection to 127.1.250.67:41801: connect: Connection refused (error 111)
W20260709 13:19:01.045130  3806 leader_election.cc:336] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 48080cf0460346769ab046a4f9457aa5 (127.1.250.67:41801): Network error: Client connection negotiation failed: client connection to 127.1.250.67:41801: connect: Connection refused (error 111)
W20260709 13:19:01.048077  3806 leader_election.cc:336] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:19:01.048327  2025 tablet_replica.cc:333] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.048624  3806 leader_election.cc:304] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:19:01.049278  2025 raft_consensus.cc:2243] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.049396 10670 raft_consensus.cc:2749] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:01.050376  3806 leader_election.cc:336] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:19:01.050555  2025 raft_consensus.cc:2272] T 772d700b048349bf9547efac6befb60d P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.050902  3806 leader_election.cc:304] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 48080cf0460346769ab046a4f9457aa5, fc48eecc27554cb58b15193cd442b1d3
I20260709 13:19:01.051692 10670 raft_consensus.cc:2749] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:01.052670  3806 leader_election.cc:336] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:19:01.053778  2025 tablet_replica.cc:333] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.054751  2025 raft_consensus.cc:2243] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.055871  2025 raft_consensus.cc:2272] T aded29f2cce84c3c8e2a5337dce77bde P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.059016  2025 tablet_replica.cc:333] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.059849  2025 raft_consensus.cc:2243] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.060506  2025 raft_consensus.cc:2272] T 66614160a1bf4bb49ea02007f6679b0f P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.067870  2025 tablet_replica.cc:333] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.068845  2025 raft_consensus.cc:2243] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.070792  2025 raft_consensus.cc:2272] T f97b7c75c06648e2b8f08f69dcb106af P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.081593  2025 tablet_replica.cc:333] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.082827  2025 raft_consensus.cc:2243] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.084321  2025 raft_consensus.cc:2272] T 6ce6e7e8eeb846ab832cf477e2ba0b35 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.087680  2025 tablet_replica.cc:333] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.088783  2025 raft_consensus.cc:2243] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.089907  2025 raft_consensus.cc:2272] T c7177cc3a5e547a3b1bef3c6c3c3a368 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.093340  2025 tablet_replica.cc:333] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.094485  2025 raft_consensus.cc:2243] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.095306  2025 raft_consensus.cc:2272] T d2222d9a550a4cdaa84c7bf97a7ab954 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.098294  2025 tablet_replica.cc:333] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.099530  2025 raft_consensus.cc:2243] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.100190  2025 raft_consensus.cc:2272] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.103046  2025 tablet_replica.cc:333] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.103991  2025 raft_consensus.cc:2243] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.104823  2025 raft_consensus.cc:2272] T 94bb18481fd64fec92315ec868c651f4 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.110098  2025 tablet_replica.cc:333] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.111217  2025 raft_consensus.cc:2243] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.112197  2025 raft_consensus.cc:2272] T 023c1461b69c46bdb3c42ee16f303ea2 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.117022  2025 tablet_replica.cc:333] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.118088  2025 raft_consensus.cc:2243] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.119433  2025 raft_consensus.cc:2272] T 404209c6105f4945b077c33471d63370 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.123046  2025 tablet_replica.cc:333] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.124112  2025 raft_consensus.cc:2243] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.124907  2025 raft_consensus.cc:2272] T 528677c11f624ca18f75db1e739e29d6 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.128577  2025 tablet_replica.cc:333] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.129611  2025 raft_consensus.cc:2243] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.130364  2025 raft_consensus.cc:2272] T 432d705ff69845aaac398233202f4081 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.133630  2025 tablet_replica.cc:333] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.134506  2025 raft_consensus.cc:2243] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.135391  2025 raft_consensus.cc:2272] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.141067  2025 tablet_replica.cc:333] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.142203  2025 raft_consensus.cc:2243] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.143246  2025 raft_consensus.cc:2272] T b7ab044361f54dae84978720aac3998c P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.146571  2025 tablet_replica.cc:333] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.147478  2025 raft_consensus.cc:2243] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.148180  2025 raft_consensus.cc:2272] T 2d7a98c6990948fab7c20936964c4d3e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.151188  2025 tablet_replica.cc:333] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.152105  2025 raft_consensus.cc:2243] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.153199  2025 raft_consensus.cc:2272] T 386629ac4b1c40a2973b2650d0165bc3 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.156389  2025 tablet_replica.cc:333] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.157486  2025 raft_consensus.cc:2243] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.158861  2025 raft_consensus.cc:2272] T 5f5212495b02454ba6ddf4c62cf58b04 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.162061  2025 tablet_replica.cc:333] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.163053  2025 raft_consensus.cc:2243] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.164254  2025 raft_consensus.cc:2272] T 3af680172a5440a2bfa7e8a99ea9c1fc P 0930e3e7657c43bcaaa5b0778f3e08cf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.167747  2025 tablet_replica.cc:333] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.168700  2025 raft_consensus.cc:2243] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.169515  2025 raft_consensus.cc:2272] T ccc7fa450cf74c28bef080a5f5dc8fa8 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.172572  2025 tablet_replica.cc:333] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.173484  2025 raft_consensus.cc:2243] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.174413  2025 raft_consensus.cc:2272] T c209ebcbec0e4e4ba79f8473c2f4d39b P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.177624  2025 tablet_replica.cc:333] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.178416  2025 raft_consensus.cc:2243] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.179360  2025 raft_consensus.cc:2272] T b4f37f97e44445a8978d2cde7a9c9c58 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.183063  2025 tablet_replica.cc:333] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.183893  2025 raft_consensus.cc:2243] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.184684  2025 raft_consensus.cc:2272] T 4d7eb1bec1634d2784b28588ef1161c0 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.188210  2025 tablet_replica.cc:333] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.189045  2025 raft_consensus.cc:2243] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.189865  2025 raft_consensus.cc:2272] T 9e51511dc4ca4db4817c3216d9d1db6e P 0930e3e7657c43bcaaa5b0778f3e08cf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.193042  2025 tablet_replica.cc:333] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.193858  2025 raft_consensus.cc:2243] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.194489  2025 raft_consensus.cc:2272] T de07cb03de034f1bae53ef08d27db7a7 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.197585  2025 tablet_replica.cc:333] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.198405  2025 raft_consensus.cc:2243] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.199620  2025 raft_consensus.cc:2272] T 30f88ddc17f44a3084db05c84e5e6a81 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.202888  2025 tablet_replica.cc:333] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.203667  2025 raft_consensus.cc:2243] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.204360  2025 raft_consensus.cc:2272] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.207116  2025 tablet_replica.cc:333] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.207885  2025 raft_consensus.cc:2243] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.210933  2025 raft_consensus.cc:2272] T 5881853d6b7b4e038027c4a93fdc0b41 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.213939  2025 tablet_replica.cc:333] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf: stopping tablet replica
I20260709 13:19:01.215211  2025 raft_consensus.cc:2243] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:01.215979  2025 raft_consensus.cc:2272] T 9d10d3c525b541649db9c882a1398789 P 0930e3e7657c43bcaaa5b0778f3e08cf [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:01.392409  3807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.431222  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.449396  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.456482  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.523474  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.553697  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.580035  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.850900  3805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.954152  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.961217  3806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.976032  3805 leader_election.cc:336] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Network error: Client connection negotiation failed: client connection to 127.1.250.66:42299: connect: Connection refused (error 111)
I20260709 13:19:01.976534  3805 leader_election.cc:304] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:19:01.977147  3805 raft_consensus.cc:2686] T 37a53418fbf14b998493923afc272c3c P 0930e3e7657c43bcaaa5b0778f3e08cf: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:19:01.991178 10679 leader_election.cc:336] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Service unavailable: reactor is shutting down (error 108)
I20260709 13:19:01.991712 10679 leader_election.cc:304] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, fc48eecc27554cb58b15193cd442b1d3
W20260709 13:19:01.992408 10679 raft_consensus.cc:2686] T 56db43db40f644309c6db08523b1b033 P 0930e3e7657c43bcaaa5b0778f3e08cf: unable to run election callback: Service unavailable: The pool has been shut down.
W20260709 13:19:01.994951 10679 leader_election.cc:336] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Service unavailable: reactor is shutting down (error 108)
I20260709 13:19:01.995360 10679 leader_election.cc:304] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0930e3e7657c43bcaaa5b0778f3e08cf; no voters: 43b01d5a97e149008d543a6615219928, 48080cf0460346769ab046a4f9457aa5
W20260709 13:19:01.995971 10679 raft_consensus.cc:2686] T 7b205eb6f14c40c88b346e392de18687 P 0930e3e7657c43bcaaa5b0778f3e08cf: unable to run election callback: Service unavailable: The pool has been shut down.
W20260709 13:19:01.998000 10679 leader_election.cc:336] T 233be522a83f4bea8c48247e49ee33a0 P 0930e3e7657c43bcaaa5b0778f3e08cf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 43b01d5a97e149008d543a6615219928 (127.1.250.66:42299): Service unavailable: reactor is shutting down (error 108)
W20260709 13:19:03.000803  2025 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 3864)
W20260709 13:19:03.693522  3020 catalog_manager.cc:4755] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7b205eb6f14c40c88b346e392de18687: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:19:03.996790  2025 tablet_server.cc:196] TabletServer@127.1.250.68:0 shutdown complete.
I20260709 13:19:04.139495  2025 master.cc:562] Master@127.1.250.126:33381 shutting down...
W20260709 13:19:04.178359  3082 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:19:04.178637  3082 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:19:04.178889  3082 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:19:06.211436  3065 debug-util.cc:398] Leaking SignalData structure 0x7b0800175540 after lost signal to thread 2028
W20260709 13:19:06.211911  3065 debug-util.cc:398] Leaking SignalData structure 0x7b0800338d00 after lost signal to thread 3068
W20260709 13:19:08.953351  3020 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111) [suppressed 65 similar messages]
W20260709 13:19:08.957203  3020 catalog_manager.cc:4755] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2fe9b83583444570807fd6aa3bcc925d: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:19:20.121389  3020 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
W20260709 13:19:20.125412  3020 catalog_manager.cc:4755] TS fc48eecc27554cb58b15193cd442b1d3 (127.1.250.65:41323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7b205eb6f14c40c88b346e392de18687: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41323: connect: Connection refused (error 111)
I20260709 13:19:21.221542  2025 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:21.223363  2025 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.224555  2025 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2d86a7fbede6469c844c1637c8ddd791: stopping tablet replica
I20260709 13:19:21.465221  2025 master.cc:584] Master@127.1.250.126:33381 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (243913 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:19:21.599082  2025 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.250.126:41433
I20260709 13:19:21.600347  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:21.606649 10688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:21.606710 10689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:21.607841 10691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:21.609058  2025 server_base.cc:1061] running on GCE node
I20260709 13:19:21.612442  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:21.612679  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:21.612843  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603161612828 us; error 0 us; skew 500 ppm
I20260709 13:19:21.613801  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:21.616592  2025 webserver.cc:533] Webserver started at http://127.1.250.126:37251/ using document root <none> and password file <none>
I20260709 13:19:21.617244  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:21.617452  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:21.617739  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:21.619040  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/master-0-root/instance:
uuid: "2a38c5fcfa734219bf695f7f43a1393b"
format_stamp: "Formatted at 2026-07-09 13:19:21 on dist-test-slave-g4pn"
I20260709 13:19:21.624847  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:19:21.628543 10696 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:21.629470  2025 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:19:21.629850  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/master-0-root
uuid: "2a38c5fcfa734219bf695f7f43a1393b"
format_stamp: "Formatted at 2026-07-09 13:19:21 on dist-test-slave-g4pn"
I20260709 13:19:21.630247  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:21.651355  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:21.652638  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:21.698676  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.126:41433
I20260709 13:19:21.698837 10747 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.126:41433 every 8 connection(s)
I20260709 13:19:21.702926 10748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:21.715422 10748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b: Bootstrap starting.
I20260709 13:19:21.721041 10748 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:21.725708 10748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b: No bootstrap required, opened a new log
I20260709 13:19:21.728322 10748 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a38c5fcfa734219bf695f7f43a1393b" member_type: VOTER }
I20260709 13:19:21.728891 10748 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:21.729202 10748 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a38c5fcfa734219bf695f7f43a1393b, State: Initialized, Role: FOLLOWER
I20260709 13:19:21.729781 10748 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a38c5fcfa734219bf695f7f43a1393b" member_type: VOTER }
I20260709 13:19:21.730286 10748 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:21.730518 10748 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:21.730808 10748 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:21.736006 10748 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a38c5fcfa734219bf695f7f43a1393b" member_type: VOTER }
I20260709 13:19:21.736572 10748 leader_election.cc:304] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a38c5fcfa734219bf695f7f43a1393b; no voters: 
I20260709 13:19:21.737818 10748 leader_election.cc:290] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:21.738282 10751 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:21.740025 10751 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [term 1 LEADER]: Becoming Leader. State: Replica: 2a38c5fcfa734219bf695f7f43a1393b, State: Running, Role: LEADER
I20260709 13:19:21.740877 10748 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:21.740792 10751 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a38c5fcfa734219bf695f7f43a1393b" member_type: VOTER }
I20260709 13:19:21.750299 10753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a38c5fcfa734219bf695f7f43a1393b. Latest consensus state: current_term: 1 leader_uuid: "2a38c5fcfa734219bf695f7f43a1393b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a38c5fcfa734219bf695f7f43a1393b" member_type: VOTER } }
I20260709 13:19:21.750975 10753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:21.751370 10752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a38c5fcfa734219bf695f7f43a1393b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a38c5fcfa734219bf695f7f43a1393b" member_type: VOTER } }
I20260709 13:19:21.752067 10752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:21.753845 10762 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:21.759056 10762 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:21.760298  2025 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:21.768687 10762 catalog_manager.cc:1383] Generated new cluster ID: dac70397a3994ba294ba0585276bcd5b
I20260709 13:19:21.769001 10762 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:21.792626 10762 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:21.794269 10762 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:21.807344 10762 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b: Generated new TSK 0
I20260709 13:19:21.807989 10762 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:21.827467  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:21.834388 10769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:21.835337 10770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:21.837203 10772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:21.838469  2025 server_base.cc:1061] running on GCE node
I20260709 13:19:21.840835  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:21.841034  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:21.841317  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603161841290 us; error 0 us; skew 500 ppm
I20260709 13:19:21.841980  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:21.844544  2025 webserver.cc:533] Webserver started at http://127.1.250.65:39349/ using document root <none> and password file <none>
I20260709 13:19:21.845058  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:21.845295  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:21.845577  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:21.846662  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-0-root/instance:
uuid: "d726aaf867ea423fa4efe8a15d1896d1"
format_stamp: "Formatted at 2026-07-09 13:19:21 on dist-test-slave-g4pn"
I20260709 13:19:21.851823  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:19:21.856411 10777 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:21.857410  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:21.858011  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-0-root
uuid: "d726aaf867ea423fa4efe8a15d1896d1"
format_stamp: "Formatted at 2026-07-09 13:19:21 on dist-test-slave-g4pn"
I20260709 13:19:21.858415  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:21.883208  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:21.884512  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:21.886238  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:21.888789  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:21.888983  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:21.889309  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:21.889474  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:21.945483  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.65:37493
I20260709 13:19:21.945606 10839 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.65:37493 every 8 connection(s)
I20260709 13:19:21.951229  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:21.959412 10844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:21.962332 10845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:21.966137 10847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:21.967000  2025 server_base.cc:1061] running on GCE node
I20260709 13:19:21.968289 10840 heartbeater.cc:344] Connected to a master server at 127.1.250.126:41433
I20260709 13:19:21.968679 10840 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:21.969555  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:19:21.969566 10840 heartbeater.cc:507] Master 127.1.250.126:41433 requested a full tablet report, sending...
W20260709 13:19:21.969933  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:21.970184  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603161970170 us; error 0 us; skew 500 ppm
I20260709 13:19:21.970818  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:21.972244 10713 ts_manager.cc:194] Registered new tserver with Master: d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:21.973508  2025 webserver.cc:533] Webserver started at http://127.1.250.66:35711/ using document root <none> and password file <none>
I20260709 13:19:21.974067  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:21.974260  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:21.974532  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:21.974709 10713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49254
I20260709 13:19:21.976038  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-1-root/instance:
uuid: "02260b9a864a4665ae3c33869adeaaf5"
format_stamp: "Formatted at 2026-07-09 13:19:21 on dist-test-slave-g4pn"
I20260709 13:19:21.981846  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.005s
I20260709 13:19:21.985842 10852 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:21.986774  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:19:21.987197  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-1-root
uuid: "02260b9a864a4665ae3c33869adeaaf5"
format_stamp: "Formatted at 2026-07-09 13:19:21 on dist-test-slave-g4pn"
I20260709 13:19:21.987560  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:22.031360  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:22.032716  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:22.034395  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:22.036753  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:22.036986  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:22.037247  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:22.037420  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:22.088390  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.66:43287
I20260709 13:19:22.088502 10914 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.66:43287 every 8 connection(s)
I20260709 13:19:22.094048  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:22.101572 10918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:22.103945 10919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:22.108605  2025 server_base.cc:1061] running on GCE node
I20260709 13:19:22.109148 10915 heartbeater.cc:344] Connected to a master server at 127.1.250.126:41433
W20260709 13:19:22.109445 10921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:22.109608 10915 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:22.110651  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:22.110976  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:22.110862 10915 heartbeater.cc:507] Master 127.1.250.126:41433 requested a full tablet report, sending...
I20260709 13:19:22.111374  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603162111353 us; error 0 us; skew 500 ppm
I20260709 13:19:22.112423  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:22.113834 10713 ts_manager.cc:194] Registered new tserver with Master: 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:22.115165  2025 webserver.cc:533] Webserver started at http://127.1.250.67:37941/ using document root <none> and password file <none>
I20260709 13:19:22.115646 10713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49266
I20260709 13:19:22.115734  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:22.116102  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:22.116371  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:22.118047  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-2-root/instance:
uuid: "348b268fc1da46ac98e10bbe776b018b"
format_stamp: "Formatted at 2026-07-09 13:19:22 on dist-test-slave-g4pn"
I20260709 13:19:22.123683  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:19:22.128473 10926 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:22.129547  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:22.129873  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-2-root
uuid: "348b268fc1da46ac98e10bbe776b018b"
format_stamp: "Formatted at 2026-07-09 13:19:22 on dist-test-slave-g4pn"
I20260709 13:19:22.130177  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:22.156551  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:22.158226  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:22.160032  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:22.163146  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:22.163455  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:22.163738  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:22.163933  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:22.219348  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.67:45115
I20260709 13:19:22.219494 10988 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.67:45115 every 8 connection(s)
I20260709 13:19:22.224985  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:22.233589 10992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:22.234939 10993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:22.237587  2025 server_base.cc:1061] running on GCE node
W20260709 13:19:22.237711 10995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:22.238948  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:22.239207  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:22.239421  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603162239402 us; error 0 us; skew 500 ppm
I20260709 13:19:22.240017  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:22.243019  2025 webserver.cc:533] Webserver started at http://127.1.250.68:42107/ using document root <none> and password file <none>
I20260709 13:19:22.243589  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:22.243844  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:22.244164  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:22.244406 10989 heartbeater.cc:344] Connected to a master server at 127.1.250.126:41433
I20260709 13:19:22.244871 10989 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:22.245734  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-3-root/instance:
uuid: "10307244fcd642b89723e4fb4ac1291a"
format_stamp: "Formatted at 2026-07-09 13:19:22 on dist-test-slave-g4pn"
I20260709 13:19:22.245982 10989 heartbeater.cc:507] Master 127.1.250.126:41433 requested a full tablet report, sending...
I20260709 13:19:22.248545 10713 ts_manager.cc:194] Registered new tserver with Master: 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:22.250469 10713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49272
I20260709 13:19:22.251672  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:19:22.256287 11000 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:22.257426  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:19:22.257771  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-3-root
uuid: "10307244fcd642b89723e4fb4ac1291a"
format_stamp: "Formatted at 2026-07-09 13:19:22 on dist-test-slave-g4pn"
I20260709 13:19:22.258065  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:22.276279  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:22.277812  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:22.279551  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:22.281999  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:22.282238  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:22.282493  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:22.282694  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:22.330467  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.68:44237
I20260709 13:19:22.330591 11062 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.68:44237 every 8 connection(s)
I20260709 13:19:22.346719 11063 heartbeater.cc:344] Connected to a master server at 127.1.250.126:41433
I20260709 13:19:22.347240 11063 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:22.348155 11063 heartbeater.cc:507] Master 127.1.250.126:41433 requested a full tablet report, sending...
I20260709 13:19:22.351126 10713 ts_manager.cc:194] Registered new tserver with Master: 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:22.351953  2025 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017844824s
I20260709 13:19:22.352896 10713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49286
I20260709 13:19:22.385217 10713 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49300:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:19:22.659801 10953 tablet_service.cc:1511] Processing CreateTablet for tablet b949895bff3f409b9781c118fe3c9c21 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:22.661685 10953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b949895bff3f409b9781c118fe3c9c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.663589 10951 tablet_service.cc:1511] Processing CreateTablet for tablet 93233fc4a74c4234ae8eb56ad603713a (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:22.665686 10951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93233fc4a74c4234ae8eb56ad603713a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.668257 10952 tablet_service.cc:1511] Processing CreateTablet for tablet 1f7e307af3a04b85a49fcabdbdc687d5 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:22.669768 10952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f7e307af3a04b85a49fcabdbdc687d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.669413 10804 tablet_service.cc:1511] Processing CreateTablet for tablet 99b759717fbb437b92f5c1e04e6e5ce7 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:22.670028 10954 tablet_service.cc:1511] Processing CreateTablet for tablet bb34c068418c4622b74233a46424384d (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:22.671187 10804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b759717fbb437b92f5c1e04e6e5ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.671106 10800 tablet_service.cc:1511] Processing CreateTablet for tablet 94bc42d21ce64138aec6ff49d068ab86 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:22.672668 10800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bc42d21ce64138aec6ff49d068ab86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.674533 10950 tablet_service.cc:1511] Processing CreateTablet for tablet 94bc42d21ce64138aec6ff49d068ab86 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:22.671622 10954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb34c068418c4622b74233a46424384d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.677352 10803 tablet_service.cc:1511] Processing CreateTablet for tablet 1f7e307af3a04b85a49fcabdbdc687d5 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:22.679109 10803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f7e307af3a04b85a49fcabdbdc687d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.682503 10802 tablet_service.cc:1511] Processing CreateTablet for tablet 93233fc4a74c4234ae8eb56ad603713a (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:22.683681 10950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bc42d21ce64138aec6ff49d068ab86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.684149 10802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93233fc4a74c4234ae8eb56ad603713a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.687495 10801 tablet_service.cc:1511] Processing CreateTablet for tablet f7e627f9d3ca4ef68b1fbeb3f16da01a (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:22.689574 10801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e627f9d3ca4ef68b1fbeb3f16da01a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.694522 10805 tablet_service.cc:1511] Processing CreateTablet for tablet b949895bff3f409b9781c118fe3c9c21 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:22.696197 10805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b949895bff3f409b9781c118fe3c9c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.697926 11028 tablet_service.cc:1511] Processing CreateTablet for tablet bb34c068418c4622b74233a46424384d (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:22.699326 11028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb34c068418c4622b74233a46424384d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.699818 10880 tablet_service.cc:1511] Processing CreateTablet for tablet bb34c068418c4622b74233a46424384d (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:22.702584 10799 tablet_service.cc:1511] Processing CreateTablet for tablet 34a961ac552345e8b4c84ccdcb5ee1cf (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:22.704154 10799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a961ac552345e8b4c84ccdcb5ee1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.703982 10878 tablet_service.cc:1511] Processing CreateTablet for tablet 99b759717fbb437b92f5c1e04e6e5ce7 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:22.706529 10877 tablet_service.cc:1511] Processing CreateTablet for tablet 93233fc4a74c4234ae8eb56ad603713a (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:22.709125 11027 tablet_service.cc:1511] Processing CreateTablet for tablet 99b759717fbb437b92f5c1e04e6e5ce7 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:22.710590 11027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b759717fbb437b92f5c1e04e6e5ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.710896 10875 tablet_service.cc:1511] Processing CreateTablet for tablet 6c9c2d96172a4900bbd79e91d3cfd69a (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:22.702629 10879 tablet_service.cc:1511] Processing CreateTablet for tablet b949895bff3f409b9781c118fe3c9c21 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:22.708797 10876 tablet_service.cc:1511] Processing CreateTablet for tablet f7e627f9d3ca4ef68b1fbeb3f16da01a (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:22.714361 11026 tablet_service.cc:1511] Processing CreateTablet for tablet 1f7e307af3a04b85a49fcabdbdc687d5 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:22.715574 10880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb34c068418c4622b74233a46424384d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.715737 11026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f7e307af3a04b85a49fcabdbdc687d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.718276 11025 tablet_service.cc:1511] Processing CreateTablet for tablet f7e627f9d3ca4ef68b1fbeb3f16da01a (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:22.719666 11025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e627f9d3ca4ef68b1fbeb3f16da01a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.722134 10948 tablet_service.cc:1511] Processing CreateTablet for tablet 34a961ac552345e8b4c84ccdcb5ee1cf (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:22.723163 10874 tablet_service.cc:1511] Processing CreateTablet for tablet 34a961ac552345e8b4c84ccdcb5ee1cf (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:22.723755 10948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a961ac552345e8b4c84ccdcb5ee1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.723606 11022 tablet_service.cc:1511] Processing CreateTablet for tablet 211db9e835d644ccb7787552caa46c93 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:22.725045 10875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9c2d96172a4900bbd79e91d3cfd69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.725462 11022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211db9e835d644ccb7787552caa46c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.726169 11023 tablet_service.cc:1511] Processing CreateTablet for tablet 6c9c2d96172a4900bbd79e91d3cfd69a (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:22.727504 10874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a961ac552345e8b4c84ccdcb5ee1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.729070 10949 tablet_service.cc:1511] Processing CreateTablet for tablet 6c9c2d96172a4900bbd79e91d3cfd69a (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:22.731196 10949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9c2d96172a4900bbd79e91d3cfd69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.732342 10876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e627f9d3ca4ef68b1fbeb3f16da01a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.732734 11024 tablet_service.cc:1511] Processing CreateTablet for tablet 94bc42d21ce64138aec6ff49d068ab86 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:22.727622 11023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9c2d96172a4900bbd79e91d3cfd69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.737668 10879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b949895bff3f409b9781c118fe3c9c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.741534 11024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bc42d21ce64138aec6ff49d068ab86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.744488 10878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b759717fbb437b92f5c1e04e6e5ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.745440 10877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93233fc4a74c4234ae8eb56ad603713a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:22.752290 10760 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:22.783597 10798 tablet_service.cc:1511] Processing CreateTablet for tablet 211db9e835d644ccb7787552caa46c93 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:22.785302 10798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211db9e835d644ccb7787552caa46c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.796801 10873 tablet_service.cc:1511] Processing CreateTablet for tablet 211db9e835d644ccb7787552caa46c93 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:22.798370 10873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211db9e835d644ccb7787552caa46c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.804836 10951 tablet_service.cc:1511] Processing CreateTablet for tablet b9864e48c6a44db483a571660db1433d (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:22.806308 10951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9864e48c6a44db483a571660db1433d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.825519 11083 tablet_bootstrap.cc:492] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:22.855630 11021 tablet_service.cc:1511] Processing CreateTablet for tablet b9864e48c6a44db483a571660db1433d (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:22.857118 11021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9864e48c6a44db483a571660db1433d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.877372 10872 tablet_service.cc:1511] Processing CreateTablet for tablet b2b83744fc2a4faeb2a1ed98da1092b0 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:22.878201 10952 tablet_service.cc:1511] Processing CreateTablet for tablet b2b83744fc2a4faeb2a1ed98da1092b0 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:22.879040 10872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b83744fc2a4faeb2a1ed98da1092b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.879510 10952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b83744fc2a4faeb2a1ed98da1092b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.922089 11028 tablet_service.cc:1511] Processing CreateTablet for tablet b2b83744fc2a4faeb2a1ed98da1092b0 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:22.923585 11028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b83744fc2a4faeb2a1ed98da1092b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.925793 11086 tablet_bootstrap.cc:492] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:22.929905 11083 tablet_bootstrap.cc:654] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:22.936281 10799 tablet_service.cc:1511] Processing CreateTablet for tablet e4b2704733d44a9f8b55a95b4c06a389 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:22.941177 10801 tablet_service.cc:1511] Processing CreateTablet for tablet b9864e48c6a44db483a571660db1433d (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:22.942574 11084 tablet_bootstrap.cc:492] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:22.943650 10952 tablet_service.cc:1511] Processing CreateTablet for tablet e4b2704733d44a9f8b55a95b4c06a389 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:22.945641 10799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b2704733d44a9f8b55a95b4c06a389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.945964 11085 tablet_bootstrap.cc:492] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:22.949694 11086 tablet_bootstrap.cc:654] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:22.947068 10952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b2704733d44a9f8b55a95b4c06a389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.954563 10880 tablet_service.cc:1511] Processing CreateTablet for tablet e4b2704733d44a9f8b55a95b4c06a389 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:22.955901 10880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b2704733d44a9f8b55a95b4c06a389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.957854 11025 tablet_service.cc:1511] Processing CreateTablet for tablet c2fedddd0f2b4818ad11904281a7f444 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:22.959333 11025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2fedddd0f2b4818ad11904281a7f444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.963335 11084 tablet_bootstrap.cc:654] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:22.965499 10801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9864e48c6a44db483a571660db1433d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.965381 11085 tablet_bootstrap.cc:654] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:22.967358 10804 tablet_service.cc:1511] Processing CreateTablet for tablet c2fedddd0f2b4818ad11904281a7f444 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:22.968756 10804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2fedddd0f2b4818ad11904281a7f444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.969684 10876 tablet_service.cc:1511] Processing CreateTablet for tablet c2fedddd0f2b4818ad11904281a7f444 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:22.971045 10876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2fedddd0f2b4818ad11904281a7f444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.980466 10840 heartbeater.cc:499] Master 127.1.250.126:41433 was elected leader, sending a full tablet report...
I20260709 13:19:22.992306 10948 tablet_service.cc:1511] Processing CreateTablet for tablet 9e2f9f95429447eb9cb87f21c0785a9b (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:22.993813 10948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e2f9f95429447eb9cb87f21c0785a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.996349 10803 tablet_service.cc:1511] Processing CreateTablet for tablet 9e2f9f95429447eb9cb87f21c0785a9b (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:22.997771 10803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e2f9f95429447eb9cb87f21c0785a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.001857 11025 tablet_service.cc:1511] Processing CreateTablet for tablet 9e2f9f95429447eb9cb87f21c0785a9b (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:23.011075 11025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e2f9f95429447eb9cb87f21c0785a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.031589 11083 tablet_bootstrap.cc:492] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:23.032589 11083 ts_tablet_manager.cc:1403] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.208s	user 0.017s	sys 0.000s
I20260709 13:19:23.036468 11083 raft_consensus.cc:359] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:23.037424 11083 raft_consensus.cc:385] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.037729 11083 raft_consensus.cc:740] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.038517 11083 consensus_queue.cc:260] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:23.043372 10877 tablet_service.cc:1511] Processing CreateTablet for tablet ccc6fa17f15647569501a369656211c7 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:23.045641 10877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc6fa17f15647569501a369656211c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.048374 11086 tablet_bootstrap.cc:492] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:23.048935 11086 ts_tablet_manager.cc:1403] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.124s	user 0.023s	sys 0.038s
I20260709 13:19:23.049162 11085 tablet_bootstrap.cc:492] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:23.049216 10948 tablet_service.cc:1511] Processing CreateTablet for tablet ccc6fa17f15647569501a369656211c7 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:23.049767 11085 ts_tablet_manager.cc:1403] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.018s
I20260709 13:19:23.053314 11085 raft_consensus.cc:359] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.054036 11085 raft_consensus.cc:385] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.054339 11085 raft_consensus.cc:740] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.055126 11085 consensus_queue.cc:260] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.057399 11021 tablet_service.cc:1511] Processing CreateTablet for tablet ccc6fa17f15647569501a369656211c7 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:23.058882 11021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc6fa17f15647569501a369656211c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.059952 11086 raft_consensus.cc:359] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.060708 11086 raft_consensus.cc:385] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.060988 11086 raft_consensus.cc:740] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.061932 11086 consensus_queue.cc:260] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.076890 10948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc6fa17f15647569501a369656211c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.081386 10805 tablet_service.cc:1511] Processing CreateTablet for tablet bff1646148f04205b5383bbc084a62af (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:23.078812 11084 tablet_bootstrap.cc:492] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:23.085757 11084 ts_tablet_manager.cc:1403] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.170s	user 0.013s	sys 0.010s
I20260709 13:19:23.086145 10805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bff1646148f04205b5383bbc084a62af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.089881 10951 tablet_service.cc:1511] Processing CreateTablet for tablet bff1646148f04205b5383bbc084a62af (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:23.092360 11025 tablet_service.cc:1511] Processing CreateTablet for tablet b676ac3e11504dd5bc9a471a2216273f (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:23.093914 11025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b676ac3e11504dd5bc9a471a2216273f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.093914 10951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bff1646148f04205b5383bbc084a62af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.092675 11084 raft_consensus.cc:359] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:23.102883 11084 raft_consensus.cc:385] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.114841 10801 tablet_service.cc:1511] Processing CreateTablet for tablet b676ac3e11504dd5bc9a471a2216273f (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:23.116909 10801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b676ac3e11504dd5bc9a471a2216273f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.106724 11084 raft_consensus.cc:740] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.118081 11084 consensus_queue.cc:260] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:23.119216 10915 heartbeater.cc:499] Master 127.1.250.126:41433 was elected leader, sending a full tablet report...
I20260709 13:19:23.125862 10949 tablet_service.cc:1511] Processing CreateTablet for tablet 92b42bdb5b9e408b8ae8b4449e21be82 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:23.128348 11026 tablet_service.cc:1511] Processing CreateTablet for tablet 92b42bdb5b9e408b8ae8b4449e21be82 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:23.128866 10799 tablet_service.cc:1511] Processing CreateTablet for tablet 92b42bdb5b9e408b8ae8b4449e21be82 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:23.129484 10880 tablet_service.cc:1511] Processing CreateTablet for tablet b676ac3e11504dd5bc9a471a2216273f (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:23.135989 10949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92b42bdb5b9e408b8ae8b4449e21be82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.136605 10880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b676ac3e11504dd5bc9a471a2216273f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.139834 10950 tablet_service.cc:1511] Processing CreateTablet for tablet 023f097eceb641d18e1870dbd3a1ede3 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:23.141209 10950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023f097eceb641d18e1870dbd3a1ede3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.141537 11063 heartbeater.cc:499] Master 127.1.250.126:41433 was elected leader, sending a full tablet report...
I20260709 13:19:23.141943 10877 tablet_service.cc:1511] Processing CreateTablet for tablet 023f097eceb641d18e1870dbd3a1ede3 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:23.143260 10877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023f097eceb641d18e1870dbd3a1ede3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.143798 11091 raft_consensus.cc:493] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.145666 11026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92b42bdb5b9e408b8ae8b4449e21be82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.146572 10876 tablet_service.cc:1511] Processing CreateTablet for tablet bff1646148f04205b5383bbc084a62af (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:23.149677 10799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92b42bdb5b9e408b8ae8b4449e21be82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.155719 11021 tablet_service.cc:1511] Processing CreateTablet for tablet 023f097eceb641d18e1870dbd3a1ede3 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:23.158931 11021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023f097eceb641d18e1870dbd3a1ede3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.151189 11091 raft_consensus.cc:515] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.167757 10804 tablet_service.cc:1511] Processing CreateTablet for tablet c78decb93a9542368bf3107bc846a6f0 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:23.171605 10989 heartbeater.cc:499] Master 127.1.250.126:41433 was elected leader, sending a full tablet report...
I20260709 13:19:23.174542 10804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c78decb93a9542368bf3107bc846a6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.178045 10872 tablet_service.cc:1511] Processing CreateTablet for tablet c78decb93a9542368bf3107bc846a6f0 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:23.172991 11085 ts_tablet_manager.cc:1434] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.123s	user 0.007s	sys 0.009s
I20260709 13:19:23.176764 10953 tablet_service.cc:1511] Processing CreateTablet for tablet c78decb93a9542368bf3107bc846a6f0 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:23.187234 10876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bff1646148f04205b5383bbc084a62af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.205634 10953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c78decb93a9542368bf3107bc846a6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.206660 11028 tablet_service.cc:1511] Processing CreateTablet for tablet 61d37e6e4c06405fa84aaf770ff215bc (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:23.208475 11028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d37e6e4c06405fa84aaf770ff215bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.211709 10879 tablet_service.cc:1511] Processing CreateTablet for tablet 61d37e6e4c06405fa84aaf770ff215bc (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:23.202171 10872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c78decb93a9542368bf3107bc846a6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.215073 10803 tablet_service.cc:1511] Processing CreateTablet for tablet 61d37e6e4c06405fa84aaf770ff215bc (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:23.216395 10803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d37e6e4c06405fa84aaf770ff215bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.217543 10879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d37e6e4c06405fa84aaf770ff215bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.218279 11086 ts_tablet_manager.cc:1434] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.169s	user 0.012s	sys 0.012s
I20260709 13:19:23.219691 11086 tablet_bootstrap.cc:492] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
W20260709 13:19:23.228185 10990 tablet.cc:2406] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:19:23.228632 11093 raft_consensus.cc:493] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.229384 11093 raft_consensus.cc:515] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:23.246424 11083 ts_tablet_manager.cc:1434] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.214s	user 0.012s	sys 0.010s
I20260709 13:19:23.250141 11085 tablet_bootstrap.cc:492] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:23.239428 11093 leader_election.cc:290] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:23.261289 11026 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0b6d45547e4ef89454d41c9943374f (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:23.258436 10798 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0b6d45547e4ef89454d41c9943374f (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:23.270985 11083 tablet_bootstrap.cc:492] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:23.271221 10952 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0b6d45547e4ef89454d41c9943374f (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:23.298100 10952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0b6d45547e4ef89454d41c9943374f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.280121 11091 leader_election.cc:290] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:23.288915 11026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0b6d45547e4ef89454d41c9943374f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.302148 11084 ts_tablet_manager.cc:1434] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.216s	user 0.009s	sys 0.006s
I20260709 13:19:23.304286 11084 tablet_bootstrap.cc:492] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:23.308751 11085 tablet_bootstrap.cc:654] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.289836 10798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0b6d45547e4ef89454d41c9943374f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.418037 10804 tablet_service.cc:1511] Processing CreateTablet for tablet 6b7600277a13475fa3c331ef52fb4d51 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:23.427452 10804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b7600277a13475fa3c331ef52fb4d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.429723 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
W20260709 13:19:23.433754 10930 leader_election.cc:343] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.439680 10949 tablet_service.cc:1511] Processing CreateTablet for tablet 858421950e8a4552815da6611d222770 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:23.328224 11083 tablet_bootstrap.cc:654] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.442276 10879 tablet_service.cc:1511] Processing CreateTablet for tablet 6b7600277a13475fa3c331ef52fb4d51 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:23.443697 11095 raft_consensus.cc:493] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.444445 10879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b7600277a13475fa3c331ef52fb4d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.444697 11095 raft_consensus.cc:515] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:23.316978 11086 tablet_bootstrap.cc:654] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.449718 11028 tablet_service.cc:1511] Processing CreateTablet for tablet 858421950e8a4552815da6611d222770 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:23.455358 11028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 858421950e8a4552815da6611d222770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.448979 11092 raft_consensus.cc:493] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.451367 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:23.456508 11092 raft_consensus.cc:515] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
W20260709 13:19:23.463078 10928 leader_election.cc:343] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.463822 10928 leader_election.cc:304] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:23.465385 11093 raft_consensus.cc:2749] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:23.469708 10949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 858421950e8a4552815da6611d222770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.423925 10877 tablet_service.cc:1511] Processing CreateTablet for tablet 858421950e8a4552815da6611d222770 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:23.474071 10877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 858421950e8a4552815da6611d222770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.488235 11085 tablet_bootstrap.cc:492] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:23.501597 11085 ts_tablet_manager.cc:1403] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.300s	user 0.009s	sys 0.014s
I20260709 13:19:23.486467 11092 leader_election.cc:290] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:23.508314 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b759717fbb437b92f5c1e04e6e5ce7" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
W20260709 13:19:23.510423 10856 leader_election.cc:343] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.533308 11085 raft_consensus.cc:359] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:23.529644 11084 tablet_bootstrap.cc:654] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.534399 11085 raft_consensus.cc:385] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.552168 10799 tablet_service.cc:1511] Processing CreateTablet for tablet 34c729794e1e4b7bb1571a3e52c12585 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:23.553797 10799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c729794e1e4b7bb1571a3e52c12585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.547432 11085 raft_consensus.cc:740] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
W20260709 13:19:23.546761 10698 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 64031.4us
I20260709 13:19:23.564209 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b759717fbb437b92f5c1e04e6e5ce7" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:23.565536 10699 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 74997.8us
W20260709 13:19:23.566690 10854 leader_election.cc:343] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.567245 10854 leader_election.cc:304] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:23.568825 11091 raft_consensus.cc:2749] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:23.569013 10952 tablet_service.cc:1511] Processing CreateTablet for tablet 6b7600277a13475fa3c331ef52fb4d51 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:23.570703 10952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b7600277a13475fa3c331ef52fb4d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.574440 11095 leader_election.cc:290] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:23.560508 11085 consensus_queue.cc:260] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:23.578935 11085 ts_tablet_manager.cc:1434] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.077s	user 0.011s	sys 0.000s
I20260709 13:19:23.580649 11085 tablet_bootstrap.cc:492] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:23.583593 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211db9e835d644ccb7787552caa46c93" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
W20260709 13:19:23.586064 11002 leader_election.cc:343] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.602751 11021 tablet_service.cc:1511] Processing CreateTablet for tablet 34c729794e1e4b7bb1571a3e52c12585 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:23.604153 11021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c729794e1e4b7bb1571a3e52c12585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.603868 10872 tablet_service.cc:1511] Processing CreateTablet for tablet 34c729794e1e4b7bb1571a3e52c12585 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:23.605221 10872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c729794e1e4b7bb1571a3e52c12585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.611418 11086 tablet_bootstrap.cc:492] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:23.611435 11083 tablet_bootstrap.cc:492] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:23.612311 11086 ts_tablet_manager.cc:1403] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.393s	user 0.012s	sys 0.016s
I20260709 13:19:23.612407 11083 ts_tablet_manager.cc:1403] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.342s	user 0.021s	sys 0.016s
I20260709 13:19:23.620208 11083 raft_consensus.cc:359] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.624545 11083 raft_consensus.cc:385] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.624869 11083 raft_consensus.cc:740] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.627334 10804 tablet_service.cc:1511] Processing CreateTablet for tablet d09ec691f9324f94a67cc88b0a2d4522 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:23.630391 10804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09ec691f9324f94a67cc88b0a2d4522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.632318 11083 consensus_queue.cc:260] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.628274 11028 tablet_service.cc:1511] Processing CreateTablet for tablet d09ec691f9324f94a67cc88b0a2d4522 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:23.635107 10953 tablet_service.cc:1511] Processing CreateTablet for tablet d09ec691f9324f94a67cc88b0a2d4522 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:23.639333 11028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09ec691f9324f94a67cc88b0a2d4522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.643235 10953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09ec691f9324f94a67cc88b0a2d4522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.644866 11084 tablet_bootstrap.cc:492] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:23.642172 11086 raft_consensus.cc:359] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.645525 11084 ts_tablet_manager.cc:1403] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.341s	user 0.019s	sys 0.013s
I20260709 13:19:23.645751 11086 raft_consensus.cc:385] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.646116 11086 raft_consensus.cc:740] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.649048 11084 raft_consensus.cc:359] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.649883 11084 raft_consensus.cc:385] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.650202 11084 raft_consensus.cc:740] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.650452 11093 raft_consensus.cc:493] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.650992 11093 raft_consensus.cc:515] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.654140 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7e307af3a04b85a49fcabdbdc687d5" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:23.654976 11086 consensus_queue.cc:260] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.655669 11093 leader_election.cc:290] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
W20260709 13:19:23.656023 10779 leader_election.cc:343] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.641310 11083 ts_tablet_manager.cc:1434] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.003s
I20260709 13:19:23.657768 11083 tablet_bootstrap.cc:492] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:23.657797 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb34c068418c4622b74233a46424384d" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
W20260709 13:19:23.659476 10928 leader_election.cc:343] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.662465 10876 tablet_service.cc:1511] Processing CreateTablet for tablet c282271ee3314a2db79070b0c703e56d (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:23.663910 10876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c282271ee3314a2db79070b0c703e56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.667385 11026 tablet_service.cc:1511] Processing CreateTablet for tablet c282271ee3314a2db79070b0c703e56d (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:23.668807 11026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c282271ee3314a2db79070b0c703e56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.670702 10949 tablet_service.cc:1511] Processing CreateTablet for tablet c282271ee3314a2db79070b0c703e56d (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:23.672165 10949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c282271ee3314a2db79070b0c703e56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.675931 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb34c068418c4622b74233a46424384d" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:23.677699 10928 leader_election.cc:343] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.677418 11084 consensus_queue.cc:260] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.678344 10928 leader_election.cc:304] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:23.679955 11093 raft_consensus.cc:2749] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:23.681068 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7e307af3a04b85a49fcabdbdc687d5" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
W20260709 13:19:23.683159 10780 leader_election.cc:343] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.683640 10780 leader_election.cc:304] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:23.684455 11095 raft_consensus.cc:2749] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:23.689793 11084 ts_tablet_manager.cc:1434] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
I20260709 13:19:23.690435 11086 ts_tablet_manager.cc:1434] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.078s	user 0.003s	sys 0.008s
I20260709 13:19:23.697731 11084 tablet_bootstrap.cc:492] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:23.698067 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211db9e835d644ccb7787552caa46c93" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
W20260709 13:19:23.699937 11004 leader_election.cc:343] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.702032 11004 leader_election.cc:304] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:23.703168 11092 raft_consensus.cc:2749] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:23.708355 11085 tablet_bootstrap.cc:654] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.708005 10801 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf42b68842d44bbbeaf36ee573a6da0 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:23.708973 10879 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf42b68842d44bbbeaf36ee573a6da0 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:23.710541 10879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf42b68842d44bbbeaf36ee573a6da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.709664 10801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf42b68842d44bbbeaf36ee573a6da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.711470 11086 tablet_bootstrap.cc:492] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:23.712486 11083 tablet_bootstrap.cc:654] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.715917 10950 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf42b68842d44bbbeaf36ee573a6da0 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:23.717501 10950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf42b68842d44bbbeaf36ee573a6da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.717262 11025 tablet_service.cc:1511] Processing CreateTablet for tablet 533e572edda34e56bb0fc3aaf49022da (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:23.718647 11025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533e572edda34e56bb0fc3aaf49022da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.720868 11084 tablet_bootstrap.cc:654] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.729218 10877 tablet_service.cc:1511] Processing CreateTablet for tablet 533e572edda34e56bb0fc3aaf49022da (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:23.737108 11027 tablet_service.cc:1511] Processing CreateTablet for tablet 64eb7071b63a4a51bc2c3b07b243711e (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:23.737859 10799 tablet_service.cc:1511] Processing CreateTablet for tablet 533e572edda34e56bb0fc3aaf49022da (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:23.738621 11027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64eb7071b63a4a51bc2c3b07b243711e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.739183 10799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533e572edda34e56bb0fc3aaf49022da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.741842 10798 tablet_service.cc:1511] Processing CreateTablet for tablet 64eb7071b63a4a51bc2c3b07b243711e (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:23.743284 10798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64eb7071b63a4a51bc2c3b07b243711e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:23.760821 10760 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:23.763010 10952 tablet_service.cc:1511] Processing CreateTablet for tablet 64eb7071b63a4a51bc2c3b07b243711e (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:23.765026 10952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64eb7071b63a4a51bc2c3b07b243711e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.756546 10877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533e572edda34e56bb0fc3aaf49022da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.773011 10872 tablet_service.cc:1511] Processing CreateTablet for tablet 4c225028946540c2ad3af7200d7f49e3 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:23.774436 11086 tablet_bootstrap.cc:654] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.774701 10872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c225028946540c2ad3af7200d7f49e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.777978 10951 tablet_service.cc:1511] Processing CreateTablet for tablet 4c225028946540c2ad3af7200d7f49e3 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:23.779495 10951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c225028946540c2ad3af7200d7f49e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.784360 11024 tablet_service.cc:1511] Processing CreateTablet for tablet 4c225028946540c2ad3af7200d7f49e3 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:23.785808 11024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c225028946540c2ad3af7200d7f49e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.788046 11083 tablet_bootstrap.cc:492] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:23.788578 11083 ts_tablet_manager.cc:1403] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.000s
I20260709 13:19:23.781203 10803 tablet_service.cc:1511] Processing CreateTablet for tablet 84aaea3ca9c0459e98df2be582872d60 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:23.790918 10803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84aaea3ca9c0459e98df2be582872d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.799865 11085 tablet_bootstrap.cc:492] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:23.800419 11085 ts_tablet_manager.cc:1403] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.220s	user 0.017s	sys 0.006s
I20260709 13:19:23.806900 11084 tablet_bootstrap.cc:492] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:23.808707 11084 ts_tablet_manager.cc:1403] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.111s	user 0.019s	sys 0.004s
I20260709 13:19:23.816318 11084 raft_consensus.cc:359] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:23.803779 11085 raft_consensus.cc:359] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.832316 11085 raft_consensus.cc:385] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.832868 11085 raft_consensus.cc:740] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.834980 11085 consensus_queue.cc:260] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.824555 10876 tablet_service.cc:1511] Processing CreateTablet for tablet 84aaea3ca9c0459e98df2be582872d60 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:23.838028 10876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84aaea3ca9c0459e98df2be582872d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.792554 11083 raft_consensus.cc:359] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:23.839155 11083 raft_consensus.cc:385] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.839643 11083 raft_consensus.cc:740] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.840646 11083 consensus_queue.cc:260] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:23.843361 11083 ts_tablet_manager.cc:1434] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 13:19:23.846701 11083 tablet_bootstrap.cc:492] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:23.826030 10948 tablet_service.cc:1511] Processing CreateTablet for tablet 84aaea3ca9c0459e98df2be582872d60 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:23.850325 10948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84aaea3ca9c0459e98df2be582872d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.853189 11085 ts_tablet_manager.cc:1434] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.052s	user 0.003s	sys 0.006s
I20260709 13:19:23.855552 11085 tablet_bootstrap.cc:492] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:23.839639 11084 raft_consensus.cc:385] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.861446 11084 raft_consensus.cc:740] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.862397 11084 consensus_queue.cc:260] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:23.865720 11092 raft_consensus.cc:493] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.866288 11092 raft_consensus.cc:515] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:23.871080 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c9c2d96172a4900bbd79e91d3cfd69a" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:23.873739 11092 leader_election.cc:290] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:23.874121 11091 raft_consensus.cc:493] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.874619 11091 raft_consensus.cc:515] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
W20260709 13:19:23.875885 11002 leader_election.cc:343] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.877399 11091 leader_election.cc:290] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:23.879418 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211db9e835d644ccb7787552caa46c93" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:23.881685 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211db9e835d644ccb7787552caa46c93" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:23.882422 11038 raft_consensus.cc:2468] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
W20260709 13:19:23.883915 10856 leader_election.cc:343] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.886173 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c9c2d96172a4900bbd79e91d3cfd69a" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
W20260709 13:19:23.887710 11003 leader_election.cc:343] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.887912 10854 leader_election.cc:304] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:23.888221 11003 leader_election.cc:304] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:23.889225 11091 raft_consensus.cc:2804] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:23.889539 11092 raft_consensus.cc:2749] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:23.889612 11091 raft_consensus.cc:493] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.890240 11091 raft_consensus.cc:3060] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.890504 11095 raft_consensus.cc:493] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.891029 11095 raft_consensus.cc:515] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.894140 11095 leader_election.cc:290] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:23.897523 11092 raft_consensus.cc:493] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.898100 11092 raft_consensus.cc:515] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.901813 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb34c068418c4622b74233a46424384d" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:23.902191 11092 leader_election.cc:290] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:23.902542 10964 raft_consensus.cc:2468] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:23.906638 11025 tablet_service.cc:1511] Processing CreateTablet for tablet b64ecb0ea0324b31ae37b194ad98e73a (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:23.908018 11003 leader_election.cc:304] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:23.908520 10798 tablet_service.cc:1511] Processing CreateTablet for tablet b64ecb0ea0324b31ae37b194ad98e73a (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:23.903779 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb34c068418c4622b74233a46424384d" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:23.909636 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e627f9d3ca4ef68b1fbeb3f16da01a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:23.909987 10798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b64ecb0ea0324b31ae37b194ad98e73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.908048 11025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b64ecb0ea0324b31ae37b194ad98e73a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:23.911234 11002 leader_election.cc:343] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.912256 11084 ts_tablet_manager.cc:1434] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.099s	user 0.005s	sys 0.002s
I20260709 13:19:23.910604 11086 tablet_bootstrap.cc:492] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:23.913007 11086 ts_tablet_manager.cc:1403] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.222s	user 0.047s	sys 0.013s
I20260709 13:19:23.915717 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e627f9d3ca4ef68b1fbeb3f16da01a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:23.916718 11084 tablet_bootstrap.cc:492] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
W20260709 13:19:23.917412 10779 leader_election.cc:343] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.903986 11091 raft_consensus.cc:515] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.921384 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211db9e835d644ccb7787552caa46c93" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:23.922040 11038 raft_consensus.cc:3060] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:23.922472 10779 leader_election.cc:343] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.923015 10779 leader_election.cc:304] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:23.923872 11095 raft_consensus.cc:2749] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:23.924783 11083 tablet_bootstrap.cc:654] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.924887 11086 raft_consensus.cc:359] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:23.930470 11086 raft_consensus.cc:385] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.930639 11091 leader_election.cc:290] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:23.930794 11086 raft_consensus.cc:740] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.931375 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211db9e835d644ccb7787552caa46c93" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:23.931910 11086 consensus_queue.cc:260] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:23.932906 10876 tablet_service.cc:1511] Processing CreateTablet for tablet b64ecb0ea0324b31ae37b194ad98e73a (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 13:19:23.933343 10856 leader_election.cc:343] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.936465 11086 ts_tablet_manager.cc:1434] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 13:19:23.936925 11118 raft_consensus.cc:2804] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:23.937469 11118 raft_consensus.cc:493] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.937734 11086 tablet_bootstrap.cc:492] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:23.937842 11118 raft_consensus.cc:3060] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.941000 10948 tablet_service.cc:1511] Processing CreateTablet for tablet b73cc1fc36c14e8cb8698530765f5134 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:23.942591 10948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b73cc1fc36c14e8cb8698530765f5134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.944142 11038 raft_consensus.cc:2468] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:23.945662 10854 leader_election.cc:304] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:23.946921 11091 raft_consensus.cc:2804] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:23.951479 10876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b64ecb0ea0324b31ae37b194ad98e73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.953474 11086 tablet_bootstrap.cc:654] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.953742 11025 tablet_service.cc:1511] Processing CreateTablet for tablet b73cc1fc36c14e8cb8698530765f5134 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:23.955204 11085 tablet_bootstrap.cc:654] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.956348 10798 tablet_service.cc:1511] Processing CreateTablet for tablet b73cc1fc36c14e8cb8698530765f5134 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:23.955205 11025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b73cc1fc36c14e8cb8698530765f5134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.958510 11095 raft_consensus.cc:493] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.959172 11095 raft_consensus.cc:515] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:23.961184 11091 raft_consensus.cc:697] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:23.962100 11095 leader_election.cc:290] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:23.962199 11091 consensus_queue.cc:237] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:23.964927 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:23.965858 10964 raft_consensus.cc:2468] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:23.968053 10780 leader_election.cc:304] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:23.969506 11083 tablet_bootstrap.cc:492] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:23.970472 11095 raft_consensus.cc:2804] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:23.971022 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:23.971118 11095 raft_consensus.cc:493] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:23.973448 10779 leader_election.cc:343] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.977190 11095 raft_consensus.cc:3060] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.980247 11084 tablet_bootstrap.cc:654] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.970058 11083 ts_tablet_manager.cc:1403] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.124s	user 0.010s	sys 0.002s
I20260709 13:19:23.971828 10798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b73cc1fc36c14e8cb8698530765f5134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.988957 10877 tablet_service.cc:1511] Processing CreateTablet for tablet 2729869dbf7e461db0eacdce000b036f (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:23.990504 10877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2729869dbf7e461db0eacdce000b036f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.995628 11083 raft_consensus.cc:359] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:23.996534 11083 raft_consensus.cc:385] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.996872 11083 raft_consensus.cc:740] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.997383 10951 tablet_service.cc:1511] Processing CreateTablet for tablet 2729869dbf7e461db0eacdce000b036f (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:23.997855 11083 consensus_queue.cc:260] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:23.998886 10951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2729869dbf7e461db0eacdce000b036f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.000227 11024 tablet_service.cc:1511] Processing CreateTablet for tablet 2729869dbf7e461db0eacdce000b036f (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:24.001832 11024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2729869dbf7e461db0eacdce000b036f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.003397 10711 catalog_manager.cc:5697] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.017347 11093 raft_consensus.cc:493] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.017976 11093 raft_consensus.cc:515] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:24.020296 11093 leader_election.cc:290] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:24.021677 10803 tablet_service.cc:1511] Processing CreateTablet for tablet 3c926e4bc5c549a88846566915db122f (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:24.023083 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949895bff3f409b9781c118fe3c9c21" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:24.023537 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949895bff3f409b9781c118fe3c9c21" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:24.023557 10879 tablet_service.cc:1511] Processing CreateTablet for tablet 3c926e4bc5c549a88846566915db122f (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:24.023733 11083 ts_tablet_manager.cc:1434] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
W20260709 13:19:24.025110 10928 leader_election.cc:343] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.025504 10879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c926e4bc5c549a88846566915db122f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:24.026463 10930 leader_election.cc:343] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.023111 10803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c926e4bc5c549a88846566915db122f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.035362 10930 leader_election.cc:304] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:24.036829 11086 tablet_bootstrap.cc:492] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:24.042833 11093 raft_consensus.cc:2749] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:24.043241 11086 ts_tablet_manager.cc:1403] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.106s	user 0.029s	sys 0.012s
I20260709 13:19:24.044500 11095 raft_consensus.cc:515] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:24.037613 11083 tablet_bootstrap.cc:492] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:24.007270 11118 raft_consensus.cc:515] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:24.052011 11027 tablet_service.cc:1511] Processing CreateTablet for tablet 6e271b04664c496a88d89b0bbfa85c36 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:24.054008 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb34c068418c4622b74233a46424384d" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:24.054278 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:24.054716 10963 raft_consensus.cc:3060] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.054605 10948 tablet_service.cc:1511] Processing CreateTablet for tablet 3c926e4bc5c549a88846566915db122f (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:19:24.055981 10779 leader_election.cc:343] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.056272 11027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e271b04664c496a88d89b0bbfa85c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.046996 11086 raft_consensus.cc:359] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:24.057850 11086 raft_consensus.cc:385] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.058179 11086 raft_consensus.cc:740] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.060792 11086 consensus_queue.cc:260] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:24.050760 11085 tablet_bootstrap.cc:492] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:24.050479 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:24.064361 10964 raft_consensus.cc:3060] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.064838 10948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c926e4bc5c549a88846566915db122f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.070397 11086 ts_tablet_manager.cc:1434] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:19:24.071977 11086 tablet_bootstrap.cc:492] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:24.073573 11085 ts_tablet_manager.cc:1403] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.219s	user 0.020s	sys 0.011s
I20260709 13:19:24.073992 11084 tablet_bootstrap.cc:492] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:24.076172 11084 ts_tablet_manager.cc:1403] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.160s	user 0.015s	sys 0.006s
I20260709 13:19:24.062912 11095 leader_election.cc:290] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:24.079654 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb34c068418c4622b74233a46424384d" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:24.080502 10799 tablet_service.cc:1511] Processing CreateTablet for tablet 6e271b04664c496a88d89b0bbfa85c36 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:24.081966 10799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e271b04664c496a88d89b0bbfa85c36. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:24.081903 11002 leader_election.cc:343] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.078202 11118 leader_election.cc:290] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:24.096475 10964 raft_consensus.cc:2468] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:24.097962 10780 leader_election.cc:304] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5
I20260709 13:19:24.099241 11095 raft_consensus.cc:2804] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:24.102222 11083 tablet_bootstrap.cc:654] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.104542 11086 tablet_bootstrap.cc:654] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.107739 10872 tablet_service.cc:1511] Processing CreateTablet for tablet 6e271b04664c496a88d89b0bbfa85c36 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:24.109613 10950 tablet_service.cc:1511] Processing CreateTablet for tablet cfc5d48da62642a9a8e39ec61cfc914d (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:24.113595 10950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc5d48da62642a9a8e39ec61cfc914d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.113996 10872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e271b04664c496a88d89b0bbfa85c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.115947 11025 tablet_service.cc:1511] Processing CreateTablet for tablet cfc5d48da62642a9a8e39ec61cfc914d (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:24.119829 10949 tablet_service.cc:1511] Processing CreateTablet for tablet 10ebefb588f745118a0b6ec5c6519a65 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:24.122051 11091 raft_consensus.cc:493] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.122558 11091 raft_consensus.cc:515] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:24.124259 10876 tablet_service.cc:1511] Processing CreateTablet for tablet 10ebefb588f745118a0b6ec5c6519a65 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:24.125617 10876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ebefb588f745118a0b6ec5c6519a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.126323 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
W20260709 13:19:24.127894 10856 leader_election.cc:343] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.130460 10880 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0bdc10add5473a94bcb1e1e5d2d1bc (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:24.132027 10880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0bdc10add5473a94bcb1e1e5d2d1bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.138520 10804 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0bdc10add5473a94bcb1e1e5d2d1bc (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:24.138738 10952 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb72b7a1eed4df08c0414cdb29fb6f1 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:24.139017 10953 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0bdc10add5473a94bcb1e1e5d2d1bc (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:24.140008 10804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0bdc10add5473a94bcb1e1e5d2d1bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.143764 11025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc5d48da62642a9a8e39ec61cfc914d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.144057 11021 tablet_service.cc:1511] Processing CreateTablet for tablet cf66c391c2ea4f04a1eb536f28d4b170 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:24.141714 10949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ebefb588f745118a0b6ec5c6519a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.145571 11021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf66c391c2ea4f04a1eb536f28d4b170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.146814 11028 tablet_service.cc:1511] Processing CreateTablet for tablet 10ebefb588f745118a0b6ec5c6519a65 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:24.148156 11026 tablet_service.cc:1511] Processing CreateTablet for tablet 84a90e754ea44ce5b10285e034656db6 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:24.151921 10875 tablet_service.cc:1511] Processing CreateTablet for tablet cf66c391c2ea4f04a1eb536f28d4b170 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:24.154757 10801 tablet_service.cc:1511] Processing CreateTablet for tablet cf66c391c2ea4f04a1eb536f28d4b170 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:24.155490 10805 tablet_service.cc:1511] Processing CreateTablet for tablet 84a90e754ea44ce5b10285e034656db6 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:24.156049 10953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0bdc10add5473a94bcb1e1e5d2d1bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.156363 10801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf66c391c2ea4f04a1eb536f28d4b170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.156646 11022 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb72b7a1eed4df08c0414cdb29fb6f1 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:24.149932 11026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a90e754ea44ce5b10285e034656db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.158571 11022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb72b7a1eed4df08c0414cdb29fb6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.159052 10952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb72b7a1eed4df08c0414cdb29fb6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.158627 10874 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb72b7a1eed4df08c0414cdb29fb6f1 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:24.159914 10963 raft_consensus.cc:2468] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:24.160229 10874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb72b7a1eed4df08c0414cdb29fb6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.156991 10805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a90e754ea44ce5b10285e034656db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.106561 11084 raft_consensus.cc:359] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:24.164919 10875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf66c391c2ea4f04a1eb536f28d4b170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.158512 10800 tablet_service.cc:1511] Processing CreateTablet for tablet b854da4ba865432d90d6a626e5b585bf (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:24.171267 10800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b854da4ba865432d90d6a626e5b585bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.171581 10878 tablet_service.cc:1511] Processing CreateTablet for tablet b854da4ba865432d90d6a626e5b585bf (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:24.173295 11003 leader_election.cc:304] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5
I20260709 13:19:24.174638 11118 raft_consensus.cc:2804] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:24.175136 11118 raft_consensus.cc:697] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:24.175958 11118 consensus_queue.cc:237] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:24.177214 11028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ebefb588f745118a0b6ec5c6519a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.185631 10951 tablet_service.cc:1511] Processing CreateTablet for tablet 84a90e754ea44ce5b10285e034656db6 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:24.194953 10954 tablet_service.cc:1511] Processing CreateTablet for tablet b854da4ba865432d90d6a626e5b585bf (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:24.166723 11091 leader_election.cc:290] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:24.196573 10954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b854da4ba865432d90d6a626e5b585bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.201661 11085 raft_consensus.cc:359] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:24.202495 11085 raft_consensus.cc:385] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.202816 11085 raft_consensus.cc:740] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.168123 11084 raft_consensus.cc:385] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.169243 11095 raft_consensus.cc:697] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:24.211673 11085 consensus_queue.cc:260] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:24.209575 11084 raft_consensus.cc:740] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.212523 11095 consensus_queue.cc:237] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:24.214201 11084 consensus_queue.cc:260] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:24.218000 10878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b854da4ba865432d90d6a626e5b585bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.219749 11024 tablet_service.cc:1511] Processing CreateTablet for tablet b145e95f652c4178b64b4379f53a809d (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:24.221323 11024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b145e95f652c4178b64b4379f53a809d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.221910 10802 tablet_service.cc:1511] Processing CreateTablet for tablet b145e95f652c4178b64b4379f53a809d (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:24.223295 10802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b145e95f652c4178b64b4379f53a809d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.229331 10947 tablet_service.cc:1511] Processing CreateTablet for tablet 52a060d27b9f4695a643036bb5223916 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:24.233072 11084 ts_tablet_manager.cc:1434] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.157s	user 0.009s	sys 0.004s
I20260709 13:19:24.234359 11084 tablet_bootstrap.cc:492] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:24.247267 10951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a90e754ea44ce5b10285e034656db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.260916 11127 raft_consensus.cc:493] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.261552 11127 raft_consensus.cc:515] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:24.263813 11127 leader_election.cc:290] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:24.260737 11085 ts_tablet_manager.cc:1434] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.186s	user 0.012s	sys 0.000s
I20260709 13:19:24.278023 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bc42d21ce64138aec6ff49d068ab86" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:24.277880 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bc42d21ce64138aec6ff49d068ab86" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:24.282769 10947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a060d27b9f4695a643036bb5223916. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:24.284299 10779 leader_election.cc:343] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.286942 11085 tablet_bootstrap.cc:492] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:24.286652 11023 tablet_service.cc:1511] Processing CreateTablet for tablet 52a060d27b9f4695a643036bb5223916 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:24.288403 11023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a060d27b9f4695a643036bb5223916. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:24.292510 10780 leader_election.cc:343] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.293229 10780 leader_election.cc:304] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:24.298975 10798 tablet_service.cc:1511] Processing CreateTablet for tablet 52a060d27b9f4695a643036bb5223916 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:24.299558 11127 raft_consensus.cc:2749] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:24.306409 10946 tablet_service.cc:1511] Processing CreateTablet for tablet 585cc3c8fea2482e99b321de3dc98356 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:24.301594 10709 catalog_manager.cc:5697] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 1 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:24.308280 10946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585cc3c8fea2482e99b321de3dc98356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.313629 10879 tablet_service.cc:1511] Processing CreateTablet for tablet b145e95f652c4178b64b4379f53a809d (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:24.315145 10879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b145e95f652c4178b64b4379f53a809d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.318562 11083 tablet_bootstrap.cc:492] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:24.319248 11083 ts_tablet_manager.cc:1403] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.287s	user 0.014s	sys 0.007s
I20260709 13:19:24.347635 10877 tablet_service.cc:1511] Processing CreateTablet for tablet 585cc3c8fea2482e99b321de3dc98356 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:24.350409 10877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585cc3c8fea2482e99b321de3dc98356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.349834 10805 tablet_service.cc:1511] Processing CreateTablet for tablet 2904c45fa164407791817b45928f663e (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:24.355195 10803 tablet_service.cc:1511] Processing CreateTablet for tablet cfc5d48da62642a9a8e39ec61cfc914d (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:24.373279 11093 raft_consensus.cc:493] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.374421 11093 raft_consensus.cc:515] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:24.378916 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
W20260709 13:19:24.383041 10930 leader_election.cc:343] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.385151 10798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a060d27b9f4695a643036bb5223916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.393221 11093 leader_election.cc:290] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:24.395721 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:24.396790 10890 raft_consensus.cc:2468] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 0.
I20260709 13:19:24.398401 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:24.399370 10963 raft_consensus.cc:2468] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:24.400381 10803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc5d48da62642a9a8e39ec61cfc914d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.402485 11025 tablet_service.cc:1511] Processing CreateTablet for tablet 585cc3c8fea2482e99b321de3dc98356 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:24.406714 10928 leader_election.cc:304] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:24.411290 11025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585cc3c8fea2482e99b321de3dc98356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.410157 10855 leader_election.cc:304] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:24.424147 11085 tablet_bootstrap.cc:654] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.436563 11084 tablet_bootstrap.cc:654] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.417948 11093 raft_consensus.cc:2804] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.442806 10950 tablet_service.cc:1511] Processing CreateTablet for tablet 2904c45fa164407791817b45928f663e (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:24.444998 10805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2904c45fa164407791817b45928f663e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.455713 11091 raft_consensus.cc:2804] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.457571 11091 raft_consensus.cc:493] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.458014 11091 raft_consensus.cc:3060] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.461035 10712 catalog_manager.cc:5697] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:24.461961 10950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2904c45fa164407791817b45928f663e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.448017 11093 raft_consensus.cc:493] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:24.494287 10855 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 84618.7us
I20260709 13:19:24.502904 11086 tablet_bootstrap.cc:492] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:24.507586 10874 tablet_service.cc:1511] Processing CreateTablet for tablet 2904c45fa164407791817b45928f663e (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:24.510242 10874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2904c45fa164407791817b45928f663e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.503659 11086 ts_tablet_manager.cc:1403] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.432s	user 0.023s	sys 0.021s
I20260709 13:19:24.523849 11026 tablet_service.cc:1511] Processing CreateTablet for tablet 0005319a469f4f4e993fa7679707faa5 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:24.494099 11093 raft_consensus.cc:3060] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.526238 11026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0005319a469f4f4e993fa7679707faa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.531276 11083 raft_consensus.cc:359] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:24.532302 11083 raft_consensus.cc:385] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.532720 11083 raft_consensus.cc:740] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.516505 11091 raft_consensus.cc:515] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:24.581326 11136 raft_consensus.cc:493] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.582159 11136 raft_consensus.cc:515] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:24.587354 10802 tablet_service.cc:1511] Processing CreateTablet for tablet 0005319a469f4f4e993fa7679707faa5 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:24.596295 10949 tablet_service.cc:1511] Processing CreateTablet for tablet df06b225878d49589732d38cda773b7e (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:24.606634 10800 tablet_service.cc:1511] Processing CreateTablet for tablet df06b225878d49589732d38cda773b7e (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:24.554659 11083 consensus_queue.cc:260] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:24.596946 11085 tablet_bootstrap.cc:492] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:24.626472 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e627f9d3ca4ef68b1fbeb3f16da01a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:24.627664 11085 ts_tablet_manager.cc:1403] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.342s	user 0.027s	sys 0.009s
I20260709 13:19:24.627768 11038 raft_consensus.cc:2468] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:24.616179 10878 tablet_service.cc:1511] Processing CreateTablet for tablet 0005319a469f4f4e993fa7679707faa5 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:24.630321 10878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0005319a469f4f4e993fa7679707faa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.631846 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:24.580294 11086 raft_consensus.cc:359] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:24.616639 11025 tablet_service.cc:1511] Processing CreateTablet for tablet df06b225878d49589732d38cda773b7e (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:24.618191 10880 tablet_service.cc:1511] Processing CreateTablet for tablet d5bd727bd3f64651b8e9d3dae0169166 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:24.633369 11086 raft_consensus.cc:385] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.633780 11086 raft_consensus.cc:740] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.634150 10880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5bd727bd3f64651b8e9d3dae0169166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.634591 11086 consensus_queue.cc:260] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:24.635643 11085 raft_consensus.cc:359] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:24.636420 11085 raft_consensus.cc:385] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.636721 11085 raft_consensus.cc:740] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.634150 11025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df06b225878d49589732d38cda773b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.637821 11085 consensus_queue.cc:260] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:24.638590 10854 leader_election.cc:304] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:24.629827 11091 leader_election.cc:290] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:24.617035 11095 consensus_queue.cc:1048] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.627779 11136 leader_election.cc:290] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
W20260709 13:19:24.644147 11002 consensus_peers.cc:597] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:24.644583 11136 raft_consensus.cc:2804] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.645015 11136 raft_consensus.cc:493] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.645387 11136 raft_consensus.cc:3060] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.618908 10951 tablet_service.cc:1511] Processing CreateTablet for tablet d5bd727bd3f64651b8e9d3dae0169166 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:24.650941 10951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5bd727bd3f64651b8e9d3dae0169166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.664130 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e627f9d3ca4ef68b1fbeb3f16da01a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:24.665306 10815 raft_consensus.cc:2468] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:24.671742 10949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df06b225878d49589732d38cda773b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.672664 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:24.684700 11084 tablet_bootstrap.cc:492] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:24.686013 11084 ts_tablet_manager.cc:1403] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.451s	user 0.013s	sys 0.008s
I20260709 13:19:24.687222 11085 ts_tablet_manager.cc:1434] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.004s
I20260709 13:19:24.689339 10800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df06b225878d49589732d38cda773b7e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:24.696628 10856 leader_election.cc:343] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.698105 10802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0005319a469f4f4e993fa7679707faa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.683156 11083 ts_tablet_manager.cc:1434] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.364s	user 0.011s	sys 0.008s
I20260709 13:19:24.703936 11083 tablet_bootstrap.cc:492] T 94bc42d21ce64138aec6ff49d068ab86 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:24.703686 11023 tablet_service.cc:1511] Processing CreateTablet for tablet d5bd727bd3f64651b8e9d3dae0169166 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:19:24.708117 10856 consensus_peers.cc:597] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:24.717013 11085 tablet_bootstrap.cc:492] T 99b759717fbb437b92f5c1e04e6e5ce7 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:24.715318 11093 raft_consensus.cc:515] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:24.723754 11083 tablet_bootstrap.cc:654] T 94bc42d21ce64138aec6ff49d068ab86 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.727694 11023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5bd727bd3f64651b8e9d3dae0169166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.731469 10963 raft_consensus.cc:2393] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 02260b9a864a4665ae3c33869adeaaf5 in current term 1: Already voted for candidate 348b268fc1da46ac98e10bbe776b018b in this term.
I20260709 13:19:24.733755 10798 tablet_service.cc:1511] Processing CreateTablet for tablet 4a3926cff4dd4248bf3731e550fd2356 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:24.762347 10798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a3926cff4dd4248bf3731e550fd2356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.733649 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
W20260709 13:19:24.768481 10930 leader_election.cc:343] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.734732 11093 leader_election.cc:290] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:24.770699 10878 tablet_service.cc:1511] Processing CreateTablet for tablet 4a3926cff4dd4248bf3731e550fd2356 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:24.770982 10855 leader_election.cc:304] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:24.748220 11118 consensus_queue.cc:1048] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
W20260709 13:19:24.773451 10760 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:24.779731 11144 raft_consensus.cc:2749] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:24.782390 11136 raft_consensus.cc:515] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:24.786870 10878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a3926cff4dd4248bf3731e550fd2356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.791003 11136 leader_election.cc:290] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:24.789940 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e627f9d3ca4ef68b1fbeb3f16da01a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:24.791738 10814 raft_consensus.cc:3060] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.793305 11084 raft_consensus.cc:359] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:24.793583 11025 tablet_service.cc:1511] Processing CreateTablet for tablet 25e873664b784f37bb216a0a11da17aa (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:24.795801 11025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e873664b784f37bb216a0a11da17aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.794299 11084 raft_consensus.cc:385] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.820196 11084 raft_consensus.cc:740] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.821169 11084 consensus_queue.cc:260] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:24.822166 10803 tablet_service.cc:1511] Processing CreateTablet for tablet 25e873664b784f37bb216a0a11da17aa (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:24.826035 10803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e873664b784f37bb216a0a11da17aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.826203 10949 tablet_service.cc:1511] Processing CreateTablet for tablet 4a3926cff4dd4248bf3731e550fd2356 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:24.827751 10949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a3926cff4dd4248bf3731e550fd2356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.818161 11085 tablet_bootstrap.cc:654] T 99b759717fbb437b92f5c1e04e6e5ce7 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.830158 11086 ts_tablet_manager.cc:1434] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.294s	user 0.017s	sys 0.040s
I20260709 13:19:24.837453 10814 raft_consensus.cc:2468] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
W20260709 13:19:24.776876 10854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:44237, user_credentials={real_user=slave}} blocked reactor thread for 138378us
I20260709 13:19:24.841387 11145 raft_consensus.cc:493] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.841986 11145 raft_consensus.cc:515] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:24.850394 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:24.851311 10856 leader_election.cc:304] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:24.852471 10890 raft_consensus.cc:2393] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 348b268fc1da46ac98e10bbe776b018b in current term 1: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
W20260709 13:19:24.853428 10779 consensus_peers.cc:597] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:24.854079 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e627f9d3ca4ef68b1fbeb3f16da01a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:24.854779 11145 leader_election.cc:290] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:24.856928 11084 ts_tablet_manager.cc:1434] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.171s	user 0.011s	sys 0.000s
I20260709 13:19:24.857741 11143 raft_consensus.cc:2804] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:24.858414 11143 raft_consensus.cc:697] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:24.857190 11037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7e307af3a04b85a49fcabdbdc687d5" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:24.860749 11084 tablet_bootstrap.cc:492] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:24.856161 11038 raft_consensus.cc:3060] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:24.864060 10928 leader_election.cc:343] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.865830 10928 leader_election.cc:304] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:24.866458 11136 consensus_queue.cc:1048] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.867761 11145 raft_consensus.cc:2749] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:24.882391 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7e307af3a04b85a49fcabdbdc687d5" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:24.883297 10814 raft_consensus.cc:2468] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 0.
I20260709 13:19:24.884361 10879 tablet_service.cc:1511] Processing CreateTablet for tablet 25e873664b784f37bb216a0a11da17aa (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:24.885797 10930 leader_election.cc:304] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:24.886438 10879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e873664b784f37bb216a0a11da17aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.859732 11143 consensus_queue.cc:237] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:24.890664 11145 raft_consensus.cc:2804] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.891294 11145 raft_consensus.cc:493] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.891932 11145 raft_consensus.cc:3060] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.874840 11136 raft_consensus.cc:493] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:24.897981 10780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 59148us
I20260709 13:19:24.931190 11038 raft_consensus.cc:2468] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:24.936952 11086 tablet_bootstrap.cc:492] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:24.941303 11083 tablet_bootstrap.cc:492] T 94bc42d21ce64138aec6ff49d068ab86 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:24.942031 11083 ts_tablet_manager.cc:1403] T 94bc42d21ce64138aec6ff49d068ab86 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.238s	user 0.018s	sys 0.005s
I20260709 13:19:24.913980 11136 raft_consensus.cc:515] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:24.956153 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c9c2d96172a4900bbd79e91d3cfd69a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
W20260709 13:19:24.960160 10855 leader_election.cc:343] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.962689 10951 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc701e5f842459cb7e7469da45a4132 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:24.963614 11086 tablet_bootstrap.cc:654] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.964265 10951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc701e5f842459cb7e7469da45a4132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.967939 11025 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc701e5f842459cb7e7469da45a4132 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:24.970870 11025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc701e5f842459cb7e7469da45a4132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.976557 11084 tablet_bootstrap.cc:654] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.971819 10805 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc701e5f842459cb7e7469da45a4132 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:24.978833 10805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc701e5f842459cb7e7469da45a4132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.988122 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c9c2d96172a4900bbd79e91d3cfd69a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:24.988968 11038 raft_consensus.cc:2468] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:24.988483 10709 catalog_manager.cc:5697] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.989689 11085 tablet_bootstrap.cc:492] T 99b759717fbb437b92f5c1e04e6e5ce7 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:24.983388 11136 leader_election.cc:290] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:24.990298 11085 ts_tablet_manager.cc:1403] T 99b759717fbb437b92f5c1e04e6e5ce7 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.274s	user 0.029s	sys 0.011s
I20260709 13:19:24.990538 10854 leader_election.cc:304] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:24.998507 11085 raft_consensus.cc:359] T 99b759717fbb437b92f5c1e04e6e5ce7 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:24.999370 11085 raft_consensus.cc:385] T 99b759717fbb437b92f5c1e04e6e5ce7 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.999704 11085 raft_consensus.cc:740] T 99b759717fbb437b92f5c1e04e6e5ce7 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.000584 11085 consensus_queue.cc:260] T 99b759717fbb437b92f5c1e04e6e5ce7 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:25.006023 11136 raft_consensus.cc:2804] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:25.022779 11136 raft_consensus.cc:493] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.023214 11136 raft_consensus.cc:3060] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.024693 10880 tablet_service.cc:1511] Processing CreateTablet for tablet 80d3cc9c0f484ffd9e1b216fa14990e8 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:25.026997 10880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d3cc9c0f484ffd9e1b216fa14990e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.031260 11026 tablet_service.cc:1511] Processing CreateTablet for tablet 80d3cc9c0f484ffd9e1b216fa14990e8 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:25.022024 10950 tablet_service.cc:1511] Processing CreateTablet for tablet 80d3cc9c0f484ffd9e1b216fa14990e8 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:24.997196 11145 raft_consensus.cc:515] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.044540 11083 raft_consensus.cc:359] T 94bc42d21ce64138aec6ff49d068ab86 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:25.049365 11083 raft_consensus.cc:385] T 94bc42d21ce64138aec6ff49d068ab86 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.049719 11083 raft_consensus.cc:740] T 94bc42d21ce64138aec6ff49d068ab86 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.050347 11145 leader_election.cc:290] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:25.051067 11083 consensus_queue.cc:260] T 94bc42d21ce64138aec6ff49d068ab86 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:25.051592 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7e307af3a04b85a49fcabdbdc687d5" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:25.052469 10814 raft_consensus.cc:3060] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.056001 11083 ts_tablet_manager.cc:1434] T 94bc42d21ce64138aec6ff49d068ab86 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.005s
I20260709 13:19:25.056974 11037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7e307af3a04b85a49fcabdbdc687d5" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
W20260709 13:19:25.059244 10928 leader_election.cc:343] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:25.048887 11085 ts_tablet_manager.cc:1434] T 99b759717fbb437b92f5c1e04e6e5ce7 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:19:25.063968 11085 tablet_bootstrap.cc:492] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:25.034698 11026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d3cc9c0f484ffd9e1b216fa14990e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.099982 10950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d3cc9c0f484ffd9e1b216fa14990e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.101344 10802 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3e7b60faa74f27a65a25f8e94e3fa5 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:25.102836 10802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3e7b60faa74f27a65a25f8e94e3fa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.147928 11140 raft_consensus.cc:493] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.148936 11140 raft_consensus.cc:515] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:25.149705 11083 tablet_bootstrap.cc:492] T b2b83744fc2a4faeb2a1ed98da1092b0 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:25.151842 10949 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3e7b60faa74f27a65a25f8e94e3fa5 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:25.155333 11153 raft_consensus.cc:493] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.156847 11153 raft_consensus.cc:515] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:25.172326 11084 tablet_bootstrap.cc:492] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:25.178959 11084 ts_tablet_manager.cc:1403] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.319s	user 0.034s	sys 0.016s
I20260709 13:19:25.181198 10949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3e7b60faa74f27a65a25f8e94e3fa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.181983 10814 raft_consensus.cc:2468] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:25.159705 10879 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3e7b60faa74f27a65a25f8e94e3fa5 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:25.189113 10879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3e7b60faa74f27a65a25f8e94e3fa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.193425 11084 raft_consensus.cc:359] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:25.194280 11084 raft_consensus.cc:385] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.194604 11084 raft_consensus.cc:740] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.195441 11084 consensus_queue.cc:260] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:25.210804 11086 tablet_bootstrap.cc:492] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:25.211556 11086 ts_tablet_manager.cc:1403] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.307s	user 0.006s	sys 0.038s
I20260709 13:19:25.214309 11084 ts_tablet_manager.cc:1434] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:19:25.215536 10930 leader_election.cc:304] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:25.222123 11145 raft_consensus.cc:2804] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:25.222751 11145 raft_consensus.cc:697] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:25.224064 11145 consensus_queue.cc:237] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.225207 11085 tablet_bootstrap.cc:654] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.228896 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bc42d21ce64138aec6ff49d068ab86" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:25.229740 10964 raft_consensus.cc:2468] T 94bc42d21ce64138aec6ff49d068ab86 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:25.231233 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bc42d21ce64138aec6ff49d068ab86" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:25.232174 10815 raft_consensus.cc:2468] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:25.232965 11003 leader_election.cc:304] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:25.234514 11118 raft_consensus.cc:2804] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:25.234995 11118 raft_consensus.cc:493] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.235405 11118 raft_consensus.cc:3060] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.239324 11136 raft_consensus.cc:515] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.243774 11140 leader_election.cc:290] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:25.244694 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b759717fbb437b92f5c1e04e6e5ce7" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:25.245263 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b759717fbb437b92f5c1e04e6e5ce7" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:25.247205 11084 tablet_bootstrap.cc:492] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:25.248385 11025 tablet_service.cc:1511] Processing CreateTablet for tablet 06b6e17edd7f4c618e7260d4e3a65f8a (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:25.255739 10815 raft_consensus.cc:2468] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:25.256239 11025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b6e17edd7f4c618e7260d4e3a65f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.251914 11153 leader_election.cc:290] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:25.259259 11038 raft_consensus.cc:2468] T 99b759717fbb437b92f5c1e04e6e5ce7 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:25.261391 10854 leader_election.cc:304] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:25.262540 11140 raft_consensus.cc:2804] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:25.262921 11140 raft_consensus.cc:493] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.263224 11140 raft_consensus.cc:3060] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.260792 10805 tablet_service.cc:1511] Processing CreateTablet for tablet 06b6e17edd7f4c618e7260d4e3a65f8a (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:25.270568 10805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b6e17edd7f4c618e7260d4e3a65f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.293488 10710 catalog_manager.cc:5697] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 0 to 1, leader changed from <none> to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 1 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.295679 10879 tablet_service.cc:1511] Processing CreateTablet for tablet 06b6e17edd7f4c618e7260d4e3a65f8a (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:25.254282 11086 raft_consensus.cc:359] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:25.295751 10951 tablet_service.cc:1511] Processing CreateTablet for tablet 0223927df5f442079c8fa526ed7eef26 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:25.297945 10879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b6e17edd7f4c618e7260d4e3a65f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.298063 10951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0223927df5f442079c8fa526ed7eef26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.305261 11095 raft_consensus.cc:493] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.305869 11095 raft_consensus.cc:515] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:25.297181 11083 tablet_bootstrap.cc:654] T b2b83744fc2a4faeb2a1ed98da1092b0 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.308053 11095 leader_election.cc:290] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:25.310904 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:25.311827 10964 raft_consensus.cc:2393] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d726aaf867ea423fa4efe8a15d1896d1 in current term 1: Already voted for candidate 348b268fc1da46ac98e10bbe776b018b in this term.
I20260709 13:19:25.314105 11136 leader_election.cc:290] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:25.314643 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:25.314851 11136 consensus_queue.cc:1048] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:25.315478 10890 raft_consensus.cc:2393] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d726aaf867ea423fa4efe8a15d1896d1 in current term 1: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
I20260709 13:19:25.316881 10779 leader_election.cc:304] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:25.298887 11086 raft_consensus.cc:385] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.317965 11086 raft_consensus.cc:740] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.319025 11095 raft_consensus.cc:3060] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.318840 11086 consensus_queue.cc:260] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:25.316954 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c9c2d96172a4900bbd79e91d3cfd69a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:25.326249 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c9c2d96172a4900bbd79e91d3cfd69a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
W20260709 13:19:25.328974 10855 leader_election.cc:343] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:25.329741 11086 ts_tablet_manager.cc:1434] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.117s	user 0.011s	sys 0.000s
I20260709 13:19:25.331050 11086 tablet_bootstrap.cc:492] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:25.333647 11038 raft_consensus.cc:3060] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.333989 11118 raft_consensus.cc:515] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:25.337462 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bc42d21ce64138aec6ff49d068ab86" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:25.338284 10964 raft_consensus.cc:3060] T 94bc42d21ce64138aec6ff49d068ab86 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.348094 11025 tablet_service.cc:1511] Processing CreateTablet for tablet 0223927df5f442079c8fa526ed7eef26 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:25.349962 11025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0223927df5f442079c8fa526ed7eef26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.353681 11084 tablet_bootstrap.cc:654] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.357717 11118 leader_election.cc:290] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:25.366395 10802 tablet_service.cc:1511] Processing CreateTablet for tablet 0223927df5f442079c8fa526ed7eef26 (DEFAULT_TABLE table=test-workload [id=e6321e5707b24d1ea81a71bb5ee08051]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:25.367318 11085 tablet_bootstrap.cc:492] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:25.367761 10802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0223927df5f442079c8fa526ed7eef26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.367931 11085 ts_tablet_manager.cc:1403] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.305s	user 0.006s	sys 0.023s
I20260709 13:19:25.368448 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bc42d21ce64138aec6ff49d068ab86" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:25.368986 10815 raft_consensus.cc:3060] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.383288 11038 raft_consensus.cc:2468] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:25.385006 10854 leader_election.cc:304] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:25.386339 11144 raft_consensus.cc:2804] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:25.386976 11144 raft_consensus.cc:697] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:25.388408 11144 consensus_queue.cc:237] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.386242 10964 raft_consensus.cc:2468] T 94bc42d21ce64138aec6ff49d068ab86 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:25.391220 11003 leader_election.cc:304] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:25.392935 11118 raft_consensus.cc:2804] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:25.393677 11118 raft_consensus.cc:697] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:25.395213 11118 consensus_queue.cc:237] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:25.388882 11085 raft_consensus.cc:359] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.401356 11085 raft_consensus.cc:385] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.406497 11083 tablet_bootstrap.cc:492] T b2b83744fc2a4faeb2a1ed98da1092b0 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:25.407169 11083 ts_tablet_manager.cc:1403] T b2b83744fc2a4faeb2a1ed98da1092b0 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.258s	user 0.028s	sys 0.020s
I20260709 13:19:25.416611 10815 raft_consensus.cc:2468] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:25.402407 11085 raft_consensus.cc:740] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.396333 11140 raft_consensus.cc:515] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:25.426541 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b759717fbb437b92f5c1e04e6e5ce7" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:25.427377 11038 raft_consensus.cc:3060] T 99b759717fbb437b92f5c1e04e6e5ce7 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.428541 11086 tablet_bootstrap.cc:654] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.433290 11136 consensus_queue.cc:1048] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:25.434648 11084 tablet_bootstrap.cc:492] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:25.434832 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b759717fbb437b92f5c1e04e6e5ce7" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:25.435345 11084 ts_tablet_manager.cc:1403] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.188s	user 0.015s	sys 0.009s
I20260709 13:19:25.435581 10815 raft_consensus.cc:3060] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.437351 11140 leader_election.cc:290] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:25.442417 11083 raft_consensus.cc:359] T b2b83744fc2a4faeb2a1ed98da1092b0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.439359 10711 catalog_manager.cc:5697] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.443425 11083 raft_consensus.cc:385] T b2b83744fc2a4faeb2a1ed98da1092b0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.447589 11095 raft_consensus.cc:2749] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:25.440752 11085 consensus_queue.cc:260] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.447321 11083 raft_consensus.cc:740] T b2b83744fc2a4faeb2a1ed98da1092b0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.455440 11084 raft_consensus.cc:359] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:25.456395 11085 ts_tablet_manager.cc:1434] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.088s	user 0.014s	sys 0.000s
I20260709 13:19:25.453599 11038 raft_consensus.cc:2468] T 99b759717fbb437b92f5c1e04e6e5ce7 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:25.456640 11084 raft_consensus.cc:385] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.458837 11084 raft_consensus.cc:740] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.458362 10815 raft_consensus.cc:2468] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:25.458038 11083 consensus_queue.cc:260] T b2b83744fc2a4faeb2a1ed98da1092b0 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.479597 11083 ts_tablet_manager.cc:1434] T b2b83744fc2a4faeb2a1ed98da1092b0 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.004s
I20260709 13:19:25.460825 10854 leader_election.cc:304] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:25.480631 11175 raft_consensus.cc:2804] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:25.481251 11175 raft_consensus.cc:697] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:25.482612 11083 tablet_bootstrap.cc:492] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:25.482287 11175 consensus_queue.cc:237] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:25.468664 11084 consensus_queue.cc:260] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:25.468375 10710 catalog_manager.cc:5697] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 1 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.510982 11083 tablet_bootstrap.cc:654] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.512651 11084 ts_tablet_manager.cc:1434] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.004s
I20260709 13:19:25.516606 11084 tablet_bootstrap.cc:492] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:25.536463 11084 tablet_bootstrap.cc:654] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.548763 11086 tablet_bootstrap.cc:492] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:25.549394 11086 ts_tablet_manager.cc:1403] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.219s	user 0.053s	sys 0.042s
I20260709 13:19:25.551704 11083 tablet_bootstrap.cc:492] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:25.552599 11083 ts_tablet_manager.cc:1403] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.007s
I20260709 13:19:25.552981 11086 raft_consensus.cc:359] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:25.553917 11086 raft_consensus.cc:385] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.554234 11086 raft_consensus.cc:740] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.555061 11086 consensus_queue.cc:260] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:25.557940 11083 raft_consensus.cc:359] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:25.558007 11086 ts_tablet_manager.cc:1434] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:19:25.559224 11083 raft_consensus.cc:385] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.541429 11085 tablet_bootstrap.cc:492] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:25.560799 11086 tablet_bootstrap.cc:492] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:25.569010 11086 tablet_bootstrap.cc:654] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.568121 10711 catalog_manager.cc:5697] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:25.569305 11083 raft_consensus.cc:740] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.570662 11083 consensus_queue.cc:260] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:25.573719 11083 ts_tablet_manager.cc:1434] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:19:25.576040 11083 tablet_bootstrap.cc:492] T 6c9c2d96172a4900bbd79e91d3cfd69a P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:25.581831 11085 tablet_bootstrap.cc:654] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.589735 11084 tablet_bootstrap.cc:492] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:25.590512 11084 ts_tablet_manager.cc:1403] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.001s
I20260709 13:19:25.594259 11084 raft_consensus.cc:359] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:25.595026 11084 raft_consensus.cc:385] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.595338 11084 raft_consensus.cc:740] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.596150 11084 consensus_queue.cc:260] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:25.597898 11083 tablet_bootstrap.cc:654] T 6c9c2d96172a4900bbd79e91d3cfd69a P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.598712 11086 tablet_bootstrap.cc:492] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:25.599138 11084 ts_tablet_manager.cc:1434] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:25.599303 11086 ts_tablet_manager.cc:1403] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.016s
I20260709 13:19:25.601579 11084 tablet_bootstrap.cc:492] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:25.602854 11086 raft_consensus.cc:359] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:25.603718 11086 raft_consensus.cc:385] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.604168 11086 raft_consensus.cc:740] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.605144 11086 consensus_queue.cc:260] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:25.608491 11086 ts_tablet_manager.cc:1434] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:19:25.609910 11086 tablet_bootstrap.cc:492] T b2b83744fc2a4faeb2a1ed98da1092b0 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:25.610778 11145 raft_consensus.cc:493] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.611747 11145 raft_consensus.cc:515] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:25.618049 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949895bff3f409b9781c118fe3c9c21" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:25.618906 11086 tablet_bootstrap.cc:654] T b2b83744fc2a4faeb2a1ed98da1092b0 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.619622 11175 raft_consensus.cc:493] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.620203 11175 raft_consensus.cc:515] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
W20260709 13:19:25.622104 10930 leader_election.cc:343] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:25.622812 10928 consensus_peers.cc:597] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b -> Peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Couldn't send request to peer 10307244fcd642b89723e4fb4ac1291a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.626857 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:25.630311 11095 raft_consensus.cc:493] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.638196 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:25.638000 11095 raft_consensus.cc:515] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:25.640522 10856 leader_election.cc:304] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:25.643371 11084 tablet_bootstrap.cc:654] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.632718 11175 leader_election.cc:290] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:25.641863 10890 raft_consensus.cc:3060] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.646849 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211db9e835d644ccb7787552caa46c93" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:25.644055 11140 raft_consensus.cc:2749] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:25.650410 11145 leader_election.cc:290] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:25.655028 11095 leader_election.cc:290] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:25.660149 11085 tablet_bootstrap.cc:492] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:25.660748 11085 ts_tablet_manager.cc:1403] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.120s	user 0.014s	sys 0.014s
I20260709 13:19:25.663551 11085 raft_consensus.cc:359] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:25.664065 11085 raft_consensus.cc:385] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.664239 11085 raft_consensus.cc:740] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.664811 11085 consensus_queue.cc:260] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:25.665796 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949895bff3f409b9781c118fe3c9c21" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:25.666549 10889 raft_consensus.cc:2468] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 0.
I20260709 13:19:25.667657 11086 tablet_bootstrap.cc:492] T b2b83744fc2a4faeb2a1ed98da1092b0 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:25.668053 10928 leader_election.cc:304] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:25.668659 11086 ts_tablet_manager.cc:1403] T b2b83744fc2a4faeb2a1ed98da1092b0 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.007s
I20260709 13:19:25.669399 11118 raft_consensus.cc:493] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.669943 11118 raft_consensus.cc:515] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.670864 11085 ts_tablet_manager.cc:1434] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:19:25.672364 11118 leader_election.cc:290] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:25.672145 11086 raft_consensus.cc:359] T b2b83744fc2a4faeb2a1ed98da1092b0 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.672891 11086 raft_consensus.cc:385] T b2b83744fc2a4faeb2a1ed98da1092b0 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.673307 11086 raft_consensus.cc:740] T b2b83744fc2a4faeb2a1ed98da1092b0 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.674297 11145 raft_consensus.cc:2804] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:25.674072 11086 consensus_queue.cc:260] T b2b83744fc2a4faeb2a1ed98da1092b0 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.674772 11145 raft_consensus.cc:493] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.674872 11085 tablet_bootstrap.cc:492] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:25.675349 11145 raft_consensus.cc:3060] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.674885 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b83744fc2a4faeb2a1ed98da1092b0" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:25.676666 11086 ts_tablet_manager.cc:1434] T b2b83744fc2a4faeb2a1ed98da1092b0 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:19:25.676545 10963 raft_consensus.cc:2468] T b2b83744fc2a4faeb2a1ed98da1092b0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:25.677981 11086 tablet_bootstrap.cc:492] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:25.678570 11003 leader_election.cc:304] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:25.679639 11164 raft_consensus.cc:2804] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:25.680016 11164 raft_consensus.cc:493] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.680330 11164 raft_consensus.cc:3060] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.683058 11085 tablet_bootstrap.cc:654] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.668725 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211db9e835d644ccb7787552caa46c93" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:25.686854 10779 leader_election.cc:304] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:25.688638 11095 raft_consensus.cc:2749] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:25.688959 11145 raft_consensus.cc:515] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:25.691326 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b83744fc2a4faeb2a1ed98da1092b0" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:25.692415 10889 raft_consensus.cc:2468] T b2b83744fc2a4faeb2a1ed98da1092b0 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:25.693230 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949895bff3f409b9781c118fe3c9c21" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
W20260709 13:19:25.694816 10930 leader_election.cc:343] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:25.699829 11084 tablet_bootstrap.cc:492] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:25.700582 11084 ts_tablet_manager.cc:1403] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.099s	user 0.024s	sys 0.008s
I20260709 13:19:25.705302 11084 raft_consensus.cc:359] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:25.706184 11084 raft_consensus.cc:385] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.708127 10814 raft_consensus.cc:3060] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.708649 11086 tablet_bootstrap.cc:654] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.710126 11145 leader_election.cc:290] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:25.706581 11084 raft_consensus.cc:740] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.712387 11084 consensus_queue.cc:260] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:25.712545 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949895bff3f409b9781c118fe3c9c21" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:25.717255 10889 raft_consensus.cc:3060] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.717527 11083 tablet_bootstrap.cc:492] T 6c9c2d96172a4900bbd79e91d3cfd69a P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:25.718134 11083 ts_tablet_manager.cc:1403] T 6c9c2d96172a4900bbd79e91d3cfd69a P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.142s	user 0.013s	sys 0.015s
I20260709 13:19:25.721040 11083 raft_consensus.cc:359] T 6c9c2d96172a4900bbd79e91d3cfd69a P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.721745 11083 raft_consensus.cc:385] T 6c9c2d96172a4900bbd79e91d3cfd69a P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.722041 11083 raft_consensus.cc:740] T 6c9c2d96172a4900bbd79e91d3cfd69a P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.723538 11084 ts_tablet_manager.cc:1434] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.007s
I20260709 13:19:25.725014 11084 tablet_bootstrap.cc:492] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:25.731889 11084 tablet_bootstrap.cc:654] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.734608 11083 consensus_queue.cc:260] T 6c9c2d96172a4900bbd79e91d3cfd69a P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.742587 11083 ts_tablet_manager.cc:1434] T 6c9c2d96172a4900bbd79e91d3cfd69a P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
I20260709 13:19:25.744467 11083 tablet_bootstrap.cc:492] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:25.745736 11164 raft_consensus.cc:515] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.751336 11140 raft_consensus.cc:493] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10307244fcd642b89723e4fb4ac1291a)
I20260709 13:19:25.752087 11140 raft_consensus.cc:515] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:25.753633 11084 tablet_bootstrap.cc:492] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:25.754257 11084 ts_tablet_manager.cc:1403] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.003s
I20260709 13:19:25.754164 11145 consensus_queue.cc:1048] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:25.756181 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb34c068418c4622b74233a46424384d" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:25.757472 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb34c068418c4622b74233a46424384d" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:25.760659 10855 leader_election.cc:304] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:25.761905 11141 raft_consensus.cc:2749] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:25.766891 11085 tablet_bootstrap.cc:492] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:25.767741 11084 raft_consensus.cc:359] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:25.769358 11084 raft_consensus.cc:385] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.770000 11084 raft_consensus.cc:740] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.767743 11085 ts_tablet_manager.cc:1403] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.093s	user 0.019s	sys 0.019s
I20260709 13:19:25.770838 11083 tablet_bootstrap.cc:654] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.768575 11140 leader_election.cc:290] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:25.774832 11084 consensus_queue.cc:260] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:25.775564 11085 raft_consensus.cc:359] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.780632 11085 raft_consensus.cc:385] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.781180 11085 raft_consensus.cc:740] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.782410 11085 consensus_queue.cc:260] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.786273 11085 ts_tablet_manager.cc:1434] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 13:19:25.788239 11085 tablet_bootstrap.cc:492] T b9864e48c6a44db483a571660db1433d P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:25.792209 10889 raft_consensus.cc:2468] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:25.782838 11084 ts_tablet_manager.cc:1434] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.008s
W20260709 13:19:25.794205 10760 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:25.795022 11084 tablet_bootstrap.cc:492] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:25.795781 11085 tablet_bootstrap.cc:654] T b9864e48c6a44db483a571660db1433d P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.798290 11164 leader_election.cc:290] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:25.799346 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b83744fc2a4faeb2a1ed98da1092b0" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:25.799762 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b83744fc2a4faeb2a1ed98da1092b0" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:25.800241 10890 raft_consensus.cc:3060] T b2b83744fc2a4faeb2a1ed98da1092b0 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.800595 10963 raft_consensus.cc:3060] T b2b83744fc2a4faeb2a1ed98da1092b0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.806210 10928 leader_election.cc:304] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:25.808060 11145 raft_consensus.cc:2804] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:25.808589 11145 raft_consensus.cc:697] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:25.809871 11145 consensus_queue.cc:237] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:25.812904 10890 raft_consensus.cc:2468] T b2b83744fc2a4faeb2a1ed98da1092b0 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:25.814950 11002 leader_election.cc:304] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:25.815514 10964 raft_consensus.cc:3060] T 6c9c2d96172a4900bbd79e91d3cfd69a P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.816207 11118 raft_consensus.cc:2804] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:25.817039 11118 raft_consensus.cc:697] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:25.818951 11118 consensus_queue.cc:237] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.823212 11086 tablet_bootstrap.cc:492] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:25.823820 11086 ts_tablet_manager.cc:1403] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.146s	user 0.048s	sys 0.009s
I20260709 13:19:25.834900 11153 consensus_queue.cc:1048] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:25.835733 11083 tablet_bootstrap.cc:492] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:25.836295 11083 ts_tablet_manager.cc:1403] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.000s
I20260709 13:19:25.839797 11083 raft_consensus.cc:359] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:25.840567 11083 raft_consensus.cc:385] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.840862 11083 raft_consensus.cc:740] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.841746 11083 consensus_queue.cc:260] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:25.843575 11086 raft_consensus.cc:359] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.845029 11086 raft_consensus.cc:385] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.845438 11086 raft_consensus.cc:740] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.846611 11086 consensus_queue.cc:260] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.863786 11086 ts_tablet_manager.cc:1434] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.039s	user 0.012s	sys 0.003s
I20260709 13:19:25.872043 11140 consensus_queue.cc:1048] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:25.873068 11086 tablet_bootstrap.cc:492] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:25.874917 10963 raft_consensus.cc:2468] T b2b83744fc2a4faeb2a1ed98da1092b0 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:25.883332 11084 tablet_bootstrap.cc:654] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.898948 11118 raft_consensus.cc:493] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.902819 11118 raft_consensus.cc:515] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.904224 11085 tablet_bootstrap.cc:492] T b9864e48c6a44db483a571660db1433d P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:25.905395 11085 ts_tablet_manager.cc:1403] T b9864e48c6a44db483a571660db1433d P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.118s	user 0.008s	sys 0.011s
I20260709 13:19:25.905777 11086 tablet_bootstrap.cc:654] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.910843 11085 raft_consensus.cc:359] T b9864e48c6a44db483a571660db1433d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:25.911540 11085 raft_consensus.cc:385] T b9864e48c6a44db483a571660db1433d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.911834 11085 raft_consensus.cc:740] T b9864e48c6a44db483a571660db1433d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.912858 11083 ts_tablet_manager.cc:1434] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.076s	user 0.020s	sys 0.005s
I20260709 13:19:25.918503 10890 raft_consensus.cc:3060] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.922008 11141 raft_consensus.cc:493] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.922587 11141 raft_consensus.cc:515] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:25.929574 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc6fa17f15647569501a369656211c7" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:25.930179 11118 leader_election.cc:290] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:25.933303 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7e307af3a04b85a49fcabdbdc687d5" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:25.934238 10712 catalog_manager.cc:5697] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 0 to 1, leader changed from <none> to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 1 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:25.900360 10710 catalog_manager.cc:5697] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 1 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:25.936494 10855 leader_election.cc:343] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:25.938162 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7e307af3a04b85a49fcabdbdc687d5" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:25.939611 11003 leader_election.cc:304] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:25.940264 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc6fa17f15647569501a369656211c7" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:25.941161 11118 raft_consensus.cc:2749] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:25.942025 10854 leader_election.cc:343] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:25.942646 10854 leader_election.cc:304] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:25.943643 11140 raft_consensus.cc:2749] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:25.943810 11083 tablet_bootstrap.cc:492] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:25.944531 11141 leader_election.cc:290] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:25.952329 11095 raft_consensus.cc:493] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.953361 11095 raft_consensus.cc:515] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:25.955816 11083 tablet_bootstrap.cc:654] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.958597 11118 consensus_queue.cc:1048] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:25.958714 11095 leader_election.cc:290] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:25.960079 11084 tablet_bootstrap.cc:492] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:25.960652 11084 ts_tablet_manager.cc:1403] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.166s	user 0.016s	sys 0.006s
I20260709 13:19:25.960908 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fedddd0f2b4818ad11904281a7f444" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
W20260709 13:19:25.963418 10779 leader_election.cc:343] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:25.964056 11084 raft_consensus.cc:359] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:25.965404 11084 raft_consensus.cc:385] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.965817 11084 raft_consensus.cc:740] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.966809 11084 consensus_queue.cc:260] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:25.968880 11086 tablet_bootstrap.cc:492] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:25.969496 11086 ts_tablet_manager.cc:1403] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.097s	user 0.016s	sys 0.005s
I20260709 13:19:25.964636 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fedddd0f2b4818ad11904281a7f444" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:25.975728 11038 raft_consensus.cc:2468] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:25.977061 11141 consensus_queue.cc:1048] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:25.977185 10779 leader_election.cc:304] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5
I20260709 13:19:25.989563 11095 raft_consensus.cc:493] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.990419 11095 raft_consensus.cc:515] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:25.993818 11095 leader_election.cc:290] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:25.997251 11208 raft_consensus.cc:2804] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:25.999538 11175 consensus_queue.cc:1048] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:26.024024 11208 raft_consensus.cc:493] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.025280 11208 raft_consensus.cc:3060] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.005501 11037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2f9f95429447eb9cb87f21c0785a9b" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:26.028715 10779 leader_election.cc:343] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:26.008411 11083 tablet_bootstrap.cc:492] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:26.008734 11086 raft_consensus.cc:359] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.033595 11086 raft_consensus.cc:385] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.033800 11083 ts_tablet_manager.cc:1403] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.090s	user 0.019s	sys 0.000s
I20260709 13:19:26.011173 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2f9f95429447eb9cb87f21c0785a9b" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:26.041754 10962 raft_consensus.cc:2468] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:25.942127 11085 consensus_queue.cc:260] T b9864e48c6a44db483a571660db1433d P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.033958 11086 raft_consensus.cc:740] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.043403 11086 consensus_queue.cc:260] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.044447 11083 raft_consensus.cc:359] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.035859 11208 raft_consensus.cc:515] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:26.009881 11084 ts_tablet_manager.cc:1434] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.004s
I20260709 13:19:26.048976 11084 tablet_bootstrap.cc:492] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:26.043457 10780 leader_election.cc:304] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:26.049964 11208 leader_election.cc:290] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:26.050042 11212 raft_consensus.cc:2804] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:26.052234 11212 raft_consensus.cc:493] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.052551 11212 raft_consensus.cc:3060] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.045908 11086 ts_tablet_manager.cc:1434] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 13:19:26.047284 11210 raft_consensus.cc:493] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.051399 11083 raft_consensus.cc:385] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.057610 11083 raft_consensus.cc:740] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.059437 11086 tablet_bootstrap.cc:492] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:26.057932 11210 raft_consensus.cc:515] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.064128 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b2704733d44a9f8b55a95b4c06a389" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:26.069314 11201 raft_consensus.cc:493] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.070026 11201 raft_consensus.cc:515] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.070863 11084 tablet_bootstrap.cc:654] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.075239 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fedddd0f2b4818ad11904281a7f444" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:26.076503 11035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9864e48c6a44db483a571660db1433d" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:26.076648 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fedddd0f2b4818ad11904281a7f444" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:26.076711 11038 raft_consensus.cc:3060] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.077524 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b2704733d44a9f8b55a95b4c06a389" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:26.080533 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9864e48c6a44db483a571660db1433d" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:26.079068 11083 consensus_queue.cc:260] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.083123 11034 raft_consensus.cc:3060] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.090150 10888 raft_consensus.cc:2468] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:26.079775 11201 leader_election.cc:290] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
W20260709 13:19:26.083978 10779 leader_election.cc:343] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:26.094238 10930 leader_election.cc:343] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:26.095470 10779 leader_election.cc:304] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:26.062781 11210 leader_election.cc:290] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:26.096582 11095 raft_consensus.cc:2804] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:26.096989 11095 raft_consensus.cc:493] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.097672 11095 raft_consensus.cc:3060] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.088577 11085 ts_tablet_manager.cc:1434] T b9864e48c6a44db483a571660db1433d P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.183s	user 0.005s	sys 0.003s
I20260709 13:19:26.101153 11085 tablet_bootstrap.cc:492] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:26.082396 11035 raft_consensus.cc:2468] T b9864e48c6a44db483a571660db1433d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 0.
I20260709 13:19:26.103389 10928 leader_election.cc:304] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:26.105568 10962 raft_consensus.cc:2468] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:26.105669 11201 raft_consensus.cc:2804] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:26.107290 11201 raft_consensus.cc:493] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.108592 11201 raft_consensus.cc:3060] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.109231 11141 consensus_queue.cc:1048] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:26.115453 11086 tablet_bootstrap.cc:654] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.122553 11083 ts_tablet_manager.cc:1434] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 13:19:26.130300 11083 tablet_bootstrap.cc:492] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:26.067803 11212 raft_consensus.cc:515] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.137769 11085 tablet_bootstrap.cc:654] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.155579 11083 tablet_bootstrap.cc:654] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.159337 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2f9f95429447eb9cb87f21c0785a9b" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:26.160091 10963 raft_consensus.cc:3060] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.173300 11037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2f9f95429447eb9cb87f21c0785a9b" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
W20260709 13:19:26.175117 10779 leader_election.cc:343] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:26.176275 11212 leader_election.cc:290] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:26.168787 10963 raft_consensus.cc:2468] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:26.182595 11212 raft_consensus.cc:493] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.188071 11212 raft_consensus.cc:515] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.194561 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949895bff3f409b9781c118fe3c9c21" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:26.190261 11038 raft_consensus.cc:2468] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:26.195472 10890 raft_consensus.cc:2393] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d726aaf867ea423fa4efe8a15d1896d1 in current term 1: Already voted for candidate 348b268fc1da46ac98e10bbe776b018b in this term.
I20260709 13:19:26.198877 10780 leader_election.cc:304] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:26.200249 11210 raft_consensus.cc:2804] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:26.200786 11210 raft_consensus.cc:697] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:26.201354 11095 raft_consensus.cc:515] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.201669 11210 consensus_queue.cc:237] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.203882 11095 leader_election.cc:290] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:26.206478 11201 raft_consensus.cc:515] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.212203 11086 tablet_bootstrap.cc:492] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:26.212630 10779 leader_election.cc:304] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5
I20260709 13:19:26.212783 11086 ts_tablet_manager.cc:1403] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.154s	user 0.017s	sys 0.010s
I20260709 13:19:26.216957 11084 tablet_bootstrap.cc:492] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:26.217195 11095 raft_consensus.cc:2804] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:26.217556 11084 ts_tablet_manager.cc:1403] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.169s	user 0.051s	sys 0.061s
I20260709 13:19:26.217726 11095 raft_consensus.cc:697] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:26.218667 11095 consensus_queue.cc:237] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:26.221740 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b2704733d44a9f8b55a95b4c06a389" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:26.222355 10890 raft_consensus.cc:3060] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.223296 11201 leader_election.cc:290] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:26.225417 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9864e48c6a44db483a571660db1433d" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:26.226527 11034 raft_consensus.cc:3060] T b9864e48c6a44db483a571660db1433d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.221058 11084 raft_consensus.cc:359] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.227845 11086 raft_consensus.cc:359] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:26.228720 11084 raft_consensus.cc:385] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.229239 11084 raft_consensus.cc:740] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.229897 11212 leader_election.cc:290] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:26.230084 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9864e48c6a44db483a571660db1433d" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:26.231033 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949895bff3f409b9781c118fe3c9c21" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:26.231087 11084 consensus_queue.cc:260] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.232321 10814 raft_consensus.cc:3060] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.233285 10780 leader_election.cc:304] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:26.242586 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b2704733d44a9f8b55a95b4c06a389" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:26.228924 11086 raft_consensus.cc:385] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.243363 11212 raft_consensus.cc:3060] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.249861 11086 raft_consensus.cc:740] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.247182 10814 raft_consensus.cc:2468] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:26.249619 10963 raft_consensus.cc:3060] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.251579 11083 tablet_bootstrap.cc:492] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:26.257309 11083 ts_tablet_manager.cc:1403] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.127s	user 0.022s	sys 0.033s
I20260709 13:19:26.259536 11212 raft_consensus.cc:2749] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:26.252327 11086 consensus_queue.cc:260] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:26.262895 11086 ts_tablet_manager.cc:1434] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.002s
I20260709 13:19:26.252692 10930 leader_election.cc:304] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:26.264079 11086 tablet_bootstrap.cc:492] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:26.264539 11201 raft_consensus.cc:2804] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:26.264732 10963 raft_consensus.cc:2468] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:26.265143 11201 raft_consensus.cc:697] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:26.266098 11201 consensus_queue.cc:237] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.266618 11085 tablet_bootstrap.cc:492] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:26.267122 11085 ts_tablet_manager.cc:1403] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.166s	user 0.021s	sys 0.000s
I20260709 13:19:26.270489 10780 leader_election.cc:304] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:26.271143 11086 tablet_bootstrap.cc:654] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.256301 11084 ts_tablet_manager.cc:1434] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:19:26.272519 11085 raft_consensus.cc:359] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.273396 11085 raft_consensus.cc:385] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.260535 11083 raft_consensus.cc:359] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.273496 11118 consensus_queue.cc:1048] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:26.273754 11085 raft_consensus.cc:740] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.274115 11083 raft_consensus.cc:385] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.274469 11083 raft_consensus.cc:740] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.274868 11085 consensus_queue.cc:260] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.275199 11083 consensus_queue.cc:260] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.278278 11085 ts_tablet_manager.cc:1434] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:19:26.273782 11084 tablet_bootstrap.cc:492] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:26.278745 11083 ts_tablet_manager.cc:1434] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:19:26.276728 10709 catalog_manager.cc:5697] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:26.279958 11197 consensus_queue.cc:1048] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:26.280326 11083 tablet_bootstrap.cc:492] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:26.285324 11212 raft_consensus.cc:2804] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:26.286433 11212 raft_consensus.cc:697] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:26.291595 11212 consensus_queue.cc:237] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.290342 10890 raft_consensus.cc:2468] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:26.288880 11034 raft_consensus.cc:2468] T b9864e48c6a44db483a571660db1433d P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:26.287999 11085 tablet_bootstrap.cc:492] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:26.310449 11084 tablet_bootstrap.cc:654] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.311858 10710 catalog_manager.cc:5697] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 0 to 1, leader changed from <none> to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 1 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.312109 11083 tablet_bootstrap.cc:654] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.330806 11085 tablet_bootstrap.cc:654] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.338609 11140 raft_consensus.cc:493] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.339241 11140 raft_consensus.cc:515] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:26.340469 11153 consensus_queue.cc:1048] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:26.341817 11140 leader_election.cc:290] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:26.344635 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fedddd0f2b4818ad11904281a7f444" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:26.344987 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fedddd0f2b4818ad11904281a7f444" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:26.345808 11034 raft_consensus.cc:2393] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 02260b9a864a4665ae3c33869adeaaf5 in current term 1: Already voted for candidate d726aaf867ea423fa4efe8a15d1896d1 in this term.
I20260709 13:19:26.348450 10856 leader_election.cc:304] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:26.350342 11175 raft_consensus.cc:3060] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.365600 11197 consensus_queue.cc:1048] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:26.383792 11084 tablet_bootstrap.cc:492] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:26.384421 11084 ts_tablet_manager.cc:1403] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.007s
I20260709 13:19:26.389784 11084 raft_consensus.cc:359] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.390795 11084 raft_consensus.cc:385] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.391076 11084 raft_consensus.cc:740] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.391222 11083 tablet_bootstrap.cc:492] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:26.391789 11083 ts_tablet_manager.cc:1403] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.008s
I20260709 13:19:26.391816 11084 consensus_queue.cc:260] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.395280 11084 ts_tablet_manager.cc:1434] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:19:26.396715 11084 tablet_bootstrap.cc:492] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:26.398386 11083 raft_consensus.cc:359] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:26.399158 11083 raft_consensus.cc:385] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.399443 11083 raft_consensus.cc:740] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.404181 11153 raft_consensus.cc:493] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.404990 11153 raft_consensus.cc:515] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.407508 11083 consensus_queue.cc:260] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:26.409296 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2f9f95429447eb9cb87f21c0785a9b" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:26.410506 10963 raft_consensus.cc:2393] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10307244fcd642b89723e4fb4ac1291a in current term 1: Already voted for candidate d726aaf867ea423fa4efe8a15d1896d1 in this term.
I20260709 13:19:26.409794 10712 catalog_manager.cc:5697] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.412976 10712 catalog_manager.cc:5697] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.414904 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2f9f95429447eb9cb87f21c0785a9b" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:26.415462 11083 ts_tablet_manager.cc:1434] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 13:19:26.416653 11083 tablet_bootstrap.cc:492] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:26.417477 11004 leader_election.cc:304] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:26.424446 11175 raft_consensus.cc:2749] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:26.426414 11085 tablet_bootstrap.cc:492] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:26.419582 11153 leader_election.cc:290] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:26.427506 11085 ts_tablet_manager.cc:1403] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.140s	user 0.011s	sys 0.020s
I20260709 13:19:26.427172 11118 raft_consensus.cc:3060] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.432581 11085 raft_consensus.cc:359] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:26.433861 11085 raft_consensus.cc:385] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.434351 11085 raft_consensus.cc:740] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.435559 11085 consensus_queue.cc:260] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:26.439440 11084 tablet_bootstrap.cc:654] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.445153 11175 raft_consensus.cc:493] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.446048 11086 tablet_bootstrap.cc:492] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:26.445865 11175 raft_consensus.cc:515] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.446518 11086 ts_tablet_manager.cc:1403] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.183s	user 0.047s	sys 0.083s
I20260709 13:19:26.449041 11086 raft_consensus.cc:359] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:26.449764 11086 raft_consensus.cc:385] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.450081 11086 raft_consensus.cc:740] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.450883 11086 consensus_queue.cc:260] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:26.451618 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:26.453639 11086 ts_tablet_manager.cc:1434] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:26.452870 10815 raft_consensus.cc:2468] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:26.454842 11086 tablet_bootstrap.cc:492] T 023f097eceb641d18e1870dbd3a1ede3 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:26.455986 10856 leader_election.cc:304] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:26.457414 11140 raft_consensus.cc:2804] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:26.457929 11140 raft_consensus.cc:493] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.458395 11140 raft_consensus.cc:3060] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.462335 11086 tablet_bootstrap.cc:654] T 023f097eceb641d18e1870dbd3a1ede3 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.477626 11199 raft_consensus.cc:493] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.478534 11199 raft_consensus.cc:515] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.482060 11083 tablet_bootstrap.cc:654] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.490447 11199 leader_election.cc:290] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:26.491247 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff1646148f04205b5383bbc084a62af" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
W20260709 13:19:26.493690 10928 leader_election.cc:343] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:26.495406 11175 leader_election.cc:290] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:26.450884 11118 raft_consensus.cc:2749] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:26.499668 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:26.499769 11212 raft_consensus.cc:493] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.501824 11212 raft_consensus.cc:515] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.500752 10963 raft_consensus.cc:2468] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:26.509148 11140 raft_consensus.cc:515] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.513724 11212 leader_election.cc:290] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:26.514642 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff1646148f04205b5383bbc084a62af" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:26.515388 10962 raft_consensus.cc:2468] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:26.517251 11086 tablet_bootstrap.cc:492] T 023f097eceb641d18e1870dbd3a1ede3 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:26.517227 10780 leader_election.cc:304] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:26.518047 11086 ts_tablet_manager.cc:1403] T 023f097eceb641d18e1870dbd3a1ede3 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.063s	user 0.023s	sys 0.023s
I20260709 13:19:26.518301 11212 raft_consensus.cc:2804] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:26.518752 11212 raft_consensus.cc:493] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.519160 11212 raft_consensus.cc:3060] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.521524 11086 raft_consensus.cc:359] T 023f097eceb641d18e1870dbd3a1ede3 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:26.522354 11086 raft_consensus.cc:385] T 023f097eceb641d18e1870dbd3a1ede3 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.522773 11086 raft_consensus.cc:740] T 023f097eceb641d18e1870dbd3a1ede3 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.523680 11086 consensus_queue.cc:260] T 023f097eceb641d18e1870dbd3a1ede3 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:26.524278 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:26.525645 11086 ts_tablet_manager.cc:1434] T 023f097eceb641d18e1870dbd3a1ede3 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:26.525894 10814 raft_consensus.cc:3060] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.527009 11086 tablet_bootstrap.cc:492] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:26.527787 11212 raft_consensus.cc:515] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.530895 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff1646148f04205b5383bbc084a62af" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:26.522054 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff1646148f04205b5383bbc084a62af" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
W20260709 13:19:26.532627 10779 leader_election.cc:343] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:26.534026 10779 leader_election.cc:343] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:26.535163 11140 leader_election.cc:290] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:26.535591 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:26.536434 10962 raft_consensus.cc:3060] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.539134 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff1646148f04205b5383bbc084a62af" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:26.539861 10963 raft_consensus.cc:3060] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.540729 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff1646148f04205b5383bbc084a62af" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:26.542121 10815 raft_consensus.cc:2393] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 348b268fc1da46ac98e10bbe776b018b in current term 1: Already voted for candidate d726aaf867ea423fa4efe8a15d1896d1 in this term.
I20260709 13:19:26.543793 10930 leader_election.cc:304] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:26.544523 11086 tablet_bootstrap.cc:654] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.547858 10963 raft_consensus.cc:2468] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:26.548512 11199 raft_consensus.cc:2749] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:26.549217 11212 leader_election.cc:290] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:26.551414 10780 leader_election.cc:304] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5
I20260709 13:19:26.548485 10962 raft_consensus.cc:2468] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:26.556141 11085 ts_tablet_manager.cc:1434] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.128s	user 0.009s	sys 0.001s
I20260709 13:19:26.556520 10855 leader_election.cc:304] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:26.561182 11086 tablet_bootstrap.cc:492] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:26.561442 11085 tablet_bootstrap.cc:492] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:26.561913 11086 ts_tablet_manager.cc:1403] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.001s
I20260709 13:19:26.565135 11141 raft_consensus.cc:2804] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:26.565064 11086 raft_consensus.cc:359] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.565974 11086 raft_consensus.cc:385] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.566274 11086 raft_consensus.cc:740] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.567022 11086 consensus_queue.cc:260] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.570426 11212 raft_consensus.cc:2804] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:26.571550 11086 ts_tablet_manager.cc:1434] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:19:26.572666 11086 tablet_bootstrap.cc:492] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:26.573137 11212 raft_consensus.cc:697] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:26.574230 11212 consensus_queue.cc:237] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.577809 11201 raft_consensus.cc:493] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.578409 11201 raft_consensus.cc:515] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:26.580034 11086 tablet_bootstrap.cc:654] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.580519 11201 leader_election.cc:290] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:26.582329 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc6fa17f15647569501a369656211c7" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:26.583058 11034 raft_consensus.cc:2468] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 0.
I20260709 13:19:26.584399 10928 leader_election.cc:304] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:26.586311 11201 raft_consensus.cc:2804] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:26.586777 11201 raft_consensus.cc:493] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.587208 11201 raft_consensus.cc:3060] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.591115 11141 raft_consensus.cc:697] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:26.592598 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc6fa17f15647569501a369656211c7" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:26.592360 11141 consensus_queue.cc:237] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.593310 10889 raft_consensus.cc:2468] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 0.
I20260709 13:19:26.603035 10814 raft_consensus.cc:2468] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:26.608448 11201 raft_consensus.cc:515] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:26.608880 11210 consensus_queue.cc:1048] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:26.610069 11083 tablet_bootstrap.cc:492] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:26.610761 11083 ts_tablet_manager.cc:1403] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.194s	user 0.017s	sys 0.020s
I20260709 13:19:26.610939 11201 leader_election.cc:290] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:26.612255 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc6fa17f15647569501a369656211c7" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:26.612872 11034 raft_consensus.cc:3060] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.615901 11083 raft_consensus.cc:359] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:26.616405 11086 tablet_bootstrap.cc:492] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:26.617710 11083 raft_consensus.cc:385] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.617949 11086 ts_tablet_manager.cc:1403] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.005s
I20260709 13:19:26.618394 11083 raft_consensus.cc:740] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.619781 11083 consensus_queue.cc:260] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:26.623318 11083 ts_tablet_manager.cc:1434] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.001s
I20260709 13:19:26.626812 11083 tablet_bootstrap.cc:492] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:26.629658 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc6fa17f15647569501a369656211c7" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:26.630421 10889 raft_consensus.cc:3060] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.635373 11208 consensus_queue.cc:1048] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:26.641388 11083 tablet_bootstrap.cc:654] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.642889 11208 consensus_queue.cc:1048] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:26.653165 11085 tablet_bootstrap.cc:654] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.653995 11084 tablet_bootstrap.cc:492] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:26.654181 11034 raft_consensus.cc:2468] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:26.654635 11084 ts_tablet_manager.cc:1403] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.258s	user 0.071s	sys 0.064s
I20260709 13:19:26.655562 10928 leader_election.cc:304] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:26.657871 11201 raft_consensus.cc:2804] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:26.658773 11201 raft_consensus.cc:697] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:26.623175 11086 raft_consensus.cc:359] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:26.659176 11084 raft_consensus.cc:359] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.660050 11084 raft_consensus.cc:385] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.660413 11084 raft_consensus.cc:740] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.659655 11201 consensus_queue.cc:237] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:26.661396 11084 consensus_queue.cc:260] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.663658 11084 ts_tablet_manager.cc:1434] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:19:26.659690 11086 raft_consensus.cc:385] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.664820 11084 tablet_bootstrap.cc:492] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:26.665156 11086 raft_consensus.cc:740] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.667754 11086 consensus_queue.cc:260] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:26.668879 10889 raft_consensus.cc:2468] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:26.684108 11083 tablet_bootstrap.cc:492] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:26.684859 11083 ts_tablet_manager.cc:1403] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.058s	user 0.004s	sys 0.011s
I20260709 13:19:26.690583 11086 ts_tablet_manager.cc:1434] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.072s	user 0.009s	sys 0.001s
I20260709 13:19:26.692654 11086 tablet_bootstrap.cc:492] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:26.699779 11083 raft_consensus.cc:359] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.700615 11083 raft_consensus.cc:385] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.696844 10710 catalog_manager.cc:5697] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 0 to 1, leader changed from <none> to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 1 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.700908 11083 raft_consensus.cc:740] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.705140 11084 tablet_bootstrap.cc:654] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.708922 11083 consensus_queue.cc:260] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.714610 11083 ts_tablet_manager.cc:1434] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:19:26.705981 10712 catalog_manager.cc:5697] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.723356 11086 tablet_bootstrap.cc:654] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.724267 11208 raft_consensus.cc:493] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.724851 11208 raft_consensus.cc:515] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.730636 11208 leader_election.cc:290] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:26.724606 11083 tablet_bootstrap.cc:492] T 5f0b6d45547e4ef89454d41c9943374f P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:26.734202 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:26.725607 11141 raft_consensus.cc:493] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.735023 10962 raft_consensus.cc:2468] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:26.735162 11141 raft_consensus.cc:515] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.738374 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff1646148f04205b5383bbc084a62af" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:26.732399 11208 consensus_queue.cc:1048] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:19:26.744303 11085 tablet_bootstrap.cc:492] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:26.744910 11085 ts_tablet_manager.cc:1403] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.188s	user 0.027s	sys 0.017s
I20260709 13:19:26.756692 11238 raft_consensus.cc:493] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.751617 11201 consensus_queue.cc:1048] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:19:26.759848 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff1646148f04205b5383bbc084a62af" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:26.761349 10963 raft_consensus.cc:2393] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 02260b9a864a4665ae3c33869adeaaf5 in current term 1: Already voted for candidate d726aaf867ea423fa4efe8a15d1896d1 in this term.
I20260709 13:19:26.766225 10855 leader_election.cc:304] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:26.767711 11140 raft_consensus.cc:3060] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.753273 11141 leader_election.cc:290] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:26.757663 11238 raft_consensus.cc:515] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:26.768591 11085 raft_consensus.cc:359] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:26.777334 11085 raft_consensus.cc:385] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.777822 11085 raft_consensus.cc:740] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.779636 11085 consensus_queue.cc:260] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:26.781792 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:26.783951 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d37e6e4c06405fa84aaf770ff215bc" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:26.784209 11084 tablet_bootstrap.cc:492] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:26.784598 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d37e6e4c06405fa84aaf770ff215bc" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:26.785223 11084 ts_tablet_manager.cc:1403] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.121s	user 0.029s	sys 0.017s
W20260709 13:19:26.785707 10854 leader_election.cc:343] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:26.786289 10856 leader_election.cc:343] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:26.786757 10856 leader_election.cc:304] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:26.787602 11141 raft_consensus.cc:2749] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:26.787606 11238 leader_election.cc:290] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:26.791432 11085 ts_tablet_manager.cc:1434] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:19:26.792548 11085 tablet_bootstrap.cc:492] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:26.794900 10711 catalog_manager.cc:5697] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 0 to 2, leader changed from <none> to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.801803 10780 leader_election.cc:304] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:26.806829 11140 raft_consensus.cc:2749] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:26.812675 11250 consensus_queue.cc:1048] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:26.814689 11250 raft_consensus.cc:2804] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:26.815546 11250 raft_consensus.cc:493] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.815927 11250 raft_consensus.cc:3060] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.818040 11086 tablet_bootstrap.cc:492] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:26.818639 11086 ts_tablet_manager.cc:1403] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.015s
W20260709 13:19:26.818998 10779 leader_election.cc:343] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:26.814649 11084 raft_consensus.cc:359] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.824851 11084 raft_consensus.cc:385] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.825464 11084 raft_consensus.cc:740] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.826294 11084 consensus_queue.cc:260] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.827911 11083 tablet_bootstrap.cc:654] T 5f0b6d45547e4ef89454d41c9943374f P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.830089 11086 raft_consensus.cc:359] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.830842 11086 raft_consensus.cc:385] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.831116 11086 raft_consensus.cc:740] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.832278 11210 consensus_queue.cc:1048] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:26.834157 11086 consensus_queue.cc:260] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:26.836516 11086 ts_tablet_manager.cc:1434] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:19:26.837587 11086 tablet_bootstrap.cc:492] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:26.847929 11201 raft_consensus.cc:493] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.849213 11201 raft_consensus.cc:515] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:26.850023 11084 ts_tablet_manager.cc:1434] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.000s
I20260709 13:19:26.851424 11201 leader_election.cc:290] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:26.854243 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023f097eceb641d18e1870dbd3a1ede3" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:26.854823 11084 tablet_bootstrap.cc:492] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:26.854563 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023f097eceb641d18e1870dbd3a1ede3" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:26.855510 10888 raft_consensus.cc:2468] T 023f097eceb641d18e1870dbd3a1ede3 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 0.
I20260709 13:19:26.857479 10928 leader_election.cc:304] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
W20260709 13:19:26.858402 10928 leader_election.cc:343] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:26.859987 11197 raft_consensus.cc:2804] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:26.860441 11197 raft_consensus.cc:493] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.860803 11197 raft_consensus.cc:3060] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.862296 11085 tablet_bootstrap.cc:654] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.846887 11250 raft_consensus.cc:515] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:26.871598 11164 raft_consensus.cc:493] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.871937 11201 consensus_queue.cc:1048] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:26.872221 11164 raft_consensus.cc:515] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:26.881579 11084 tablet_bootstrap.cc:654] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.893777 11140 raft_consensus.cc:493] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.894380 11140 raft_consensus.cc:515] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:26.898170 11140 leader_election.cc:290] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:26.900717 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b676ac3e11504dd5bc9a471a2216273f" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:26.900907 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b676ac3e11504dd5bc9a471a2216273f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
W20260709 13:19:26.907296 11004 leader_election.cc:343] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:26.908229 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b676ac3e11504dd5bc9a471a2216273f" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:26.909365 11250 leader_election.cc:290] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:26.925501 11086 tablet_bootstrap.cc:654] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.922431 11164 leader_election.cc:290] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:26.930119 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:26.909947 11034 raft_consensus.cc:2468] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
W20260709 13:19:26.944280 10779 leader_election.cc:343] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:26.923278 10856 leader_election.cc:343] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:26.956637 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b676ac3e11504dd5bc9a471a2216273f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:26.958604 10888 raft_consensus.cc:2468] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:26.961144 10854 leader_election.cc:304] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:26.970780 11002 leader_election.cc:304] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:26.972812 11164 raft_consensus.cc:2804] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:26.926723 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:26.973254 11164 raft_consensus.cc:493] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.973693 10964 raft_consensus.cc:3060] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.973701 11164 raft_consensus.cc:3060] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.954720 11197 raft_consensus.cc:515] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:26.983902 11238 raft_consensus.cc:2804] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:26.986795 11238 raft_consensus.cc:493] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.987192 11238 raft_consensus.cc:3060] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.000313 11085 tablet_bootstrap.cc:492] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:27.001008 11085 ts_tablet_manager.cc:1403] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.209s	user 0.019s	sys 0.037s
W20260709 13:19:27.005710 10760 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:26.997043 11164 raft_consensus.cc:515] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:26.996451 11238 raft_consensus.cc:515] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.010046 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b676ac3e11504dd5bc9a471a2216273f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:27.011998 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b676ac3e11504dd5bc9a471a2216273f" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:27.004918 11085 raft_consensus.cc:359] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.012714 11085 raft_consensus.cc:385] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.012888 11036 raft_consensus.cc:2393] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 02260b9a864a4665ae3c33869adeaaf5 in current term 1: Already voted for candidate 10307244fcd642b89723e4fb4ac1291a in this term.
I20260709 13:19:27.013010 11085 raft_consensus.cc:740] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.013762 11085 consensus_queue.cc:260] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.014185 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023f097eceb641d18e1870dbd3a1ede3" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
W20260709 13:19:27.014778 11004 leader_election.cc:343] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:27.016399 11085 ts_tablet_manager.cc:1434] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:19:27.017175 10889 raft_consensus.cc:3060] T 023f097eceb641d18e1870dbd3a1ede3 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.020923 11238 leader_election.cc:290] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:27.022888 11164 leader_election.cc:290] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:27.015422 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b676ac3e11504dd5bc9a471a2216273f" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:27.032406 11197 leader_election.cc:290] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:27.036883 11037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023f097eceb641d18e1870dbd3a1ede3" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:27.034799 11085 tablet_bootstrap.cc:492] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
W20260709 13:19:27.035909 10856 leader_election.cc:343] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:27.039781 10856 leader_election.cc:304] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
W20260709 13:19:27.045049 10928 leader_election.cc:343] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:27.046713 10889 raft_consensus.cc:2468] T 023f097eceb641d18e1870dbd3a1ede3 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:27.047363 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b676ac3e11504dd5bc9a471a2216273f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:27.047086 11250 consensus_queue.cc:1048] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:27.055181 10928 leader_election.cc:304] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:27.056945 11201 raft_consensus.cc:2804] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:27.057612 11201 raft_consensus.cc:697] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:27.064149 10813 raft_consensus.cc:1275] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:27.065249 10964 raft_consensus.cc:2468] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:27.065968 11140 consensus_queue.cc:1048] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:27.067363 11085 tablet_bootstrap.cc:654] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.068020 10780 leader_election.cc:304] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:27.069271 11208 raft_consensus.cc:493] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.069867 11208 raft_consensus.cc:515] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.064215 11201 consensus_queue.cc:237] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.071964 11208 leader_election.cc:290] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:27.072543 11208 raft_consensus.cc:2804] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:27.049609 11238 raft_consensus.cc:2749] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:27.084311 11086 tablet_bootstrap.cc:492] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:27.085093 11086 ts_tablet_manager.cc:1403] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.248s	user 0.027s	sys 0.006s
I20260709 13:19:27.088814 11083 tablet_bootstrap.cc:492] T 5f0b6d45547e4ef89454d41c9943374f P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:27.089952 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78decb93a9542368bf3107bc846a6f0" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:27.081070 11208 raft_consensus.cc:697] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:27.092752 11083 ts_tablet_manager.cc:1403] T 5f0b6d45547e4ef89454d41c9943374f P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.368s	user 0.023s	sys 0.003s
I20260709 13:19:27.092883 11208 consensus_queue.cc:237] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.093572 11086 raft_consensus.cc:359] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.094312 11086 raft_consensus.cc:385] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.094960 11086 raft_consensus.cc:740] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.095712 11086 consensus_queue.cc:260] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
W20260709 13:19:27.096195 10780 leader_election.cc:343] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:27.096289 11083 raft_consensus.cc:359] T 5f0b6d45547e4ef89454d41c9943374f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.097066 11083 raft_consensus.cc:385] T 5f0b6d45547e4ef89454d41c9943374f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.097383 11083 raft_consensus.cc:740] T 5f0b6d45547e4ef89454d41c9943374f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.098332 11086 ts_tablet_manager.cc:1434] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:19:27.098546 10888 raft_consensus.cc:2393] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10307244fcd642b89723e4fb4ac1291a in current term 1: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
I20260709 13:19:27.101159 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78decb93a9542368bf3107bc846a6f0" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:27.101910 11086 tablet_bootstrap.cc:492] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:27.098120 11083 consensus_queue.cc:260] T 5f0b6d45547e4ef89454d41c9943374f P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.104269 11084 tablet_bootstrap.cc:492] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:27.105032 11084 ts_tablet_manager.cc:1403] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.250s	user 0.013s	sys 0.008s
I20260709 13:19:27.105896 10889 raft_consensus.cc:2468] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:27.109509 10779 leader_election.cc:304] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:27.110714 11250 raft_consensus.cc:2804] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:27.111068 11250 raft_consensus.cc:493] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.111383 11250 raft_consensus.cc:3060] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.119582 11083 ts_tablet_manager.cc:1434] T 5f0b6d45547e4ef89454d41c9943374f P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:19:27.126607 11002 leader_election.cc:304] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:27.127985 11256 raft_consensus.cc:2749] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:27.133556 11086 tablet_bootstrap.cc:654] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.131304 11084 raft_consensus.cc:359] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.136770 11084 raft_consensus.cc:385] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.137099 11084 raft_consensus.cc:740] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.137871 11084 consensus_queue.cc:260] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.139575 11095 consensus_queue.cc:1048] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:27.140398 11084 ts_tablet_manager.cc:1434] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:19:27.141494 11084 tablet_bootstrap.cc:492] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:27.145402 11085 tablet_bootstrap.cc:492] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:27.145962 11085 ts_tablet_manager.cc:1403] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.111s	user 0.017s	sys 0.005s
I20260709 13:19:27.148352 11084 tablet_bootstrap.cc:654] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.148932 11085 raft_consensus.cc:359] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.153501 11085 raft_consensus.cc:385] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.153806 11085 raft_consensus.cc:740] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.155575 11085 consensus_queue.cc:260] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.160132 11256 raft_consensus.cc:493] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.163029 11256 raft_consensus.cc:515] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.167718 11083 tablet_bootstrap.cc:492] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:27.169535 11085 ts_tablet_manager.cc:1434] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:19:27.172911 11085 tablet_bootstrap.cc:492] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:27.177747 11250 raft_consensus.cc:515] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.176831 10709 catalog_manager.cc:5697] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 0 to 1, leader changed from <none> to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 1 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.181339 10962 raft_consensus.cc:1275] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:27.182217 11084 tablet_bootstrap.cc:492] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:27.182720 11084 ts_tablet_manager.cc:1403] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.009s
I20260709 13:19:27.183395 11083 tablet_bootstrap.cc:654] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.183776 11140 consensus_queue.cc:1048] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:27.186319 11084 raft_consensus.cc:359] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.186971 11084 raft_consensus.cc:385] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.187151 11084 raft_consensus.cc:740] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.190862 11084 consensus_queue.cc:260] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.192764 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:27.193691 10962 raft_consensus.cc:2393] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10307244fcd642b89723e4fb4ac1291a in current term 1: Already voted for candidate d726aaf867ea423fa4efe8a15d1896d1 in this term.
I20260709 13:19:27.194664 11084 ts_tablet_manager.cc:1434] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:19:27.194891 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78decb93a9542368bf3107bc846a6f0" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:27.195648 10890 raft_consensus.cc:3060] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.195840 11084 tablet_bootstrap.cc:492] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:27.197325 11256 leader_election.cc:290] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:27.198426 11086 tablet_bootstrap.cc:492] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:27.198915 11086 ts_tablet_manager.cc:1403] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.097s	user 0.018s	sys 0.014s
I20260709 13:19:27.201771 11086 raft_consensus.cc:359] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.202975 11084 tablet_bootstrap.cc:654] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.202454 11086 raft_consensus.cc:385] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.203871 11086 raft_consensus.cc:740] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.205636 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:27.202076 11250 leader_election.cc:290] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:27.206640 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78decb93a9542368bf3107bc846a6f0" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:27.207722 11004 leader_election.cc:304] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:27.208817 11256 raft_consensus.cc:3060] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:27.215193 10780 leader_election.cc:343] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:27.204744 11086 consensus_queue.cc:260] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.238595 11086 ts_tablet_manager.cc:1434] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:19:27.240402 11085 tablet_bootstrap.cc:654] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.239481 11256 raft_consensus.cc:2749] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:27.241325 11086 tablet_bootstrap.cc:492] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:27.247197 11256 raft_consensus.cc:493] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.247812 10890 raft_consensus.cc:2468] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:27.247925 11256 raft_consensus.cc:515] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.249271 10779 leader_election.cc:304] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:27.253108 11256 leader_election.cc:290] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:27.253636 11083 tablet_bootstrap.cc:492] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:27.254153 11083 ts_tablet_manager.cc:1403] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.008s
I20260709 13:19:27.257180 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0b6d45547e4ef89454d41c9943374f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:27.258793 10962 raft_consensus.cc:2468] T 5f0b6d45547e4ef89454d41c9943374f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:27.259714 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0b6d45547e4ef89454d41c9943374f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:27.261150 11003 leader_election.cc:304] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:27.263922 11256 raft_consensus.cc:2804] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:27.265158 11256 raft_consensus.cc:493] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.265396 10814 raft_consensus.cc:2468] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:27.276644 11256 raft_consensus.cc:3060] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.274888 11263 consensus_queue.cc:1048] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:27.277244 11250 raft_consensus.cc:2804] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:27.278580 11250 raft_consensus.cc:697] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:27.288156 11086 tablet_bootstrap.cc:654] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.296756 11141 raft_consensus.cc:493] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.297044 11250 consensus_queue.cc:237] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.297513 11141 raft_consensus.cc:515] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.300290 11141 leader_election.cc:290] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:27.301445 11256 raft_consensus.cc:515] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.303442 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7600277a13475fa3c331ef52fb4d51" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:27.304497 11256 leader_election.cc:290] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:27.305838 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0b6d45547e4ef89454d41c9943374f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:27.306789 10963 raft_consensus.cc:3060] T 5f0b6d45547e4ef89454d41c9943374f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.306921 11083 raft_consensus.cc:359] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.308027 11083 raft_consensus.cc:385] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.308533 11083 raft_consensus.cc:740] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
W20260709 13:19:27.310963 10856 leader_election.cc:343] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:27.313722 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7600277a13475fa3c331ef52fb4d51" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:27.319430 11263 consensus_queue.cc:1048] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 13:19:27.323300 10855 leader_election.cc:343] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:27.324295 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0b6d45547e4ef89454d41c9943374f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:27.324810 10855 leader_election.cc:304] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:27.324952 10814 raft_consensus.cc:3060] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.326036 11141 raft_consensus.cc:2749] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:27.330459 11083 consensus_queue.cc:260] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.337365 11084 tablet_bootstrap.cc:492] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:27.338022 11084 ts_tablet_manager.cc:1403] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.142s	user 0.033s	sys 0.033s
I20260709 13:19:27.341150 11084 raft_consensus.cc:359] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.341871 11084 raft_consensus.cc:385] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.342139 11084 raft_consensus.cc:740] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.343058 11084 consensus_queue.cc:260] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.345360 11084 ts_tablet_manager.cc:1434] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:27.346447 11084 tablet_bootstrap.cc:492] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:27.362195 11084 tablet_bootstrap.cc:654] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.368206 11085 tablet_bootstrap.cc:492] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:27.368860 11085 ts_tablet_manager.cc:1403] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.197s	user 0.026s	sys 0.015s
I20260709 13:19:27.376191 11085 raft_consensus.cc:359] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.376749 11085 raft_consensus.cc:385] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.376719 11083 ts_tablet_manager.cc:1434] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.122s	user 0.010s	sys 0.000s
I20260709 13:19:27.377562 11085 raft_consensus.cc:740] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.348392 10710 catalog_manager.cc:5697] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:27.385630 11083 tablet_bootstrap.cc:492] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:27.386417 11085 consensus_queue.cc:260] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.390678 10963 raft_consensus.cc:2468] T 5f0b6d45547e4ef89454d41c9943374f P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:27.392051 11003 leader_election.cc:304] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:27.392997 11256 raft_consensus.cc:2804] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:27.393487 11256 raft_consensus.cc:697] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:27.394331 11256 consensus_queue.cc:237] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.404320 10814 raft_consensus.cc:2468] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:27.408881 11083 tablet_bootstrap.cc:654] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.411693 11085 ts_tablet_manager.cc:1434] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:19:27.417021 11250 raft_consensus.cc:493] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.417821 11250 raft_consensus.cc:515] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.419240 11085 tablet_bootstrap.cc:492] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:27.420619 11250 leader_election.cc:290] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:27.417039 11084 tablet_bootstrap.cc:492] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:27.419688 11086 tablet_bootstrap.cc:492] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:27.426731 11084 ts_tablet_manager.cc:1403] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.003s
I20260709 13:19:27.422914 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d37e6e4c06405fa84aaf770ff215bc" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:27.422683 11037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d37e6e4c06405fa84aaf770ff215bc" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:27.427440 11085 tablet_bootstrap.cc:654] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.426837 11086 ts_tablet_manager.cc:1403] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.186s	user 0.014s	sys 0.008s
I20260709 13:19:27.427382 10890 raft_consensus.cc:2468] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:27.427670 11037 raft_consensus.cc:2468] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:27.429252 10779 leader_election.cc:304] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:27.429883 11084 raft_consensus.cc:359] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.430873 11084 raft_consensus.cc:385] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.430920 11250 raft_consensus.cc:2804] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:27.431767 11250 raft_consensus.cc:493] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.432166 11250 raft_consensus.cc:3060] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.434082 11086 raft_consensus.cc:359] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.434966 11086 raft_consensus.cc:385] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.435732 11086 raft_consensus.cc:740] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.436412 11086 consensus_queue.cc:260] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.438910 11086 ts_tablet_manager.cc:1434] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:27.439917 11086 tablet_bootstrap.cc:492] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:27.440513 11250 raft_consensus.cc:515] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.442030 11084 raft_consensus.cc:740] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.443063 11084 consensus_queue.cc:260] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.445230 11084 ts_tablet_manager.cc:1434] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:19:27.445643 11085 tablet_bootstrap.cc:492] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:27.446127 11085 ts_tablet_manager.cc:1403] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.013s
I20260709 13:19:27.447733 11037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d37e6e4c06405fa84aaf770ff215bc" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:27.448357 11037 raft_consensus.cc:3060] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.452704 11083 tablet_bootstrap.cc:492] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:27.448805 11085 raft_consensus.cc:359] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.453281 11083 ts_tablet_manager.cc:1403] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.002s
I20260709 13:19:27.456094 11083 raft_consensus.cc:359] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.456817 11083 raft_consensus.cc:385] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.457129 11083 raft_consensus.cc:740] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.458197 11084 tablet_bootstrap.cc:492] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:27.457858 11083 consensus_queue.cc:260] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.453305 11085 raft_consensus.cc:385] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.458714 11085 raft_consensus.cc:740] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.452729 11086 tablet_bootstrap.cc:654] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.459543 11085 consensus_queue.cc:260] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.461385 11037 raft_consensus.cc:2468] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:27.462021 11085 ts_tablet_manager.cc:1434] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:19:27.462781 10779 leader_election.cc:304] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:27.463280 11085 tablet_bootstrap.cc:492] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:27.463650 11210 raft_consensus.cc:2804] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:27.463523 10709 catalog_manager.cc:5697] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.464437 11210 raft_consensus.cc:697] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:27.465384 11210 consensus_queue.cc:237] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.470016 11085 tablet_bootstrap.cc:654] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.470520 11238 raft_consensus.cc:493] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.471027 11238 raft_consensus.cc:515] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.474232 11238 leader_election.cc:290] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:27.478295 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c729794e1e4b7bb1571a3e52c12585" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:27.481271 11083 ts_tablet_manager.cc:1434] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:19:27.482390 11083 tablet_bootstrap.cc:492] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
W20260709 13:19:27.481148 10856 leader_election.cc:343] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:27.485890 11250 leader_election.cc:290] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:27.489447 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d37e6e4c06405fa84aaf770ff215bc" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:27.490423 10890 raft_consensus.cc:3060] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.492460 11083 tablet_bootstrap.cc:654] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.494402 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c729794e1e4b7bb1571a3e52c12585" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:27.475098 10710 catalog_manager.cc:5697] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 1 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.505586 11084 tablet_bootstrap.cc:654] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:27.509500 10854 leader_election.cc:343] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:27.510267 10854 leader_election.cc:304] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:27.521185 11238 raft_consensus.cc:2749] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:27.524088 11086 tablet_bootstrap.cc:492] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:27.524971 11086 ts_tablet_manager.cc:1403] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.001s
I20260709 13:19:27.520931 10890 raft_consensus.cc:2468] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:27.546686 11084 tablet_bootstrap.cc:492] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:27.546638 11086 raft_consensus.cc:359] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.547598 11084 ts_tablet_manager.cc:1403] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.006s
I20260709 13:19:27.547827 11086 raft_consensus.cc:385] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.548112 11086 raft_consensus.cc:740] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.547992 10709 catalog_manager.cc:5697] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.549119 11086 consensus_queue.cc:260] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.549793 11083 tablet_bootstrap.cc:492] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:27.550292 11083 ts_tablet_manager.cc:1403] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.023s
I20260709 13:19:27.550575 11084 raft_consensus.cc:359] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.551373 11084 raft_consensus.cc:385] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.551527 11086 ts_tablet_manager.cc:1434] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:19:27.551671 11084 raft_consensus.cc:740] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.552589 11086 tablet_bootstrap.cc:492] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:27.552686 11140 raft_consensus.cc:493] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.553280 11140 raft_consensus.cc:515] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.556090 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858421950e8a4552815da6611d222770" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:27.556965 10963 raft_consensus.cc:2468] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:27.557986 11140 leader_election.cc:290] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:27.555806 11084 consensus_queue.cc:260] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.559916 11083 raft_consensus.cc:359] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.560389 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858421950e8a4552815da6611d222770" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:27.560518 11084 ts_tablet_manager.cc:1434] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:19:27.561924 11084 tablet_bootstrap.cc:492] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
W20260709 13:19:27.562143 10854 leader_election.cc:343] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:27.551509 11085 tablet_bootstrap.cc:492] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:27.563444 11085 ts_tablet_manager.cc:1403] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.100s	user 0.017s	sys 0.000s
I20260709 13:19:27.566246 11250 consensus_queue.cc:1048] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:27.566222 11085 raft_consensus.cc:359] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.568149 11084 tablet_bootstrap.cc:654] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.568204 11085 raft_consensus.cc:385] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.568809 11085 raft_consensus.cc:740] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.569569 10855 leader_election.cc:304] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:27.569666 11085 consensus_queue.cc:260] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.560633 11083 raft_consensus.cc:385] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.570966 11140 raft_consensus.cc:2804] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:27.571185 11083 raft_consensus.cc:740] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.571431 11140 raft_consensus.cc:493] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.571821 11140 raft_consensus.cc:3060] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.572134 11083 consensus_queue.cc:260] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.574975 11083 ts_tablet_manager.cc:1434] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:19:27.576534 11083 tablet_bootstrap.cc:492] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:27.579804 11085 ts_tablet_manager.cc:1434] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:19:27.580334 11036 raft_consensus.cc:3060] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.583735 11083 tablet_bootstrap.cc:654] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.586699 11140 raft_consensus.cc:515] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.580919 11085 tablet_bootstrap.cc:492] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:27.596002 11083 tablet_bootstrap.cc:492] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:27.596671 11083 ts_tablet_manager.cc:1403] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.003s
I20260709 13:19:27.598124 11140 leader_election.cc:290] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:27.599383 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858421950e8a4552815da6611d222770" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:27.599562 11083 raft_consensus.cc:359] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.600080 11038 raft_consensus.cc:3060] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.600333 11083 raft_consensus.cc:385] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.600684 11083 raft_consensus.cc:740] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.601986 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858421950e8a4552815da6611d222770" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:27.605419 10963 raft_consensus.cc:3060] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.609268 11085 tablet_bootstrap.cc:654] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.611869 11083 consensus_queue.cc:260] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.615231 11250 raft_consensus.cc:493] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.615923 11208 consensus_queue.cc:1048] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:27.615988 11250 raft_consensus.cc:515] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.618481 11250 leader_election.cc:290] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:27.624864 11083 ts_tablet_manager.cc:1434] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.003s
I20260709 13:19:27.628301 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c729794e1e4b7bb1571a3e52c12585" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:27.629354 10888 raft_consensus.cc:2468] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:27.635893 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c729794e1e4b7bb1571a3e52c12585" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:27.636426 10779 leader_election.cc:304] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:27.641975 11083 tablet_bootstrap.cc:492] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:27.644423 11250 raft_consensus.cc:2804] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:27.644873 11250 raft_consensus.cc:493] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.645328 11250 raft_consensus.cc:3060] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:27.647563 10779 leader_election.cc:343] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:27.636515 11197 raft_consensus.cc:493] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.652617 11197 raft_consensus.cc:515] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.658460 11201 consensus_queue.cc:1048] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:27.667524 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78decb93a9542368bf3107bc846a6f0" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:27.672261 11038 raft_consensus.cc:2468] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:27.673775 10854 leader_election.cc:304] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:27.674916 11140 raft_consensus.cc:2804] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:27.675681 11140 raft_consensus.cc:697] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:27.675909 11086 tablet_bootstrap.cc:654] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.676638 11140 consensus_queue.cc:237] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.682452 10963 raft_consensus.cc:2468] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:27.682550 11212 raft_consensus.cc:493] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.688711 11212 raft_consensus.cc:515] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.693848 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78decb93a9542368bf3107bc846a6f0" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:27.694350 11212 leader_election.cc:290] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:27.694808 10890 raft_consensus.cc:2393] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 348b268fc1da46ac98e10bbe776b018b in current term 1: Already voted for candidate d726aaf867ea423fa4efe8a15d1896d1 in this term.
I20260709 13:19:27.695587 11256 raft_consensus.cc:493] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.696476 11197 leader_election.cc:290] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:27.696281 11256 raft_consensus.cc:515] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.678550 11250 raft_consensus.cc:515] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.696302 10928 leader_election.cc:304] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:27.701747 11201 raft_consensus.cc:3060] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.703208 11212 raft_consensus.cc:493] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.703799 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b676ac3e11504dd5bc9a471a2216273f" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:27.705152 11038 raft_consensus.cc:2393] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d726aaf867ea423fa4efe8a15d1896d1 in current term 1: Already voted for candidate 10307244fcd642b89723e4fb4ac1291a in this term.
I20260709 13:19:27.703784 11212 raft_consensus.cc:515] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.708520 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023f097eceb641d18e1870dbd3a1ede3" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:27.709350 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7600277a13475fa3c331ef52fb4d51" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:27.710002 10964 raft_consensus.cc:2468] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:27.711238 10780 leader_election.cc:304] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:27.712007 11212 leader_election.cc:290] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:27.712524 11212 raft_consensus.cc:2804] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:27.714525 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7600277a13475fa3c331ef52fb4d51" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:27.715557 10888 raft_consensus.cc:2468] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:27.716817 11083 tablet_bootstrap.cc:654] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.712957 11212 raft_consensus.cc:493] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.718174 11212 raft_consensus.cc:3060] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.718768 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023f097eceb641d18e1870dbd3a1ede3" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:27.720384 11250 leader_election.cc:290] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:27.720582 11003 leader_election.cc:304] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:27.721520 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c729794e1e4b7bb1571a3e52c12585" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:27.726922 11256 leader_election.cc:290] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:27.727237 11164 raft_consensus.cc:2749] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:27.721520 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b676ac3e11504dd5bc9a471a2216273f" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:27.728379 10890 raft_consensus.cc:2393] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d726aaf867ea423fa4efe8a15d1896d1 in current term 1: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
I20260709 13:19:27.722702 11199 consensus_queue.cc:1048] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:27.729158 11085 tablet_bootstrap.cc:492] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:27.729709 11085 ts_tablet_manager.cc:1403] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.149s	user 0.033s	sys 0.026s
I20260709 13:19:27.729813 11084 tablet_bootstrap.cc:492] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:27.730278 11084 ts_tablet_manager.cc:1403] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.169s	user 0.021s	sys 0.017s
I20260709 13:19:27.733817 11085 raft_consensus.cc:359] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.734539 11085 raft_consensus.cc:385] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.734840 11085 raft_consensus.cc:740] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.735991 11212 raft_consensus.cc:515] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.723685 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c729794e1e4b7bb1571a3e52c12585" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:27.736440 11084 raft_consensus.cc:359] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.737200 11084 raft_consensus.cc:385] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.737141 10888 raft_consensus.cc:3060] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.737650 11084 raft_consensus.cc:740] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.738243 11212 leader_election.cc:290] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:27.738428 11084 consensus_queue.cc:260] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.737836 11201 raft_consensus.cc:2749] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:27.739959 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7600277a13475fa3c331ef52fb4d51" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:27.740617 11084 ts_tablet_manager.cc:1434] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:19:27.740562 10963 raft_consensus.cc:3060] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.741168 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7600277a13475fa3c331ef52fb4d51" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:27.741705 11084 tablet_bootstrap.cc:492] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:27.741843 10890 raft_consensus.cc:3060] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.742493 11085 consensus_queue.cc:260] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.744187 11085 ts_tablet_manager.cc:1434] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:19:27.745189 11085 tablet_bootstrap.cc:492] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:27.747017 11250 consensus_queue.cc:1048] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:27.750977 11085 tablet_bootstrap.cc:654] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.753518 10963 raft_consensus.cc:2468] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:27.754246 10779 leader_election.cc:304] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a
W20260709 13:19:27.758443 10779 leader_election.cc:343] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:27.765372 10780 leader_election.cc:304] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:27.766525 11250 raft_consensus.cc:2804] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:27.767052 11250 raft_consensus.cc:697] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:27.767970 11250 consensus_queue.cc:237] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:27.768446 10888 raft_consensus.cc:2468] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:27.770639 11083 tablet_bootstrap.cc:492] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:27.771423 11083 ts_tablet_manager.cc:1403] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.002s
I20260709 13:19:27.773401 11084 tablet_bootstrap.cc:654] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.777868 10779 leader_election.cc:304] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:27.756982 11212 raft_consensus.cc:3060] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.780968 11210 raft_consensus.cc:2804] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:27.784847 11210 raft_consensus.cc:697] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:27.784861 10890 raft_consensus.cc:2468] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:27.785791 11210 consensus_queue.cc:237] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.783493 11086 tablet_bootstrap.cc:492] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:27.788106 11086 ts_tablet_manager.cc:1403] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.236s	user 0.013s	sys 0.012s
I20260709 13:19:27.797396 11085 tablet_bootstrap.cc:492] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:27.798009 11085 ts_tablet_manager.cc:1403] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.007s
I20260709 13:19:27.806494 11086 raft_consensus.cc:359] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.807305 11086 raft_consensus.cc:385] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.807703 11086 raft_consensus.cc:740] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.807220 10713 catalog_manager.cc:5697] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.808437 11086 consensus_queue.cc:260] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.800836 11083 raft_consensus.cc:359] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.809979 11083 raft_consensus.cc:385] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.810267 11083 raft_consensus.cc:740] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.810986 11083 consensus_queue.cc:260] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.815466 11238 raft_consensus.cc:493] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.816231 11238 raft_consensus.cc:515] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.816968 11086 ts_tablet_manager.cc:1434] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.004s
I20260709 13:19:27.821116 11086 tablet_bootstrap.cc:492] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:27.824307 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c225028946540c2ad3af7200d7f49e3" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:27.817600 11083 ts_tablet_manager.cc:1434] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:19:27.826066 11083 tablet_bootstrap.cc:492] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
W20260709 13:19:27.826642 10855 leader_election.cc:343] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:27.831599 11085 raft_consensus.cc:359] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.832964 11085 raft_consensus.cc:385] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.833316 11085 raft_consensus.cc:740] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.834578 11085 consensus_queue.cc:260] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.836537 11256 raft_consensus.cc:493] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.837178 11256 raft_consensus.cc:515] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:27.838995 11085 ts_tablet_manager.cc:1434] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.002s
I20260709 13:19:27.841126 11085 tablet_bootstrap.cc:492] T d09ec691f9324f94a67cc88b0a2d4522 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:27.827579 11250 consensus_queue.cc:1048] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:27.853578 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c729794e1e4b7bb1571a3e52c12585" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:27.840798 11256 leader_election.cc:290] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:27.862855 11083 tablet_bootstrap.cc:654] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.861542 11238 leader_election.cc:290] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:27.890273 10710 catalog_manager.cc:5697] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:27.898891 11002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 60159.3us
I20260709 13:19:27.901553 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c729794e1e4b7bb1571a3e52c12585" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:27.902462 10887 raft_consensus.cc:2393] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10307244fcd642b89723e4fb4ac1291a in current term 1: Already voted for candidate d726aaf867ea423fa4efe8a15d1896d1 in this term.
I20260709 13:19:27.897027 10710 catalog_manager.cc:5697] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:27.922204 11004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 66571.9us
I20260709 13:19:27.919113 11256 consensus_queue.cc:1048] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:27.931388 11084 tablet_bootstrap.cc:492] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:27.932731 11084 ts_tablet_manager.cc:1403] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.191s	user 0.036s	sys 0.041s
I20260709 13:19:27.936607 11212 raft_consensus.cc:2749] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:27.940974 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c225028946540c2ad3af7200d7f49e3" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:27.946714 11302 log.cc:927] Time spent T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 13:19:27.951144 11084 raft_consensus.cc:359] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.957475 11084 raft_consensus.cc:385] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.958416 11084 raft_consensus.cc:740] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.958630 11085 tablet_bootstrap.cc:654] T d09ec691f9324f94a67cc88b0a2d4522 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.954985 11086 tablet_bootstrap.cc:654] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.957863 11002 leader_election.cc:304] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
W20260709 13:19:27.963765 10854 leader_election.cc:343] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:27.964308 10854 leader_election.cc:304] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:27.965710 11256 raft_consensus.cc:3060] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.966295 11140 raft_consensus.cc:2749] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:27.962150 11083 tablet_bootstrap.cc:492] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:27.959303 11084 consensus_queue.cc:260] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:27.975454 11084 ts_tablet_manager.cc:1434] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:19:27.976835 11084 tablet_bootstrap.cc:492] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:27.979856 11304 raft_consensus.cc:493] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.980438 11304 raft_consensus.cc:515] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.981812 11083 ts_tablet_manager.cc:1403] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.156s	user 0.006s	sys 0.026s
I20260709 13:19:27.983076 11304 leader_election.cc:290] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:27.985214 11083 raft_consensus.cc:359] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:27.986249 11083 raft_consensus.cc:385] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.986601 11083 raft_consensus.cc:740] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.996541 11256 raft_consensus.cc:2749] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:27.997521 11085 tablet_bootstrap.cc:492] T d09ec691f9324f94a67cc88b0a2d4522 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:27.998261 11085 ts_tablet_manager.cc:1403] T d09ec691f9324f94a67cc88b0a2d4522 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.158s	user 0.013s	sys 0.005s
I20260709 13:19:28.002751 11083 consensus_queue.cc:260] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:28.004912 11083 ts_tablet_manager.cc:1434] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.005s
I20260709 13:19:28.005923 11083 tablet_bootstrap.cc:492] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:28.005482 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282271ee3314a2db79070b0c703e56d" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:28.006760 10964 raft_consensus.cc:2468] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:28.008545 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282271ee3314a2db79070b0c703e56d" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:28.009409 10887 raft_consensus.cc:2468] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:27.989796 11197 raft_consensus.cc:493] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.011559 11197 raft_consensus.cc:515] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.014101 11197 leader_election.cc:290] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:28.014163 11002 leader_election.cc:304] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:28.015242 11164 raft_consensus.cc:2804] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:28.015640 11164 raft_consensus.cc:493] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.016008 11164 raft_consensus.cc:3060] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.017385 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64eb7071b63a4a51bc2c3b07b243711e" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:28.022817 10928 leader_election.cc:343] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:28.024063 11083 tablet_bootstrap.cc:654] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.025166 11197 raft_consensus.cc:493] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.025794 11197 raft_consensus.cc:515] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.031006 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64eb7071b63a4a51bc2c3b07b243711e" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:28.002043 11256 consensus_queue.cc:1048] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
W20260709 13:19:28.033301 10930 leader_election.cc:343] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:28.035267 10930 leader_election.cc:304] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:28.038931 11201 raft_consensus.cc:2749] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:28.041920 11210 consensus_queue.cc:1048] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:28.047827 11084 tablet_bootstrap.cc:654] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.052668 11085 raft_consensus.cc:359] T d09ec691f9324f94a67cc88b0a2d4522 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.053900 11085 raft_consensus.cc:385] T d09ec691f9324f94a67cc88b0a2d4522 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.054296 11085 raft_consensus.cc:740] T d09ec691f9324f94a67cc88b0a2d4522 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.055373 11085 consensus_queue.cc:260] T d09ec691f9324f94a67cc88b0a2d4522 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.037118 11164 raft_consensus.cc:515] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:28.062903 11086 tablet_bootstrap.cc:492] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:28.063658 11086 ts_tablet_manager.cc:1403] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.243s	user 0.014s	sys 0.004s
I20260709 13:19:28.065316 11085 ts_tablet_manager.cc:1434] T d09ec691f9324f94a67cc88b0a2d4522 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.067s	user 0.010s	sys 0.000s
I20260709 13:19:28.067324 11085 tablet_bootstrap.cc:492] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:28.067991 11197 leader_election.cc:290] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:28.068329 11212 consensus_queue.cc:1048] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:28.070231 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ec691f9324f94a67cc88b0a2d4522" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:28.070940 11036 raft_consensus.cc:2468] T d09ec691f9324f94a67cc88b0a2d4522 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 0.
I20260709 13:19:28.073191 10928 leader_election.cc:304] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:28.075152 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ec691f9324f94a67cc88b0a2d4522" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:28.076052 10813 raft_consensus.cc:2468] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 0.
W20260709 13:19:28.078852 10760 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:28.082978 11197 raft_consensus.cc:2804] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:28.092867 11197 raft_consensus.cc:493] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.098886 11197 raft_consensus.cc:3060] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.103416 11083 tablet_bootstrap.cc:492] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:28.103992 11083 ts_tablet_manager.cc:1403] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.098s	user 0.015s	sys 0.014s
I20260709 13:19:28.103852 11086 raft_consensus.cc:359] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.104926 11086 raft_consensus.cc:385] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.105291 11086 raft_consensus.cc:740] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.105391 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282271ee3314a2db79070b0c703e56d" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:28.106016 10962 raft_consensus.cc:3060] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.106423 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282271ee3314a2db79070b0c703e56d" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:28.107071 10890 raft_consensus.cc:3060] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.108152 11197 raft_consensus.cc:515] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.110747 11197 leader_election.cc:290] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:28.112107 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ec691f9324f94a67cc88b0a2d4522" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:28.112936 11038 raft_consensus.cc:3060] T d09ec691f9324f94a67cc88b0a2d4522 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.114969 11083 raft_consensus.cc:359] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.115717 11083 raft_consensus.cc:385] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.115998 11083 raft_consensus.cc:740] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.121050 11038 raft_consensus.cc:2468] T d09ec691f9324f94a67cc88b0a2d4522 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:28.122468 10928 leader_election.cc:304] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:28.123596 11197 raft_consensus.cc:2804] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:28.124138 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ec691f9324f94a67cc88b0a2d4522" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:28.124326 11197 raft_consensus.cc:697] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:28.116685 11083 consensus_queue.cc:260] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.125777 11197 consensus_queue.cc:237] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.128463 11083 ts_tablet_manager.cc:1434] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:19:28.129582 11083 tablet_bootstrap.cc:492] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:28.106004 11086 consensus_queue.cc:260] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.132748 11164 leader_election.cc:290] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:28.137784 10813 raft_consensus.cc:3060] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.138505 11086 ts_tablet_manager.cc:1434] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.001s
I20260709 13:19:28.139536 11086 tablet_bootstrap.cc:492] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:28.123039 10890 raft_consensus.cc:2468] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:28.143464 11002 leader_election.cc:304] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:28.147609 11086 tablet_bootstrap.cc:654] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.161502 11084 tablet_bootstrap.cc:492] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:28.162129 11084 ts_tablet_manager.cc:1403] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.186s	user 0.017s	sys 0.002s
I20260709 13:19:28.162530 11083 tablet_bootstrap.cc:654] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.165153 11084 raft_consensus.cc:359] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.165941 11084 raft_consensus.cc:385] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.166213 11084 raft_consensus.cc:740] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.166647 10962 raft_consensus.cc:2468] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:28.167148 11084 consensus_queue.cc:260] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.150583 11164 raft_consensus.cc:2804] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:28.169509 11084 ts_tablet_manager.cc:1434] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:28.177129 11085 tablet_bootstrap.cc:654] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.170380 11164 raft_consensus.cc:697] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:28.184186 11164 consensus_queue.cc:237] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:28.188915 10709 catalog_manager.cc:5697] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 0 to 1, leader changed from <none> to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 1 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.187961 10813 raft_consensus.cc:2468] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:28.194692 11083 tablet_bootstrap.cc:492] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:28.195464 11083 ts_tablet_manager.cc:1403] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.002s
I20260709 13:19:28.199353 11095 consensus_queue.cc:1048] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:28.210846 11083 raft_consensus.cc:359] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.211598 11083 raft_consensus.cc:385] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.211867 11083 raft_consensus.cc:740] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.214047 11210 raft_consensus.cc:493] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.214646 11210 raft_consensus.cc:515] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.215394 11208 consensus_queue.cc:1048] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:28.213765 11083 consensus_queue.cc:260] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.218137 11210 leader_election.cc:290] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:28.220139 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf42b68842d44bbbeaf36ee573a6da0" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:28.218333 11083 ts_tablet_manager.cc:1434] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 13:19:28.221958 11083 tablet_bootstrap.cc:492] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:28.220932 10964 raft_consensus.cc:2468] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:28.223482 10780 leader_election.cc:304] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:28.224436 11210 raft_consensus.cc:2804] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:28.224876 11210 raft_consensus.cc:493] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.225348 11210 raft_consensus.cc:3060] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.225605 11140 consensus_queue.cc:1048] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:28.220767 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf42b68842d44bbbeaf36ee573a6da0" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:28.229764 11084 tablet_bootstrap.cc:492] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:28.234874 10888 raft_consensus.cc:2468] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:28.248080 11085 tablet_bootstrap.cc:492] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:28.248608 11085 ts_tablet_manager.cc:1403] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.182s	user 0.016s	sys 0.013s
I20260709 13:19:28.245419 10709 catalog_manager.cc:5697] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 1 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:28.257259 11086 tablet_bootstrap.cc:492] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:28.257802 11086 ts_tablet_manager.cc:1403] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.013s
I20260709 13:19:28.260778 11086 raft_consensus.cc:359] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.261584 11086 raft_consensus.cc:385] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.261854 11086 raft_consensus.cc:740] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.262646 11086 consensus_queue.cc:260] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.271898 11212 consensus_queue.cc:1048] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:28.272902 11140 consensus_queue.cc:1048] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:28.276991 11086 ts_tablet_manager.cc:1434] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:19:28.278133 11086 tablet_bootstrap.cc:492] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:28.279891 11083 tablet_bootstrap.cc:654] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.288829 11085 raft_consensus.cc:359] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.289964 11085 raft_consensus.cc:385] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.290289 11084 tablet_bootstrap.cc:654] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.290515 11085 raft_consensus.cc:740] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.301039 11086 tablet_bootstrap.cc:654] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.300573 11085 consensus_queue.cc:260] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.306896 11085 ts_tablet_manager.cc:1434] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:19:28.307951 11085 tablet_bootstrap.cc:492] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:28.318940 11210 raft_consensus.cc:515] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.321450 11208 raft_consensus.cc:493] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.322016 11208 raft_consensus.cc:515] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.330797 11208 leader_election.cc:290] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:28.344521 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf42b68842d44bbbeaf36ee573a6da0" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:28.338640 11210 leader_election.cc:290] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:28.345290 10890 raft_consensus.cc:3060] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.348367 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533e572edda34e56bb0fc3aaf49022da" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:28.352924 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533e572edda34e56bb0fc3aaf49022da" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:28.353714 10889 raft_consensus.cc:2468] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
W20260709 13:19:28.355293 10779 leader_election.cc:343] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:28.359623 10779 leader_election.cc:304] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:28.365659 11086 tablet_bootstrap.cc:492] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:28.361510 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf42b68842d44bbbeaf36ee573a6da0" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:28.370868 10962 raft_consensus.cc:3060] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.371656 11085 tablet_bootstrap.cc:654] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.375579 11084 tablet_bootstrap.cc:492] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:28.376094 11084 ts_tablet_manager.cc:1403] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.147s	user 0.014s	sys 0.014s
I20260709 13:19:28.378018 11086 ts_tablet_manager.cc:1403] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.005s
I20260709 13:19:28.378878 11083 tablet_bootstrap.cc:492] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:28.379359 11083 ts_tablet_manager.cc:1403] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.158s	user 0.013s	sys 0.002s
I20260709 13:19:28.384060 11086 raft_consensus.cc:359] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.384835 11086 raft_consensus.cc:385] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.385144 11086 raft_consensus.cc:740] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.385833 11086 consensus_queue.cc:260] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.377650 11250 raft_consensus.cc:2804] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:28.398670 11086 ts_tablet_manager.cc:1434] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:19:28.400822 10962 raft_consensus.cc:2468] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:28.403111 10890 raft_consensus.cc:2468] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:28.403975 11086 tablet_bootstrap.cc:492] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:28.402822 11250 raft_consensus.cc:493] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.409889 11250 raft_consensus.cc:3060] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.409612 11083 raft_consensus.cc:359] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:28.410372 11083 raft_consensus.cc:385] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.410656 11083 raft_consensus.cc:740] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.408017 10780 leader_election.cc:304] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:28.408453 11085 tablet_bootstrap.cc:492] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:28.411458 11083 consensus_queue.cc:260] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:28.412353 11085 ts_tablet_manager.cc:1403] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.105s	user 0.017s	sys 0.013s
I20260709 13:19:28.415657 11085 raft_consensus.cc:359] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.416465 11085 raft_consensus.cc:385] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.416812 11085 raft_consensus.cc:740] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.417608 11085 consensus_queue.cc:260] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.422168 11083 ts_tablet_manager.cc:1434] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:19:28.423393 11085 ts_tablet_manager.cc:1434] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:19:28.424582 11085 tablet_bootstrap.cc:492] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:28.430619 11250 raft_consensus.cc:515] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.433843 11084 raft_consensus.cc:359] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.443523 11084 raft_consensus.cc:385] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.443867 11084 raft_consensus.cc:740] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.444631 11084 consensus_queue.cc:260] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.445492 11085 tablet_bootstrap.cc:654] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.446758 11250 leader_election.cc:290] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:28.434798 11208 raft_consensus.cc:2804] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:28.435916 11083 tablet_bootstrap.cc:492] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:28.438241 11304 raft_consensus.cc:493] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.447851 11208 raft_consensus.cc:697] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:28.448098 11304 raft_consensus.cc:515] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.448640 11208 consensus_queue.cc:237] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.450331 11304 leader_election.cc:290] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:28.451993 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64eb7071b63a4a51bc2c3b07b243711e" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:28.452420 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64eb7071b63a4a51bc2c3b07b243711e" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:28.452948 10813 raft_consensus.cc:2468] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:28.453159 10962 raft_consensus.cc:2468] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:28.454371 11083 tablet_bootstrap.cc:654] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.454916 11004 leader_election.cc:304] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:28.461860 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533e572edda34e56bb0fc3aaf49022da" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:28.462740 11038 raft_consensus.cc:3060] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.466609 11304 raft_consensus.cc:2804] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:28.467231 11304 raft_consensus.cc:493] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.467774 11304 raft_consensus.cc:3060] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.474537 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533e572edda34e56bb0fc3aaf49022da" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:28.475509 10890 raft_consensus.cc:3060] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.447378 11084 ts_tablet_manager.cc:1434] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.071s	user 0.010s	sys 0.000s
I20260709 13:19:28.455215 11201 raft_consensus.cc:493] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.477512 11201 raft_consensus.cc:515] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:28.480396 11201 leader_election.cc:290] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:28.483661 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c225028946540c2ad3af7200d7f49e3" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:28.484707 10888 raft_consensus.cc:2468] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 0.
I20260709 13:19:28.486713 10928 leader_election.cc:304] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:28.487022 10890 raft_consensus.cc:2468] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:28.489140 11084 tablet_bootstrap.cc:492] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:28.493333 11201 raft_consensus.cc:2804] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:28.493963 11201 raft_consensus.cc:493] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.494495 11201 raft_consensus.cc:3060] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.501717 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c225028946540c2ad3af7200d7f49e3" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:28.504192 10928 leader_election.cc:343] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:28.509666 10779 leader_election.cc:304] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:28.510895 11210 raft_consensus.cc:2804] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:28.511513 11210 raft_consensus.cc:697] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:28.512570 11210 consensus_queue.cc:237] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.441983 11086 tablet_bootstrap.cc:654] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.527032 11038 raft_consensus.cc:2468] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:28.528373 11201 raft_consensus.cc:515] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:28.532621 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c225028946540c2ad3af7200d7f49e3" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:28.533327 10890 raft_consensus.cc:3060] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.544906 10890 raft_consensus.cc:2468] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:28.546118 11304 raft_consensus.cc:515] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.546496 10928 leader_election.cc:304] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:28.547358 11197 raft_consensus.cc:2804] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:28.548619 11304 leader_election.cc:290] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:28.549903 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64eb7071b63a4a51bc2c3b07b243711e" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:28.550750 10962 raft_consensus.cc:3060] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.554930 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64eb7071b63a4a51bc2c3b07b243711e" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:28.555909 10813 raft_consensus.cc:3060] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:28.578886 10779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 69346.9us
I20260709 13:19:28.580463 11329 consensus_queue.cc:1048] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:28.586658 11197 raft_consensus.cc:697] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:28.587834 11197 consensus_queue.cc:237] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:28.609349 11085 tablet_bootstrap.cc:492] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:28.609966 11085 ts_tablet_manager.cc:1403] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.186s	user 0.008s	sys 0.047s
I20260709 13:19:28.611228 11084 tablet_bootstrap.cc:654] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.605146 11086 tablet_bootstrap.cc:492] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:28.614895 11086 ts_tablet_manager.cc:1403] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.211s	user 0.012s	sys 0.016s
I20260709 13:19:28.617949 11086 raft_consensus.cc:359] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.618635 11086 raft_consensus.cc:385] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.618912 11086 raft_consensus.cc:740] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.619601 11086 consensus_queue.cc:260] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.624814 11085 raft_consensus.cc:359] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.625643 11085 raft_consensus.cc:385] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.625918 11085 raft_consensus.cc:740] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.626595 11085 consensus_queue.cc:260] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.593953 10962 raft_consensus.cc:2468] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:28.628878 11003 leader_election.cc:304] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:28.630409 11164 raft_consensus.cc:2804] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:28.631048 11164 raft_consensus.cc:697] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:28.632347 11164 consensus_queue.cc:237] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.633911 11197 consensus_queue.cc:1048] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:28.638422 11085 ts_tablet_manager.cc:1434] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:19:28.626947 10713 catalog_manager.cc:5697] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 0 to 1, leader changed from <none> to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 1 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.628811 11086 ts_tablet_manager.cc:1434] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:19:28.640805 11086 tablet_bootstrap.cc:492] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:28.642237 11201 leader_election.cc:290] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:28.644605 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c225028946540c2ad3af7200d7f49e3" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
W20260709 13:19:28.646760 10928 leader_election.cc:343] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:28.649583 10813 raft_consensus.cc:2468] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:28.656713 11304 raft_consensus.cc:493] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.657518 11304 raft_consensus.cc:515] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.660710 11304 leader_election.cc:290] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:28.661274 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b676ac3e11504dd5bc9a471a2216273f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:28.661957 11083 tablet_bootstrap.cc:492] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:28.662508 11083 ts_tablet_manager.cc:1403] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.229s	user 0.033s	sys 0.018s
I20260709 13:19:28.662840 10888 raft_consensus.cc:2468] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:28.664269 11002 leader_election.cc:304] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:28.664923 11084 tablet_bootstrap.cc:492] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:28.665452 11084 ts_tablet_manager.cc:1403] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.177s	user 0.013s	sys 0.001s
I20260709 13:19:28.639775 11085 tablet_bootstrap.cc:492] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:28.668370 11303 raft_consensus.cc:2804] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:28.668771 11303 raft_consensus.cc:493] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.669111 11303 raft_consensus.cc:3060] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:28.661729 10709 catalog_manager.cc:5697] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.674779 11201 consensus_queue.cc:1048] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:28.676164 11085 tablet_bootstrap.cc:654] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.676450 11256 consensus_queue.cc:1048] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:28.679131 11084 raft_consensus.cc:359] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.679829 11084 raft_consensus.cc:385] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.680094 11084 raft_consensus.cc:740] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.680778 11084 consensus_queue.cc:260] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.686753 11084 ts_tablet_manager.cc:1434] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 13:19:28.685017 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b676ac3e11504dd5bc9a471a2216273f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:28.687837 11084 tablet_bootstrap.cc:492] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:28.687732 10813 raft_consensus.cc:2468] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:28.690385 11337 raft_consensus.cc:493] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.690925 11337 raft_consensus.cc:515] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.695444 11337 leader_election.cc:290] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:28.695163 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:28.695708 11086 tablet_bootstrap.cc:654] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:28.697696 10930 leader_election.cc:343] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:28.700837 11140 raft_consensus.cc:493] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.701691 11140 raft_consensus.cc:515] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.704758 11140 leader_election.cc:290] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:28.706524 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:28.707362 10961 raft_consensus.cc:2468] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:28.708724 10855 leader_election.cc:304] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:28.710353 11331 raft_consensus.cc:2804] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:28.710850 11331 raft_consensus.cc:493] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.711290 11331 raft_consensus.cc:3060] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.720045 11140 raft_consensus.cc:493] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.720959 11140 raft_consensus.cc:515] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.719895 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:28.695125 11084 tablet_bootstrap.cc:654] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.728482 11140 leader_election.cc:290] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:28.738368 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:28.738090 11331 raft_consensus.cc:515] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.739749 10888 raft_consensus.cc:2393] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 348b268fc1da46ac98e10bbe776b018b in current term 1: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
I20260709 13:19:28.742185 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:28.742909 10962 raft_consensus.cc:3060] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.743939 11037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64ecb0ea0324b31ae37b194ad98e73a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:28.744997 11037 raft_consensus.cc:2468] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:28.746940 11331 leader_election.cc:290] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:28.748447 10854 leader_election.cc:304] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:28.750348 11140 raft_consensus.cc:2804] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:28.750731 11140 raft_consensus.cc:493] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.751065 11140 raft_consensus.cc:3060] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.751965 10928 leader_election.cc:304] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:28.758069 11164 consensus_queue.cc:1048] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:28.759038 10856 leader_election.cc:343] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:28.758168 10713 catalog_manager.cc:5697] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 1 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.762723 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64ecb0ea0324b31ae37b194ad98e73a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:28.766296 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:28.763494 10813 raft_consensus.cc:2468] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:28.783614 11140 raft_consensus.cc:515] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
W20260709 13:19:28.784760 10856 leader_election.cc:343] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:28.789583 11037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64ecb0ea0324b31ae37b194ad98e73a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:28.790433 11037 raft_consensus.cc:3060] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.790900 11083 raft_consensus.cc:359] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.791711 11083 raft_consensus.cc:385] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.792011 11083 raft_consensus.cc:740] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.792119 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64ecb0ea0324b31ae37b194ad98e73a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:28.795897 10814 raft_consensus.cc:3060] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.796945 11140 leader_election.cc:290] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:28.795351 10962 raft_consensus.cc:2468] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:28.810055 11346 raft_consensus.cc:2749] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:28.814920 10855 leader_election.cc:304] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:28.816013 11238 raft_consensus.cc:2804] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:28.816533 11238 raft_consensus.cc:697] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:28.819845 11037 raft_consensus.cc:2468] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:28.821271 11303 raft_consensus.cc:515] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.824082 10854 leader_election.cc:304] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:28.825712 11238 consensus_queue.cc:237] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.830075 11332 raft_consensus.cc:2804] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:28.830704 11332 raft_consensus.cc:697] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:28.831529 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b676ac3e11504dd5bc9a471a2216273f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:28.832547 10890 raft_consensus.cc:3060] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:28.831607 11332 consensus_queue.cc:237] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.838582 11086 tablet_bootstrap.cc:492] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:28.839176 11086 ts_tablet_manager.cc:1403] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.199s	user 0.004s	sys 0.030s
I20260709 13:19:28.841426 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b676ac3e11504dd5bc9a471a2216273f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:28.842271 10813 raft_consensus.cc:3060] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:28.843217 11086 raft_consensus.cc:359] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.843995 11086 raft_consensus.cc:385] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.843613 11083 consensus_queue.cc:260] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.844324 11086 raft_consensus.cc:740] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.846001 11083 ts_tablet_manager.cc:1434] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.183s	user 0.005s	sys 0.001s
I20260709 13:19:28.819667 10814 raft_consensus.cc:2468] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:28.824235 11303 leader_election.cc:290] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:28.846557 10890 raft_consensus.cc:2468] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 2.
I20260709 13:19:28.847203 11083 tablet_bootstrap.cc:492] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:28.852353 11084 tablet_bootstrap.cc:492] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:28.855633 11084 ts_tablet_manager.cc:1403] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.168s	user 0.014s	sys 0.022s
I20260709 13:19:28.847990 11086 consensus_queue.cc:260] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.852243 10709 catalog_manager.cc:5697] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.858546 11086 ts_tablet_manager.cc:1434] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
I20260709 13:19:28.859568 11086 tablet_bootstrap.cc:492] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:28.865605 11002 leader_election.cc:304] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:28.866943 11304 raft_consensus.cc:2804] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:28.867481 11304 raft_consensus.cc:697] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 2 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:28.868330 11304 consensus_queue.cc:237] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:28.885344 11346 raft_consensus.cc:493] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.885977 11346 raft_consensus.cc:515] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:28.888298 11346 leader_election.cc:290] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:28.893273 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73cc1fc36c14e8cb8698530765f5134" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:28.894361 11085 tablet_bootstrap.cc:492] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:28.894903 11085 ts_tablet_manager.cc:1403] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.255s	user 0.051s	sys 0.022s
W20260709 13:19:28.895118 10930 leader_election.cc:343] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:28.895874 11083 tablet_bootstrap.cc:654] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.897492 11037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73cc1fc36c14e8cb8698530765f5134" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:28.900187 10928 leader_election.cc:343] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:28.902980 11085 raft_consensus.cc:359] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:28.903975 11085 raft_consensus.cc:385] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.904258 11085 raft_consensus.cc:740] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.900789 10928 leader_election.cc:304] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:28.905278 11085 consensus_queue.cc:260] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:28.906527 11201 raft_consensus.cc:2749] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:28.913914 11085 ts_tablet_manager.cc:1434] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:19:28.915094 11085 tablet_bootstrap.cc:492] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:28.921420 11085 tablet_bootstrap.cc:654] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.928254 11086 tablet_bootstrap.cc:654] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.921031 11084 raft_consensus.cc:359] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.934876 11084 raft_consensus.cc:385] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.935369 11084 raft_consensus.cc:740] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.937637 11084 consensus_queue.cc:260] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:28.933840 10813 raft_consensus.cc:2468] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 2.
I20260709 13:19:28.940958 11095 consensus_queue.cc:1048] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:28.950273 10712 catalog_manager.cc:5697] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.953644 11095 consensus_queue.cc:1048] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:28.954181 10712 catalog_manager.cc:5697] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:28.967062 11084 ts_tablet_manager.cc:1434] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.111s	user 0.008s	sys 0.000s
I20260709 13:19:28.968755 11084 tablet_bootstrap.cc:492] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:28.977780 11085 tablet_bootstrap.cc:492] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:28.978135 11083 tablet_bootstrap.cc:492] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:28.978451 11085 ts_tablet_manager.cc:1403] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.007s
I20260709 13:19:28.978688 11083 ts_tablet_manager.cc:1403] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.132s	user 0.023s	sys 0.038s
I20260709 13:19:28.982774 11084 tablet_bootstrap.cc:654] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.982431 11083 raft_consensus.cc:359] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:28.983713 11083 raft_consensus.cc:385] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.984140 11083 raft_consensus.cc:740] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.985105 11083 consensus_queue.cc:260] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:28.997807 11083 ts_tablet_manager.cc:1434] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:19:28.998795 11083 tablet_bootstrap.cc:492] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:29.005678 11083 tablet_bootstrap.cc:654] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.018311 11085 raft_consensus.cc:359] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:29.021925 11085 raft_consensus.cc:385] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.011858 10713 catalog_manager.cc:5697] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 0 to 2, leader changed from <none> to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 2 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.022270 11085 raft_consensus.cc:740] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.025023 11085 consensus_queue.cc:260] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:29.027484 11086 tablet_bootstrap.cc:492] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:29.028033 11086 ts_tablet_manager.cc:1403] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.169s	user 0.012s	sys 0.005s
I20260709 13:19:29.032873 11197 consensus_queue.cc:1048] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:29.044498 11085 ts_tablet_manager.cc:1434] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.000s
I20260709 13:19:29.046627 11085 tablet_bootstrap.cc:492] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:29.059221 11095 consensus_queue.cc:1048] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:29.065246 11085 tablet_bootstrap.cc:654] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.065366 11038 raft_consensus.cc:3060] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.069386 11086 raft_consensus.cc:359] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:29.070549 11086 raft_consensus.cc:385] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.070894 11086 raft_consensus.cc:740] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.071660 11086 consensus_queue.cc:260] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:29.074704 11084 tablet_bootstrap.cc:492] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:29.075309 11084 ts_tablet_manager.cc:1403] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.107s	user 0.028s	sys 0.012s
I20260709 13:19:29.079897 11086 ts_tablet_manager.cc:1434] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.004s
I20260709 13:19:29.081043 11086 tablet_bootstrap.cc:492] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:29.084264 11201 consensus_queue.cc:1048] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:29.087096 11084 raft_consensus.cc:359] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:29.087893 11084 raft_consensus.cc:385] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.088181 11084 raft_consensus.cc:740] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.088899 11084 consensus_queue.cc:260] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:29.091395 11084 ts_tablet_manager.cc:1434] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:19:29.094458 11086 tablet_bootstrap.cc:654] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.099582 11085 tablet_bootstrap.cc:492] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:29.100297 11085 ts_tablet_manager.cc:1403] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.005s
I20260709 13:19:29.111361 11084 tablet_bootstrap.cc:492] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:29.120321 11084 tablet_bootstrap.cc:654] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.140388 11303 consensus_queue.cc:1048] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:29.147545 11329 consensus_queue.cc:1048] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:29.150962 11083 tablet_bootstrap.cc:492] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:29.151539 11083 ts_tablet_manager.cc:1403] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.005s
I20260709 13:19:29.153760 11085 raft_consensus.cc:359] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:29.154831 11085 raft_consensus.cc:385] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.155189 11085 raft_consensus.cc:740] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.155979 11085 consensus_queue.cc:260] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:29.158658 11084 tablet_bootstrap.cc:492] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:29.159511 11084 ts_tablet_manager.cc:1403] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.048s	user 0.005s	sys 0.009s
I20260709 13:19:29.160130 11085 ts_tablet_manager.cc:1434] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.004s
I20260709 13:19:29.163290 11085 tablet_bootstrap.cc:492] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:29.167783 11304 consensus_queue.cc:1048] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:29.171850 11084 raft_consensus.cc:359] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:29.181695 11085 tablet_bootstrap.cc:654] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.185216 11238 raft_consensus.cc:493] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.187103 11084 raft_consensus.cc:385] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.187779 11084 raft_consensus.cc:740] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.187275 11238 raft_consensus.cc:515] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:29.188565 11084 consensus_queue.cc:260] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:29.190835 11084 ts_tablet_manager.cc:1434] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:19:29.155435 11083 raft_consensus.cc:359] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:29.191362 11083 raft_consensus.cc:385] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.191895 11084 tablet_bootstrap.cc:492] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:29.197247 11238 leader_election.cc:290] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:29.199630 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:29.199785 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:29.201185 10856 leader_election.cc:343] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:29.201803 10854 leader_election.cc:343] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:29.202445 10854 leader_election.cc:304] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:29.203092 11084 tablet_bootstrap.cc:654] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.205461 11352 raft_consensus.cc:2749] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:29.214411 10814 raft_consensus.cc:3060] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.217623 11084 tablet_bootstrap.cc:492] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:29.218230 11084 ts_tablet_manager.cc:1403] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.010s
I20260709 13:19:29.221693 11084 raft_consensus.cc:359] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:29.222654 11084 raft_consensus.cc:385] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.223006 11084 raft_consensus.cc:740] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.223915 11084 consensus_queue.cc:260] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:29.226143 11084 ts_tablet_manager.cc:1434] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:19:29.227352 11084 tablet_bootstrap.cc:492] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:29.234966 11084 tablet_bootstrap.cc:654] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.250671 11083 raft_consensus.cc:740] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.255677 11083 consensus_queue.cc:260] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:29.261502 11086 tablet_bootstrap.cc:492] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:29.262100 11086 ts_tablet_manager.cc:1403] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.181s	user 0.041s	sys 0.059s
I20260709 13:19:29.264942 11086 raft_consensus.cc:359] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:29.265547 11329 raft_consensus.cc:493] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.265661 11086 raft_consensus.cc:385] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.266218 11329 raft_consensus.cc:515] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:29.261258 11083 ts_tablet_manager.cc:1434] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.000s
I20260709 13:19:29.268379 11083 tablet_bootstrap.cc:492] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:29.266201 11086 raft_consensus.cc:740] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.269663 11086 consensus_queue.cc:260] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:29.272763 11086 ts_tablet_manager.cc:1434] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:19:29.275986 11332 consensus_queue.cc:1048] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:29.280619 11086 tablet_bootstrap.cc:492] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:29.288676 11086 tablet_bootstrap.cc:654] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.298107 11329 leader_election.cc:290] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:29.308250 11084 tablet_bootstrap.cc:492] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:29.309113 11084 ts_tablet_manager.cc:1403] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.006s
I20260709 13:19:29.310956 11083 tablet_bootstrap.cc:654] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.315338 11085 tablet_bootstrap.cc:492] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:29.319659 11085 ts_tablet_manager.cc:1403] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.156s	user 0.029s	sys 0.036s
I20260709 13:19:29.327903 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:29.329430 11238 raft_consensus.cc:493] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.330047 11238 raft_consensus.cc:515] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:29.317162 11329 raft_consensus.cc:493] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.342926 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:29.343601 10962 raft_consensus.cc:2468] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:29.344604 10780 leader_election.cc:304] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:29.348869 11332 consensus_queue.cc:1048] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:29.349296 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2729869dbf7e461db0eacdce000b036f" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:29.349951 10963 raft_consensus.cc:2468] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:29.351853 10855 leader_election.cc:304] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:29.353144 11352 raft_consensus.cc:2804] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:29.353510 11352 raft_consensus.cc:493] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.353830 11352 raft_consensus.cc:3060] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.355608 11238 leader_election.cc:290] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:29.333909 11329 raft_consensus.cc:515] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:29.356807 11210 raft_consensus.cc:2804] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:29.357940 11210 raft_consensus.cc:493] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 02260b9a864a4665ae3c33869adeaaf5)
I20260709 13:19:29.358335 11210 raft_consensus.cc:3060] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:29.358505 11329 leader_election.cc:290] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:29.360090 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73cc1fc36c14e8cb8698530765f5134" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:29.360739 10961 raft_consensus.cc:2468] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:29.362615 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73cc1fc36c14e8cb8698530765f5134" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:29.363306 11038 raft_consensus.cc:2468] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:29.365034 11084 raft_consensus.cc:359] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:29.365726 11084 raft_consensus.cc:385] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.365976 11084 raft_consensus.cc:740] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.364182 10780 leader_election.cc:304] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:29.363863 11085 raft_consensus.cc:359] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:29.367455 11085 raft_consensus.cc:385] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.369582 11208 raft_consensus.cc:2804] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:29.370018 11208 raft_consensus.cc:493] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.370370 11208 raft_consensus.cc:3060] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.367848 11085 raft_consensus.cc:740] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.373272 11084 consensus_queue.cc:260] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:29.384907 11085 consensus_queue.cc:260] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:29.389588 11084 ts_tablet_manager.cc:1434] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.005s
W20260709 13:19:29.390035 10760 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:29.390830 11084 tablet_bootstrap.cc:492] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:29.392583 11083 tablet_bootstrap.cc:492] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:29.393103 11083 ts_tablet_manager.cc:1403] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.125s	user 0.017s	sys 0.006s
I20260709 13:19:29.384332 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2729869dbf7e461db0eacdce000b036f" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:29.393597 11038 raft_consensus.cc:2468] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:29.395860 11303 raft_consensus.cc:493] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.399302 11085 ts_tablet_manager.cc:1434] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.000s
I20260709 13:19:29.400625 11085 tablet_bootstrap.cc:492] T cfc5d48da62642a9a8e39ec61cfc914d P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:29.399559 11083 raft_consensus.cc:359] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:29.401736 11083 raft_consensus.cc:385] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.402065 11083 raft_consensus.cc:740] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.405120 11086 tablet_bootstrap.cc:492] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:29.405735 11086 ts_tablet_manager.cc:1403] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.131s	user 0.019s	sys 0.019s
I20260709 13:19:29.406811 11083 consensus_queue.cc:260] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:29.400601 11303 raft_consensus.cc:515] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:29.413934 11086 raft_consensus.cc:359] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:29.416005 11086 raft_consensus.cc:385] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.416587 11086 raft_consensus.cc:740] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.417457 11083 ts_tablet_manager.cc:1434] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:19:29.418357 11085 tablet_bootstrap.cc:654] T cfc5d48da62642a9a8e39ec61cfc914d P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.418547 11083 tablet_bootstrap.cc:492] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:29.417227 11086 consensus_queue.cc:260] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:29.426901 11086 ts_tablet_manager.cc:1434] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:19:29.427285 11303 leader_election.cc:290] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:29.428473 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2729869dbf7e461db0eacdce000b036f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:29.429216 10962 raft_consensus.cc:2468] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:29.429661 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2729869dbf7e461db0eacdce000b036f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:29.430295 11003 leader_election.cc:304] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:29.431236 11303 raft_consensus.cc:2804] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:29.431594 11303 raft_consensus.cc:493] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.431921 11303 raft_consensus.cc:3060] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.439898 11331 consensus_queue.cc:1048] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:29.428030 11086 tablet_bootstrap.cc:492] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
W20260709 13:19:29.442976 10779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:44237, user_credentials={real_user=slave}} blocked reactor thread for 78793.3us
I20260709 13:19:29.445240 11329 raft_consensus.cc:493] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.445880 11329 raft_consensus.cc:515] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:29.399317 11210 raft_consensus.cc:515] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:29.458268 11083 tablet_bootstrap.cc:654] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.456507 11303 raft_consensus.cc:515] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:29.452924 11084 tablet_bootstrap.cc:654] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.462965 11331 consensus_queue.cc:1048] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:29.466063 10814 raft_consensus.cc:1240] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Rejecting Update request from peer 02260b9a864a4665ae3c33869adeaaf5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:29.474179 10812 raft_consensus.cc:1275] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Refusing update from remote peer 10307244fcd642b89723e4fb4ac1291a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:29.469374 11210 leader_election.cc:290] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:29.485879 11329 leader_election.cc:290] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:29.486406 11303 leader_election.cc:290] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:29.489805 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c926e4bc5c549a88846566915db122f" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:29.490535 10964 raft_consensus.cc:2468] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:29.491920 10780 leader_election.cc:304] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:29.483575 11304 consensus_queue.cc:1048] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:19:29.494769 11329 raft_consensus.cc:2804] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:29.495304 11329 raft_consensus.cc:493] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.495658 11329 raft_consensus.cc:3060] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.488368 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2729869dbf7e461db0eacdce000b036f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:29.496742 11352 raft_consensus.cc:515] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:29.497046 10961 raft_consensus.cc:3060] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.498155 10888 raft_consensus.cc:2393] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10307244fcd642b89723e4fb4ac1291a in current term 1: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
I20260709 13:19:29.488296 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:29.507619 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:29.509763 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c926e4bc5c549a88846566915db122f" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:29.510509 10888 raft_consensus.cc:2468] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:29.519173 11085 tablet_bootstrap.cc:492] T cfc5d48da62642a9a8e39ec61cfc914d P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:29.518774 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2729869dbf7e461db0eacdce000b036f" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:29.519941 11085 ts_tablet_manager.cc:1403] T cfc5d48da62642a9a8e39ec61cfc914d P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.120s	user 0.018s	sys 0.003s
I20260709 13:19:29.520134 11036 raft_consensus.cc:2393] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 02260b9a864a4665ae3c33869adeaaf5 in current term 1: Already voted for candidate 10307244fcd642b89723e4fb4ac1291a in this term.
I20260709 13:19:29.491981 11208 raft_consensus.cc:515] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:29.529927 10888 raft_consensus.cc:1275] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer 10307244fcd642b89723e4fb4ac1291a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:29.529781 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2729869dbf7e461db0eacdce000b036f" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:29.528263 11352 leader_election.cc:290] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:29.556743 11085 raft_consensus.cc:359] T cfc5d48da62642a9a8e39ec61cfc914d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:29.558384 11085 raft_consensus.cc:385] T cfc5d48da62642a9a8e39ec61cfc914d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.558820 11085 raft_consensus.cc:740] T cfc5d48da62642a9a8e39ec61cfc914d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.560470 11086 tablet_bootstrap.cc:654] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.562556 11085 consensus_queue.cc:260] T cfc5d48da62642a9a8e39ec61cfc914d P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:29.548877 11210 raft_consensus.cc:493] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.558943 11095 raft_consensus.cc:493] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.574491 11085 ts_tablet_manager.cc:1434] T cfc5d48da62642a9a8e39ec61cfc914d P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.054s	user 0.012s	sys 0.004s
I20260709 13:19:29.571177 11238 raft_consensus.cc:493] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.576977 11085 tablet_bootstrap.cc:492] T cf66c391c2ea4f04a1eb536f28d4b170 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:29.564776 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2729869dbf7e461db0eacdce000b036f" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:29.581534 11238 raft_consensus.cc:515] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:29.596892 10888 raft_consensus.cc:2393] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10307244fcd642b89723e4fb4ac1291a in current term 1: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
I20260709 13:19:29.573932 11210 raft_consensus.cc:515] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:29.602519 11084 tablet_bootstrap.cc:492] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:29.603112 11084 ts_tablet_manager.cc:1403] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.213s	user 0.029s	sys 0.045s
I20260709 13:19:29.603586 11210 leader_election.cc:290] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:29.591732 10855 leader_election.cc:304] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:29.604296 11304 consensus_queue.cc:1048] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:29.579026 11095 raft_consensus.cc:515] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:29.606603 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf66c391c2ea4f04a1eb536f28d4b170" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:29.608145 10854 leader_election.cc:343] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:29.609331 11084 raft_consensus.cc:359] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:29.610042 11084 raft_consensus.cc:385] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.610327 11084 raft_consensus.cc:740] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.604826 11238 leader_election.cc:290] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:29.622689 11085 tablet_bootstrap.cc:654] T cf66c391c2ea4f04a1eb536f28d4b170 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.624648 11379 raft_consensus.cc:2749] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:29.641522 11084 consensus_queue.cc:260] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:29.628186 11238 consensus_queue.cc:1059] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:19:29.638310 11095 leader_election.cc:290] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:29.653605 11379 raft_consensus.cc:3055] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:29.657582 11084 ts_tablet_manager.cc:1434] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 13:19:29.658773 11084 tablet_bootstrap.cc:492] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:29.655951 11379 raft_consensus.cc:740] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:29.670681 11304 raft_consensus.cc:493] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.666183 11208 leader_election.cc:290] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:29.672542 11379 consensus_queue.cc:260] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:29.689442 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73cc1fc36c14e8cb8698530765f5134" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:29.691037 10962 raft_consensus.cc:3060] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.671352 11304 raft_consensus.cc:515] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:29.695742 11304 leader_election.cc:290] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:29.700989 10962 raft_consensus.cc:2468] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:29.703843 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a90e754ea44ce5b10285e034656db6" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:29.736411 11084 tablet_bootstrap.cc:654] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.723663 11379 raft_consensus.cc:3060] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:29.745061 11083 tablet_bootstrap.cc:492] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:29.745697 11083 ts_tablet_manager.cc:1403] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.327s	user 0.016s	sys 0.004s
I20260709 13:19:29.746949 11086 tablet_bootstrap.cc:492] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:29.746649 11329 raft_consensus.cc:515] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:29.747558 11086 ts_tablet_manager.cc:1403] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.320s	user 0.015s	sys 0.005s
I20260709 13:19:29.747885 11337 raft_consensus.cc:493] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.748637 11337 raft_consensus.cc:515] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:29.751824 11337 leader_election.cc:290] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:29.680397 10779 leader_election.cc:304] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:29.760998 11086 raft_consensus.cc:359] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:29.762089 11086 raft_consensus.cc:385] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.762416 11086 raft_consensus.cc:740] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.763916 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf66c391c2ea4f04a1eb536f28d4b170" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:29.765533 10814 raft_consensus.cc:2468] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:29.763295 11086 consensus_queue.cc:260] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:29.770663 11083 raft_consensus.cc:359] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:29.774251 11083 raft_consensus.cc:385] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.768903 11095 raft_consensus.cc:2749] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:29.774565 11083 raft_consensus.cc:740] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.780071 11086 ts_tablet_manager.cc:1434] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.004s
I20260709 13:19:29.784621 11083 consensus_queue.cc:260] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:29.790377 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:29.791344 10888 raft_consensus.cc:2468] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:29.772307 11329 leader_election.cc:290] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:29.765296 10961 raft_consensus.cc:2468] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
W20260709 13:19:29.779047 10779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 113762us
I20260709 13:19:29.805778 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:29.807776 11083 ts_tablet_manager.cc:1434] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.001s
I20260709 13:19:29.816761 11083 tablet_bootstrap.cc:492] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:29.820582 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5d48da62642a9a8e39ec61cfc914d" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:29.821673 11038 raft_consensus.cc:2468] T cfc5d48da62642a9a8e39ec61cfc914d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 0.
I20260709 13:19:29.819662 10813 raft_consensus.cc:2468] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:29.824735 11002 leader_election.cc:304] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:29.825883 10928 leader_election.cc:304] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:29.825902 11304 raft_consensus.cc:2804] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:29.827158 11304 raft_consensus.cc:493] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.827385 11003 leader_election.cc:304] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5
I20260709 13:19:29.827973 11304 raft_consensus.cc:3060] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.828415 11256 raft_consensus.cc:2804] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:29.828935 11256 raft_consensus.cc:697] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:29.829674 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c926e4bc5c549a88846566915db122f" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:29.830317 10961 raft_consensus.cc:3060] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.829852 11256 consensus_queue.cc:237] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:29.827612 11201 raft_consensus.cc:2804] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:29.832597 11201 raft_consensus.cc:493] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.832993 11201 raft_consensus.cc:3060] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.824741 11337 raft_consensus.cc:493] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.837365 11085 tablet_bootstrap.cc:492] T cf66c391c2ea4f04a1eb536f28d4b170 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:29.838043 11085 ts_tablet_manager.cc:1403] T cf66c391c2ea4f04a1eb536f28d4b170 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.261s	user 0.031s	sys 0.019s
I20260709 13:19:29.837500 11337 raft_consensus.cc:515] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:29.840113 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:29.840869 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:29.841104 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b854da4ba865432d90d6a626e5b585bf" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:29.841815 10890 raft_consensus.cc:2468] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:29.850811 11037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73cc1fc36c14e8cb8698530765f5134" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:29.851532 11037 raft_consensus.cc:3060] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.858305 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c926e4bc5c549a88846566915db122f" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:29.856796 10780 leader_election.cc:304] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:29.859550 10888 raft_consensus.cc:3060] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.859982 11387 raft_consensus.cc:2804] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:19:29.860140 10928 leader_election.cc:343] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:29.860602 11387 raft_consensus.cc:697] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:29.861593 11387 consensus_queue.cc:237] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
W20260709 13:19:29.867038 10780 leader_election.cc:343] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:29.869966 11085 raft_consensus.cc:359] T cf66c391c2ea4f04a1eb536f28d4b170 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:29.872011 11085 raft_consensus.cc:385] T cf66c391c2ea4f04a1eb536f28d4b170 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.872282 11085 raft_consensus.cc:740] T cf66c391c2ea4f04a1eb536f28d4b170 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.872622 11084 tablet_bootstrap.cc:492] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:29.873292 11084 ts_tablet_manager.cc:1403] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.215s	user 0.021s	sys 0.020s
I20260709 13:19:29.874779 11085 consensus_queue.cc:260] T cf66c391c2ea4f04a1eb536f28d4b170 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:29.882550 10961 raft_consensus.cc:2468] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:29.886154 10780 leader_election.cc:304] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:29.887063 11386 raft_consensus.cc:2804] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:29.887576 11386 raft_consensus.cc:697] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:29.888403 11386 consensus_queue.cc:237] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:29.889935 11037 raft_consensus.cc:2468] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:29.893489 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a90e754ea44ce5b10285e034656db6" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:29.882391 10856 leader_election.cc:304] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:29.895505 11086 tablet_bootstrap.cc:492] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:29.840888 11337 leader_election.cc:290] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:29.909744 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5d48da62642a9a8e39ec61cfc914d" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:29.904304 11085 ts_tablet_manager.cc:1434] T cf66c391c2ea4f04a1eb536f28d4b170 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.003s
I20260709 13:19:29.913061 11379 raft_consensus.cc:2804] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:29.917013 11379 raft_consensus.cc:493] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.917455 11379 raft_consensus.cc:3060] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.919667 11086 tablet_bootstrap.cc:654] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.914220 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b854da4ba865432d90d6a626e5b585bf" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:29.928723 11085 tablet_bootstrap.cc:492] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
W20260709 13:19:29.939833 10779 leader_election.cc:343] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:29.940377 10779 leader_election.cc:304] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:29.941879 11210 raft_consensus.cc:2749] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:29.946681 10930 leader_election.cc:343] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:29.949298 10856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 67013.4us
I20260709 13:19:29.886364 11304 raft_consensus.cc:515] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:29.961321 11036 raft_consensus.cc:2393] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d726aaf867ea423fa4efe8a15d1896d1 in current term 1: Already voted for candidate 10307244fcd642b89723e4fb4ac1291a in this term.
I20260709 13:19:29.963842 10888 raft_consensus.cc:2468] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:29.965821 10779 leader_election.cc:304] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:29.970336 11352 raft_consensus.cc:493] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.976106 11387 raft_consensus.cc:2804] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:19:29.971715 10930 leader_election.cc:343] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.000900 11086 tablet_bootstrap.cc:492] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:30.001956 11086 ts_tablet_manager.cc:1403] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.011s
I20260709 13:19:29.989863 11387 raft_consensus.cc:493] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.991792 10930 leader_election.cc:304] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:30.010695 11401 raft_consensus.cc:2749] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:30.011509 11201 raft_consensus.cc:515] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.014976 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5d48da62642a9a8e39ec61cfc914d" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:30.015818 11034 raft_consensus.cc:3060] T cfc5d48da62642a9a8e39ec61cfc914d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.017917 11201 leader_election.cc:290] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:29.985903 11352 raft_consensus.cc:515] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.007891 11387 raft_consensus.cc:3060] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.030042 11083 tablet_bootstrap.cc:654] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.035074 11085 tablet_bootstrap.cc:654] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.039896 10812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5d48da62642a9a8e39ec61cfc914d" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:30.042203 11086 raft_consensus.cc:359] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.044950 11086 raft_consensus.cc:385] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.045305 11086 raft_consensus.cc:740] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.045951 11086 consensus_queue.cc:260] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.048887 11086 ts_tablet_manager.cc:1434] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:19:30.052265 11086 tablet_bootstrap.cc:492] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
W20260709 13:19:30.058708 10930 leader_election.cc:343] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.060628 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:30.061755 10888 raft_consensus.cc:3060] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.053956 11304 leader_election.cc:290] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:30.068173 11084 raft_consensus.cc:359] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.069911 11379 raft_consensus.cc:515] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:30.072192 11379 leader_election.cc:290] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:30.075290 10812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf66c391c2ea4f04a1eb536f28d4b170" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:30.076043 10812 raft_consensus.cc:3060] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.076893 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf66c391c2ea4f04a1eb536f28d4b170" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:30.077632 11036 raft_consensus.cc:3060] T cf66c391c2ea4f04a1eb536f28d4b170 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.078137 11352 leader_election.cc:290] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:30.079490 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ebefb588f745118a0b6ec5c6519a65" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:30.081728 10854 leader_election.cc:343] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:30.082854 11398 log.cc:927] Time spent T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:19:30.091325 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ebefb588f745118a0b6ec5c6519a65" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:30.068962 11084 raft_consensus.cc:385] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.094398 11084 raft_consensus.cc:740] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.095916 11084 consensus_queue.cc:260] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.097712 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:30.093394 11036 raft_consensus.cc:2468] T cf66c391c2ea4f04a1eb536f28d4b170 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:30.094839 10709 catalog_manager.cc:5697] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 1 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.105517 11084 ts_tablet_manager.cc:1434] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.232s	user 0.008s	sys 0.000s
W20260709 13:19:30.098563 10855 leader_election.cc:343] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.109380 11084 tablet_bootstrap.cc:492] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:30.112530 10855 leader_election.cc:304] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:30.114869 11085 tablet_bootstrap.cc:492] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:30.115389 11085 ts_tablet_manager.cc:1403] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.187s	user 0.034s	sys 0.015s
I20260709 13:19:30.115609 10854 leader_election.cc:304] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:30.116658 11379 raft_consensus.cc:2749] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:30.117280 11352 raft_consensus.cc:2804] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:30.117841 11352 raft_consensus.cc:697] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:30.118769 11352 consensus_queue.cc:237] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:30.102793 11095 raft_consensus.cc:493] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.121698 10888 raft_consensus.cc:2468] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:30.123605 11002 leader_election.cc:304] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:30.121503 11095 raft_consensus.cc:515] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.124514 11256 raft_consensus.cc:2804] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:30.125041 11256 raft_consensus.cc:697] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:30.125360 11086 tablet_bootstrap.cc:654] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.125165 10713 catalog_manager.cc:5697] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.126299 11095 leader_election.cc:290] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:30.125962 11256 consensus_queue.cc:237] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:30.115283 11034 raft_consensus.cc:2468] T cfc5d48da62642a9a8e39ec61cfc914d P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:30.133764 10928 leader_election.cc:304] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:30.134312 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bdc10add5473a94bcb1e1e5d2d1bc" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:30.134716 11387 raft_consensus.cc:515] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:30.135150 11201 raft_consensus.cc:2804] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:30.135737 11201 raft_consensus.cc:697] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:30.136663 11201 consensus_queue.cc:237] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.139587 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bdc10add5473a94bcb1e1e5d2d1bc" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:30.139743 11085 raft_consensus.cc:359] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.140417 11085 raft_consensus.cc:385] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.140306 10887 raft_consensus.cc:2468] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:30.140736 11085 raft_consensus.cc:740] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.140952 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:30.143410 11084 tablet_bootstrap.cc:654] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.143559 10814 raft_consensus.cc:2393] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10307244fcd642b89723e4fb4ac1291a in current term 1: Already voted for candidate d726aaf867ea423fa4efe8a15d1896d1 in this term.
W20260709 13:19:30.137028 10780 leader_election.cc:343] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.136893 11387 leader_election.cc:290] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:30.144388 11085 consensus_queue.cc:260] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.157711 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:30.162063 10779 leader_election.cc:304] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:30.165176 11085 ts_tablet_manager.cc:1434] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:19:30.166829 11085 tablet_bootstrap.cc:492] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:30.172572 11095 raft_consensus.cc:2804] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:30.180531 10887 raft_consensus.cc:2393] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d726aaf867ea423fa4efe8a15d1896d1 in current term 1: Already voted for candidate 10307244fcd642b89723e4fb4ac1291a in this term.
I20260709 13:19:30.184000 11095 raft_consensus.cc:493] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.189052 11095 raft_consensus.cc:3060] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.191769 10812 raft_consensus.cc:2468] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:30.191900 11086 tablet_bootstrap.cc:492] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:30.194134 11086 ts_tablet_manager.cc:1403] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.142s	user 0.018s	sys 0.002s
I20260709 13:19:30.197055 11086 raft_consensus.cc:359] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.197813 11086 raft_consensus.cc:385] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.198098 11086 raft_consensus.cc:740] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.198309 11085 tablet_bootstrap.cc:654] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.199101 10779 leader_election.cc:304] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:30.199905 11210 raft_consensus.cc:2749] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:30.202513 11086 consensus_queue.cc:260] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.204841 11086 ts_tablet_manager.cc:1434] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:19:30.205353 11095 raft_consensus.cc:515] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.206362 11083 tablet_bootstrap.cc:492] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:30.207079 11083 ts_tablet_manager.cc:1403] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.391s	user 0.016s	sys 0.021s
I20260709 13:19:30.208122 11084 tablet_bootstrap.cc:492] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:30.208609 11084 ts_tablet_manager.cc:1403] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.100s	user 0.025s	sys 0.021s
I20260709 13:19:30.209070 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bdc10add5473a94bcb1e1e5d2d1bc" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:30.209321 11095 leader_election.cc:290] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
W20260709 13:19:30.210639 10780 leader_election.cc:343] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.211362 11084 raft_consensus.cc:359] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.212042 11084 raft_consensus.cc:385] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.212309 11084 raft_consensus.cc:740] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.205914 11086 tablet_bootstrap.cc:492] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:30.212985 11084 consensus_queue.cc:260] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.217859 11084 ts_tablet_manager.cc:1434] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:19:30.218811 11084 tablet_bootstrap.cc:492] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:30.218694 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bdc10add5473a94bcb1e1e5d2d1bc" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:30.219344 10888 raft_consensus.cc:3060] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.219887 11086 tablet_bootstrap.cc:654] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.219554 10710 catalog_manager.cc:5697] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 0 to 1, leader changed from <none> to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 1 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:30.216671 10712 catalog_manager.cc:5697] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.227941 10888 raft_consensus.cc:2468] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:30.232834 11256 consensus_queue.cc:1048] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:30.238976 11084 tablet_bootstrap.cc:654] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.242595 11083 raft_consensus.cc:359] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.243394 11083 raft_consensus.cc:385] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.243719 11083 raft_consensus.cc:740] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.242980 10779 leader_election.cc:304] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:30.244908 11387 raft_consensus.cc:2804] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:30.245836 11387 raft_consensus.cc:697] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:30.246989 11387 consensus_queue.cc:237] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.247593 11083 consensus_queue.cc:260] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.255119 11083 ts_tablet_manager.cc:1434] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.002s
I20260709 13:19:30.256419 11083 tablet_bootstrap.cc:492] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:30.275979 11085 tablet_bootstrap.cc:492] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:30.275679 11303 consensus_queue.cc:1048] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:30.276499 11085 ts_tablet_manager.cc:1403] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.110s	user 0.027s	sys 0.008s
I20260709 13:19:30.277505 11083 tablet_bootstrap.cc:654] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.279346 11085 raft_consensus.cc:359] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.280097 11085 raft_consensus.cc:385] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.280385 11085 raft_consensus.cc:740] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.281191 11085 consensus_queue.cc:260] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.283385 11085 ts_tablet_manager.cc:1434] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:30.284479 11085 tablet_bootstrap.cc:492] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:30.284577 11387 consensus_queue.cc:1048] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:30.291390 11084 tablet_bootstrap.cc:492] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:30.292064 11084 ts_tablet_manager.cc:1403] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.004s
I20260709 13:19:30.298491 11084 raft_consensus.cc:359] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:30.299177 11084 raft_consensus.cc:385] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.299423 11084 raft_consensus.cc:740] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.300066 11084 consensus_queue.cc:260] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:30.302184 11084 ts_tablet_manager.cc:1434] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:19:30.304553 11085 tablet_bootstrap.cc:654] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.307083 11086 tablet_bootstrap.cc:492] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:30.307422 11084 tablet_bootstrap.cc:492] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:30.307682 11396 raft_consensus.cc:493] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.309692 11396 raft_consensus.cc:515] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.312489 11396 leader_election.cc:290] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:30.315016 11084 tablet_bootstrap.cc:654] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.318992 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a90e754ea44ce5b10285e034656db6" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:30.319926 10813 raft_consensus.cc:2468] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:30.322324 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a90e754ea44ce5b10285e034656db6" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:30.323904 10712 catalog_manager.cc:5697] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:30.326191 11084 tablet_bootstrap.cc:492] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:30.326666 11084 ts_tablet_manager.cc:1403] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.000s
I20260709 13:19:30.328459 11387 consensus_queue.cc:1048] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:30.329502 11084 raft_consensus.cc:359] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.330155 11084 raft_consensus.cc:385] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.330403 11084 raft_consensus.cc:740] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.331243 11084 consensus_queue.cc:260] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.333348 11084 ts_tablet_manager.cc:1434] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:19:30.333112 11004 leader_election.cc:304] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:30.334321 11084 tablet_bootstrap.cc:492] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:30.337060 11095 consensus_queue.cc:1048] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:30.340204 11003 leader_election.cc:343] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.340619 11084 tablet_bootstrap.cc:654] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.352288 11303 raft_consensus.cc:2804] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:30.352869 11303 raft_consensus.cc:493] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.353330 11303 raft_consensus.cc:3060] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.354539 11084 tablet_bootstrap.cc:492] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:30.355057 11084 ts_tablet_manager.cc:1403] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.008s
I20260709 13:19:30.358963 11084 raft_consensus.cc:359] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.361339 11084 raft_consensus.cc:385] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.307588 11086 ts_tablet_manager.cc:1403] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.008s
I20260709 13:19:30.361660 11084 raft_consensus.cc:740] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.362449 11084 consensus_queue.cc:260] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.364845 11084 ts_tablet_manager.cc:1434] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:19:30.365933 11084 tablet_bootstrap.cc:492] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:30.372454 11084 tablet_bootstrap.cc:654] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.325860 10712 catalog_manager.cc:5697] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:30.382576 11086 raft_consensus.cc:359] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.389768 11084 tablet_bootstrap.cc:492] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:30.390375 11084 ts_tablet_manager.cc:1403] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.004s
I20260709 13:19:30.392771 11086 raft_consensus.cc:385] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.393312 11084 raft_consensus.cc:359] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.394038 11084 raft_consensus.cc:385] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.394321 11084 raft_consensus.cc:740] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.394964 11084 consensus_queue.cc:260] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.396991 11084 ts_tablet_manager.cc:1434] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:30.393689 11086 raft_consensus.cc:740] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.398069 11084 tablet_bootstrap.cc:492] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:30.398211 11086 consensus_queue.cc:260] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.422286 11084 tablet_bootstrap.cc:654] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.424065 11086 ts_tablet_manager.cc:1434] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 13:19:30.431107 11095 raft_consensus.cc:493] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.431911 11095 raft_consensus.cc:515] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:30.434078 11095 leader_election.cc:290] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:30.434376 11084 tablet_bootstrap.cc:492] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:30.434988 11084 ts_tablet_manager.cc:1403] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.037s	user 0.026s	sys 0.008s
I20260709 13:19:30.437132 11086 tablet_bootstrap.cc:492] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:30.438007 11084 raft_consensus.cc:359] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.438755 11084 raft_consensus.cc:385] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.439263 11084 raft_consensus.cc:740] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.439311 11083 tablet_bootstrap.cc:492] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:30.439989 11083 ts_tablet_manager.cc:1403] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.184s	user 0.031s	sys 0.015s
I20260709 13:19:30.440062 11084 consensus_queue.cc:260] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.419808 10710 catalog_manager.cc:5697] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 1 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:30.442667 11084 ts_tablet_manager.cc:1434] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:30.442970 11083 raft_consensus.cc:359] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.449431 11379 raft_consensus.cc:493] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.449647 11210 consensus_queue.cc:1048] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:30.450660 11083 raft_consensus.cc:385] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.451020 11083 raft_consensus.cc:740] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.451315 11084 tablet_bootstrap.cc:492] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:30.451726 11083 consensus_queue.cc:260] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.454010 11083 ts_tablet_manager.cc:1434] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:19:30.454109 11303 raft_consensus.cc:515] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.454979 11083 tablet_bootstrap.cc:492] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:30.457116 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a90e754ea44ce5b10285e034656db6" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:30.457276 11379 raft_consensus.cc:515] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.458415 11084 tablet_bootstrap.cc:654] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:30.458611 11003 leader_election.cc:343] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.458635 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145e95f652c4178b64b4379f53a809d" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:30.459483 11379 leader_election.cc:290] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:30.460394 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb72b7a1eed4df08c0414cdb29fb6f1" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
W20260709 13:19:30.462126 10855 leader_election.cc:343] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.462258 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb72b7a1eed4df08c0414cdb29fb6f1" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:30.463188 11036 raft_consensus.cc:2468] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:30.464656 11083 tablet_bootstrap.cc:654] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.464931 10854 leader_election.cc:304] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 348b268fc1da46ac98e10bbe776b018b
W20260709 13:19:30.450137 10760 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:30.466938 11379 raft_consensus.cc:2804] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:30.467463 11379 raft_consensus.cc:493] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.467924 11379 raft_consensus.cc:3060] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.480046 11210 raft_consensus.cc:493] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.480852 11210 raft_consensus.cc:515] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.485631 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b854da4ba865432d90d6a626e5b585bf" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:30.486706 10962 raft_consensus.cc:2468] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:30.492102 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b854da4ba865432d90d6a626e5b585bf" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:30.493059 10889 raft_consensus.cc:2468] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:30.498976 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a90e754ea44ce5b10285e034656db6" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:30.500128 10813 raft_consensus.cc:3060] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.502044 10780 leader_election.cc:304] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:30.494922 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145e95f652c4178b64b4379f53a809d" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:30.497454 11303 leader_election.cc:290] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:30.524550 11086 tablet_bootstrap.cc:654] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.542992 11387 raft_consensus.cc:2804] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:30.543692 11387 raft_consensus.cc:493] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.544127 11387 raft_consensus.cc:3060] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.561362 11303 consensus_queue.cc:1048] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:30.578207 10779 leader_election.cc:343] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.579195 11085 tablet_bootstrap.cc:492] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:30.579783 11085 ts_tablet_manager.cc:1403] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.296s	user 0.015s	sys 0.024s
I20260709 13:19:30.535234 11210 leader_election.cc:290] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:30.583022 11085 raft_consensus.cc:359] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:30.583760 11085 raft_consensus.cc:385] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.584019 11085 raft_consensus.cc:740] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.584636 11085 consensus_queue.cc:260] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:30.585585 11346 consensus_queue.cc:1048] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:30.586921 11085 ts_tablet_manager.cc:1434] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:30.587935 11085 tablet_bootstrap.cc:492] T 10ebefb588f745118a0b6ec5c6519a65 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:30.591990 10813 raft_consensus.cc:2468] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:30.594058 11004 leader_election.cc:304] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:30.595633 11396 raft_consensus.cc:2804] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:30.596321 11396 raft_consensus.cc:697] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:30.598466 11352 consensus_queue.cc:1048] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:30.599198 11085 tablet_bootstrap.cc:654] T 10ebefb588f745118a0b6ec5c6519a65 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.598519 11396 consensus_queue.cc:237] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.609009 11329 raft_consensus.cc:493] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.609767 11329 raft_consensus.cc:515] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.612488 11329 leader_election.cc:290] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:30.616906 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df06b225878d49589732d38cda773b7e" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
W20260709 13:19:30.620245 10780 leader_election.cc:343] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.630673 11085 tablet_bootstrap.cc:492] T 10ebefb588f745118a0b6ec5c6519a65 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:30.631249 11085 ts_tablet_manager.cc:1403] T 10ebefb588f745118a0b6ec5c6519a65 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.007s
I20260709 13:19:30.632262 11303 raft_consensus.cc:493] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.632812 11303 raft_consensus.cc:515] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:30.635293 11303 leader_election.cc:290] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:30.636222 11346 raft_consensus.cc:493] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.636993 11346 raft_consensus.cc:515] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.639937 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145e95f652c4178b64b4379f53a809d" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:30.640616 11085 raft_consensus.cc:359] T 10ebefb588f745118a0b6ec5c6519a65 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.641345 11085 raft_consensus.cc:385] T 10ebefb588f745118a0b6ec5c6519a65 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.641625 11085 raft_consensus.cc:740] T 10ebefb588f745118a0b6ec5c6519a65 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.641963 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bdc10add5473a94bcb1e1e5d2d1bc" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:30.642800 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145e95f652c4178b64b4379f53a809d" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:30.643092 10888 raft_consensus.cc:2393] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 348b268fc1da46ac98e10bbe776b018b in current term 1: Already voted for candidate d726aaf867ea423fa4efe8a15d1896d1 in this term.
I20260709 13:19:30.643646 10814 raft_consensus.cc:2468] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:30.644245 11238 consensus_queue.cc:1048] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:30.645143 11004 leader_election.cc:304] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:30.646224 11256 raft_consensus.cc:2804] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:30.646626 11256 raft_consensus.cc:493] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.646955 11256 raft_consensus.cc:3060] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.645072 11085 consensus_queue.cc:260] T 10ebefb588f745118a0b6ec5c6519a65 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.650215 10964 raft_consensus.cc:3060] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.652324 11085 ts_tablet_manager.cc:1434] T 10ebefb588f745118a0b6ec5c6519a65 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:19:30.653414 11085 tablet_bootstrap.cc:492] T 585cc3c8fea2482e99b321de3dc98356 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:30.654758 11201 raft_consensus.cc:493] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.655483 11201 raft_consensus.cc:515] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
W20260709 13:19:30.657805 11002 leader_election.cc:343] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.658420 11201 leader_election.cc:290] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:30.663683 11346 leader_election.cc:290] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:30.664510 11085 tablet_bootstrap.cc:654] T 585cc3c8fea2482e99b321de3dc98356 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:30.665463 10779 leader_election.cc:343] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.666209 10779 leader_election.cc:304] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:30.667623 11095 raft_consensus.cc:2749] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:30.669574 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ebefb588f745118a0b6ec5c6519a65" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:30.670562 10887 raft_consensus.cc:2468] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 0.
I20260709 13:19:30.675288 10928 leader_election.cc:304] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:30.681665 11346 raft_consensus.cc:2804] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:30.682374 11346 raft_consensus.cc:493] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.683537 11346 raft_consensus.cc:3060] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.686152 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ebefb588f745118a0b6ec5c6519a65" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:30.686959 11034 raft_consensus.cc:2468] T 10ebefb588f745118a0b6ec5c6519a65 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 0.
W20260709 13:19:30.693982 10856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 52447.4us
I20260709 13:19:30.698386 11386 raft_consensus.cc:493] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.698910 11386 raft_consensus.cc:515] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.701419 11386 leader_election.cc:290] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:30.701918 11387 raft_consensus.cc:515] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.707013 11387 leader_election.cc:290] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:30.633013 11379 raft_consensus.cc:515] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.713371 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904c45fa164407791817b45928f663e" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:30.717397 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b854da4ba865432d90d6a626e5b585bf" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:30.763149 10963 raft_consensus.cc:3060] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.763651 11379 leader_election.cc:290] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
W20260709 13:19:30.765763 10780 leader_election.cc:343] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.767061 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb72b7a1eed4df08c0414cdb29fb6f1" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
W20260709 13:19:30.768676 10855 leader_election.cc:343] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:30.729486 10779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 64060.4us
I20260709 13:19:30.731925 11210 consensus_queue.cc:1048] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:30.731638 11346 raft_consensus.cc:515] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.743971 11303 consensus_queue.cc:1048] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:30.774608 11086 tablet_bootstrap.cc:492] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:30.775130 11086 ts_tablet_manager.cc:1403] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.338s	user 0.018s	sys 0.000s
I20260709 13:19:30.776185 11346 leader_election.cc:290] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:30.778007 11085 tablet_bootstrap.cc:492] T 585cc3c8fea2482e99b321de3dc98356 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:30.778496 11085 ts_tablet_manager.cc:1403] T 585cc3c8fea2482e99b321de3dc98356 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.125s	user 0.024s	sys 0.012s
I20260709 13:19:30.740621 11256 raft_consensus.cc:515] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:30.721685 11083 tablet_bootstrap.cc:492] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:30.796108 11083 ts_tablet_manager.cc:1403] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.341s	user 0.062s	sys 0.077s
I20260709 13:19:30.799206 11083 raft_consensus.cc:359] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.799955 11083 raft_consensus.cc:385] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.800241 11083 raft_consensus.cc:740] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.772709 10963 raft_consensus.cc:2468] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:30.800915 11083 consensus_queue.cc:260] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.802139 10780 leader_election.cc:304] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:30.803236 11095 raft_consensus.cc:2804] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:30.803893 11083 ts_tablet_manager.cc:1434] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:30.803932 11095 raft_consensus.cc:697] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:30.805529 11095 consensus_queue.cc:237] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:30.810464 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145e95f652c4178b64b4379f53a809d" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:30.811053 10814 raft_consensus.cc:3060] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.816501 11085 raft_consensus.cc:359] T 585cc3c8fea2482e99b321de3dc98356 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.817380 11085 raft_consensus.cc:385] T 585cc3c8fea2482e99b321de3dc98356 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.817668 11085 raft_consensus.cc:740] T 585cc3c8fea2482e99b321de3dc98356 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.785251 11084 tablet_bootstrap.cc:492] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:30.832175 11084 ts_tablet_manager.cc:1403] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.381s	user 0.153s	sys 0.132s
I20260709 13:19:30.786844 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ebefb588f745118a0b6ec5c6519a65" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:30.834892 10888 raft_consensus.cc:3060] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.788807 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb72b7a1eed4df08c0414cdb29fb6f1" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:30.839370 11034 raft_consensus.cc:3060] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.818799 11256 leader_election.cc:290] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:30.819752 11083 tablet_bootstrap.cc:492] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:30.821663 10812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bdc10add5473a94bcb1e1e5d2d1bc" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:30.821893 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145e95f652c4178b64b4379f53a809d" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:30.823346 11086 raft_consensus.cc:359] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.782770 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ebefb588f745118a0b6ec5c6519a65" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:30.825881 10815 raft_consensus.cc:3060] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.849467 11086 raft_consensus.cc:385] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.832137 11085 consensus_queue.cc:260] T 585cc3c8fea2482e99b321de3dc98356 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.847440 10712 catalog_manager.cc:5697] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 1 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:30.850381 11086 raft_consensus.cc:740] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.849623 11036 raft_consensus.cc:3060] T 10ebefb588f745118a0b6ec5c6519a65 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.826710 10814 raft_consensus.cc:2468] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:30.851123 11086 consensus_queue.cc:260] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.854846 11086 ts_tablet_manager.cc:1434] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.003s
I20260709 13:19:30.855748 11086 tablet_bootstrap.cc:492] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:30.851879 11387 raft_consensus.cc:493] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.861591 11387 raft_consensus.cc:515] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.862295 11085 ts_tablet_manager.cc:1434] T 585cc3c8fea2482e99b321de3dc98356 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 13:19:30.863233 11085 tablet_bootstrap.cc:492] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:30.863693 11387 leader_election.cc:290] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:30.865717 10930 leader_election.cc:304] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:30.868445 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a060d27b9f4695a643036bb5223916" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:30.860288 10710 catalog_manager.cc:5697] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:30.868960 11085 tablet_bootstrap.cc:654] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.876147 11083 tablet_bootstrap.cc:654] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:30.878821 10780 leader_election.cc:343] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.882308 11004 leader_election.cc:304] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:30.884922 10886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b854da4ba865432d90d6a626e5b585bf" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:30.885622 10886 raft_consensus.cc:3060] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:30.887774 11256 raft_consensus.cc:2804] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:30.888499 11256 raft_consensus.cc:697] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:30.889360 11256 consensus_queue.cc:237] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:30.892051 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a060d27b9f4695a643036bb5223916" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:30.876469 11201 raft_consensus.cc:2749] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:30.901250 11084 raft_consensus.cc:359] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:30.909590 11084 raft_consensus.cc:385] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:30.910089 11084 raft_consensus.cc:740] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.903160 10888 raft_consensus.cc:2468] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:30.905306 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904c45fa164407791817b45928f663e" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:30.917171 11035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df06b225878d49589732d38cda773b7e" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:30.919206 11084 consensus_queue.cc:260] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:30.922991 10928 leader_election.cc:304] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
W20260709 13:19:30.897776 11002 leader_election.cc:343] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:30.932559 10779 leader_election.cc:343] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.932698 11346 raft_consensus.cc:2804] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:30.933156 10779 leader_election.cc:304] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:30.933521 11346 raft_consensus.cc:697] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
W20260709 13:19:30.934489 10779 leader_election.cc:343] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.934878 10779 leader_election.cc:304] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:30.934667 11346 consensus_queue.cc:237] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.935729 11329 raft_consensus.cc:2749] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:30.936555 11095 raft_consensus.cc:2749] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:30.942663 11084 ts_tablet_manager.cc:1434] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.000s
I20260709 13:19:30.943905 11084 tablet_bootstrap.cc:492] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:30.928620 11034 raft_consensus.cc:2468] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:30.950464 11095 consensus_queue.cc:1048] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:30.953560 10886 raft_consensus.cc:2468] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:30.975822 11036 raft_consensus.cc:2468] T 10ebefb588f745118a0b6ec5c6519a65 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
W20260709 13:19:30.977321 10779 leader_election.cc:343] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:30.977749 10779 leader_election.cc:304] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:30.958132 11086 tablet_bootstrap.cc:654] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:30.971182 11386 raft_consensus.cc:493] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.972258 11447 consensus_queue.cc:1048] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:30.979094 11403 raft_consensus.cc:2749] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:30.982601 11386 raft_consensus.cc:515] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:30.983075 10854 leader_election.cc:304] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:30.989149 11379 raft_consensus.cc:2804] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:30.989991 11379 raft_consensus.cc:697] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:30.990374 11386 leader_election.cc:290] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:30.998114 10712 catalog_manager.cc:5697] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 1 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:31.005232 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5d48da62642a9a8e39ec61cfc914d" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:31.017736 11083 tablet_bootstrap.cc:492] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:31.018345 11083 ts_tablet_manager.cc:1403] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.199s	user 0.006s	sys 0.008s
I20260709 13:19:30.991039 11379 consensus_queue.cc:237] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:30.999331 11386 raft_consensus.cc:493] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.023212 11084 tablet_bootstrap.cc:654] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:31.034287 11201 raft_consensus.cc:493] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 02260b9a864a4665ae3c33869adeaaf5)
I20260709 13:19:31.034806 11201 raft_consensus.cc:515] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:31.036685 11201 leader_election.cc:290] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:31.025803 11386 raft_consensus.cc:515] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:31.047242 11386 leader_election.cc:290] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:31.047952 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:31.048631 10887 raft_consensus.cc:2468] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 2.
I20260709 13:19:31.051892 10713 catalog_manager.cc:5697] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 0 to 1, leader changed from <none> to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 1 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:31.056382 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:31.057511 10815 raft_consensus.cc:2393] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 348b268fc1da46ac98e10bbe776b018b in current term 2: Already voted for candidate d726aaf867ea423fa4efe8a15d1896d1 in this term.
I20260709 13:19:31.054978 11083 raft_consensus.cc:359] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:31.061182 11083 raft_consensus.cc:385] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:31.061511 11083 raft_consensus.cc:740] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.068280 10928 leader_election.cc:304] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:31.070137 11346 raft_consensus.cc:2804] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:31.070554 11346 raft_consensus.cc:493] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 02260b9a864a4665ae3c33869adeaaf5)
I20260709 13:19:31.070922 11346 raft_consensus.cc:3060] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.073381 11401 raft_consensus.cc:493] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.059621 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc5d48da62642a9a8e39ec61cfc914d" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:31.073910 11401 raft_consensus.cc:515] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:31.076262 11401 leader_election.cc:290] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:31.078383 10886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0005319a469f4f4e993fa7679707faa5" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:31.079221 11352 raft_consensus.cc:493] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.077575 11083 consensus_queue.cc:260] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:31.079713 11352 raft_consensus.cc:515] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:31.070350 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0005319a469f4f4e993fa7679707faa5" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:31.109736 11085 tablet_bootstrap.cc:492] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:31.110297 11085 ts_tablet_manager.cc:1403] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.247s	user 0.012s	sys 0.005s
I20260709 13:19:31.114099 11083 ts_tablet_manager.cc:1434] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.002s
I20260709 13:19:31.115167 11083 tablet_bootstrap.cc:492] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:31.117487 10780 leader_election.cc:304] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:31.124075 10811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a90e754ea44ce5b10285e034656db6" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:31.124950 10811 raft_consensus.cc:2393] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 348b268fc1da46ac98e10bbe776b018b in current term 1: Already voted for candidate 10307244fcd642b89723e4fb4ac1291a in this term.
I20260709 13:19:31.125037 11083 tablet_bootstrap.cc:654] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:31.116314 11256 consensus_queue.cc:1048] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:19:31.128634 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a90e754ea44ce5b10285e034656db6" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:31.117411 10779 leader_election.cc:343] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:31.143651 11352 leader_election.cc:290] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:31.146136 11086 tablet_bootstrap.cc:492] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:31.146842 11086 ts_tablet_manager.cc:1403] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.291s	user 0.021s	sys 0.005s
I20260709 13:19:31.150138 11346 raft_consensus.cc:515] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:31.150606 11086 raft_consensus.cc:359] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:31.151407 11086 raft_consensus.cc:385] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:31.151739 11086 raft_consensus.cc:740] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.153262 11346 leader_election.cc:290] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:31.153506 11086 consensus_queue.cc:260] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:31.162016 11085 raft_consensus.cc:359] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:31.162863 11085 raft_consensus.cc:385] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:31.163264 11085 raft_consensus.cc:740] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.164261 11086 ts_tablet_manager.cc:1434] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:19:31.163940 11085 consensus_queue.cc:260] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:31.154650 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585cc3c8fea2482e99b321de3dc98356" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:31.155725 10928 leader_election.cc:304] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:31.166970 11401 raft_consensus.cc:3060] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:31.172595 11403 raft_consensus.cc:2749] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:31.175935 11401 raft_consensus.cc:2749] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:31.179904 11038 raft_consensus.cc:2468] T 585cc3c8fea2482e99b321de3dc98356 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:31.181631 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:31.185276 11085 ts_tablet_manager.cc:1434] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.002s
I20260709 13:19:31.185619 11396 consensus_queue.cc:1048] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:31.186338 11085 tablet_bootstrap.cc:492] T 0005319a469f4f4e993fa7679707faa5 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:31.190084 10889 raft_consensus.cc:2468] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 2.
I20260709 13:19:31.194010 10854 leader_election.cc:304] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:31.197417 11238 raft_consensus.cc:2804] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:31.194556 11086 tablet_bootstrap.cc:492] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:31.197774 11238 raft_consensus.cc:493] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.198153 11238 raft_consensus.cc:3060] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:31.201220 10855 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 124125us
I20260709 13:19:31.203264 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585cc3c8fea2482e99b321de3dc98356" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:31.204061 11086 tablet_bootstrap.cc:654] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:31.205627 10928 leader_election.cc:304] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:31.207507 11084 tablet_bootstrap.cc:492] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:31.208017 11084 ts_tablet_manager.cc:1403] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.264s	user 0.013s	sys 0.021s
I20260709 13:19:31.208964 11201 raft_consensus.cc:2804] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:31.209656 11201 raft_consensus.cc:697] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
W20260709 13:19:31.210711 10855 leader_election.cc:343] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:31.210655 11201 consensus_queue.cc:237] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:31.217005 11085 tablet_bootstrap.cc:654] T 0005319a469f4f4e993fa7679707faa5 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:31.217217 11352 raft_consensus.cc:493] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.217749 11352 raft_consensus.cc:515] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:31.219861 11238 raft_consensus.cc:515] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:31.220846 10811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145e95f652c4178b64b4379f53a809d" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:31.235646 10811 raft_consensus.cc:2393] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 02260b9a864a4665ae3c33869adeaaf5 in current term 1: Already voted for candidate 10307244fcd642b89723e4fb4ac1291a in this term.
I20260709 13:19:31.220801 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145e95f652c4178b64b4379f53a809d" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:31.223769 10709 catalog_manager.cc:5697] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:31.237675 10854 leader_election.cc:304] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:31.239012 11238 leader_election.cc:290] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:31.239624 11238 raft_consensus.cc:3060] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:31.240507 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585cc3c8fea2482e99b321de3dc98356" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:31.241067 11038 raft_consensus.cc:3060] T 585cc3c8fea2482e99b321de3dc98356 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:31.240447 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585cc3c8fea2482e99b321de3dc98356" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
W20260709 13:19:31.246799 10855 leader_election.cc:343] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:31.230966 11352 leader_election.cc:290] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:31.254118 11083 tablet_bootstrap.cc:492] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:31.254779 11083 ts_tablet_manager.cc:1403] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.140s	user 0.009s	sys 0.020s
I20260709 13:19:31.255628 11084 raft_consensus.cc:359] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:31.256182 11038 raft_consensus.cc:2468] T 585cc3c8fea2482e99b321de3dc98356 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:31.333230 11086 tablet_bootstrap.cc:492] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:31.333823 11086 ts_tablet_manager.cc:1403] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.169s	user 0.012s	sys 0.042s
I20260709 13:19:31.256559 11084 raft_consensus.cc:385] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:31.234386 10779 leader_election.cc:343] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:31.312266 11095 raft_consensus.cc:493] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.334462 10779 leader_election.cc:304] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:31.334808 11095 raft_consensus.cc:515] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:31.334266 11084 raft_consensus.cc:740] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
W20260709 13:19:31.336444 10779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 102092us
I20260709 13:19:31.322685 11083 raft_consensus.cc:359] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:31.327241 11201 raft_consensus.cc:493] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.342517 11083 raft_consensus.cc:385] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:31.342859 11083 raft_consensus.cc:740] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.341773 11201 raft_consensus.cc:515] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:31.343500 11083 consensus_queue.cc:260] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:31.354233 11084 consensus_queue.cc:260] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:31.357872 11095 leader_election.cc:290] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:31.363147 11083 ts_tablet_manager.cc:1434] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.007s
I20260709 13:19:31.364066 10713 catalog_manager.cc:5697] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 1 to 2, leader changed from 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 2 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.369758 11085 tablet_bootstrap.cc:492] T 0005319a469f4f4e993fa7679707faa5 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:31.369479 11086 raft_consensus.cc:359] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:31.370146 11086 raft_consensus.cc:385] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:31.370224 11085 ts_tablet_manager.cc:1403] T 0005319a469f4f4e993fa7679707faa5 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.184s	user 0.015s	sys 0.000s
I20260709 13:19:31.370450 11086 raft_consensus.cc:740] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.371162 11086 consensus_queue.cc:260] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:31.360827 11304 raft_consensus.cc:493] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.374241 11304 raft_consensus.cc:515] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:31.376315 11304 leader_election.cc:290] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:31.365551 10854 leader_election.cc:304] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:31.379205 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a060d27b9f4695a643036bb5223916" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:31.379891 10964 raft_consensus.cc:2468] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:31.353543 11329 raft_consensus.cc:2749] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:31.383797 11201 leader_election.cc:290] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:31.385035 11003 leader_election.cc:304] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:31.388039 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a060d27b9f4695a643036bb5223916" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:31.388474 11445 raft_consensus.cc:2804] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:31.388955 11445 raft_consensus.cc:493] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.390568 11445 raft_consensus.cc:3060] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:31.392280 11352 raft_consensus.cc:2804] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:31.392814 11352 raft_consensus.cc:697] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:31.393646 11352 consensus_queue.cc:237] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:31.397526 11085 raft_consensus.cc:359] T 0005319a469f4f4e993fa7679707faa5 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:31.398252 11085 raft_consensus.cc:385] T 0005319a469f4f4e993fa7679707faa5 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:31.398514 11085 raft_consensus.cc:740] T 0005319a469f4f4e993fa7679707faa5 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.399142 11085 consensus_queue.cc:260] T 0005319a469f4f4e993fa7679707faa5 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:31.404677 11086 ts_tablet_manager.cc:1434] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.070s	user 0.002s	sys 0.004s
I20260709 13:19:31.405591 11086 tablet_bootstrap.cc:492] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
W20260709 13:19:31.409878 10779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 71889.2us
I20260709 13:19:31.425578 11085 ts_tablet_manager.cc:1434] T 0005319a469f4f4e993fa7679707faa5 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:19:31.430737 11083 tablet_bootstrap.cc:492] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:31.431133 10812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a060d27b9f4695a643036bb5223916" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:31.436477 10812 raft_consensus.cc:2468] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 0.
I20260709 13:19:31.433835 11084 ts_tablet_manager.cc:1434] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.225s	user 0.007s	sys 0.015s
I20260709 13:19:31.431291 11085 tablet_bootstrap.cc:492] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:31.433396 11463 raft_consensus.cc:493] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.448174 11463 raft_consensus.cc:515] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:31.450416 11463 leader_election.cc:290] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:31.435789 11238 raft_consensus.cc:2749] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:31.428277 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:31.441825 10812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a060d27b9f4695a643036bb5223916" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:31.454319 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0005319a469f4f4e993fa7679707faa5" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:31.454416 10888 raft_consensus.cc:2468] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:31.442756 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:31.454979 10814 raft_consensus.cc:2468] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:31.439087 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:31.456270 10856 leader_election.cc:304] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:31.457207 11379 raft_consensus.cc:2804] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:31.457713 11379 raft_consensus.cc:493] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.458128 11379 raft_consensus.cc:3060] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:31.456272 10815 raft_consensus.cc:2393] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 348b268fc1da46ac98e10bbe776b018b in current term 2: Already voted for candidate d726aaf867ea423fa4efe8a15d1896d1 in this term.
I20260709 13:19:31.452251 10930 leader_election.cc:304] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:31.454511 10812 raft_consensus.cc:2468] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:31.452857 11084 tablet_bootstrap.cc:492] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:31.435775 11086 tablet_bootstrap.cc:654] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:31.446497 11445 raft_consensus.cc:515] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:31.462522 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0005319a469f4f4e993fa7679707faa5" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:31.468612 10779 leader_election.cc:304] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:31.470662 11095 raft_consensus.cc:2804] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:31.471000 11095 raft_consensus.cc:493] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.471271 11095 raft_consensus.cc:3060] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:31.465196 11401 raft_consensus.cc:2804] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:31.474942 11038 raft_consensus.cc:2393] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 348b268fc1da46ac98e10bbe776b018b in current term 1: Already voted for candidate 10307244fcd642b89723e4fb4ac1291a in this term.
I20260709 13:19:31.474099 11401 raft_consensus.cc:493] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.475656 11401 raft_consensus.cc:3060] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:31.477140 11032 raft_consensus.cc:2468] T 0005319a469f4f4e993fa7679707faa5 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:31.478179 11471 consensus_queue.cc:1048] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:19:31.485544 11445 leader_election.cc:290] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:31.494645 11401 raft_consensus.cc:515] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:31.501186 11083 tablet_bootstrap.cc:654] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:31.503707 11401 leader_election.cc:290] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:31.525367 10812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a060d27b9f4695a643036bb5223916" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:31.526095 10812 raft_consensus.cc:3060] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:31.525849 11379 raft_consensus.cc:515] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:31.514660 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a060d27b9f4695a643036bb5223916" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:31.530460 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a060d27b9f4695a643036bb5223916" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:31.529071 10964 raft_consensus.cc:2393] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10307244fcd642b89723e4fb4ac1291a in current term 1: Already voted for candidate 348b268fc1da46ac98e10bbe776b018b in this term.
I20260709 13:19:31.530992 11084 tablet_bootstrap.cc:654] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:31.531273 11034 raft_consensus.cc:2393] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 348b268fc1da46ac98e10bbe776b018b in current term 1: Already voted for candidate 10307244fcd642b89723e4fb4ac1291a in this term.
I20260709 13:19:31.532292 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0005319a469f4f4e993fa7679707faa5" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:31.532744 11085 tablet_bootstrap.cc:654] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:31.532829 11034 raft_consensus.cc:3060] T 0005319a469f4f4e993fa7679707faa5 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:31.535207 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a060d27b9f4695a643036bb5223916" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:31.499691 11304 consensus_queue.cc:1048] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 13:19:31.542178 10812 raft_consensus.cc:2468] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:31.550012 11201 consensus_queue.cc:1048] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:31.557133 11473 raft_consensus.cc:493] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.557672 11473 raft_consensus.cc:515] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:31.558346 11095 raft_consensus.cc:515] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:31.559176 11086 tablet_bootstrap.cc:492] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:31.559695 11086 ts_tablet_manager.cc:1403] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.154s	user 0.021s	sys 0.008s
I20260709 13:19:31.560384 10886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3926cff4dd4248bf3731e550fd2356" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
W20260709 13:19:31.561833 10779 leader_election.cc:343] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:31.567106 11448 consensus_queue.cc:1048] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:19:31.568310 11004 leader_election.cc:304] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:31.568905 10811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0005319a469f4f4e993fa7679707faa5" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:31.569430 11396 raft_consensus.cc:2749] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:31.569599 10811 raft_consensus.cc:3060] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:31.564661 11095 leader_election.cc:290] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:31.581395 11379 leader_election.cc:290] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:31.553033 11471 consensus_queue.cc:1048] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:19:31.579382 10930 leader_election.cc:304] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:31.599956 11379 consensus_queue.cc:1048] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:31.601994 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3926cff4dd4248bf3731e550fd2356" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:31.603180 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
W20260709 13:19:31.608451 10780 leader_election.cc:343] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:31.608879 10780 leader_election.cc:304] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:31.610368 11210 raft_consensus.cc:2749] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:31.633607 10930 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 54305.7us
I20260709 13:19:31.585000 11034 raft_consensus.cc:2468] T 0005319a469f4f4e993fa7679707faa5 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:31.637449 11401 raft_consensus.cc:2804] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:31.644972 11401 raft_consensus.cc:697] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:31.645911 11401 consensus_queue.cc:237] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:31.600957 10811 raft_consensus.cc:2468] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:31.658713 11473 leader_election.cc:290] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:31.659011 10886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:31.659646 10886 raft_consensus.cc:3060] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:31.654249 11086 raft_consensus.cc:359] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:31.662070 11086 raft_consensus.cc:385] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:31.662484 11086 raft_consensus.cc:740] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.666581 10961 raft_consensus.cc:3060] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:31.667239 10856 leader_election.cc:304] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:31.678109 11379 raft_consensus.cc:2804] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:31.678699 11379 raft_consensus.cc:697] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:31.679752 11447 consensus_queue.cc:1048] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:31.679667 11379 consensus_queue.cc:237] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:31.684960 11086 consensus_queue.cc:260] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:31.690356 11086 ts_tablet_manager.cc:1434] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.130s	user 0.009s	sys 0.000s
W20260709 13:19:31.699512 10760 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:31.715245 11086 tablet_bootstrap.cc:492] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:31.718405 11462 consensus_queue.cc:1048] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:19:31.719421 11084 tablet_bootstrap.cc:492] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:31.738401 11084 ts_tablet_manager.cc:1403] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.287s	user 0.015s	sys 0.019s
I20260709 13:19:31.752162 11083 tablet_bootstrap.cc:492] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:31.752853 11083 ts_tablet_manager.cc:1403] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.322s	user 0.015s	sys 0.017s
I20260709 13:19:31.770162 11085 tablet_bootstrap.cc:492] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:31.770910 11085 ts_tablet_manager.cc:1403] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.344s	user 0.017s	sys 0.011s
W20260709 13:19:31.791684 10855 consensus_peers.cc:597] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Couldn't send request to peer 348b268fc1da46ac98e10bbe776b018b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:31.774727 11083 raft_consensus.cc:359] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:31.811021 11083 raft_consensus.cc:385] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:31.811396 11083 raft_consensus.cc:740] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.823549 10886 raft_consensus.cc:2468] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 3.
I20260709 13:19:31.812286 11083 consensus_queue.cc:260] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:31.837112 10779 leader_election.cc:304] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:31.846438 11085 raft_consensus.cc:359] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:31.847299 11095 raft_consensus.cc:2804] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:31.847505 11085 raft_consensus.cc:385] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:31.849150 11085 raft_consensus.cc:740] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.850257 11095 raft_consensus.cc:697] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:31.844672 11084 raft_consensus.cc:359] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:31.850911 11084 raft_consensus.cc:385] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:31.851193 11084 raft_consensus.cc:740] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.831581 10709 catalog_manager.cc:5697] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.851280 11095 consensus_queue.cc:237] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:31.853536 11201 raft_consensus.cc:493] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.853106 11083 ts_tablet_manager.cc:1434] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.100s	user 0.004s	sys 0.004s
I20260709 13:19:31.853855 11084 consensus_queue.cc:260] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:31.854027 11201 raft_consensus.cc:515] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:31.842988 10887 raft_consensus.cc:1240] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Rejecting Update request from peer 348b268fc1da46ac98e10bbe776b018b for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:31.851329 11085 consensus_queue.cc:260] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:31.855484 11086 tablet_bootstrap.cc:654] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:31.861593 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585cc3c8fea2482e99b321de3dc98356" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:31.862146 11238 consensus_queue.cc:1048] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:31.863106 11401 consensus_queue.cc:1059] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:31.864099 11401 raft_consensus.cc:3055] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:31.864414 11401 raft_consensus.cc:740] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:31.865418 11401 consensus_queue.cc:260] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:31.857681 11201 leader_election.cc:290] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:31.857833 11083 tablet_bootstrap.cc:492] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:31.866605 11401 raft_consensus.cc:3060] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:31.855075 10709 catalog_manager.cc:5697] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:31.875025 11085 ts_tablet_manager.cc:1434] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.002s
I20260709 13:19:31.877524 11084 ts_tablet_manager.cc:1434] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.139s	user 0.004s	sys 0.007s
I20260709 13:19:31.878865 11084 tablet_bootstrap.cc:492] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:31.859283 11304 raft_consensus.cc:493] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.904781 11085 tablet_bootstrap.cc:492] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:31.904062 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585cc3c8fea2482e99b321de3dc98356" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:31.928119 11086 tablet_bootstrap.cc:492] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:31.912724 10813 raft_consensus.cc:1240] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Rejecting Update request from peer 348b268fc1da46ac98e10bbe776b018b for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:31.929044 11086 ts_tablet_manager.cc:1403] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.216s	user 0.016s	sys 0.015s
I20260709 13:19:31.903445 11304 raft_consensus.cc:515] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:31.930094 11085 tablet_bootstrap.cc:654] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:31.931640 11304 leader_election.cc:290] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:31.934309 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df06b225878d49589732d38cda773b7e" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
W20260709 13:19:31.936190 11003 leader_election.cc:343] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:31.936352 10928 leader_election.cc:304] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:31.937229 11401 raft_consensus.cc:2749] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:31.940797 11084 tablet_bootstrap.cc:654] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:31.966660 11086 raft_consensus.cc:359] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:31.967445 11086 raft_consensus.cc:385] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:31.967741 11086 raft_consensus.cc:740] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.968823 11086 consensus_queue.cc:260] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:31.972375 11086 ts_tablet_manager.cc:1434] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.003s
I20260709 13:19:31.973285 11462 raft_consensus.cc:493] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.973644 10811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df06b225878d49589732d38cda773b7e" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:31.974161 11462 raft_consensus.cc:515] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:31.974669 10811 raft_consensus.cc:2468] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:31.976259 11462 leader_election.cc:290] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:31.977006 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd727bd3f64651b8e9d3dae0169166" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:31.977313 11086 tablet_bootstrap.cc:492] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
W20260709 13:19:31.978526 10855 leader_election.cc:343] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:31.982973 11086 tablet_bootstrap.cc:654] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:31.993489 11004 leader_election.cc:304] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:32.001257 11304 raft_consensus.cc:2804] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:32.001773 11304 raft_consensus.cc:493] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.002228 11304 raft_consensus.cc:3060] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:31.991708 10712 catalog_manager.cc:5697] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 2 to 3, leader changed from 348b268fc1da46ac98e10bbe776b018b (127.1.250.67) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:32.014178 11352 raft_consensus.cc:493] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.014947 11352 raft_consensus.cc:515] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.017251 11352 leader_election.cc:290] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:32.019373 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904c45fa164407791817b45928f663e" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
W20260709 13:19:32.020963 10855 leader_election.cc:343] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:32.021350 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd727bd3f64651b8e9d3dae0169166" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:32.023317 10854 leader_election.cc:343] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:32.023510 11083 tablet_bootstrap.cc:654] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:32.023909 10854 leader_election.cc:304] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:32.029924 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904c45fa164407791817b45928f663e" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:32.031862 10813 raft_consensus.cc:2468] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:32.035775 10856 leader_election.cc:304] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:32.036512 11463 raft_consensus.cc:2804] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:32.036870 11463 raft_consensus.cc:493] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.037225 11463 raft_consensus.cc:3060] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.030287 11352 raft_consensus.cc:2749] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:32.051453 11304 raft_consensus.cc:515] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:32.054723 11463 raft_consensus.cc:515] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.056022 10812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df06b225878d49589732d38cda773b7e" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:32.061479 10812 raft_consensus.cc:3060] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.056648 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df06b225878d49589732d38cda773b7e" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:32.062254 11084 tablet_bootstrap.cc:492] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:32.064577 11084 ts_tablet_manager.cc:1403] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.186s	user 0.006s	sys 0.011s
I20260709 13:19:32.063232 11304 leader_election.cc:290] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:32.068796 11463 leader_election.cc:290] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:32.069778 10811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904c45fa164407791817b45928f663e" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
W20260709 13:19:32.073812 11003 leader_election.cc:343] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:32.075178 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904c45fa164407791817b45928f663e" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:32.075809 11084 raft_consensus.cc:359] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:32.074766 10811 raft_consensus.cc:3060] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.077454 11084 raft_consensus.cc:385] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:32.077857 11084 raft_consensus.cc:740] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:32.078640 11084 consensus_queue.cc:260] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:32.079600 11085 tablet_bootstrap.cc:492] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:32.081861 11085 ts_tablet_manager.cc:1403] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.177s	user 0.040s	sys 0.057s
I20260709 13:19:32.082587 11084 ts_tablet_manager.cc:1434] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
W20260709 13:19:32.082659 10855 leader_election.cc:343] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:32.083882 11086 tablet_bootstrap.cc:492] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:32.083977 11084 tablet_bootstrap.cc:492] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:32.084508 11086 ts_tablet_manager.cc:1403] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.107s	user 0.018s	sys 0.015s
I20260709 13:19:32.089229 11352 consensus_queue.cc:1048] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:32.088011 10811 raft_consensus.cc:2468] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:32.090904 10856 leader_election.cc:304] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:32.091212 11086 raft_consensus.cc:359] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.091907 11086 raft_consensus.cc:385] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:32.092168 11086 raft_consensus.cc:740] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:32.092326 11379 raft_consensus.cc:2804] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:32.092875 11379 raft_consensus.cc:697] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:32.093832 11085 raft_consensus.cc:359] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:32.094605 11085 raft_consensus.cc:385] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:32.094894 11085 raft_consensus.cc:740] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:32.094995 11379 consensus_queue.cc:237] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.095706 11085 consensus_queue.cc:260] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:32.092862 11086 consensus_queue.cc:260] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.101156 11086 ts_tablet_manager.cc:1434] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:19:32.102414 11086 tablet_bootstrap.cc:492] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:32.104288 11085 ts_tablet_manager.cc:1434] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:19:32.105346 11085 tablet_bootstrap.cc:492] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:32.105492 11084 tablet_bootstrap.cc:654] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:32.119414 11083 tablet_bootstrap.cc:492] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:32.120205 11083 ts_tablet_manager.cc:1403] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.266s	user 0.016s	sys 0.002s
I20260709 13:19:32.120754 10812 raft_consensus.cc:2468] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:32.126955 11004 leader_election.cc:304] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:32.126758 11083 raft_consensus.cc:359] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:32.127550 11083 raft_consensus.cc:385] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:32.127831 11083 raft_consensus.cc:740] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:32.128162 11445 raft_consensus.cc:2804] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:32.128687 11445 raft_consensus.cc:697] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:32.129601 11445 consensus_queue.cc:237] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:32.133955 11463 raft_consensus.cc:493] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.134497 11463 raft_consensus.cc:515] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.136658 11463 leader_election.cc:290] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:32.137777 11086 tablet_bootstrap.cc:654] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:32.138019 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3926cff4dd4248bf3731e550fd2356" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:32.138327 10811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3926cff4dd4248bf3731e550fd2356" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:32.139149 10811 raft_consensus.cc:2468] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
W20260709 13:19:32.139858 10855 leader_election.cc:343] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:32.140540 10856 leader_election.cc:304] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:32.146373 11463 raft_consensus.cc:2804] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:32.147800 11463 raft_consensus.cc:493] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.148155 11463 raft_consensus.cc:3060] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.146777 11083 consensus_queue.cc:260] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:32.156602 11083 ts_tablet_manager.cc:1434] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.004s
I20260709 13:19:32.157804 11083 tablet_bootstrap.cc:492] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:32.193993 11085 tablet_bootstrap.cc:654] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:32.199441 11401 consensus_queue.cc:1048] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:32.202806 11084 tablet_bootstrap.cc:492] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:32.203325 11084 ts_tablet_manager.cc:1403] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.120s	user 0.017s	sys 0.005s
I20260709 13:19:32.206986 11084 raft_consensus.cc:359] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:32.207646 11084 raft_consensus.cc:385] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:32.207899 11084 raft_consensus.cc:740] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:32.209959 10713 catalog_manager.cc:5697] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 0 to 1, leader changed from <none> to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 1 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:32.210986 11084 consensus_queue.cc:260] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:32.223585 11084 ts_tablet_manager.cc:1434] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:19:32.224045 11352 consensus_queue.cc:1048] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:32.224488 11084 tablet_bootstrap.cc:492] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:32.223608 11401 consensus_queue.cc:1048] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:32.213609 11463 raft_consensus.cc:515] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.247515 11471 raft_consensus.cc:493] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.256150 11471 raft_consensus.cc:515] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:32.259251 11086 tablet_bootstrap.cc:492] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:32.260732 11086 ts_tablet_manager.cc:1403] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.158s	user 0.020s	sys 0.003s
I20260709 13:19:32.273782 11201 raft_consensus.cc:493] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.274377 11201 raft_consensus.cc:515] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:32.278601 11083 tablet_bootstrap.cc:654] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:32.280009 11084 tablet_bootstrap.cc:654] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:32.280427 11086 raft_consensus.cc:359] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:32.281203 11086 raft_consensus.cc:385] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:32.281469 11086 raft_consensus.cc:740] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:32.282158 11086 consensus_queue.cc:260] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:32.293704 11201 leader_election.cc:290] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:32.295363 11085 tablet_bootstrap.cc:492] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:32.296059 11085 ts_tablet_manager.cc:1403] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.191s	user 0.011s	sys 0.006s
I20260709 13:19:32.286334 11462 raft_consensus.cc:493] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.312500 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df06b225878d49589732d38cda773b7e" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:32.315362 11463 leader_election.cc:290] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:32.316627 11086 ts_tablet_manager.cc:1434] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:19:32.316816 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3926cff4dd4248bf3731e550fd2356" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:32.317508 10815 raft_consensus.cc:3060] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.317683 11086 tablet_bootstrap.cc:492] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:32.314515 11462 raft_consensus.cc:515] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:32.320360 11462 leader_election.cc:290] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:32.322808 11085 raft_consensus.cc:359] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:32.323119 10812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:32.323541 11085 raft_consensus.cc:385] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:32.323892 11085 raft_consensus.cc:740] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:32.324652 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:32.324741 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3926cff4dd4248bf3731e550fd2356" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:32.325392 10888 raft_consensus.cc:2468] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:32.317740 11471 leader_election.cc:290] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
W20260709 13:19:32.326519 10855 leader_election.cc:343] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:32.314345 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df06b225878d49589732d38cda773b7e" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:32.327422 10779 leader_election.cc:304] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:32.327955 10813 raft_consensus.cc:2393] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 348b268fc1da46ac98e10bbe776b018b in current term 1: Already voted for candidate 10307244fcd642b89723e4fb4ac1291a in this term.
I20260709 13:19:32.323840 10812 raft_consensus.cc:2468] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:32.324715 11085 consensus_queue.cc:260] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:32.332033 10930 leader_election.cc:304] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:32.343324 10886 raft_consensus.cc:1275] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:32.341567 11447 raft_consensus.cc:3060] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.345067 11095 consensus_queue.cc:1048] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:32.346151 10961 raft_consensus.cc:3060] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.349217 10815 raft_consensus.cc:2468] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:32.355235 10856 leader_election.cc:304] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:32.357623 11083 tablet_bootstrap.cc:492] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:32.359268 11083 ts_tablet_manager.cc:1403] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.202s	user 0.020s	sys 0.014s
I20260709 13:19:32.361069 11396 raft_consensus.cc:493] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.362421 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:32.362773 11396 raft_consensus.cc:515] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:32.364271 11462 raft_consensus.cc:2804] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:32.364822 11462 raft_consensus.cc:697] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:32.365531 11032 raft_consensus.cc:2468] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:32.341874 11387 raft_consensus.cc:2804] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:32.365972 11462 consensus_queue.cc:237] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.362246 11084 tablet_bootstrap.cc:492] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:32.361403 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:32.369323 11086 tablet_bootstrap.cc:654] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:32.367835 11084 ts_tablet_manager.cc:1403] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.144s	user 0.008s	sys 0.007s
I20260709 13:19:32.371622 11085 ts_tablet_manager.cc:1434] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.001s
I20260709 13:19:32.373807 11085 tablet_bootstrap.cc:492] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:32.377910 10710 catalog_manager.cc:5697] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 1 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:32.365017 11396 leader_election.cc:290] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:32.384100 10856 leader_election.cc:304] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:32.386791 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:32.387223 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:32.387427 10887 raft_consensus.cc:2468] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:32.387866 10815 raft_consensus.cc:2468] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:32.388207 11352 raft_consensus.cc:2804] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:32.388585 11352 raft_consensus.cc:493] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.388906 11352 raft_consensus.cc:3060] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.389256 11387 raft_consensus.cc:493] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.389595 11387 raft_consensus.cc:3060] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.389974 11004 leader_election.cc:304] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:32.390753 11304 raft_consensus.cc:2804] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:32.391112 11304 raft_consensus.cc:493] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.391424 11304 raft_consensus.cc:3060] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.412652 11447 raft_consensus.cc:2749] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:32.422310 11084 raft_consensus.cc:359] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.439556 11084 raft_consensus.cc:385] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:32.439966 11084 raft_consensus.cc:740] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:32.435098 10963 raft_consensus.cc:1275] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:19:32.443841 10963 pending_rounds.cc:85] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b: Aborting all ops after (but not including) 1
I20260709 13:19:32.440618 11095 raft_consensus.cc:493] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.434569 11085 tablet_bootstrap.cc:654] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:32.416726 11083 raft_consensus.cc:359] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
W20260709 13:19:32.445431 11515 log.cc:927] Time spent T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:19:32.444005 11084 consensus_queue.cc:260] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.457656 11084 ts_tablet_manager.cc:1434] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.002s
I20260709 13:19:32.458178 11095 raft_consensus.cc:515] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:32.458793 11083 raft_consensus.cc:385] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:32.468930 11083 raft_consensus.cc:740] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:32.462270 11304 raft_consensus.cc:515] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:32.472601 11083 consensus_queue.cc:260] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.489398 11083 ts_tablet_manager.cc:1434] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.121s	user 0.008s	sys 0.000s
I20260709 13:19:32.467882 11085 tablet_bootstrap.cc:492] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:32.490151 11085 ts_tablet_manager.cc:1403] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.000s
I20260709 13:19:32.490545 11304 leader_election.cc:290] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:32.469379 11084 tablet_bootstrap.cc:492] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
W20260709 13:19:32.447932 11510 log.cc:927] Time spent T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:19:32.475059 11095 leader_election.cc:290] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:32.469188 10963 pending_rounds.cc:107] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:19:32.476390 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc701e5f842459cb7e7469da45a4132" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:32.481175 11086 tablet_bootstrap.cc:492] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:32.481550 11352 raft_consensus.cc:515] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:32.486330 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc701e5f842459cb7e7469da45a4132" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:32.493065 11085 raft_consensus.cc:359] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:32.499111 11352 leader_election.cc:290] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:32.493675 10886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:32.503033 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:32.503544 11085 raft_consensus.cc:385] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:32.497406 10780 leader_election.cc:343] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:32.503238 10886 raft_consensus.cc:2393] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10307244fcd642b89723e4fb4ac1291a in current term 1: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
I20260709 13:19:32.505251 11085 raft_consensus.cc:740] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:32.498422 11463 consensus_queue.cc:1048] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:19:32.495880 10963 raft_consensus.cc:2889] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:32.496922 11086 ts_tablet_manager.cc:1403] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.179s	user 0.032s	sys 0.043s
I20260709 13:19:32.503888 11034 raft_consensus.cc:2393] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 02260b9a864a4665ae3c33869adeaaf5 in current term 1: Already voted for candidate 10307244fcd642b89723e4fb4ac1291a in this term.
I20260709 13:19:32.506273 11085 consensus_queue.cc:260] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:32.508900 11032 raft_consensus.cc:2468] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:32.512502 11085 ts_tablet_manager.cc:1434] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:19:32.513588 11085 tablet_bootstrap.cc:492] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:32.514658 10811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:32.516052 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:32.465260 11387 raft_consensus.cc:515] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:32.517758 10811 raft_consensus.cc:2393] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 02260b9a864a4665ae3c33869adeaaf5 in current term 1: Already voted for candidate d726aaf867ea423fa4efe8a15d1896d1 in this term.
I20260709 13:19:32.521034 11387 leader_election.cc:290] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:32.521185 11473 consensus_queue.cc:1048] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:19:32.526716 11086 raft_consensus.cc:359] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.527534 11086 raft_consensus.cc:385] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:32.527802 11086 raft_consensus.cc:740] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:32.528753 11004 leader_election.cc:304] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:32.529642 11448 raft_consensus.cc:2749] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:32.464026 10712 catalog_manager.cc:5697] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:32.535710 11303 raft_consensus.cc:493] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.536334 11303 raft_consensus.cc:515] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:32.539953 11303 leader_election.cc:290] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:32.528566 11086 consensus_queue.cc:260] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.548063 11086 ts_tablet_manager.cc:1434] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260709 13:19:32.540741 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd727bd3f64651b8e9d3dae0169166" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:32.541528 10779 leader_election.cc:304] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:32.545648 11084 tablet_bootstrap.cc:654] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:32.521968 10856 leader_election.cc:304] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
W20260709 13:19:32.554396 11003 leader_election.cc:343] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:32.556207 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
W20260709 13:19:32.597719 10856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 75839.7us
I20260709 13:19:32.598453 11032 raft_consensus.cc:2393] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d726aaf867ea423fa4efe8a15d1896d1 in current term 1: Already voted for candidate 10307244fcd642b89723e4fb4ac1291a in this term.
I20260709 13:19:32.557518 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:32.599895 10887 raft_consensus.cc:2393] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d726aaf867ea423fa4efe8a15d1896d1 in current term 1: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
I20260709 13:19:32.558480 11387 raft_consensus.cc:2804] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:32.601032 11387 raft_consensus.cc:493] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.601395 11387 raft_consensus.cc:3060] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.602779 11084 tablet_bootstrap.cc:492] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1: No bootstrap required, opened a new log
I20260709 13:19:32.570714 11085 tablet_bootstrap.cc:654] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:32.601536 10779 leader_election.cc:304] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:32.605711 11329 raft_consensus.cc:2749] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:32.521934 11083 tablet_bootstrap.cc:492] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:32.611599 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd727bd3f64651b8e9d3dae0169166" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:32.612393 10887 raft_consensus.cc:2468] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:32.603307 11084 ts_tablet_manager.cc:1403] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.134s	user 0.008s	sys 0.015s
I20260709 13:19:32.616101 11084 raft_consensus.cc:359] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:32.616858 11084 raft_consensus.cc:385] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:32.617202 11084 raft_consensus.cc:740] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:32.617930 11084 consensus_queue.cc:260] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:32.620121 11084 ts_tablet_manager.cc:1434] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:19:32.602370 11379 raft_consensus.cc:2749] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:32.627969 11083 tablet_bootstrap.cc:654] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:32.642786 10961 raft_consensus.cc:3060] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.549054 11086 tablet_bootstrap.cc:492] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
I20260709 13:19:32.668605 11303 consensus_queue.cc:1048] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:32.626844 11387 raft_consensus.cc:515] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:32.684250 11085 tablet_bootstrap.cc:492] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:32.684778 11085 ts_tablet_manager.cc:1403] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.171s	user 0.007s	sys 0.004s
I20260709 13:19:32.685060 11304 consensus_queue.cc:1048] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:32.686957 11387 leader_election.cc:290] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:32.688094 11002 leader_election.cc:304] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:32.688908 11304 raft_consensus.cc:2804] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:32.689317 11304 raft_consensus.cc:493] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.689646 11304 raft_consensus.cc:3060] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.699652 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc701e5f842459cb7e7469da45a4132" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:32.711043 11304 raft_consensus.cc:515] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:32.719887 11304 leader_election.cc:290] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:32.715939 11086 tablet_bootstrap.cc:654] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:32.721566 10959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd727bd3f64651b8e9d3dae0169166" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
W20260709 13:19:32.723202 11003 leader_election.cc:343] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:32.732316 11329 raft_consensus.cc:493] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.733042 11329 raft_consensus.cc:515] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
W20260709 13:19:32.820003 11524 log.cc:927] Time spent T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:19:32.825488 11085 raft_consensus.cc:359] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:32.829252 11085 raft_consensus.cc:385] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:32.829684 11085 raft_consensus.cc:740] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
W20260709 13:19:32.833478 10855 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 65917.9us
I20260709 13:19:32.833580 11085 consensus_queue.cc:260] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:32.832728 11329 leader_election.cc:290] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:32.840276 10886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd727bd3f64651b8e9d3dae0169166" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:32.841015 10886 raft_consensus.cc:3060] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.848825 10709 catalog_manager.cc:5697] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:32.850564 11095 raft_consensus.cc:493] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.851259 11095 raft_consensus.cc:515] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.853372 11095 leader_election.cc:290] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:32.859277 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc701e5f842459cb7e7469da45a4132" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:32.860116 11036 raft_consensus.cc:3060] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.869761 11095 raft_consensus.cc:493] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.870724 11095 raft_consensus.cc:515] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:32.874369 11095 leader_election.cc:290] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:32.878645 11447 raft_consensus.cc:493] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.879204 11447 raft_consensus.cc:515] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.883356 11447 leader_election.cc:290] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
W20260709 13:19:32.884227 10930 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 118304us
W20260709 13:19:32.883240 10780 leader_election.cc:343] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:32.885713 10780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 106800us
I20260709 13:19:32.887820 11085 ts_tablet_manager.cc:1434] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.203s	user 0.007s	sys 0.002s
W20260709 13:19:32.888841 10855 consensus_peers.cc:597] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Couldn't send request to peer 348b268fc1da46ac98e10bbe776b018b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.891297 11085 tablet_bootstrap.cc:492] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:32.891554 11238 consensus_queue.cc:1048] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:19:32.902585 10962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:32.901959 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0223927df5f442079c8fa526ed7eef26" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:32.907524 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904c45fa164407791817b45928f663e" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
W20260709 13:19:32.911356 10780 leader_election.cc:343] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:32.927384 10780 leader_election.cc:343] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:32.892118 10886 raft_consensus.cc:2468] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:32.945487 11002 leader_election.cc:304] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:32.946846 10812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904c45fa164407791817b45928f663e" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:32.948199 11396 raft_consensus.cc:2804] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:32.948772 11396 raft_consensus.cc:697] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:32.949733 11396 consensus_queue.cc:237] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:32.951854 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0223927df5f442079c8fa526ed7eef26" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:32.953873 10882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:32.957597 10883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b6e17edd7f4c618e7260d4e3a65f8a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:32.957877 11238 consensus_queue.cc:1048] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:32.929420 11379 raft_consensus.cc:493] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.969416 11379 raft_consensus.cc:515] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:32.971789 11379 leader_election.cc:290] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:32.972527 10813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:32.973306 10813 raft_consensus.cc:2468] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:32.973604 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:32.974439 10856 leader_election.cc:304] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
W20260709 13:19:32.975325 10855 leader_election.cc:343] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:32.975975 10882 raft_consensus.cc:2468] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:32.979768 11463 raft_consensus.cc:2804] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:32.980192 11463 raft_consensus.cc:493] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.980355 11034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b6e17edd7f4c618e7260d4e3a65f8a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:32.982306 10760 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:19:32.982416 10779 leader_election.cc:343] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:32.982900 10779 leader_election.cc:304] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:32.983872 11387 raft_consensus.cc:2749] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:32.980578 11463 raft_consensus.cc:3060] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:32.985245 11034 raft_consensus.cc:2468] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 0.
I20260709 13:19:32.996176 11086 tablet_bootstrap.cc:492] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:32.996688 11086 ts_tablet_manager.cc:1403] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.448s	user 0.013s	sys 0.017s
I20260709 13:19:33.002084 11086 raft_consensus.cc:359] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:33.002888 11086 raft_consensus.cc:385] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.003170 11086 raft_consensus.cc:740] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.003813 11086 consensus_queue.cc:260] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:33.012480 11463 raft_consensus.cc:515] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:33.016315 11036 raft_consensus.cc:2468] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
W20260709 13:19:33.018113 10779 leader_election.cc:343] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:33.019073 10779 leader_election.cc:304] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:33.020376 11387 raft_consensus.cc:2804] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:33.020741 11387 raft_consensus.cc:493] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.021054 11387 raft_consensus.cc:3060] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.026757 11463 leader_election.cc:290] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:33.027534 10811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:33.027784 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:33.032296 11083 tablet_bootstrap.cc:492] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:33.040436 11085 tablet_bootstrap.cc:654] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.041494 11083 ts_tablet_manager.cc:1403] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.520s	user 0.017s	sys 0.003s
I20260709 13:19:33.043975 11086 ts_tablet_manager.cc:1434] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
W20260709 13:19:33.048568 10928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 136006us
W20260709 13:19:33.053857 10855 leader_election.cc:343] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:33.049750 10928 leader_election.cc:304] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:33.055395 11201 raft_consensus.cc:2749] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:33.064247 11086 tablet_bootstrap.cc:492] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5: Bootstrap starting.
W20260709 13:19:33.073017 10779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 53990.5us
I20260709 13:19:33.072860 11083 raft_consensus.cc:359] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:33.073745 11083 raft_consensus.cc:385] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.074045 11083 raft_consensus.cc:740] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.074702 11083 consensus_queue.cc:260] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:33.082396 11352 raft_consensus.cc:493] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.083007 11352 raft_consensus.cc:515] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:33.085970 10779 leader_election.cc:304] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5
I20260709 13:19:33.114004 10779 leader_election.cc:304] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:33.114826 11533 raft_consensus.cc:2804] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:33.115482 11533 raft_consensus.cc:493] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.115909 11533 raft_consensus.cc:3060] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.123121 11083 ts_tablet_manager.cc:1434] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.081s	user 0.011s	sys 0.009s
I20260709 13:19:33.127971 11083 tablet_bootstrap.cc:492] T 4a3926cff4dd4248bf3731e550fd2356 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:33.128341 11095 raft_consensus.cc:2804] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:33.176265 11085 tablet_bootstrap.cc:492] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:33.176993 11085 ts_tablet_manager.cc:1403] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.288s	user 0.012s	sys 0.005s
I20260709 13:19:33.181047 11083 tablet_bootstrap.cc:654] T 4a3926cff4dd4248bf3731e550fd2356 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:33.217649 10930 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 140624us
I20260709 13:19:33.219861 11095 raft_consensus.cc:697] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:33.221175 11095 consensus_queue.cc:237] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
W20260709 13:19:33.239539 10779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 120735us
I20260709 13:19:33.247238 11352 leader_election.cc:290] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
W20260709 13:19:33.338431 10855 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 113977us
I20260709 13:19:33.338811 11033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b6e17edd7f4c618e7260d4e3a65f8a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:33.348621 11533 raft_consensus.cc:515] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:33.375403 11085 raft_consensus.cc:359] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:33.376207 11085 raft_consensus.cc:385] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.380103 11085 raft_consensus.cc:740] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.350274 11387 raft_consensus.cc:515] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:33.382052 11085 consensus_queue.cc:260] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:33.391723 11083 tablet_bootstrap.cc:492] T 4a3926cff4dd4248bf3731e550fd2356 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:33.392280 11083 ts_tablet_manager.cc:1403] T 4a3926cff4dd4248bf3731e550fd2356 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.266s	user 0.029s	sys 0.046s
I20260709 13:19:33.379092 11033 raft_consensus.cc:2468] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 0.
I20260709 13:19:33.408401 11201 raft_consensus.cc:493] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.397017 11085 ts_tablet_manager.cc:1434] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.220s	user 0.007s	sys 0.000s
I20260709 13:19:33.414348 11201 raft_consensus.cc:515] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:33.417692 11085 tablet_bootstrap.cc:492] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a: Bootstrap starting.
I20260709 13:19:33.406694 11083 raft_consensus.cc:359] T 4a3926cff4dd4248bf3731e550fd2356 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
W20260709 13:19:33.418464 10780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 138499us
I20260709 13:19:33.418704 11083 raft_consensus.cc:385] T 4a3926cff4dd4248bf3731e550fd2356 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.419018 11083 raft_consensus.cc:740] T 4a3926cff4dd4248bf3731e550fd2356 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.419734 11083 consensus_queue.cc:260] T 4a3926cff4dd4248bf3731e550fd2356 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:33.433663 11086 tablet_bootstrap.cc:654] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.446668 11201 leader_election.cc:290] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
W20260709 13:19:33.447218 10779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 47122.7us
I20260709 13:19:33.460388 11085 tablet_bootstrap.cc:654] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.461539 11387 leader_election.cc:290] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:33.461431 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b6e17edd7f4c618e7260d4e3a65f8a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:33.462805 11038 raft_consensus.cc:3060] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.450853 10811 raft_consensus.cc:2393] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 02260b9a864a4665ae3c33869adeaaf5 in current term 1: Already voted for candidate d726aaf867ea423fa4efe8a15d1896d1 in this term.
I20260709 13:19:33.479007 11038 raft_consensus.cc:2468] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:33.481491 11083 ts_tablet_manager.cc:1434] T 4a3926cff4dd4248bf3731e550fd2356 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.089s	user 0.023s	sys 0.007s
I20260709 13:19:33.484705 11083 tablet_bootstrap.cc:492] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:33.495308 10854 leader_election.cc:304] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:33.467267 11533 leader_election.cc:290] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
W20260709 13:19:33.527608 10780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 60657.6us
I20260709 13:19:33.538493 11086 tablet_bootstrap.cc:492] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5: No bootstrap required, opened a new log
I20260709 13:19:33.539232 11086 ts_tablet_manager.cc:1403] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5: Time spent bootstrapping tablet: real 0.493s	user 0.012s	sys 0.012s
W20260709 13:19:33.546027 11552 log.cc:927] Time spent T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:19:33.543779 11003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 50342.6us
I20260709 13:19:33.560364 10959 raft_consensus.cc:3060] T 4a3926cff4dd4248bf3731e550fd2356 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.502218 11379 raft_consensus.cc:2804] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:33.561836 11379 raft_consensus.cc:493] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.562232 11379 raft_consensus.cc:3060] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.564976 10709 catalog_manager.cc:5697] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 1 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:33.568120 10958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:33.573407 11303 raft_consensus.cc:493] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.574000 11303 raft_consensus.cc:515] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
W20260709 13:19:33.580711 10779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:44237, user_credentials={real_user=slave}} blocked reactor thread for 45361.5us
I20260709 13:19:33.581804 10779 leader_election.cc:304] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:33.582473 11303 leader_election.cc:290] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:33.583472 11086 raft_consensus.cc:359] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:33.588985 11086 raft_consensus.cc:385] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.590463 11086 raft_consensus.cc:740] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.602357 10814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0223927df5f442079c8fa526ed7eef26" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:33.603413 10814 raft_consensus.cc:2468] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:33.604948 11086 consensus_queue.cc:260] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
W20260709 13:19:33.606501 10856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 57183us
W20260709 13:19:33.602228 10780 leader_election.cc:343] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:33.612243 10963 raft_consensus.cc:3060] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.613109 11004 leader_election.cc:304] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:33.619019 10856 leader_election.cc:304] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:33.619755 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd727bd3f64651b8e9d3dae0169166" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:33.620631 10887 raft_consensus.cc:2393] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 348b268fc1da46ac98e10bbe776b018b in current term 1: Already voted for candidate 10307244fcd642b89723e4fb4ac1291a in this term.
I20260709 13:19:33.621462 11558 raft_consensus.cc:2749] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:33.622037 11303 raft_consensus.cc:2804] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:33.622574 11303 raft_consensus.cc:493] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.623042 11303 raft_consensus.cc:3060] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.606423 11387 raft_consensus.cc:2804] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:33.625267 11387 raft_consensus.cc:697] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:33.626214 11387 consensus_queue.cc:237] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:33.635931 11379 raft_consensus.cc:515] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:33.650645 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b6e17edd7f4c618e7260d4e3a65f8a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:33.658684 11303 raft_consensus.cc:515] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:33.661099 11303 leader_election.cc:290] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:33.662326 10957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0223927df5f442079c8fa526ed7eef26" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:33.664640 11543 raft_consensus.cc:493] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.665202 11543 raft_consensus.cc:515] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:33.666126 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b6e17edd7f4c618e7260d4e3a65f8a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:33.666666 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:33.667588 10887 raft_consensus.cc:2393] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d726aaf867ea423fa4efe8a15d1896d1 in current term 1: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
I20260709 13:19:33.666184 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd727bd3f64651b8e9d3dae0169166" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:33.667594 11543 leader_election.cc:290] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:33.669186 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d3cc9c0f484ffd9e1b216fa14990e8" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
W20260709 13:19:33.672384 10855 leader_election.cc:343] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:33.673321 11083 tablet_bootstrap.cc:654] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.680367 11531 consensus_queue.cc:1048] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:33.683588 11086 ts_tablet_manager.cc:1434] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5: Time spent starting tablet: real 0.144s	user 0.008s	sys 0.000s
I20260709 13:19:33.685745 10890 raft_consensus.cc:2393] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d726aaf867ea423fa4efe8a15d1896d1 in current term 1: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
I20260709 13:19:33.696331 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d3cc9c0f484ffd9e1b216fa14990e8" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:33.710841 10854 leader_election.cc:343] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:33.711409 10854 leader_election.cc:304] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:33.712553 11462 raft_consensus.cc:2749] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:33.718818 11035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b6e17edd7f4c618e7260d4e3a65f8a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:33.720148 11035 raft_consensus.cc:2393] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 02260b9a864a4665ae3c33869adeaaf5 in current term 1: Already voted for candidate d726aaf867ea423fa4efe8a15d1896d1 in this term.
I20260709 13:19:33.727872 11085 tablet_bootstrap.cc:492] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a: No bootstrap required, opened a new log
I20260709 13:19:33.728475 11085 ts_tablet_manager.cc:1403] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a: Time spent bootstrapping tablet: real 0.311s	user 0.024s	sys 0.016s
I20260709 13:19:33.698554 11531 consensus_queue.cc:1048] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260709 13:19:33.747018 11379 leader_election.cc:290] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:33.750804 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0223927df5f442079c8fa526ed7eef26" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:33.760257 11085 raft_consensus.cc:359] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:33.761271 11085 raft_consensus.cc:385] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.761557 11085 raft_consensus.cc:740] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.754864 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b6e17edd7f4c618e7260d4e3a65f8a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:33.762390 11085 consensus_queue.cc:260] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:33.764155 11083 tablet_bootstrap.cc:492] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
W20260709 13:19:33.764573 11003 leader_election.cc:343] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:33.764701 11083 ts_tablet_manager.cc:1403] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.281s	user 0.023s	sys 0.010s
I20260709 13:19:33.764818 11085 ts_tablet_manager.cc:1434] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:19:33.768028 11083 raft_consensus.cc:359] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:33.768784 11083 raft_consensus.cc:385] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.768975 11083 raft_consensus.cc:740] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.769672 11083 consensus_queue.cc:260] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:33.770061 10928 leader_election.cc:304] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:33.771255 11540 raft_consensus.cc:2749] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:33.773711 11083 ts_tablet_manager.cc:1434] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
W20260709 13:19:33.774153 11003 leader_election.cc:343] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:33.774840 11083 tablet_bootstrap.cc:492] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:33.785315 11083 tablet_bootstrap.cc:654] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.802701 11083 tablet_bootstrap.cc:492] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:33.803154 11083 ts_tablet_manager.cc:1403] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.029s	user 0.003s	sys 0.013s
I20260709 13:19:33.855463 10807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0223927df5f442079c8fa526ed7eef26" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:33.864320 10856 leader_election.cc:304] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:33.867373 10807 raft_consensus.cc:3060] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.875450 10959 raft_consensus.cc:3060] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.909579 11396 raft_consensus.cc:493] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.910925 11396 raft_consensus.cc:515] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:33.913054 11238 raft_consensus.cc:2749] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:33.896822 10710 catalog_manager.cc:5697] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:33.914992 10779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:44237, user_credentials={real_user=slave}} blocked reactor thread for 62617us
I20260709 13:19:33.928911 10779 leader_election.cc:304] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:33.930683 11554 raft_consensus.cc:2749] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:33.935544 11083 raft_consensus.cc:359] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:33.936744 11083 raft_consensus.cc:385] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.942145 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d3cc9c0f484ffd9e1b216fa14990e8" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:33.943807 10887 raft_consensus.cc:2468] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:33.951064 11396 leader_election.cc:290] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:33.937156 11083 raft_consensus.cc:740] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.961517 10957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d3cc9c0f484ffd9e1b216fa14990e8" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:33.975172 11002 leader_election.cc:304] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:33.979519 11445 raft_consensus.cc:2804] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:33.975234 11083 consensus_queue.cc:260] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:33.995199 10957 raft_consensus.cc:2468] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 0.
I20260709 13:19:33.995666 11083 ts_tablet_manager.cc:1434] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.192s	user 0.006s	sys 0.005s
I20260709 13:19:33.983322 11445 raft_consensus.cc:493] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.011651 11445 raft_consensus.cc:3060] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:34.009575 11083 tablet_bootstrap.cc:492] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:34.035214 10709 catalog_manager.cc:5697] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:34.038757 11083 tablet_bootstrap.cc:654] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:34.064518 11445 raft_consensus.cc:515] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:34.070595 11445 leader_election.cc:290] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:34.091647 10957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d3cc9c0f484ffd9e1b216fa14990e8" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:34.102988 10957 raft_consensus.cc:3060] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:34.113801 10807 raft_consensus.cc:2468] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:34.115504 11004 leader_election.cc:304] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:34.117964 11565 raft_consensus.cc:2804] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:34.118853 11562 raft_consensus.cc:493] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.119491 11562 raft_consensus.cc:515] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:34.120409 11387 consensus_queue.cc:1048] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:34.126382 11387 consensus_queue.cc:1048] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.118902 11565 raft_consensus.cc:697] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:34.126870 10886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d3cc9c0f484ffd9e1b216fa14990e8" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:34.141438 10886 raft_consensus.cc:3060] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:34.132661 11565 consensus_queue.cc:237] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:34.162005 11534 consensus_queue.cc:1048] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:34.180869 11029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc701e5f842459cb7e7469da45a4132" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:34.181888 11029 raft_consensus.cc:2468] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:34.183419 10928 leader_election.cc:304] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:34.186820 11562 leader_election.cc:290] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:34.200665 11083 tablet_bootstrap.cc:492] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:34.205701 11083 ts_tablet_manager.cc:1403] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.197s	user 0.014s	sys 0.009s
I20260709 13:19:34.199920 11554 consensus_queue.cc:1048] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:19:34.206842 11561 raft_consensus.cc:2804] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:34.210554 10957 raft_consensus.cc:2468] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:34.212818 11003 leader_election.cc:304] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:34.213989 11304 raft_consensus.cc:2804] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:34.214516 11304 raft_consensus.cc:697] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:34.215548 11304 consensus_queue.cc:237] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:34.227041 11561 raft_consensus.cc:493] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:34.227886 11561 raft_consensus.cc:3060] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.242060 10807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc701e5f842459cb7e7469da45a4132" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:34.280622 10886 raft_consensus.cc:2468] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:34.288266 11083 raft_consensus.cc:359] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:34.304828 11083 raft_consensus.cc:385] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:34.305342 11083 raft_consensus.cc:740] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:34.306361 11083 consensus_queue.cc:260] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:34.308701 11083 ts_tablet_manager.cc:1434] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.001s
I20260709 13:19:34.320943 11562 raft_consensus.cc:493] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.324788 11083 tablet_bootstrap.cc:492] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b: Bootstrap starting.
I20260709 13:19:34.321887 11562 raft_consensus.cc:515] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:34.336335 11561 raft_consensus.cc:515] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:34.340664 10964 raft_consensus.cc:1240] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Rejecting Update request from peer d726aaf867ea423fa4efe8a15d1896d1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:34.345976 11534 consensus_queue.cc:1059] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:34.347630 11095 raft_consensus.cc:3055] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:34.347828 10807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:34.348088 11095 raft_consensus.cc:740] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:34.348898 10807 raft_consensus.cc:2393] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 348b268fc1da46ac98e10bbe776b018b in current term 1: Already voted for candidate d726aaf867ea423fa4efe8a15d1896d1 in this term.
I20260709 13:19:34.349817 11095 consensus_queue.cc:260] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:34.351106 11095 raft_consensus.cc:3060] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.352948 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:34.354043 10890 raft_consensus.cc:2393] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 348b268fc1da46ac98e10bbe776b018b in current term 1: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
I20260709 13:19:34.347196 10710 catalog_manager.cc:5697] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 1 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:34.367162 10930 leader_election.cc:304] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:34.367412 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc701e5f842459cb7e7469da45a4132" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:34.368708 11447 raft_consensus.cc:3060] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:34.366359 10710 catalog_manager.cc:5697] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 1 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:34.356266 11562 leader_election.cc:290] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:34.389464 11447 raft_consensus.cc:2749] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:34.389972 11561 leader_election.cc:290] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:34.395233 10807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc701e5f842459cb7e7469da45a4132" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:34.394476 11095 raft_consensus.cc:493] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.412438 11095 raft_consensus.cc:515] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:34.415195 11095 leader_election.cc:290] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:34.426669 11083 tablet_bootstrap.cc:654] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:34.432125 10807 raft_consensus.cc:2468] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 2.
I20260709 13:19:34.450091 10886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:34.450920 10886 raft_consensus.cc:2468] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:34.457409 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:34.458081 11038 raft_consensus.cc:2468] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 1.
I20260709 13:19:34.472769 11083 tablet_bootstrap.cc:492] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b: No bootstrap required, opened a new log
I20260709 13:19:34.473346 11083 ts_tablet_manager.cc:1403] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b: Time spent bootstrapping tablet: real 0.149s	user 0.019s	sys 0.015s
I20260709 13:19:34.468502 10779 leader_election.cc:304] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:34.474406 11534 raft_consensus.cc:2804] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:34.474849 11534 raft_consensus.cc:493] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.475231 11534 raft_consensus.cc:3060] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.476382 11083 raft_consensus.cc:359] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:34.477975 11083 raft_consensus.cc:385] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:34.478245 11083 raft_consensus.cc:740] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Initialized, Role: FOLLOWER
I20260709 13:19:34.478917 11083 consensus_queue.cc:260] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
W20260709 13:19:34.486491 10760 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:34.487056 11534 raft_consensus.cc:515] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:34.488811 11534 leader_election.cc:290] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:34.489216 11083 ts_tablet_manager.cc:1434] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:19:34.492574 10886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:34.493257 10886 raft_consensus.cc:3060] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.493398 10930 leader_election.cc:304] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:34.494205 11562 raft_consensus.cc:2804] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:34.494715 11562 raft_consensus.cc:697] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:34.495580 11562 consensus_queue.cc:237] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:34.500572 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:34.501377 11036 raft_consensus.cc:3060] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.503840 10886 raft_consensus.cc:2468] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:34.508505 10712 catalog_manager.cc:5697] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 2 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:34.511677 11036 raft_consensus.cc:2468] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:34.513051 10779 leader_election.cc:304] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:34.513967 11473 raft_consensus.cc:2804] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:34.514474 11473 raft_consensus.cc:697] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:34.515415 11473 consensus_queue.cc:237] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:34.529348 10712 catalog_manager.cc:5697] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 0 to 2, leader changed from <none> to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:34.642755 11562 raft_consensus.cc:493] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.643241 11562 raft_consensus.cc:515] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:34.645243 11562 leader_election.cc:290] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:34.646130 11029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0223927df5f442079c8fa526ed7eef26" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:34.646522 10807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0223927df5f442079c8fa526ed7eef26" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:34.647305 10807 raft_consensus.cc:2393] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 348b268fc1da46ac98e10bbe776b018b in current term 1: Already voted for candidate 10307244fcd642b89723e4fb4ac1291a in this term.
I20260709 13:19:34.648510 10930 leader_election.cc:304] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:34.649175 11562 raft_consensus.cc:3060] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:34.652114 11445 consensus_queue.cc:1048] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.660522 11562 raft_consensus.cc:2749] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:34.666181 11565 consensus_queue.cc:1048] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.686724 11304 consensus_queue.cc:1048] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.711601 11573 consensus_queue.cc:1048] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.898200 10815 raft_consensus.cc:1275] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:34.906322 11447 consensus_queue.cc:1048] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:35.002736 11029 raft_consensus.cc:3060] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:35.003492 10886 raft_consensus.cc:1275] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:35.026798 11473 consensus_queue.cc:1048] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:35.015811 11029 raft_consensus.cc:1275] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:35.031368 11601 consensus_queue.cc:1048] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:35.058401 11029 raft_consensus.cc:1275] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:35.062474 11602 consensus_queue.cc:1048] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:35.480895 11462 raft_consensus.cc:493] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.481515 11462 raft_consensus.cc:515] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:35.483529 11462 leader_election.cc:290] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:35.484092 10807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1" is_pre_election: true
I20260709 13:19:35.484584 10957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:35.485044 10807 raft_consensus.cc:2468] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:35.485551 10957 raft_consensus.cc:2468] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:35.486411 10856 leader_election.cc:304] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:35.487298 11462 raft_consensus.cc:2804] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:35.487670 11462 raft_consensus.cc:493] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.488025 11462 raft_consensus.cc:3060] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:35.497961 11462 raft_consensus.cc:515] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:35.499861 11462 leader_election.cc:290] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:35.501180 10807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:35.501488 10957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:35.501858 10807 raft_consensus.cc:3060] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:35.502138 10957 raft_consensus.cc:3060] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:35.509228 10807 raft_consensus.cc:2468] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:35.510728 10856 leader_election.cc:304] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:35.511047 10957 raft_consensus.cc:2468] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:35.511721 11462 raft_consensus.cc:2804] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:35.512851 11462 raft_consensus.cc:697] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:35.514212 11462 consensus_queue.cc:237] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
W20260709 13:19:35.541451 10760 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:35.551714 10712 catalog_manager.cc:5697] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 0 to 2, leader changed from <none> to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:35.576884  2025 tablet_server.cc:179] TabletServer@127.1.250.65:0 shutting down...
W20260709 13:19:35.585189 10930 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:35.613986 10930 consensus_peers.cc:597] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:35.617926 10930 consensus_peers.cc:597] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:35.621475 11004 consensus_peers.cc:597] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:35.628136 10856 consensus_peers.cc:597] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:35.658200  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:35.659212  2025 tablet_replica.cc:333] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.660570  2025 raft_consensus.cc:2243] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.661594  2025 raft_consensus.cc:2272] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.664606  2025 tablet_replica.cc:333] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.665448  2025 raft_consensus.cc:2243] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.665930  2025 raft_consensus.cc:2272] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.667959  2025 tablet_replica.cc:333] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.668566  2025 raft_consensus.cc:2243] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.669016  2025 raft_consensus.cc:2272] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.671646  2025 tablet_replica.cc:333] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.672305  2025 raft_consensus.cc:2243] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.672771  2025 raft_consensus.cc:2272] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.674798  2025 tablet_replica.cc:333] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.675477  2025 raft_consensus.cc:2243] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.675858  2025 raft_consensus.cc:2272] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.678105  2025 tablet_replica.cc:333] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.678786  2025 raft_consensus.cc:2243] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.679296  2025 raft_consensus.cc:2272] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.681783  2025 tablet_replica.cc:333] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.682432  2025 raft_consensus.cc:2243] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.683401  2025 raft_consensus.cc:2272] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.685673  2025 tablet_replica.cc:333] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.686558  2025 raft_consensus.cc:2243] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.687680  2025 raft_consensus.cc:2272] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.690598  2025 tablet_replica.cc:333] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.692492  2025 raft_consensus.cc:2243] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.693050  2025 raft_consensus.cc:2272] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.695989  2025 tablet_replica.cc:333] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.696756  2025 raft_consensus.cc:2243] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:35.696857 10856 consensus_peers.cc:597] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:35.697322  2025 raft_consensus.cc:2272] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:35.699420 10930 consensus_peers.cc:597] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:35.701159  2025 tablet_replica.cc:333] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.702540  2025 raft_consensus.cc:2243] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.703423  2025 raft_consensus.cc:2272] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:35.705983 10856 consensus_peers.cc:597] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:35.706772  2025 tablet_replica.cc:333] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.707844  2025 raft_consensus.cc:2243] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.708422  2025 raft_consensus.cc:2272] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:35.709229 11004 consensus_peers.cc:597] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:35.711615  2025 tablet_replica.cc:333] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.712560  2025 raft_consensus.cc:2243] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:19:35.712751 11004 consensus_peers.cc:597] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:35.713789  2025 raft_consensus.cc:2272] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.716657  2025 tablet_replica.cc:333] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.717680  2025 raft_consensus.cc:2243] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.718581  2025 raft_consensus.cc:2272] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.720618  2025 tablet_replica.cc:333] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.721254  2025 raft_consensus.cc:2243] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.722158  2025 raft_consensus.cc:2272] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.724277  2025 tablet_replica.cc:333] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.724905  2025 raft_consensus.cc:2243] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.725409  2025 raft_consensus.cc:2272] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.727555  2025 tablet_replica.cc:333] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.728209  2025 raft_consensus.cc:2243] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.728722  2025 raft_consensus.cc:2272] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.731302  2025 tablet_replica.cc:333] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.732172  2025 raft_consensus.cc:2243] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.732751  2025 raft_consensus.cc:2272] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.734961  2025 tablet_replica.cc:333] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.735562  2025 raft_consensus.cc:2243] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.736372  2025 raft_consensus.cc:2272] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.738457  2025 tablet_replica.cc:333] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.738973  2025 raft_consensus.cc:2243] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.739743  2025 raft_consensus.cc:2272] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.741717  2025 tablet_replica.cc:333] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.742311  2025 raft_consensus.cc:2243] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.742780  2025 raft_consensus.cc:2272] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.744719  2025 tablet_replica.cc:333] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.745322  2025 raft_consensus.cc:2243] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.746134  2025 raft_consensus.cc:2272] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.748497  2025 tablet_replica.cc:333] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.749452  2025 raft_consensus.cc:2243] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.750591  2025 raft_consensus.cc:2272] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:35.752542 11004 consensus_peers.cc:597] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:35.753634  2025 tablet_replica.cc:333] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.754491  2025 raft_consensus.cc:2243] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.755029  2025 raft_consensus.cc:2272] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:35.756597 11004 consensus_peers.cc:597] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:35.757794  2025 tablet_replica.cc:333] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.758406  2025 raft_consensus.cc:2243] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.759275  2025 raft_consensus.cc:2272] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.761338  2025 tablet_replica.cc:333] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.761873  2025 raft_consensus.cc:2243] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.762285  2025 raft_consensus.cc:2272] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.765100  2025 tablet_replica.cc:333] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.765884  2025 raft_consensus.cc:2243] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.766997  2025 raft_consensus.cc:2272] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:35.767283 10856 consensus_peers.cc:597] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:35.769672  2025 tablet_replica.cc:333] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.770798  2025 raft_consensus.cc:2243] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.772135  2025 raft_consensus.cc:2272] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:35.773005 11004 consensus_peers.cc:597] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:35.774775  2025 tablet_replica.cc:333] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.775573  2025 raft_consensus.cc:2243] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.776161  2025 raft_consensus.cc:2272] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.779287  2025 tablet_replica.cc:333] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.779862  2025 raft_consensus.cc:2243] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.780695  2025 raft_consensus.cc:2272] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.782723  2025 tablet_replica.cc:333] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.783294  2025 raft_consensus.cc:2243] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.784044  2025 raft_consensus.cc:2272] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.786165  2025 tablet_replica.cc:333] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.786674  2025 raft_consensus.cc:2243] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.787137  2025 raft_consensus.cc:2272] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.789274  2025 tablet_replica.cc:333] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.789877  2025 raft_consensus.cc:2243] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.790503  2025 raft_consensus.cc:2272] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.792600  2025 tablet_replica.cc:333] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.793284  2025 raft_consensus.cc:2243] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.793715  2025 raft_consensus.cc:2272] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.796128  2025 tablet_replica.cc:333] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.796916  2025 raft_consensus.cc:2243] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.797420  2025 raft_consensus.cc:2272] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.799716  2025 tablet_replica.cc:333] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.800345  2025 raft_consensus.cc:2243] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.801364  2025 raft_consensus.cc:2272] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.803556  2025 tablet_replica.cc:333] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.804059  2025 raft_consensus.cc:2243] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.804409  2025 raft_consensus.cc:2272] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.806461  2025 tablet_replica.cc:333] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.807055  2025 raft_consensus.cc:2243] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.807786  2025 raft_consensus.cc:2272] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.809729  2025 tablet_replica.cc:333] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.810204  2025 raft_consensus.cc:2243] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.810566  2025 raft_consensus.cc:2272] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.812423  2025 tablet_replica.cc:333] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.812891  2025 raft_consensus.cc:2243] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.813670  2025 raft_consensus.cc:2272] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.815507  2025 tablet_replica.cc:333] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.815928  2025 raft_consensus.cc:2243] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.816357  2025 raft_consensus.cc:2272] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.818202  2025 tablet_replica.cc:333] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.818652  2025 raft_consensus.cc:2243] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.818981  2025 raft_consensus.cc:2272] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.820724  2025 tablet_replica.cc:333] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.821194  2025 raft_consensus.cc:2243] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.821529  2025 raft_consensus.cc:2272] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.823256  2025 tablet_replica.cc:333] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.823669  2025 raft_consensus.cc:2243] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:35.824478  2025 raft_consensus.cc:2272] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:35.826929  2025 tablet_replica.cc:333] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1: stopping tablet replica
I20260709 13:19:35.827585  2025 raft_consensus.cc:2243] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:35.828107  2025 raft_consensus.cc:2272] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:35.831748 11004 consensus_peers.cc:597] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:35.832686 11004 consensus_peers.cc:597] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:35.857028 10930 consensus_peers.cc:597] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:35.873433 10930 consensus_peers.cc:597] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:35.909132  2025 tablet_server.cc:196] TabletServer@127.1.250.65:0 shutdown complete.
W20260709 13:19:35.933593 10856 consensus_peers.cc:597] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:35.945215 10856 consensus_peers.cc:597] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:35.953267 10856 consensus_peers.cc:597] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:35.972285 10856 consensus_peers.cc:597] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:35.972761 10856 consensus_peers.cc:597] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.008424  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:36.015787 11615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:36.016546 11616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:36.018168  2025 server_base.cc:1061] running on GCE node
W20260709 13:19:36.018864 11618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:36.023377  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:36.023700  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:36.023929  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603176023904 us; error 0 us; skew 500 ppm
I20260709 13:19:36.024734  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:36.029012  2025 webserver.cc:533] Webserver started at http://127.1.250.65:39349/ using document root <none> and password file <none>
I20260709 13:19:36.029692  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:36.029877  2025 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:19:36.034157  2025 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:19:36.043097 11623 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:36.043941  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:19:36.044327  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-0-root
uuid: "d726aaf867ea423fa4efe8a15d1896d1"
format_stamp: "Formatted at 2026-07-09 13:19:21 on dist-test-slave-g4pn"
I20260709 13:19:36.044747  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602894180814-2025-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:36.055641 10964 raft_consensus.cc:1275] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:36.056895 11605 consensus_queue.cc:1048] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:36.074079 10930 consensus_peers.cc:597] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.075297  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:36.077957  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:36.092191  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:19:36.118992 11004 consensus_peers.cc:597] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.121781 11636 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:19:36.135928 10856 consensus_peers.cc:597] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:36.145037 10930 consensus_peers.cc:597] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.463840  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:19:36.464404  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.344s	user 0.007s	sys 0.005s
I20260709 13:19:36.464839  2025 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:19:36.477679 11636 tablet_bootstrap.cc:492] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:36.664719 11605 raft_consensus.cc:493] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.665321 11605 raft_consensus.cc:515] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:36.667725 11605 leader_election.cc:290] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:36.677906 10959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:36.703141 11562 raft_consensus.cc:493] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.703703 11562 raft_consensus.cc:515] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:36.707226 11562 leader_election.cc:290] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:36.709681 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7600277a13475fa3c331ef52fb4d51" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
W20260709 13:19:36.717512 10930 leader_election.cc:336] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:36.718103 10930 leader_election.cc:304] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:36.719758 11637 raft_consensus.cc:2749] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:36.721626 11636 tablet_bootstrap.cc:492] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:36.722787 11636 tablet_bootstrap.cc:492] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:36.723407 11636 ts_tablet_manager.cc:1403] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.246s	user 0.017s	sys 0.009s
I20260709 13:19:36.726323 11636 raft_consensus.cc:359] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:36.727200 11636 raft_consensus.cc:740] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
W20260709 13:19:36.756078 10856 leader_election.cc:336] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:36.756632 10856 leader_election.cc:304] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:36.770452 11630 raft_consensus.cc:493] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.770973 11630 raft_consensus.cc:515] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:36.772524 11630 leader_election.cc:290] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:36.774775 11605 raft_consensus.cc:2749] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:36.758514 11636 consensus_queue.cc:260] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
W20260709 13:19:36.777881 11004 leader_election.cc:336] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:36.782228 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d37e6e4c06405fa84aaf770ff215bc" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:36.789595 11002 leader_election.cc:304] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:36.790303 11636 ts_tablet_manager.cc:1434] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 13:19:36.790679 11573 raft_consensus.cc:2749] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:36.791253 11636 tablet_bootstrap.cc:492] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:36.800773  2025 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:19:36.801196  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.336s	user 0.279s	sys 0.005s
I20260709 13:19:36.816785 11562 raft_consensus.cc:493] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.817428 11562 raft_consensus.cc:515] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:36.819581 11562 leader_election.cc:290] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:36.821372 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b2704733d44a9f8b55a95b4c06a389" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
W20260709 13:19:36.840483 10930 leader_election.cc:336] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:36.840966 10930 leader_election.cc:304] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:36.842168 11641 raft_consensus.cc:2749] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:36.847818 11636 tablet_bootstrap.cc:492] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:36.848944 11636 tablet_bootstrap.cc:492] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:36.849647 11636 ts_tablet_manager.cc:1403] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.059s	user 0.032s	sys 0.012s
I20260709 13:19:36.851975 11636 raft_consensus.cc:359] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:36.852567 11636 raft_consensus.cc:740] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:36.853302 11636 consensus_queue.cc:260] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:36.855243 11636 ts_tablet_manager.cc:1434] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:36.856108 11636 tablet_bootstrap.cc:492] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:36.860641 11641 raft_consensus.cc:493] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.861335 11641 raft_consensus.cc:515] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:36.867779 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2f9f95429447eb9cb87f21c0785a9b" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:36.869978 10930 leader_election.cc:336] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:36.871934 10928 leader_election.cc:304] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:36.873206 11562 raft_consensus.cc:2749] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:36.877177 11641 leader_election.cc:290] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:36.880115 11462 raft_consensus.cc:493] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.880645 11462 raft_consensus.cc:515] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:36.882665 11462 leader_election.cc:290] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:36.884115 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c729794e1e4b7bb1571a3e52c12585" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:36.885769 11636 tablet_bootstrap.cc:492] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:36.886605 11636 tablet_bootstrap.cc:492] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:36.887277 11636 ts_tablet_manager.cc:1403] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.012s
I20260709 13:19:36.888056 11630 raft_consensus.cc:493] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.888590 11630 raft_consensus.cc:515] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
W20260709 13:19:36.889698 10856 leader_election.cc:336] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:36.890015 11636 raft_consensus.cc:359] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:36.890380 10856 leader_election.cc:304] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:36.890672 11630 leader_election.cc:290] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:36.890733 11636 raft_consensus.cc:740] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:36.891456 11462 raft_consensus.cc:2749] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:36.891906 11636 consensus_queue.cc:260] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:36.893965 11636 ts_tablet_manager.cc:1434] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:36.894760 11636 tablet_bootstrap.cc:492] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:36.895179 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73cc1fc36c14e8cb8698530765f5134" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
W20260709 13:19:36.896346 11004 leader_election.cc:336] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:36.897591 11462 raft_consensus.cc:493] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.897529 11003 leader_election.cc:304] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:36.898195 11462 raft_consensus.cc:515] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:36.898487 11630 raft_consensus.cc:2749] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:36.900311 11462 leader_election.cc:290] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:36.903393 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c926e4bc5c549a88846566915db122f" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:36.918498 11462 raft_consensus.cc:493] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.919154 11462 raft_consensus.cc:515] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:36.921537 11462 leader_election.cc:290] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:36.922158 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff1646148f04205b5383bbc084a62af" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
W20260709 13:19:36.923629 10856 leader_election.cc:336] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:36.924268 10856 leader_election.cc:304] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:36.925220 11462 raft_consensus.cc:2749] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:36.934031 11562 raft_consensus.cc:493] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.934849 11562 raft_consensus.cc:515] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:36.936249 11573 raft_consensus.cc:493] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.936774 11636 tablet_bootstrap.cc:492] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:36.936873 11573 raft_consensus.cc:515] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:36.938014 11636 tablet_bootstrap.cc:492] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:36.938777 11636 ts_tablet_manager.cc:1403] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.008s
I20260709 13:19:36.939492 11573 leader_election.cc:290] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:36.941758 11636 raft_consensus.cc:359] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:36.942577 11636 raft_consensus.cc:740] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:36.942878 11462 raft_consensus.cc:493] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.943348 11636 consensus_queue.cc:260] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:36.943476 11462 raft_consensus.cc:515] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:36.945808 11636 ts_tablet_manager.cc:1434] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:36.946625 11636 tablet_bootstrap.cc:492] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
W20260709 13:19:36.947547 11004 leader_election.cc:336] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:36.948647 10856 leader_election.cc:336] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:36.949100 10856 leader_election.cc:304] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:36.949894 11605 raft_consensus.cc:2749] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:36.955246 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c926e4bc5c549a88846566915db122f" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:36.955302 11605 raft_consensus.cc:493] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.956007 11605 raft_consensus.cc:515] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:36.958998 11605 leader_election.cc:290] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:36.961897 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fedddd0f2b4818ad11904281a7f444" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:36.955938 10889 raft_consensus.cc:2468] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:36.964777 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:36.965947 10957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b854da4ba865432d90d6a626e5b585bf" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:36.982024 10928 leader_election.cc:304] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:36.983024 11637 raft_consensus.cc:493] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.983214 11641 raft_consensus.cc:2804] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:36.983666 11641 raft_consensus.cc:493] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.983559 11637 raft_consensus.cc:515] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:36.984076 11641 raft_consensus.cc:3060] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:36.986116 11637 leader_election.cc:290] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:36.975301 11562 leader_election.cc:290] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:36.986961 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:36.987948 11031 raft_consensus.cc:2468] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:36.989459 10928 leader_election.cc:304] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:36.976329 11605 raft_consensus.cc:493] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.975833 11462 leader_election.cc:290] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:36.991072 11605 raft_consensus.cc:515] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:36.992208 11562 raft_consensus.cc:2804] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:36.995085 11562 raft_consensus.cc:493] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:36.995721 11562 raft_consensus.cc:3060] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:37.002326 10930 leader_election.cc:336] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.005602 11003 leader_election.cc:304] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.006564 11029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b6e17edd7f4c618e7260d4e3a65f8a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:37.007443 11573 raft_consensus.cc:2749] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:36.993985 11605 leader_election.cc:290] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:37.022716 11601 raft_consensus.cc:493] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.023402 11601 raft_consensus.cc:515] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.025784 11601 leader_election.cc:290] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
W20260709 13:19:37.027961 10856 leader_election.cc:336] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.028733 10856 leader_election.cc:304] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.029771 11601 raft_consensus.cc:493] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.030102 11605 raft_consensus.cc:2749] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:37.030555 11601 raft_consensus.cc:515] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
W20260709 13:19:37.031927 10856 leader_election.cc:336] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.032518 10856 leader_election.cc:304] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.033524 11605 raft_consensus.cc:2749] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:37.034742 11638 raft_consensus.cc:493] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.035554 11638 raft_consensus.cc:515] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.038697 11638 leader_election.cc:290] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:37.039796 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bdc10add5473a94bcb1e1e5d2d1bc" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:37.044329 10957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:37.028668 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b854da4ba865432d90d6a626e5b585bf" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:37.052150 11462 raft_consensus.cc:493] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.052896 11462 raft_consensus.cc:515] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.056218 11462 leader_election.cc:290] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:37.057489 10957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7600277a13475fa3c331ef52fb4d51" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:37.058542 10957 raft_consensus.cc:2468] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:37.060189 10855 leader_election.cc:304] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.057500 11601 leader_election.cc:290] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.073160 11605 raft_consensus.cc:2804] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.073907 11605 raft_consensus.cc:493] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.074406 11605 raft_consensus.cc:3060] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.074662 11672 raft_consensus.cc:493] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.075536 11672 raft_consensus.cc:515] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.076604 11640 raft_consensus.cc:493] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.078137 11640 raft_consensus.cc:515] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.079524 10889 raft_consensus.cc:2468] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:37.084085 10957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bdc10add5473a94bcb1e1e5d2d1bc" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:37.085136 10957 raft_consensus.cc:2468] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:37.080653 11672 leader_election.cc:290] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:37.087654 10928 leader_election.cc:304] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.088162 10855 leader_election.cc:304] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.089044 11601 raft_consensus.cc:2804] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.099232 11601 raft_consensus.cc:493] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.102365 11601 raft_consensus.cc:3060] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.099983 11638 raft_consensus.cc:2804] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.092338 11573 raft_consensus.cc:493] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.104833 11638 raft_consensus.cc:493] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
W20260709 13:19:37.097488 11004 leader_election.cc:336] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.105515 11638 raft_consensus.cc:3060] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.105110 11573 raft_consensus.cc:515] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:37.116259 11630 raft_consensus.cc:493] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.117272 11630 raft_consensus.cc:515] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.120900 11630 leader_election.cc:290] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.126878 11630 raft_consensus.cc:493] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.127769 11630 raft_consensus.cc:515] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.129609 11637 raft_consensus.cc:493] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.130385 11637 raft_consensus.cc:515] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.131456 11641 raft_consensus.cc:515] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.133425 11637 leader_election.cc:290] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.133612 11462 raft_consensus.cc:493] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.123292 11672 raft_consensus.cc:493] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.134405 11462 raft_consensus.cc:515] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.120936 11573 leader_election.cc:290] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:37.135018 11672 raft_consensus.cc:515] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.127077 11640 leader_election.cc:290] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.139384 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:37.147477 11679 raft_consensus.cc:493] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.164695 11679 raft_consensus.cc:515] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.138543 11462 leader_election.cc:290] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:37.166128 11462 raft_consensus.cc:493] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.166777 11462 raft_consensus.cc:515] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.153180 11678 raft_consensus.cc:493] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.168283 11678 raft_consensus.cc:515] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.170917 11462 leader_election.cc:290] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:37.171411 11678 leader_election.cc:290] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.171797 11679 leader_election.cc:290] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.172237 11031 raft_consensus.cc:2468] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:37.173942 11672 leader_election.cc:290] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
W20260709 13:19:37.177518 11004 leader_election.cc:336] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.178371 11004 leader_election.cc:336] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.181141 11641 leader_election.cc:290] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.181026 11680 raft_consensus.cc:493] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.180958 11601 raft_consensus.cc:515] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.182353 11637 raft_consensus.cc:493] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.183028 11637 raft_consensus.cc:515] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.183923 11601 leader_election.cc:290] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.184350 11630 leader_election.cc:290] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.185320 11637 leader_election.cc:290] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.182013 11680 raft_consensus.cc:515] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.185879 10854 leader_election.cc:304] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:37.187078 11687 raft_consensus.cc:2804] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:37.187525 11687 raft_consensus.cc:493] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.187574 11680 leader_election.cc:290] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.188050 11687 raft_consensus.cc:3060] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:37.188599 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d37e6e4c06405fa84aaf770ff215bc" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:37.189760 11031 raft_consensus.cc:2468] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:37.180825 11638 raft_consensus.cc:515] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
W20260709 13:19:37.190867 10856 leader_election.cc:336] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.192322 10856 leader_election.cc:304] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.193748 11638 leader_election.cc:290] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:37.194689 10854 leader_election.cc:304] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
W20260709 13:19:37.189149 10928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:44237, user_credentials={real_user=slave}} blocked reactor thread for 56819.9us
I20260709 13:19:37.195708 11462 raft_consensus.cc:2749] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:37.197819 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78decb93a9542368bf3107bc846a6f0" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:37.200207 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c926e4bc5c549a88846566915db122f" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:37.200838 10890 raft_consensus.cc:3060] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.203938 10882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b6e17edd7f4c618e7260d4e3a65f8a" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:37.198784 10889 raft_consensus.cc:2468] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:37.199743 11672 raft_consensus.cc:2804] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.205824 11672 raft_consensus.cc:493] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.206758 11562 raft_consensus.cc:515] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:37.212397 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:37.210994 10882 raft_consensus.cc:2468] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:37.215319 10886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b854da4ba865432d90d6a626e5b585bf" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:37.215962 10886 raft_consensus.cc:3060] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.216073 10882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff1646148f04205b5383bbc084a62af" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:37.216895 10882 raft_consensus.cc:2468] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:37.213121 10889 raft_consensus.cc:2468] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 3.
W20260709 13:19:37.219650 10930 leader_election.cc:336] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.223611 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c729794e1e4b7bb1571a3e52c12585" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:37.224354 10887 raft_consensus.cc:2468] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:37.225230 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2f9f95429447eb9cb87f21c0785a9b" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:37.211447 11672 raft_consensus.cc:3060] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.228313 11638 raft_consensus.cc:493] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.228899 11638 raft_consensus.cc:515] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.225908 10963 raft_consensus.cc:2468] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:37.226166 11605 raft_consensus.cc:515] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
W20260709 13:19:37.226410 11004 leader_election.cc:336] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.238919 11638 leader_election.cc:290] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
W20260709 13:19:37.243650 10856 leader_election.cc:336] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.244277 10856 leader_election.cc:304] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.239295 10886 raft_consensus.cc:2468] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 2.
W20260709 13:19:37.236255 11004 leader_election.cc:336] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.245639 10856 leader_election.cc:336] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.240926 10882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:37.241580 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533e572edda34e56bb0fc3aaf49022da" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
W20260709 13:19:37.246093 11004 leader_election.cc:336] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.246578 11038 raft_consensus.cc:2468] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:37.241782 11684 raft_consensus.cc:493] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.247676 11682 raft_consensus.cc:2749] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:37.247933 11684 raft_consensus.cc:515] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:37.250684 11684 leader_election.cc:290] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:37.242610 10928 leader_election.cc:304] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.251783 10928 leader_election.cc:304] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.252811 11641 raft_consensus.cc:2804] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.252876 10928 leader_election.cc:304] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.253409 11636 tablet_bootstrap.cc:492] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:37.253969 11680 raft_consensus.cc:2804] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.254336 11680 raft_consensus.cc:493] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.254714 11680 raft_consensus.cc:3060] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.258222 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf42b68842d44bbbeaf36ee573a6da0" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:37.259408 11683 raft_consensus.cc:2804] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:37.260502 10957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bdc10add5473a94bcb1e1e5d2d1bc" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:37.260914 11683 raft_consensus.cc:493] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.261212 10957 raft_consensus.cc:3060] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.261479 11683 raft_consensus.cc:3060] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:37.244294 10887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fedddd0f2b4818ad11904281a7f444" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:37.248399 10854 leader_election.cc:304] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:37.263664 10887 raft_consensus.cc:2468] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 1.
I20260709 13:19:37.253332 11641 raft_consensus.cc:493] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.265007 11641 raft_consensus.cc:3060] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.260372 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:37.242237 11562 leader_election.cc:290] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:37.266817 11636 tablet_bootstrap.cc:492] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:37.267915 11636 ts_tablet_manager.cc:1403] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.321s	user 0.103s	sys 0.114s
I20260709 13:19:37.240177 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533e572edda34e56bb0fc3aaf49022da" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:37.271008 11638 raft_consensus.cc:493] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.271574 11638 raft_consensus.cc:515] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.272492 11562 raft_consensus.cc:493] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.273317 11562 raft_consensus.cc:515] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.273752 11638 leader_election.cc:290] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:37.239179 10890 raft_consensus.cc:2468] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 2.
I20260709 13:19:37.278069 11636 raft_consensus.cc:359] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.294730 11636 raft_consensus.cc:740] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:37.279147 11641 raft_consensus.cc:515] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.275522 11562 leader_election.cc:290] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.266898 11038 raft_consensus.cc:3060] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.280447 10928 leader_election.cc:304] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.267028 11681 raft_consensus.cc:2804] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.281996 11680 raft_consensus.cc:515] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
W20260709 13:19:37.294500 10856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 48869.9us
I20260709 13:19:37.279315 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73cc1fc36c14e8cb8698530765f5134" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:37.296535 11601 raft_consensus.cc:2804] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:37.295743 11636 consensus_queue.cc:260] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.303689 11601 raft_consensus.cc:697] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:37.304422 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b2704733d44a9f8b55a95b4c06a389" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:37.304636 11601 consensus_queue.cc:237] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.306720 11684 raft_consensus.cc:493] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.281193 10886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf42b68842d44bbbeaf36ee573a6da0" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:37.307439 11684 raft_consensus.cc:515] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.297417 11680 leader_election.cc:290] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.310091 11684 leader_election.cc:290] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.297930 11036 raft_consensus.cc:2468] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:37.310734 11002 leader_election.cc:304] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.307920 10886 raft_consensus.cc:2468] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:37.311861 11002 leader_election.cc:304] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.282114 11605 leader_election.cc:290] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:37.312613 11630 raft_consensus.cc:2804] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.312915 11679 raft_consensus.cc:2804] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.312984 11630 raft_consensus.cc:493] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.313396 11636 ts_tablet_manager.cc:1434] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.004s
I20260709 13:19:37.313531 11679 raft_consensus.cc:493] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.313649 11630 raft_consensus.cc:3060] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.314054 11679 raft_consensus.cc:3060] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:37.317312 10856 leader_election.cc:336] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.305112 10964 raft_consensus.cc:2468] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 1.
I20260709 13:19:37.315137 11683 raft_consensus.cc:515] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.318859 11002 leader_election.cc:304] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.320964 11636 tablet_bootstrap.cc:492] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:37.321100 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7600277a13475fa3c331ef52fb4d51" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:37.321408 11640 raft_consensus.cc:2804] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.321688 10963 raft_consensus.cc:3060] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.321872 11640 raft_consensus.cc:493] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.322336 11640 raft_consensus.cc:3060] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.326166 11630 raft_consensus.cc:515] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
W20260709 13:19:37.320181 10856 leader_election.cc:336] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.298775 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff1646148f04205b5383bbc084a62af" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:37.299363 10928 leader_election.cc:304] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.295817 11681 raft_consensus.cc:493] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
W20260709 13:19:37.329281 10856 leader_election.cc:336] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.331905 11681 raft_consensus.cc:3060] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.331954 10856 leader_election.cc:304] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.332904 11605 raft_consensus.cc:2749] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:37.300722 11641 leader_election.cc:290] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
W20260709 13:19:37.334389 10856 leader_election.cc:336] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.335304 10856 leader_election.cc:336] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.335642 11679 raft_consensus.cc:515] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.337247 11684 raft_consensus.cc:2804] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:37.337605 10855 leader_election.cc:304] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.338476 11605 raft_consensus.cc:2804] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.337944 11630 leader_election.cc:290] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.338908 11605 raft_consensus.cc:493] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.339365 11605 raft_consensus.cc:3060] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.272696 10957 raft_consensus.cc:2468] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:37.343619 10855 leader_election.cc:304] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.344388 11682 raft_consensus.cc:2804] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:37.344908 11682 raft_consensus.cc:697] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:37.345333 11003 leader_election.cc:304] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.329173 11038 raft_consensus.cc:2468] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 2.
I20260709 13:19:37.329764 10890 raft_consensus.cc:3060] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.331307 10963 raft_consensus.cc:2468] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:37.346374 10928 leader_election.cc:304] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
W20260709 13:19:37.350502 10930 leader_election.cc:336] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.351202 10930 leader_election.cc:336] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.351526 10930 leader_election.cc:304] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.350222 10928 leader_election.cc:304] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.356487 11689 raft_consensus.cc:2749] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:37.356689 10883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:37.357309 11689 raft_consensus.cc:2804] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.357406 10883 raft_consensus.cc:2468] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 1.
I20260709 13:19:37.357698 11689 raft_consensus.cc:493] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.358089 11689 raft_consensus.cc:3060] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.359102 11681 raft_consensus.cc:515] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.360303 10889 raft_consensus.cc:2393] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10307244fcd642b89723e4fb4ac1291a in current term 2: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
I20260709 13:19:37.352061 11678 raft_consensus.cc:2804] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.361359 11678 raft_consensus.cc:493] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.361768 11678 raft_consensus.cc:3060] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.338004 11684 raft_consensus.cc:697] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:37.363806 11684 consensus_queue.cc:237] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.366894 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b6e17edd7f4c618e7260d4e3a65f8a" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:37.367591 10884 raft_consensus.cc:3060] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.368458 11002 leader_election.cc:304] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
W20260709 13:19:37.369153 10856 leader_election.cc:336] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.369314 10886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78decb93a9542368bf3107bc846a6f0" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
W20260709 13:19:37.369731 10856 leader_election.cc:336] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.369966 10886 raft_consensus.cc:3060] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.370319 11573 raft_consensus.cc:3060] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.372581 10928 leader_election.cc:304] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.345871 11682 consensus_queue.cc:237] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.355752 11641 raft_consensus.cc:2804] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.386198 10890 raft_consensus.cc:2468] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 2.
I20260709 13:19:37.390630 10855 leader_election.cc:304] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.381889 11641 raft_consensus.cc:493] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.312161 11672 raft_consensus.cc:515] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.399801 10886 raft_consensus.cc:2468] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 2.
I20260709 13:19:37.405836 11689 raft_consensus.cc:515] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.397352 11687 raft_consensus.cc:515] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.382102 11680 raft_consensus.cc:2804] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:37.408949 11680 raft_consensus.cc:697] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
W20260709 13:19:37.413713 10856 leader_election.cc:336] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.395671 11679 leader_election.cc:290] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.401598 11672 leader_election.cc:290] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:37.404014 10884 raft_consensus.cc:2468] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 2.
I20260709 13:19:37.400209 11640 raft_consensus.cc:515] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.410291 11680 consensus_queue.cc:237] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:37.425318 11683 leader_election.cc:290] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.426087 10882 raft_consensus.cc:2393] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10307244fcd642b89723e4fb4ac1291a in current term 3: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
I20260709 13:19:37.416393 11462 raft_consensus.cc:2804] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:19:37.447422 10930 leader_election.cc:336] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.453437 11462 raft_consensus.cc:697] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
W20260709 13:19:37.454094 10930 leader_election.cc:336] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.455106 10930 leader_election.cc:336] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.455700 11689 leader_election.cc:290] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
W20260709 13:19:37.455941 10930 leader_election.cc:336] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.456982 10930 leader_election.cc:336] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.412097 11641 raft_consensus.cc:3060] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:37.458069 10930 leader_election.cc:336] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.461436 10930 leader_election.cc:336] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.465209 10930 leader_election.cc:336] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.465341 10928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:44237, user_credentials={real_user=slave}} blocked reactor thread for 82620.3us
I20260709 13:19:37.465969 11462 consensus_queue.cc:237] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
W20260709 13:19:37.479877 11002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 109891us
I20260709 13:19:37.483403 10928 leader_election.cc:304] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.486892 10928 leader_election.cc:304] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.491273 10928 leader_election.cc:304] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.494526 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d37e6e4c06405fa84aaf770ff215bc" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:37.495306 11038 raft_consensus.cc:3060] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.497345 11002 leader_election.cc:304] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:37.497365 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:37.498276 11031 raft_consensus.cc:3060] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:37.501113 11696 raft_consensus.cc:2804] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:37.506218 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533e572edda34e56bb0fc3aaf49022da" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:37.507602 11696 raft_consensus.cc:697] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 2 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
W20260709 13:19:37.502907 10744 debug-util.cc:398] Leaking SignalData structure 0x7b08003cdb60 after lost signal to thread 2028
I20260709 13:19:37.509171 11696 consensus_queue.cc:237] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
W20260709 13:19:37.510845 10744 debug-util.cc:398] Leaking SignalData structure 0x7b0800049d80 after lost signal to thread 10747
W20260709 13:19:37.512599 10744 debug-util.cc:398] Leaking SignalData structure 0x7b0800213a60 after lost signal to thread 10914
I20260709 13:19:37.502837 11695 raft_consensus.cc:2804] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:37.513835 11695 raft_consensus.cc:697] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:37.514875 11695 consensus_queue.cc:237] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.492959 11687 leader_election.cc:290] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:37.489544 11562 raft_consensus.cc:2804] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.525233 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c729794e1e4b7bb1571a3e52c12585" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:37.494908 11601 raft_consensus.cc:2804] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:37.588302 10884 raft_consensus.cc:3060] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:37.596252 10854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:44237, user_credentials={real_user=slave}} blocked reactor thread for 67573.4us
W20260709 13:19:37.602134 10744 debug-util.cc:398] Leaking SignalData structure 0x7b08002d3c60 after lost signal to thread 10988
I20260709 13:19:37.595850 11562 raft_consensus.cc:493] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:19:37.610767 11681 leader_election.cc:290] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:37.605744 11601 raft_consensus.cc:697] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:37.635102 11038 raft_consensus.cc:2468] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:37.639889 11031 raft_consensus.cc:2468] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 3.
I20260709 13:19:37.640036 10884 raft_consensus.cc:2468] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 2.
W20260709 13:19:37.642093 11003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 120943us
W20260709 13:19:37.643361 10928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 152159us
I20260709 13:19:37.624028 11562 raft_consensus.cc:3060] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.636554 10712 catalog_manager.cc:5697] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 2 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:37.658834 10886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf42b68842d44bbbeaf36ee573a6da0" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:37.665674 11601 consensus_queue.cc:237] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
W20260709 13:19:37.667439 11004 leader_election.cc:336] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.668094 10744 debug-util.cc:398] Leaking SignalData structure 0x7b08003ea980 after lost signal to thread 11062
I20260709 13:19:37.668967 11636 tablet_bootstrap.cc:492] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:37.667459 11573 raft_consensus.cc:2749] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:37.676683 10856 leader_election.cc:336] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.679257 10856 leader_election.cc:336] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.685310 11636 tablet_bootstrap.cc:492] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:37.686180 11636 ts_tablet_manager.cc:1403] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.365s	user 0.054s	sys 0.040s
I20260709 13:19:37.685976 10854 leader_election.cc:304] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.688536 11002 leader_election.cc:304] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:37.692276 11002 leader_election.cc:304] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.678617 10886 raft_consensus.cc:3060] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.710052 10854 leader_election.cc:304] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.715636 11562 raft_consensus.cc:515] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.669401 11678 raft_consensus.cc:515] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:37.725463 11701 raft_consensus.cc:2804] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:37.726187 11701 raft_consensus.cc:697] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:37.727267 11701 consensus_queue.cc:237] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.702064 11640 leader_election.cc:290] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.703965 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aaea3ca9c0459e98df2be582872d60" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:37.739723 11692 raft_consensus.cc:2804] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:19:37.745249 11004 leader_election.cc:336] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.753885 10884 raft_consensus.cc:3060] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:37.753990 11692 raft_consensus.cc:697] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 2 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:37.755106 11692 consensus_queue.cc:237] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.758906 11678 leader_election.cc:290] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
W20260709 13:19:37.760044 11004 leader_election.cc:336] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.731160 11630 raft_consensus.cc:2749] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:37.761353 11702 raft_consensus.cc:2804] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:37.761945 11702 raft_consensus.cc:697] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 3 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:37.747133 11641 raft_consensus.cc:515] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:37.747534 11636 raft_consensus.cc:359] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.762977 11636 raft_consensus.cc:740] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:37.762946 11702 consensus_queue.cc:237] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.763914 11636 consensus_queue.cc:260] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.748725 11562 leader_election.cc:290] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:37.751385 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:37.765520 10890 raft_consensus.cc:3060] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.770479 11636 ts_tablet_manager.cc:1434] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 13:19:37.771116 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fedddd0f2b4818ad11904281a7f444" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:37.771871 10885 raft_consensus.cc:3060] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:37.779479 10856 leader_election.cc:336] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.787177 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73cc1fc36c14e8cb8698530765f5134" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:37.789844 11036 raft_consensus.cc:3060] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.756919 11605 raft_consensus.cc:515] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.791891 10890 raft_consensus.cc:2468] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 2.
I20260709 13:19:37.794379 10928 leader_election.cc:304] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.795331 11562 raft_consensus.cc:2804] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:37.795821 11562 raft_consensus.cc:697] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:37.797343 11032 raft_consensus.cc:2468] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:37.797811 11562 consensus_queue.cc:237] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.801662 10882 raft_consensus.cc:1275] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:37.809919 11036 raft_consensus.cc:2468] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 2.
I20260709 13:19:37.824604 11641 leader_election.cc:290] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:37.827371 10884 raft_consensus.cc:2468] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 4.
I20260709 13:19:37.814287 10928 leader_election.cc:304] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:37.805935 11689 consensus_queue.cc:1048] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:19:37.832057 10957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2f9f95429447eb9cb87f21c0785a9b" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:37.832765 10957 raft_consensus.cc:3060] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:37.833678 10930 leader_election.cc:336] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.837134 10930 leader_election.cc:336] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.837972 10930 leader_election.cc:336] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.838433 11004 leader_election.cc:336] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.838793 10930 leader_election.cc:336] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:19:37.840590 10930 leader_election.cc:336] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.845052 10957 raft_consensus.cc:2468] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 2.
I20260709 13:19:37.846202 10886 raft_consensus.cc:2468] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 2.
W20260709 13:19:37.851004 10930 leader_election.cc:336] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.853458 10928 leader_election.cc:304] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.857381 10928 leader_election.cc:304] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.857609 10882 raft_consensus.cc:1275] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:37.859735 11636 tablet_bootstrap.cc:492] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:37.851961 11684 raft_consensus.cc:2804] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:37.862336 11641 raft_consensus.cc:2804] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:37.863808 11706 raft_consensus.cc:2804] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:37.874366 11562 consensus_queue.cc:1048] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:37.879786 10885 raft_consensus.cc:2468] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 2.
W20260709 13:19:37.883674 10930 consensus_peers.cc:597] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.884485 10930 leader_election.cc:336] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.886821 11002 leader_election.cc:304] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
W20260709 13:19:37.891422 10855 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 353365us
I20260709 13:19:37.888608 10854 leader_election.cc:304] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.896451 11003 leader_election.cc:304] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:37.897594 11678 raft_consensus.cc:2804] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:37.893608 11706 raft_consensus.cc:697] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:37.900488 11706 consensus_queue.cc:237] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.901995 11605 leader_election.cc:290] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:37.893566 11700 raft_consensus.cc:2804] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:37.903759 11700 raft_consensus.cc:697] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 2 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:37.904909 11700 consensus_queue.cc:237] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.873754 11684 raft_consensus.cc:697] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:37.910513 11682 raft_consensus.cc:2804] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:37.911185 11682 raft_consensus.cc:697] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:37.912153 11682 consensus_queue.cc:237] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:37.892663 11641 raft_consensus.cc:697] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 4 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
W20260709 13:19:37.917460 10856 leader_election.cc:336] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:19:37.917990 11641 consensus_queue.cc:237] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:37.898099 11678 raft_consensus.cc:697] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 2 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:37.929481 11678 consensus_queue.cc:237] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:37.929589 11684 consensus_queue.cc:237] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:38.025244 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b2704733d44a9f8b55a95b4c06a389" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:38.029222 10964 raft_consensus.cc:3060] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:38.037328 10930 consensus_peers.cc:597] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.053473 10961 raft_consensus.cc:1275] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:38.077343 10884 raft_consensus.cc:1275] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer 10307244fcd642b89723e4fb4ac1291a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:38.071364 11701 consensus_queue.cc:1048] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:19:38.081902 10964 raft_consensus.cc:2468] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:38.086831 10888 raft_consensus.cc:1275] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:38.097882 10856 consensus_peers.cc:597] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.094342 10855 leader_election.cc:304] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:38.111572 11695 consensus_queue.cc:1048] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:38.107457 11643 raft_consensus.cc:493] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.114679 11643 raft_consensus.cc:515] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:38.116477 10957 raft_consensus.cc:1275] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:38.119513 11004 consensus_peers.cc:597] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.126477 11687 raft_consensus.cc:2804] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:38.129845 11696 consensus_queue.cc:1048] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:19:38.141927 11687 raft_consensus.cc:697] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:38.147198 11687 consensus_queue.cc:237] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:38.126559 11605 consensus_queue.cc:1048] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 13:19:38.171339 10930 consensus_peers.cc:597] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.174557 11004 consensus_peers.cc:597] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.175154 11004 consensus_peers.cc:597] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.175401 10856 consensus_peers.cc:597] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.177479 11636 tablet_bootstrap.cc:492] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:38.179450 11636 tablet_bootstrap.cc:492] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:38.180364 11636 ts_tablet_manager.cc:1403] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.321s	user 0.033s	sys 0.007s
W20260709 13:19:38.185614 11004 consensus_peers.cc:597] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:38.186378 11031 raft_consensus.cc:1275] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:38.177278 10710 catalog_manager.cc:5697] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 2 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:38.189661 10930 consensus_peers.cc:597] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.194521 10710 catalog_manager.cc:5697] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 2 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:38.196702 10710 catalog_manager.cc:5697] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 2 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:38.199512 10710 catalog_manager.cc:5697] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 2 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:38.200040 11695 consensus_queue.cc:1048] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:19:38.214036 11643 leader_election.cc:290] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:38.211520 11636 raft_consensus.cc:359] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:38.218334 11636 raft_consensus.cc:740] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:38.219154 11636 consensus_queue.cc:260] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:38.225832 11636 ts_tablet_manager.cc:1434] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:19:38.227321 11636 tablet_bootstrap.cc:492] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:38.248355 11643 raft_consensus.cc:493] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.260753 10712 catalog_manager.cc:5697] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:38.261451 11643 raft_consensus.cc:515] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:38.268689 11643 leader_election.cc:290] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:38.272198 10712 catalog_manager.cc:5697] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:38.279124 10930 consensus_peers.cc:597] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.282178 10886 raft_consensus.cc:1275] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer 10307244fcd642b89723e4fb4ac1291a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:38.286563 10712 catalog_manager.cc:5697] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:38.311017 10712 catalog_manager.cc:5697] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 2 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } }
I20260709 13:19:38.313135 10712 catalog_manager.cc:5697] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 2 to 3, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.314916 10712 catalog_manager.cc:5697] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:38.336241 11747 log.cc:927] Time spent T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:19:38.318933 11630 consensus_queue.cc:1048] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:19:38.372745 11038 raft_consensus.cc:1275] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:38.374933 11744 log.cc:927] Time spent T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:19:38.375182 11643 raft_consensus.cc:493] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.375808 11643 raft_consensus.cc:515] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
W20260709 13:19:38.405551 10930 consensus_peers.cc:597] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:38.379837 11643 leader_election.cc:290] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
W20260709 13:19:38.421865 10930 consensus_peers.cc:597] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.440150 10854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:44237, user_credentials={real_user=slave}} blocked reactor thread for 66728us
W20260709 13:19:38.439862 10930 consensus_peers.cc:597] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.441252 10930 consensus_peers.cc:597] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.457743 11032 raft_consensus.cc:1275] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:38.472616 10886 raft_consensus.cc:1275] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:38.478145 11636 tablet_bootstrap.cc:492] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:38.479354 11636 tablet_bootstrap.cc:492] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:38.480110 11636 ts_tablet_manager.cc:1403] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.253s	user 0.037s	sys 0.021s
W20260709 13:19:38.482883 11004 consensus_peers.cc:597] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.482991 10930 consensus_peers.cc:597] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.482033 11643 raft_consensus.cc:493] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.491744 11643 raft_consensus.cc:515] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:38.493882 11643 leader_election.cc:290] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
W20260709 13:19:38.483500 11004 consensus_peers.cc:597] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.462337 11682 consensus_queue.cc:1048] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 13:19:38.498004 11004 consensus_peers.cc:597] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.500114 10856 consensus_peers.cc:597] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.500706 10856 consensus_peers.cc:597] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.501245 10856 consensus_peers.cc:597] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.507172 10854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:44237, user_credentials={real_user=slave}} blocked reactor thread for 64599.1us
W20260709 13:19:38.508023 10856 consensus_peers.cc:597] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.508601 10856 consensus_peers.cc:597] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:38.514406 11683 consensus_queue.cc:1048] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:19:38.518189 11004 consensus_peers.cc:597] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.518760 11004 consensus_peers.cc:597] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:38.509724 10709 catalog_manager.cc:5697] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 2 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:38.523478 10709 catalog_manager.cc:5697] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 2 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.524791 10709 catalog_manager.cc:5697] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 2 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.526274 10709 catalog_manager.cc:5697] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 2 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.527370 10888 raft_consensus.cc:1275] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:38.521504 11636 raft_consensus.cc:359] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:38.528719 11636 raft_consensus.cc:740] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:38.532583 10885 raft_consensus.cc:1275] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:38.529415 11636 consensus_queue.cc:260] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:38.537832 10709 catalog_manager.cc:5697] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 2 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.541512 10961 raft_consensus.cc:1275] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer 10307244fcd642b89723e4fb4ac1291a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:38.536037 11724 consensus_queue.cc:1048] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:19:38.541998 11636 ts_tablet_manager.cc:1434] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 13:19:38.550216 11636 tablet_bootstrap.cc:492] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:38.550467 10888 raft_consensus.cc:1275] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer 10307244fcd642b89723e4fb4ac1291a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:38.549257 11715 consensus_queue.cc:1048] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:19:38.550755 11695 consensus_queue.cc:1048] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:19:38.555279 10888 raft_consensus.cc:1275] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:38.555667 10709 catalog_manager.cc:5697] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 2 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:38.557369 10930 consensus_peers.cc:597] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.557904 10709 catalog_manager.cc:5697] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 3 to 4, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 4 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.563026 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:38.564669 10957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904c45fa164407791817b45928f663e" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:38.585958 10886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:38.569573 11762 consensus_queue.cc:1048] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:19:38.590462 10882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:38.591646 11692 consensus_queue.cc:1048] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:38.570055 11643 raft_consensus.cc:493] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.570708 11031 raft_consensus.cc:1275] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:38.608713 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904c45fa164407791817b45928f663e" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:38.612447 11038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:38.614730 11029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211db9e835d644ccb7787552caa46c93" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:38.618552 11715 consensus_queue.cc:1048] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:38.620512 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211db9e835d644ccb7787552caa46c93" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
W20260709 13:19:38.621239 10930 consensus_peers.cc:597] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.621953 10856 consensus_peers.cc:597] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.593940 11643 raft_consensus.cc:515] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:38.624101 11643 leader_election.cc:290] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:38.625679 10957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c926e4bc5c549a88846566915db122f" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:38.575031 11695 consensus_queue.cc:1048] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
W20260709 13:19:38.637351 11004 consensus_peers.cc:597] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:38.636739 11625 leader_election.cc:304] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:38.638758 11643 raft_consensus.cc:2749] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:38.653501 11032 raft_consensus.cc:1275] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:38.657752 10856 consensus_peers.cc:597] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.658464 10856 consensus_peers.cc:597] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.659567 11004 consensus_peers.cc:597] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.672959 11760 consensus_queue.cc:1048] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:19:38.673139 10886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c926e4bc5c549a88846566915db122f" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:38.688711 11636 tablet_bootstrap.cc:492] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:38.689857 11636 tablet_bootstrap.cc:492] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:38.690613 11636 ts_tablet_manager.cc:1403] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.141s	user 0.017s	sys 0.002s
W20260709 13:19:38.690626 10856 consensus_peers.cc:597] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.691814 10856 consensus_peers.cc:597] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.692858 10856 consensus_peers.cc:597] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.694295 10930 consensus_peers.cc:597] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.705286 11004 consensus_peers.cc:597] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:38.704670 10710 catalog_manager.cc:5697] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 1 to 2, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:38.704586 11636 raft_consensus.cc:359] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:38.716738 11636 raft_consensus.cc:740] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:38.695974 11625 leader_election.cc:304] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:38.717546 11636 consensus_queue.cc:260] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:38.718209 11643 raft_consensus.cc:2749] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:38.720439 11625 leader_election.cc:304] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:38.721521 11643 raft_consensus.cc:2749] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:38.742388 10930 consensus_peers.cc:597] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:38.747037 10964 raft_consensus.cc:1275] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:38.753150 11759 consensus_queue.cc:1048] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:38.758924 11625 leader_election.cc:304] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:38.760775 11643 raft_consensus.cc:2749] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:38.762357 11625 leader_election.cc:304] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:38.786893 11643 raft_consensus.cc:2749] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:38.789517 11004 consensus_peers.cc:597] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.790199 10930 consensus_peers.cc:597] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:38.799677 11636 ts_tablet_manager.cc:1434] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.109s	user 0.016s	sys 0.011s
I20260709 13:19:38.800608 11636 tablet_bootstrap.cc:492] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
W20260709 13:19:38.876063 10856 consensus_peers.cc:597] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.882381 10856 consensus_peers.cc:597] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.893699 10930 consensus_peers.cc:597] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:38.915678 11774 raft_consensus.cc:493] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.916497 11774 raft_consensus.cc:515] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:38.931078 11774 leader_election.cc:290] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:38.935488 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0005319a469f4f4e993fa7679707faa5" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:38.943260 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0005319a469f4f4e993fa7679707faa5" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:38.945384 11625 leader_election.cc:304] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:38.946818 11774 raft_consensus.cc:2749] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:38.952523 11636 tablet_bootstrap.cc:492] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:38.956069 11636 tablet_bootstrap.cc:492] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
W20260709 13:19:38.966418 10856 consensus_peers.cc:597] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:38.975859 11636 ts_tablet_manager.cc:1403] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.175s	user 0.020s	sys 0.005s
I20260709 13:19:38.979714 11636 raft_consensus.cc:359] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:38.982800 11636 raft_consensus.cc:740] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:38.983841 11636 consensus_queue.cc:260] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:38.988739 11636 ts_tablet_manager.cc:1434] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:19:38.992872 11636 tablet_bootstrap.cc:492] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:39.030733 11636 tablet_bootstrap.cc:492] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:39.031653 11636 tablet_bootstrap.cc:492] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:39.032290 11636 ts_tablet_manager.cc:1403] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.008s
I20260709 13:19:39.035539 11636 raft_consensus.cc:359] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:39.036315 11636 raft_consensus.cc:740] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:39.051556 11636 consensus_queue.cc:260] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:39.054332 11636 ts_tablet_manager.cc:1434] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:19:39.055217 11636 tablet_bootstrap.cc:492] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:39.066601 11793 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.65:37493 every 8 connection(s)
I20260709 13:19:39.067238  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.65:37493
I20260709 13:19:39.081487 11636 tablet_bootstrap.cc:492] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:39.086663 11636 tablet_bootstrap.cc:492] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:39.087532 11636 ts_tablet_manager.cc:1403] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.003s
I20260709 13:19:39.098706 11636 raft_consensus.cc:359] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:39.099440 11636 raft_consensus.cc:740] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:39.102913 11636 consensus_queue.cc:260] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:39.106980 11636 ts_tablet_manager.cc:1434] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:19:39.107867 11636 tablet_bootstrap.cc:492] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:39.218150 11636 tablet_bootstrap.cc:492] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:39.219231 11636 tablet_bootstrap.cc:492] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:39.219929 11636 ts_tablet_manager.cc:1403] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.112s	user 0.034s	sys 0.061s
I20260709 13:19:39.223078 11636 raft_consensus.cc:359] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:39.223863 11636 raft_consensus.cc:740] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:39.224797 11636 consensus_queue.cc:260] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:39.225613 11795 heartbeater.cc:344] Connected to a master server at 127.1.250.126:41433
I20260709 13:19:39.226107 11795 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:39.227087 11795 heartbeater.cc:507] Master 127.1.250.126:41433 requested a full tablet report, sending...
I20260709 13:19:39.227487 11636 ts_tablet_manager.cc:1434] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:39.228499 11636 tablet_bootstrap.cc:492] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:39.275421 10710 ts_manager.cc:194] Re-registered known tserver with Master: d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:19:39.323618 11694 raft_consensus.cc:3060] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:39.323848 11636 tablet_bootstrap.cc:492] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:39.324986 11636 tablet_bootstrap.cc:492] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:39.325857 11636 ts_tablet_manager.cc:1403] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.098s	user 0.030s	sys 0.039s
I20260709 13:19:39.333729 11636 raft_consensus.cc:359] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:39.346235 11636 raft_consensus.cc:740] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:39.347111 11636 consensus_queue.cc:260] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:39.349737 11636 ts_tablet_manager.cc:1434] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:19:39.350634 11636 tablet_bootstrap.cc:492] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:39.391283 10710 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56004
I20260709 13:19:39.398736 11795 heartbeater.cc:499] Master 127.1.250.126:41433 was elected leader, sending a full tablet report...
I20260709 13:19:39.421898 11636 tablet_bootstrap.cc:492] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:39.423147 11636 tablet_bootstrap.cc:492] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:39.424082 11636 ts_tablet_manager.cc:1403] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.013s
I20260709 13:19:39.427999 11636 raft_consensus.cc:359] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:39.428988 11636 raft_consensus.cc:740] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:39.430016 11636 consensus_queue.cc:260] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:39.433012 11636 ts_tablet_manager.cc:1434] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:19:39.434202 11636 tablet_bootstrap.cc:492] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:39.446452 11694 raft_consensus.cc:3060] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:39.467664 11636 tablet_bootstrap.cc:492] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:39.468761 11636 tablet_bootstrap.cc:492] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:39.469496 11636 ts_tablet_manager.cc:1403] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.000s
I20260709 13:19:39.472213 11636 raft_consensus.cc:359] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:39.472952 11636 raft_consensus.cc:740] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:39.473915 11636 consensus_queue.cc:260] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:39.475870 11636 ts_tablet_manager.cc:1434] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:39.476687 11636 tablet_bootstrap.cc:492] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:39.487787 11694 raft_consensus.cc:3060] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:39.493239 11636 tablet_bootstrap.cc:492] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:39.494436 11636 tablet_bootstrap.cc:492] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:39.495153 11636 ts_tablet_manager.cc:1403] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:19:39.498554 11636 raft_consensus.cc:359] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:39.499266 11636 raft_consensus.cc:740] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:39.500150 11636 consensus_queue.cc:260] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:39.502821 11636 ts_tablet_manager.cc:1434] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:39.503912 11636 tablet_bootstrap.cc:492] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:39.537971 11636 tablet_bootstrap.cc:492] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:39.539532 11636 tablet_bootstrap.cc:492] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:39.540383 11636 ts_tablet_manager.cc:1403] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.037s	user 0.025s	sys 0.006s
I20260709 13:19:39.543735 11636 raft_consensus.cc:359] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:39.544590 11636 raft_consensus.cc:740] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:39.545462 11636 consensus_queue.cc:260] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:39.547960 11636 ts_tablet_manager.cc:1434] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:19:39.548800 11636 tablet_bootstrap.cc:492] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:39.577490 11698 raft_consensus.cc:3060] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:39.592449 11636 tablet_bootstrap.cc:492] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:39.593619 11636 tablet_bootstrap.cc:492] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:39.594287 11636 ts_tablet_manager.cc:1403] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.013s
I20260709 13:19:39.597141 11636 raft_consensus.cc:359] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:39.597889 11636 raft_consensus.cc:740] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:39.598618 11636 consensus_queue.cc:260] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:39.600713 11636 ts_tablet_manager.cc:1434] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:39.602011 11636 tablet_bootstrap.cc:492] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:39.636618 11694 raft_consensus.cc:3060] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:39.670958 11688 raft_consensus.cc:3060] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:39.685230 11636 tablet_bootstrap.cc:492] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:39.686328 11636 tablet_bootstrap.cc:492] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:39.687100 11636 ts_tablet_manager.cc:1403] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.086s	user 0.027s	sys 0.031s
I20260709 13:19:39.689741 11636 raft_consensus.cc:359] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:39.690455 11636 raft_consensus.cc:740] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:39.691277 11636 consensus_queue.cc:260] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:39.696748 11636 ts_tablet_manager.cc:1434] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:19:39.698881 11636 tablet_bootstrap.cc:492] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:39.769646 11636 tablet_bootstrap.cc:492] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:39.770500 11636 tablet_bootstrap.cc:492] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:39.773891 11636 ts_tablet_manager.cc:1403] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.075s	user 0.023s	sys 0.009s
I20260709 13:19:39.776021 11636 raft_consensus.cc:359] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:39.776609 11636 raft_consensus.cc:740] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:39.778458 11636 consensus_queue.cc:260] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:39.784798 11636 ts_tablet_manager.cc:1434] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 13:19:39.785708 11636 tablet_bootstrap.cc:492] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:39.813202 11636 tablet_bootstrap.cc:492] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:39.814041 11636 tablet_bootstrap.cc:492] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:39.814628 11636 ts_tablet_manager.cc:1403] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.006s
I20260709 13:19:39.816423 11636 raft_consensus.cc:359] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:39.816948 11636 raft_consensus.cc:740] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:39.817652 11636 consensus_queue.cc:260] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:39.819618 11636 ts_tablet_manager.cc:1434] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:39.820417 11636 tablet_bootstrap.cc:492] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:39.945039 11688 raft_consensus.cc:3060] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:40.014268 11688 raft_consensus.cc:3060] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:40.076728 11698 raft_consensus.cc:3060] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:40.395589 11636 tablet_bootstrap.cc:492] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:40.406764 11636 tablet_bootstrap.cc:492] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:40.430567 11636 ts_tablet_manager.cc:1403] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.610s	user 0.116s	sys 0.145s
W20260709 13:19:40.425805 11004 consensus_peers.cc:597] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.471843 11636 raft_consensus.cc:359] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
W20260709 13:19:40.500787 11004 consensus_peers.cc:597] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:40.504050 10856 consensus_peers.cc:597] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.516366 11636 raft_consensus.cc:740] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.517350 11636 consensus_queue.cc:260] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:40.520148 11636 ts_tablet_manager.cc:1434] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.000s
I20260709 13:19:40.548404 11636 tablet_bootstrap.cc:492] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
W20260709 13:19:40.598626 10930 consensus_peers.cc:597] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:40.638723 11636 tablet_bootstrap.cc:492] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:40.639771 11636 tablet_bootstrap.cc:492] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:40.640571 11636 ts_tablet_manager.cc:1403] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.008s
I20260709 13:19:40.643682 11636 raft_consensus.cc:359] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:40.644448 11636 raft_consensus.cc:740] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.645215 11636 consensus_queue.cc:260] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:40.647569 11636 ts_tablet_manager.cc:1434] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:19:40.648512 11636 tablet_bootstrap.cc:492] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
W20260709 13:19:40.650743 11004 consensus_peers.cc:597] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.677976 11004 consensus_peers.cc:597] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:40.701455 11636 tablet_bootstrap.cc:492] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:40.702378 11636 tablet_bootstrap.cc:492] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:40.706666 11636 ts_tablet_manager.cc:1403] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.004s
I20260709 13:19:40.711264 11636 raft_consensus.cc:359] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:40.711959 11636 raft_consensus.cc:740] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.721580 11636 consensus_queue.cc:260] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:40.724026 11636 ts_tablet_manager.cc:1434] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 13:19:40.725320 11636 tablet_bootstrap.cc:492] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
W20260709 13:19:40.751150 10930 consensus_peers.cc:597] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.759223 11636 tablet_bootstrap.cc:492] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:40.760249 11636 tablet_bootstrap.cc:492] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:40.760851 11636 ts_tablet_manager.cc:1403] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.004s
I20260709 13:19:40.762853 11636 raft_consensus.cc:359] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:40.763378 11636 raft_consensus.cc:740] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.764010 11636 consensus_queue.cc:260] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:40.770059 11636 ts_tablet_manager.cc:1434] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:19:40.770892 11636 tablet_bootstrap.cc:492] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
W20260709 13:19:40.787379 11004 consensus_peers.cc:597] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:40.795208 11636 tablet_bootstrap.cc:492] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:40.797088 11636 tablet_bootstrap.cc:492] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:40.797747 11636 ts_tablet_manager.cc:1403] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.003s
I20260709 13:19:40.800284 11636 raft_consensus.cc:359] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:40.802062 11636 raft_consensus.cc:740] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.803004 11636 consensus_queue.cc:260] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:40.804837 11636 ts_tablet_manager.cc:1434] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:19:40.805961 11636 tablet_bootstrap.cc:492] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
W20260709 13:19:40.855436 10930 consensus_peers.cc:597] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.900638 11688 raft_consensus.cc:3060] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:40.916890 10930 consensus_peers.cc:597] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:40.926944 10856 consensus_peers.cc:597] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.932984 11636 tablet_bootstrap.cc:492] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:40.934059 11636 tablet_bootstrap.cc:492] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:40.934727 11636 ts_tablet_manager.cc:1403] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.129s	user 0.034s	sys 0.022s
I20260709 13:19:40.943959 11636 raft_consensus.cc:359] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:40.944687 11636 raft_consensus.cc:740] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.945397 11636 consensus_queue.cc:260] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:40.952243 11636 ts_tablet_manager.cc:1434] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:19:40.953054 11636 tablet_bootstrap.cc:492] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:40.983702 11636 tablet_bootstrap.cc:492] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:40.996270 11636 tablet_bootstrap.cc:492] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:40.996873 11636 ts_tablet_manager.cc:1403] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.011s
W20260709 13:19:41.004151 10930 consensus_peers.cc:597] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:41.009382 11636 raft_consensus.cc:359] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:41.010247 11636 raft_consensus.cc:740] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.011845 11636 consensus_queue.cc:260] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:41.016053 11636 ts_tablet_manager.cc:1434] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:19:41.016928 11636 tablet_bootstrap.cc:492] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
W20260709 13:19:41.026678 10930 consensus_peers.cc:597] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:41.029721 11688 raft_consensus.cc:3060] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.039458 11636 tablet_bootstrap.cc:492] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.041664 11636 tablet_bootstrap.cc:492] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.045401 11636 ts_tablet_manager.cc:1403] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.008s
I20260709 13:19:41.050014 11636 raft_consensus.cc:359] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:41.051534 11636 raft_consensus.cc:740] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.054333 11636 consensus_queue.cc:260] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:41.056741 11694 raft_consensus.cc:3060] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.058245 11636 ts_tablet_manager.cc:1434] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:19:41.059787 11636 tablet_bootstrap.cc:492] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
W20260709 13:19:41.073167 11004 consensus_peers.cc:597] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:41.088641 11636 tablet_bootstrap.cc:492] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.089864 11636 tablet_bootstrap.cc:492] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.091336 11636 ts_tablet_manager.cc:1403] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.011s
I20260709 13:19:41.093796 11636 raft_consensus.cc:359] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:41.098042 11636 raft_consensus.cc:740] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.099097 11636 consensus_queue.cc:260] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:41.101361 11636 ts_tablet_manager.cc:1434] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:19:41.114060 11636 tablet_bootstrap.cc:492] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
W20260709 13:19:41.120434 11004 consensus_peers.cc:597] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:41.123538 10856 consensus_peers.cc:597] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:41.143399 11636 tablet_bootstrap.cc:492] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.144550 11636 tablet_bootstrap.cc:492] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.145314 11636 ts_tablet_manager.cc:1403] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.014s
I20260709 13:19:41.148229 11636 raft_consensus.cc:359] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:41.148912 11636 raft_consensus.cc:740] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.149567 11636 consensus_queue.cc:260] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:41.151456 11636 ts_tablet_manager.cc:1434] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:19:41.152285 11636 tablet_bootstrap.cc:492] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:41.180451 11636 tablet_bootstrap.cc:492] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.181480 11636 tablet_bootstrap.cc:492] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.182250 11636 ts_tablet_manager.cc:1403] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.016s
I20260709 13:19:41.184949 11636 raft_consensus.cc:359] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:41.185693 11636 raft_consensus.cc:740] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.186547 11636 consensus_queue.cc:260] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:41.188930 11636 ts_tablet_manager.cc:1434] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 13:19:41.189842 11636 tablet_bootstrap.cc:492] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:41.210697 11636 tablet_bootstrap.cc:492] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.211736 11636 tablet_bootstrap.cc:492] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.212440 11636 ts_tablet_manager.cc:1403] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 13:19:41.215487 11636 raft_consensus.cc:359] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:41.216214 11636 raft_consensus.cc:740] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.217391 11636 consensus_queue.cc:260] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:41.220150 11636 ts_tablet_manager.cc:1434] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:19:41.223644 11636 tablet_bootstrap.cc:492] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:41.261579 11636 tablet_bootstrap.cc:492] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.262624 11636 tablet_bootstrap.cc:492] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.264626 11636 ts_tablet_manager.cc:1403] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.041s	user 0.024s	sys 0.011s
I20260709 13:19:41.267352 11636 raft_consensus.cc:359] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:41.268268 11636 raft_consensus.cc:740] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.269228 11636 consensus_queue.cc:260] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:41.270773 11636 ts_tablet_manager.cc:1434] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:41.271801 11636 tablet_bootstrap.cc:492] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:41.296103 11636 tablet_bootstrap.cc:492] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.297246 11636 tablet_bootstrap.cc:492] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.298018 11636 ts_tablet_manager.cc:1403] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.011s
I20260709 13:19:41.300043 11636 raft_consensus.cc:359] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:41.300719 11636 raft_consensus.cc:740] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.301441 11636 consensus_queue.cc:260] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:41.304647 11636 ts_tablet_manager.cc:1434] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:41.306372 11636 tablet_bootstrap.cc:492] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:41.329367 11636 tablet_bootstrap.cc:492] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.330356 11636 tablet_bootstrap.cc:492] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.331053 11636 ts_tablet_manager.cc:1403] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.000s
I20260709 13:19:41.333938 11636 raft_consensus.cc:359] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:41.334677 11636 raft_consensus.cc:740] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.335410 11636 consensus_queue.cc:260] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:41.337850 11636 ts_tablet_manager.cc:1434] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:19:41.338688 11636 tablet_bootstrap.cc:492] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:41.372308 11636 tablet_bootstrap.cc:492] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.373364 11636 tablet_bootstrap.cc:492] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.374145 11636 ts_tablet_manager.cc:1403] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.012s
I20260709 13:19:41.376856 11636 raft_consensus.cc:359] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:41.377589 11636 raft_consensus.cc:740] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.378357 11636 consensus_queue.cc:260] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:41.380649 11636 ts_tablet_manager.cc:1434] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:41.381506 11636 tablet_bootstrap.cc:492] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
W20260709 13:19:41.391522 10930 consensus_peers.cc:597] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:41.419513 11636 tablet_bootstrap.cc:492] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.420696 11636 tablet_bootstrap.cc:492] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.421448 11636 ts_tablet_manager.cc:1403] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.040s	user 0.024s	sys 0.009s
I20260709 13:19:41.424147 11636 raft_consensus.cc:359] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:41.424844 11636 raft_consensus.cc:740] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.425560 11636 consensus_queue.cc:260] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:41.428053 11636 ts_tablet_manager.cc:1434] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:41.432595 11636 tablet_bootstrap.cc:492] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:41.473536 11636 tablet_bootstrap.cc:492] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.476085 11698 raft_consensus.cc:3060] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.479494 11694 raft_consensus.cc:3060] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:41.484946 11636 tablet_bootstrap.cc:492] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.492722 11636 ts_tablet_manager.cc:1403] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.012s
I20260709 13:19:41.495512 11636 raft_consensus.cc:359] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:41.496286 11636 raft_consensus.cc:740] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.497037 11636 consensus_queue.cc:260] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:41.497583 11677 raft_consensus.cc:3060] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:41.499569 11636 ts_tablet_manager.cc:1434] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:41.500629 11636 tablet_bootstrap.cc:492] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:41.569605 11636 tablet_bootstrap.cc:492] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.570751 11636 tablet_bootstrap.cc:492] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.571417 11636 ts_tablet_manager.cc:1403] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.071s	user 0.034s	sys 0.031s
I20260709 13:19:41.573441 11676 raft_consensus.cc:3060] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.586050 11636 raft_consensus.cc:359] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:41.586966 11636 raft_consensus.cc:740] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.587832 11636 consensus_queue.cc:260] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:41.589787 11636 ts_tablet_manager.cc:1434] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:19:41.590651 11636 tablet_bootstrap.cc:492] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:41.638437 11674 raft_consensus.cc:3060] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:41.667397 11004 consensus_peers.cc:597] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:41.673349 11636 tablet_bootstrap.cc:492] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.676057 11636 tablet_bootstrap.cc:492] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.676805 11636 ts_tablet_manager.cc:1403] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.030s
I20260709 13:19:41.699955 11636 raft_consensus.cc:359] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:41.702843 11636 raft_consensus.cc:740] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.703574 11636 consensus_queue.cc:260] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:41.719625 11636 ts_tablet_manager.cc:1434] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:19:41.720683 11636 tablet_bootstrap.cc:492] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:41.798977 11636 tablet_bootstrap.cc:492] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.799988 11636 tablet_bootstrap.cc:492] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.800670 11636 ts_tablet_manager.cc:1403] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.080s	user 0.034s	sys 0.024s
I20260709 13:19:41.803241 11636 raft_consensus.cc:359] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:41.803928 11636 raft_consensus.cc:740] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.804592 11636 consensus_queue.cc:260] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:41.806620 11636 ts_tablet_manager.cc:1434] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:19:41.807408 11636 tablet_bootstrap.cc:492] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:41.835379 11636 tablet_bootstrap.cc:492] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.836359 11636 tablet_bootstrap.cc:492] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.837244 11636 ts_tablet_manager.cc:1403] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.011s
I20260709 13:19:41.840183 11636 raft_consensus.cc:359] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:41.840791 11636 raft_consensus.cc:740] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.841609 11636 consensus_queue.cc:260] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:41.843762 11636 ts_tablet_manager.cc:1434] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:41.846566 11636 tablet_bootstrap.cc:492] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap starting.
I20260709 13:19:41.873229 11636 tablet_bootstrap.cc:492] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.874406 11636 tablet_bootstrap.cc:492] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1: Bootstrap complete.
I20260709 13:19:41.875106 11698 raft_consensus.cc:3060] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.875259 11636 ts_tablet_manager.cc:1403] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.005s
I20260709 13:19:41.878446 11636 raft_consensus.cc:359] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:41.879088 11636 raft_consensus.cc:740] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.879868 11636 consensus_queue.cc:260] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:41.881388 11636 ts_tablet_manager.cc:1434] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:41.891657 11674 raft_consensus.cc:3060] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:44.024021 10854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:44237, user_credentials={real_user=slave}} blocked reactor thread for 57454.1us
W20260709 13:19:47.359795 10855 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 50207.7us
W20260709 13:19:48.260044 11059 debug-util.cc:398] Leaking SignalData structure 0x7b08000e8ca0 after lost signal to thread 2028
W20260709 13:19:48.261047 11059 debug-util.cc:398] Leaking SignalData structure 0x7b0800100d20 after lost signal to thread 10747
W20260709 13:19:48.262131 11059 debug-util.cc:398] Leaking SignalData structure 0x7b0800317700 after lost signal to thread 10914
W20260709 13:19:48.263149 11059 debug-util.cc:398] Leaking SignalData structure 0x7b08000667e0 after lost signal to thread 10988
W20260709 13:19:48.264101 11059 debug-util.cc:398] Leaking SignalData structure 0x7b08002c36a0 after lost signal to thread 11062
W20260709 13:19:48.265059 11059 debug-util.cc:398] Leaking SignalData structure 0x7b08000a9bc0 after lost signal to thread 11793
W20260709 13:19:48.547152 10985 debug-util.cc:398] Leaking SignalData structure 0x7b08002dcb00 after lost signal to thread 2028
W20260709 13:19:48.548228 10985 debug-util.cc:398] Leaking SignalData structure 0x7b080019e7e0 after lost signal to thread 10747
W20260709 13:19:48.549365 10985 debug-util.cc:398] Leaking SignalData structure 0x7b08002773e0 after lost signal to thread 10914
W20260709 13:19:48.550347 10985 debug-util.cc:398] Leaking SignalData structure 0x7b0800120600 after lost signal to thread 10988
W20260709 13:19:48.551368 10985 debug-util.cc:398] Leaking SignalData structure 0x7b08000fa760 after lost signal to thread 11062
W20260709 13:19:48.552515 10985 debug-util.cc:398] Leaking SignalData structure 0x7b0800177100 after lost signal to thread 11793
I20260709 13:19:49.811944  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:49.940088 10885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5"
dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:19:49.940944 10885 raft_consensus.cc:606] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:49.943583 10885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa"
dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:19:49.944046 10885 raft_consensus.cc:606] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 3 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:49.946497 10885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2904c45fa164407791817b45928f663e"
dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:19:49.948032 10885 raft_consensus.cc:606] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:49.952342 10885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf"
dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:19:49.952943 10885 raft_consensus.cc:606] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:49.956192 10885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8eb72b7a1eed4df08c0414cdb29fb6f1"
dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
mode: GRACEFUL
new_leader_uuid: "10307244fcd642b89723e4fb4ac1291a"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:19:49.956780 10885 raft_consensus.cc:606] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Received request to transfer leadership to TS 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:49.979843 10964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b949895bff3f409b9781c118fe3c9c21"
dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:37896
I20260709 13:19:49.980443 10964 raft_consensus.cc:606] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:50.008860 11032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb34c068418c4622b74233a46424384d"
dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
mode: GRACEFUL
new_leader_uuid: "02260b9a864a4665ae3c33869adeaaf5"
 from {username='slave'} at 127.0.0.1:58268
I20260709 13:19:50.009536 11032 raft_consensus.cc:606] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Received request to transfer leadership to TS 02260b9a864a4665ae3c33869adeaaf5
I20260709 13:19:50.010821  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:19:50.012118  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:50.118949 11924 raft_consensus.cc:993] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a: : Instructing follower 02260b9a864a4665ae3c33869adeaaf5 to start an election
I20260709 13:19:50.119695 11924 raft_consensus.cc:1081] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Signalling peer 02260b9a864a4665ae3c33869adeaaf5 to start an election
I20260709 13:19:50.121726 10884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb34c068418c4622b74233a46424384d"
dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
 from {username='slave'} at 127.0.0.1:47650
I20260709 13:19:50.122228 10884 raft_consensus.cc:493] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:50.122653 10884 raft_consensus.cc:3060] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.131562 10884 raft_consensus.cc:515] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:50.134627 10884 leader_election.cc:290] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:50.135064 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb34c068418c4622b74233a46424384d" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:50.136106 10964 raft_consensus.cc:3060] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.138541 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb34c068418c4622b74233a46424384d" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:50.139256 11032 raft_consensus.cc:3055] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:50.139573 11032 raft_consensus.cc:740] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:50.140372 11032 consensus_queue.cc:260] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:50.142334 11032 raft_consensus.cc:3060] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.153378 11032 raft_consensus.cc:2468] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:50.156036 10854 leader_election.cc:304] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:50.159036 11922 raft_consensus.cc:2804] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:50.161453 11922 raft_consensus.cc:697] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:50.163372 11922 consensus_queue.cc:237] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:50.144832 10964 raft_consensus.cc:2468] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:50.203982 11910 raft_consensus.cc:993] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:50.204813 11910 raft_consensus.cc:1081] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 3 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:50.208577 11677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39404
I20260709 13:19:50.209311 11677 raft_consensus.cc:493] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:50.209719 11677 raft_consensus.cc:3060] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:50.265409 11677 raft_consensus.cc:515] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:50.267822 11677 leader_election.cc:290] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 4 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:50.269629 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:50.269955 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:50.270406 11032 raft_consensus.cc:3060] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:50.270622 10885 raft_consensus.cc:3055] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:50.272248 10885 raft_consensus.cc:740] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:50.273234 10885 consensus_queue.cc:260] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:50.274355 10885 raft_consensus.cc:3060] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:50.283808 11032 raft_consensus.cc:2468] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 4.
I20260709 13:19:50.285884 11625 leader_election.cc:304] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:50.287732 11910 raft_consensus.cc:993] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:50.290755 11910 raft_consensus.cc:1081] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:50.305178 11932 raft_consensus.cc:993] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5: : Instructing follower 10307244fcd642b89723e4fb4ac1291a to start an election
I20260709 13:19:50.305995 11934 raft_consensus.cc:1081] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Signalling peer 10307244fcd642b89723e4fb4ac1291a to start an election
I20260709 13:19:50.305864 11677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39404
I20260709 13:19:50.308375 11677 raft_consensus.cc:493] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:50.308847 11677 raft_consensus.cc:3060] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:50.307361 11935 raft_consensus.cc:2804] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:50.312582 10712 catalog_manager.cc:5697] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 1 to 2, leader changed from 10307244fcd642b89723e4fb4ac1291a (127.1.250.68) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:50.317493 11032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8eb72b7a1eed4df08c0414cdb29fb6f1"
dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
 from {username='slave'} at 127.0.0.1:52850
I20260709 13:19:50.319356 11935 raft_consensus.cc:697] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 4 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:50.322471 11032 raft_consensus.cc:493] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:50.323032 11935 consensus_queue.cc:237] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:50.324013 11032 raft_consensus.cc:3060] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.323396 11677 raft_consensus.cc:515] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:50.329144 11677 leader_election.cc:290] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:50.346122 11032 raft_consensus.cc:515] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:50.350142 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:50.350804 10964 raft_consensus.cc:3060] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:50.359158 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb72b7a1eed4df08c0414cdb29fb6f1" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:50.359849 10884 raft_consensus.cc:3055] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:50.360954 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:50.362282 11032 leader_election.cc:290] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:50.367372 10890 raft_consensus.cc:3055] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:50.367825 10890 raft_consensus.cc:740] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:50.368845 10890 consensus_queue.cc:260] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:50.370422 10890 raft_consensus.cc:3060] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:50.364705 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb72b7a1eed4df08c0414cdb29fb6f1" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:50.373402 10961 raft_consensus.cc:3060] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.359872 10885 raft_consensus.cc:2468] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 4.
I20260709 13:19:50.379190 10711 catalog_manager.cc:5697] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 3 to 4, leader changed from 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 4 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.382584 11923 raft_consensus.cc:993] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:50.383730 11902 raft_consensus.cc:1081] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:50.360139 10884 raft_consensus.cc:740] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:50.385998 11698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b949895bff3f409b9781c118fe3c9c21"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39406
I20260709 13:19:50.386579 11698 raft_consensus.cc:493] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:50.386979 11698 raft_consensus.cc:3060] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.386713 10884 consensus_queue.cc:260] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:50.388441 10884 raft_consensus.cc:3060] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.392326 10890 raft_consensus.cc:2468] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 3.
I20260709 13:19:50.399361 11625 leader_election.cc:304] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:50.382592 11932 raft_consensus.cc:993] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:50.399750 11910 raft_consensus.cc:993] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:50.400267 11934 raft_consensus.cc:1081] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:50.400533 11935 raft_consensus.cc:2804] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:50.401165 11935 raft_consensus.cc:697] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:50.401275 11910 raft_consensus.cc:1081] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:50.402278 11935 consensus_queue.cc:237] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:50.403513 10961 raft_consensus.cc:2468] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 2.
I20260709 13:19:50.409956 11694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2904c45fa164407791817b45928f663e"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39404
I20260709 13:19:50.410209 11003 leader_election.cc:304] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:50.410424 11676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39404
I20260709 13:19:50.410544 11694 raft_consensus.cc:493] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:50.408515 11698 raft_consensus.cc:515] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:50.411037 11694 raft_consensus.cc:3060] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.411170 11924 raft_consensus.cc:2804] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:50.411738 11924 raft_consensus.cc:697] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [term 2 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:50.412909 11698 leader_election.cc:290] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:50.411032 11676 raft_consensus.cc:493] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:50.413915 11676 raft_consensus.cc:3060] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:50.415127 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949895bff3f409b9781c118fe3c9c21" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:50.416015 10890 raft_consensus.cc:3060] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.412823 11924 consensus_queue.cc:237] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:50.419288 10884 raft_consensus.cc:2468] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 2.
I20260709 13:19:50.425964 10964 raft_consensus.cc:2468] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 3.
I20260709 13:19:50.435452 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949895bff3f409b9781c118fe3c9c21" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:50.436157 10964 raft_consensus.cc:3055] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:50.438243 10964 raft_consensus.cc:740] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:50.447359 10890 raft_consensus.cc:2468] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:50.447322 11676 raft_consensus.cc:515] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:50.459556 10964 consensus_queue.cc:260] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:50.451295 11694 raft_consensus.cc:515] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:50.466560 11676 leader_election.cc:290] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:50.466907 11694 leader_election.cc:290] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:50.469339 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:50.469898 10961 raft_consensus.cc:3060] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:50.470363 10964 raft_consensus.cc:3060] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.477571 10964 raft_consensus.cc:2468] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:50.473759 10959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904c45fa164407791817b45928f663e" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:50.480201 10959 raft_consensus.cc:3060] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.484501 10961 raft_consensus.cc:2468] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 3.
I20260709 13:19:50.485237 10964 raft_consensus.cc:1240] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Rejecting Update request from peer 02260b9a864a4665ae3c33869adeaaf5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:50.503152 11626 leader_election.cc:304] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:50.507012 11626 leader_election.cc:304] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:50.508976 11936 raft_consensus.cc:2804] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:50.495221 11910 consensus_queue.cc:1059] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 13:19:50.521785 10930 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 44942.1us
W20260709 13:19:50.522982 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 44211.6us
I20260709 13:19:50.527045 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:50.527379 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904c45fa164407791817b45928f663e" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:50.527875 10890 raft_consensus.cc:3055] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:50.528059 10885 raft_consensus.cc:3055] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:50.528415 10890 raft_consensus.cc:740] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:50.528640 10885 raft_consensus.cc:740] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:50.529644 10885 consensus_queue.cc:260] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:50.529635 10890 consensus_queue.cc:260] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:50.537446 10890 raft_consensus.cc:3060] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:50.542438 11936 raft_consensus.cc:697] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:50.542997 11947 raft_consensus.cc:2804] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:50.543640 11936 consensus_queue.cc:237] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:50.549566 10885 raft_consensus.cc:3060] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.556097 10890 raft_consensus.cc:2468] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 3.
I20260709 13:19:50.568084 10959 raft_consensus.cc:2468] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
W20260709 13:19:50.570003 11933 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:19:50.565289 11947 raft_consensus.cc:697] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:50.571626 11947 consensus_queue.cc:237] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:50.580567 10885 raft_consensus.cc:2468] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:50.578716 11626 leader_election.cc:304] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:50.592829 10960 raft_consensus.cc:1275] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:50.596248 11004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 73645.4us
I20260709 13:19:50.599611 11918 consensus_queue.cc:1048] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:50.637265 11949 raft_consensus.cc:2804] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:50.640555 11949 raft_consensus.cc:697] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:50.641618 11949 consensus_queue.cc:237] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:50.653991 10709 catalog_manager.cc:5697] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 1 to 2, leader changed from 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66) to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 2 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:50.670388 10930 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 116259us
I20260709 13:19:50.742779 10709 catalog_manager.cc:5697] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 1 to 2, leader changed from 348b268fc1da46ac98e10bbe776b018b (127.1.250.67) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.744895 10709 catalog_manager.cc:5697] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 1 to 2, leader changed from 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.748220 10709 catalog_manager.cc:5697] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 2 to 3, leader changed from 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.767972 10709 catalog_manager.cc:5697] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 2 to 3, leader changed from 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:50.770484 10930 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 74715.1us
I20260709 13:19:50.775135 10884 raft_consensus.cc:1275] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:50.770208 11032 raft_consensus.cc:1275] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 4 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:50.776785 11949 consensus_queue.cc:1048] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:50.785065 11947 consensus_queue.cc:1048] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:50.810035 11031 raft_consensus.cc:1275] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:50.811551 11922 consensus_queue.cc:1048] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:50.870110 10964 raft_consensus.cc:1275] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:50.871935 11936 consensus_queue.cc:1048] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:50.892290 10890 raft_consensus.cc:1275] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:50.894008 11949 consensus_queue.cc:1048] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:50.899876 10964 raft_consensus.cc:1275] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer 10307244fcd642b89723e4fb4ac1291a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:50.902096 11959 consensus_queue.cc:1048] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:50.936622 10890 raft_consensus.cc:1275] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer 10307244fcd642b89723e4fb4ac1291a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:50.946938 11959 consensus_queue.cc:1048] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:50.990790 10890 raft_consensus.cc:1275] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:50.994900 11936 consensus_queue.cc:1048] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:51.013186  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:51.030323 10885 raft_consensus.cc:1275] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:51.031873 11936 consensus_queue.cc:1048] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:51.038501 10960 raft_consensus.cc:1275] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:51.040464 11947 consensus_queue.cc:1048] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:51.092082 10964 raft_consensus.cc:1275] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:51.097934 11946 consensus_queue.cc:1048] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:51.139856 10960 raft_consensus.cc:1275] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:51.148293 11936 consensus_queue.cc:1048] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:51.172163 10890 raft_consensus.cc:1275] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:51.177013 11936 consensus_queue.cc:1048] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:51.459507  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:51.526503 11031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0223927df5f442079c8fa526ed7eef26"
dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:58268
I20260709 13:19:51.527160 11031 raft_consensus.cc:606] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:51.530385 11032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64eb7071b63a4a51bc2c3b07b243711e"
dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:58268
I20260709 13:19:51.531204 11032 raft_consensus.cc:606] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:51.535434 11032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84a90e754ea44ce5b10285e034656db6"
dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:58268
I20260709 13:19:51.536144 11032 raft_consensus.cc:606] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:51.541013 11032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c282271ee3314a2db79070b0c703e56d"
dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
mode: GRACEFUL
new_leader_uuid: "02260b9a864a4665ae3c33869adeaaf5"
 from {username='slave'} at 127.0.0.1:58268
I20260709 13:19:51.541652 11032 raft_consensus.cc:606] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Received request to transfer leadership to TS 02260b9a864a4665ae3c33869adeaaf5
I20260709 13:19:51.546000 11924 raft_consensus.cc:993] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:51.546480 11921 raft_consensus.cc:1081] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:51.547569 10964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c78decb93a9542368bf3107bc846a6f0"
dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:37896
I20260709 13:19:51.551450 10964 raft_consensus.cc:606] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:51.552378 11677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84a90e754ea44ce5b10285e034656db6"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39398
I20260709 13:19:51.553614 11677 raft_consensus.cc:493] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:51.556208 11677 raft_consensus.cc:3060] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:51.556630 10890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7e627f9d3ca4ef68b1fbeb3f16da01a"
dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:19:51.557354 10890 raft_consensus.cc:606] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:51.558777  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:51.561242  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:51.567890 11677 raft_consensus.cc:515] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:51.571849 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a90e754ea44ce5b10285e034656db6" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:51.571851 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a90e754ea44ce5b10285e034656db6" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:51.572763 10964 raft_consensus.cc:3060] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:51.573102 11032 raft_consensus.cc:3055] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:51.573676 11032 raft_consensus.cc:740] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:51.573864 11677 leader_election.cc:290] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:51.574887 11032 consensus_queue.cc:260] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:51.582180 11032 raft_consensus.cc:3060] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:51.591511 11924 raft_consensus.cc:993] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a: : Instructing follower 02260b9a864a4665ae3c33869adeaaf5 to start an election
I20260709 13:19:51.592180 11924 raft_consensus.cc:1081] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Signalling peer 02260b9a864a4665ae3c33869adeaaf5 to start an election
I20260709 13:19:51.598515 10890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c282271ee3314a2db79070b0c703e56d"
dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
 from {username='slave'} at 127.0.0.1:47650
I20260709 13:19:51.599109 10890 raft_consensus.cc:493] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:51.599490 10890 raft_consensus.cc:3060] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:51.600584 11032 raft_consensus.cc:2468] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:51.601994 10964 raft_consensus.cc:2468] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:51.602240 11625 leader_election.cc:304] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:51.603370 11946 raft_consensus.cc:2804] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:51.603905 11946 raft_consensus.cc:697] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:51.604916 11946 consensus_queue.cc:237] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:51.607906 10890 raft_consensus.cc:515] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:51.612186 10890 leader_election.cc:290] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:51.631450 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282271ee3314a2db79070b0c703e56d" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:51.632357 10964 raft_consensus.cc:3060] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:51.630496 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282271ee3314a2db79070b0c703e56d" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:51.633354 11032 raft_consensus.cc:3055] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:51.633700 11032 raft_consensus.cc:740] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:51.641467 11032 consensus_queue.cc:260] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:51.649174 11032 raft_consensus.cc:3060] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:51.663815 11032 raft_consensus.cc:2468] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:51.665395 10854 leader_election.cc:304] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:51.665179 10711 catalog_manager.cc:5697] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 1 to 2, leader changed from 10307244fcd642b89723e4fb4ac1291a (127.1.250.68) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:51.666846 11922 raft_consensus.cc:2804] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:51.670562 11922 raft_consensus.cc:697] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:51.663815 10964 raft_consensus.cc:2468] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:51.671459 11922 consensus_queue.cc:237] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:51.716373 10709 catalog_manager.cc:5697] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 1 to 2, leader changed from 10307244fcd642b89723e4fb4ac1291a (127.1.250.68) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:51.788800 11939 log.cc:927] Time spent T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.023s
W20260709 13:19:51.809158 10928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:44237, user_credentials={real_user=slave}} blocked reactor thread for 62395.8us
I20260709 13:19:51.821591 11952 raft_consensus.cc:993] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:51.822154 11952 raft_consensus.cc:1081] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:51.825157 11677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7e627f9d3ca4ef68b1fbeb3f16da01a"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39404
I20260709 13:19:51.830575 11677 raft_consensus.cc:493] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:51.831598 11677 raft_consensus.cc:3060] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:51.840723 10930 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 99634.9us
I20260709 13:19:51.844650 11677 raft_consensus.cc:515] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:51.851789 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e627f9d3ca4ef68b1fbeb3f16da01a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:51.852463 11032 raft_consensus.cc:3060] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:51.861223 11032 raft_consensus.cc:2468] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:51.862543 11677 leader_election.cc:290] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:51.862601 11625 leader_election.cc:304] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:51.864020 11979 raft_consensus.cc:2804] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:51.864565 11979 raft_consensus.cc:697] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:51.865540 11979 consensus_queue.cc:237] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:51.866080 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e627f9d3ca4ef68b1fbeb3f16da01a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:51.866806 10884 raft_consensus.cc:3055] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:51.867133 10884 raft_consensus.cc:740] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:51.867939 10884 consensus_queue.cc:260] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:51.870045 10884 raft_consensus.cc:3060] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:51.894603 10884 raft_consensus.cc:2468] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:51.898576 11984 raft_consensus.cc:993] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:51.902236 11984 raft_consensus.cc:1081] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:51.903988 11677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c78decb93a9542368bf3107bc846a6f0"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39406
I20260709 13:19:51.904510 11677 raft_consensus.cc:493] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:51.904865 11677 raft_consensus.cc:3060] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:51.908608 10711 catalog_manager.cc:5697] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 1 to 2, leader changed from 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.925457 11677 raft_consensus.cc:515] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:51.928663 11677 leader_election.cc:290] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:51.928860 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78decb93a9542368bf3107bc846a6f0" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:51.930433 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78decb93a9542368bf3107bc846a6f0" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:51.930727 10884 raft_consensus.cc:3060] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:51.931068 10964 raft_consensus.cc:3055] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:51.931413 10964 raft_consensus.cc:740] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:51.932425 10964 consensus_queue.cc:260] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:51.934280 10964 raft_consensus.cc:3060] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:51.943173 10964 raft_consensus.cc:2468] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 3.
I20260709 13:19:51.944427 11626 leader_election.cc:304] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:51.951352 11946 raft_consensus.cc:2804] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:51.951872 11946 raft_consensus.cc:697] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:51.952838 11946 consensus_queue.cc:237] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:51.971402 10884 raft_consensus.cc:2468] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 3.
I20260709 13:19:51.975857 10711 catalog_manager.cc:5697] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 2 to 3, leader changed from 348b268fc1da46ac98e10bbe776b018b (127.1.250.67) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.012933 10964 raft_consensus.cc:1275] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.015386 11936 consensus_queue.cc:1048] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:52.021801 11921 raft_consensus.cc:993] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:52.023437 11921 raft_consensus.cc:1081] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:52.025604 11677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64eb7071b63a4a51bc2c3b07b243711e"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39398
I20260709 13:19:52.026149 11677 raft_consensus.cc:493] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:52.026459 11677 raft_consensus.cc:3060] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.035928 11677 raft_consensus.cc:515] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:52.042770 11677 leader_election.cc:290] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:52.047820 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64eb7071b63a4a51bc2c3b07b243711e" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:52.048429 10961 raft_consensus.cc:3060] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.050021 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64eb7071b63a4a51bc2c3b07b243711e" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:52.050617 11032 raft_consensus.cc:3055] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:52.050908 11032 raft_consensus.cc:740] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:52.051687 11032 consensus_queue.cc:260] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:52.052717 11032 raft_consensus.cc:3060] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.065717 10961 raft_consensus.cc:2468] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:52.066606 10960 raft_consensus.cc:1240] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Rejecting Update request from peer 10307244fcd642b89723e4fb4ac1291a for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:52.068215 11626 leader_election.cc:304] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:52.069370 11936 raft_consensus.cc:2804] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:52.069898 11936 raft_consensus.cc:697] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:52.068213 11032 raft_consensus.cc:2468] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:52.071568 11936 consensus_queue.cc:237] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:52.118952 10711 catalog_manager.cc:5697] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 1 to 2, leader changed from 10307244fcd642b89723e4fb4ac1291a (127.1.250.68) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.120838 11945 raft_consensus.cc:993] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:52.121409 11945 raft_consensus.cc:1081] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:52.125298 11676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0223927df5f442079c8fa526ed7eef26"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39398
I20260709 13:19:52.125866 11676 raft_consensus.cc:493] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:52.126494 11676 raft_consensus.cc:3060] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.133808 11032 raft_consensus.cc:1275] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.136029 11946 consensus_queue.cc:1048] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.138041 11676 raft_consensus.cc:515] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:52.154254 10960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0223927df5f442079c8fa526ed7eef26" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:52.154958 10960 raft_consensus.cc:3060] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.157258 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0223927df5f442079c8fa526ed7eef26" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:52.157938 11032 raft_consensus.cc:3055] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:52.158267 11032 raft_consensus.cc:740] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:52.159037 11032 consensus_queue.cc:260] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:52.159979 11032 raft_consensus.cc:3060] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.162403 11031 raft_consensus.cc:1275] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.165800 11918 consensus_queue.cc:1048] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.168180 11032 raft_consensus.cc:2468] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:52.160410 11676 leader_election.cc:290] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:52.177664 11625 leader_election.cc:304] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:52.178745 11946 raft_consensus.cc:2804] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:52.179291 11946 raft_consensus.cc:697] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:52.180420 11946 consensus_queue.cc:237] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:52.191485 10961 raft_consensus.cc:1275] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.194360 11918 consensus_queue.cc:1048] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:52.211503 10960 raft_consensus.cc:2468] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:52.378845 10711 catalog_manager.cc:5697] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 1 to 2, leader changed from 10307244fcd642b89723e4fb4ac1291a (127.1.250.68) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.366442 11031 raft_consensus.cc:1275] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.403656 11946 consensus_queue.cc:1048] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.435953 10884 raft_consensus.cc:1275] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.442552 10884 raft_consensus.cc:1275] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:52.451726 11946 consensus_queue.cc:1048] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.473776 11947 consensus_queue.cc:1048] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:52.487330 10961 raft_consensus.cc:1275] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:52.489059 11946 consensus_queue.cc:1048] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:52.562301  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:52.575229 11031 raft_consensus.cc:1275] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.577394 11946 consensus_queue.cc:1048] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.625417 10964 raft_consensus.cc:1275] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.638037 11936 consensus_queue.cc:1048] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.682377 10961 raft_consensus.cc:1275] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.684475 11936 consensus_queue.cc:1048] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.704402 11031 raft_consensus.cc:1275] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.709923 11946 consensus_queue.cc:1048] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.893292  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:52.992341 10961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82"
dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:37896
I20260709 13:19:52.993053 10961 raft_consensus.cc:606] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:52.997903 10961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a"
dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:37896
I20260709 13:19:52.998555 10961 raft_consensus.cc:606] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:53.001255 10885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b64ecb0ea0324b31ae37b194ad98e73a"
dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:19:53.001847 10885 raft_consensus.cc:606] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:53.012702 10961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccc6fa17f15647569501a369656211c7"
dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
mode: GRACEFUL
new_leader_uuid: "02260b9a864a4665ae3c33869adeaaf5"
 from {username='slave'} at 127.0.0.1:37896
I20260709 13:19:53.013651 10961 raft_consensus.cc:606] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Received request to transfer leadership to TS 02260b9a864a4665ae3c33869adeaaf5
I20260709 13:19:53.026419  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:19:53.028582  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:53.308332 11952 raft_consensus.cc:993] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:53.308990 11952 raft_consensus.cc:1081] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:53.312480 11698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b64ecb0ea0324b31ae37b194ad98e73a"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39404
I20260709 13:19:53.313030 11698 raft_consensus.cc:493] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:53.313468 11698 raft_consensus.cc:3060] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:53.327450 11698 raft_consensus.cc:515] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:53.337445 11698 leader_election.cc:290] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:53.338855 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64ecb0ea0324b31ae37b194ad98e73a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:53.339550 11032 raft_consensus.cc:3060] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:53.342556 11983 raft_consensus.cc:993] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:53.343111 11983 raft_consensus.cc:1081] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:53.344635 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64ecb0ea0324b31ae37b194ad98e73a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:53.345523 10884 raft_consensus.cc:3055] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:53.345853 10884 raft_consensus.cc:740] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:53.346673 10884 consensus_queue.cc:260] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:53.348029 10884 raft_consensus.cc:3060] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:53.360430 12002 raft_consensus.cc:993] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b: : Instructing follower 02260b9a864a4665ae3c33869adeaaf5 to start an election
I20260709 13:19:53.361017 12002 raft_consensus.cc:1081] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Signalling peer 02260b9a864a4665ae3c33869adeaaf5 to start an election
I20260709 13:19:53.362943 10885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccc6fa17f15647569501a369656211c7"
dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
 from {username='slave'} at 127.0.0.1:47640
I20260709 13:19:53.363538 10885 raft_consensus.cc:493] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:53.363929 10885 raft_consensus.cc:3060] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:53.359091 10884 raft_consensus.cc:2468] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:53.368360 11694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39406
I20260709 13:19:53.369022 11694 raft_consensus.cc:493] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:53.369565 11694 raft_consensus.cc:3060] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:53.370893 11625 leader_election.cc:304] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:53.377790 10885 raft_consensus.cc:515] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:53.378273 11694 raft_consensus.cc:515] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:53.372047 11946 raft_consensus.cc:2804] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:53.381560 10960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc6fa17f15647569501a369656211c7" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:53.390377 11946 raft_consensus.cc:697] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:53.390637 10960 raft_consensus.cc:3055] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:53.391021 10960 raft_consensus.cc:740] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:53.391669 11694 leader_election.cc:290] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:53.391932 10960 consensus_queue.cc:260] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:53.392187 11946 consensus_queue.cc:237] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:53.394855 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:53.395526 11031 raft_consensus.cc:3060] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:53.405179 10960 raft_consensus.cc:3060] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:53.410761 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:53.411522 10964 raft_consensus.cc:3055] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:53.411818 10964 raft_consensus.cc:740] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:53.412557 10964 consensus_queue.cc:260] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:53.413868 10964 raft_consensus.cc:3060] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:53.435971 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc6fa17f15647569501a369656211c7" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:53.436514 10885 leader_election.cc:290] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:53.436769 11036 raft_consensus.cc:3060] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:53.448709 11036 raft_consensus.cc:2468] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:53.462330 10854 leader_election.cc:304] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:53.464121 11952 raft_consensus.cc:2804] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:53.464802 11952 raft_consensus.cc:697] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:53.465782 11952 consensus_queue.cc:237] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:53.459959 11983 raft_consensus.cc:993] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:53.493036 12002 raft_consensus.cc:1081] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:53.495918 11698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39406
I20260709 13:19:53.496493 11698 raft_consensus.cc:493] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:53.496855 11698 raft_consensus.cc:3060] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:53.504145 11031 raft_consensus.cc:2468] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 3.
I20260709 13:19:53.505584 11625 leader_election.cc:304] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:53.508102 11947 raft_consensus.cc:2804] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:53.508644 11947 raft_consensus.cc:697] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:53.509626 11947 consensus_queue.cc:237] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:19:53.513653 10709 catalog_manager.cc:5697] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 1 to 2, leader changed from 348b268fc1da46ac98e10bbe776b018b (127.1.250.67) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:53.524945 11698 raft_consensus.cc:515] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:53.555472 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:53.562367 10885 raft_consensus.cc:3060] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:53.387705 11032 raft_consensus.cc:2468] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:53.576617 10964 raft_consensus.cc:2468] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 3.
I20260709 13:19:53.582062 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:53.586871 10961 raft_consensus.cc:3055] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:53.587363 10961 raft_consensus.cc:740] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:53.577499 11698 leader_election.cc:290] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:53.596011 10885 raft_consensus.cc:2468] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 3.
I20260709 13:19:53.596045 10961 consensus_queue.cc:260] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:53.604218 11625 leader_election.cc:304] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:53.605218 10961 raft_consensus.cc:3060] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:53.612171 11979 raft_consensus.cc:2804] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:53.612804 11979 raft_consensus.cc:697] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:53.613770 11979 consensus_queue.cc:237] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:53.615262 10960 raft_consensus.cc:2468] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:53.631831 10961 raft_consensus.cc:2468] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 3.
W20260709 13:19:53.653227 10855 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 71041.8us
I20260709 13:19:53.873005 10960 raft_consensus.cc:1275] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:53.874748 12023 consensus_queue.cc:1048] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:53.949282 11036 raft_consensus.cc:1275] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:53.951638 12001 consensus_queue.cc:1048] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:53.994093 10711 catalog_manager.cc:5697] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 1 to 2, leader changed from 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.039602  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:54.154341 11626 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 78362.3us
I20260709 13:19:54.155676 11032 raft_consensus.cc:1275] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:54.159832 11032 raft_consensus.cc:1275] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:54.181696 12038 consensus_queue.cc:1048] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:54.181917 11946 consensus_queue.cc:1048] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:54.231171 10888 raft_consensus.cc:1275] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:54.252302 10961 raft_consensus.cc:1275] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:54.252908 12037 consensus_queue.cc:1048] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:19:54.243340 10882 raft_consensus.cc:1275] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:54.282099 10964 raft_consensus.cc:1275] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:19:54.292100 10854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:44237, user_credentials={real_user=slave}} blocked reactor thread for 53955.5us
I20260709 13:19:54.379856 12038 consensus_queue.cc:1048] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:19:54.381697 11947 consensus_queue.cc:1048] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:54.460772 10711 catalog_manager.cc:5697] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 2 to 3, leader changed from 348b268fc1da46ac98e10bbe776b018b (127.1.250.67) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } }
I20260709 13:19:54.487228 11946 consensus_queue.cc:1048] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:19:54.510566 12042 log.cc:927] Time spent T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:19:54.682092  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:54.744752 10709 catalog_manager.cc:5697] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 2 to 3, leader changed from 348b268fc1da46ac98e10bbe776b018b (127.1.250.67) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } }
W20260709 13:19:54.800437 11002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 65918.7us
W20260709 13:19:54.814392 11790 debug-util.cc:398] Leaking SignalData structure 0x7b08003426e0 after lost signal to thread 2028
W20260709 13:19:54.816035 11790 debug-util.cc:398] Leaking SignalData structure 0x7b080022f780 after lost signal to thread 10747
W20260709 13:19:54.818091 11790 debug-util.cc:398] Leaking SignalData structure 0x7b0800277600 after lost signal to thread 10914
I20260709 13:19:54.818287 10961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c225028946540c2ad3af7200d7f49e3"
dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
mode: GRACEFUL
new_leader_uuid: "02260b9a864a4665ae3c33869adeaaf5"
 from {username='slave'} at 127.0.0.1:37896
I20260709 13:19:54.819232 10961 raft_consensus.cc:606] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Received request to transfer leadership to TS 02260b9a864a4665ae3c33869adeaaf5
W20260709 13:19:54.820371 11790 debug-util.cc:398] Leaking SignalData structure 0x7b080022cd20 after lost signal to thread 10988
W20260709 13:19:54.822289 11790 debug-util.cc:398] Leaking SignalData structure 0x7b0800246960 after lost signal to thread 11062
W20260709 13:19:54.824199 11790 debug-util.cc:398] Leaking SignalData structure 0x7b080038f460 after lost signal to thread 11793
I20260709 13:19:54.826202 10885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "858421950e8a4552815da6611d222770"
dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
mode: GRACEFUL
new_leader_uuid: "10307244fcd642b89723e4fb4ac1291a"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:19:54.827500 10885 raft_consensus.cc:606] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Received request to transfer leadership to TS 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:54.829483  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:19:54.831686  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:54.896024 12018 raft_consensus.cc:993] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b: : Instructing follower 02260b9a864a4665ae3c33869adeaaf5 to start an election
I20260709 13:19:54.896806 12033 raft_consensus.cc:1081] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Signalling peer 02260b9a864a4665ae3c33869adeaaf5 to start an election
I20260709 13:19:54.914776 10888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c225028946540c2ad3af7200d7f49e3"
dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
 from {username='slave'} at 127.0.0.1:47640
I20260709 13:19:54.915567 10888 raft_consensus.cc:493] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:54.916024 10888 raft_consensus.cc:3060] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:54.937003 10888 raft_consensus.cc:515] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:54.939342 10888 leader_election.cc:290] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237)
I20260709 13:19:54.940677 10960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c225028946540c2ad3af7200d7f49e3" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:54.941664 10960 raft_consensus.cc:3055] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:54.942016 10960 raft_consensus.cc:740] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:19:54.942946 10960 consensus_queue.cc:260] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:54.944211 10960 raft_consensus.cc:3060] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:54.963102 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c225028946540c2ad3af7200d7f49e3" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:54.963799 11032 raft_consensus.cc:3060] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:54.977998 11032 raft_consensus.cc:2468] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:54.986057 12001 raft_consensus.cc:993] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5: : Instructing follower 10307244fcd642b89723e4fb4ac1291a to start an election
I20260709 13:19:54.986590 12001 raft_consensus.cc:1081] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Signalling peer 10307244fcd642b89723e4fb4ac1291a to start an election
I20260709 13:19:54.988096 10854 leader_election.cc:304] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:19:54.990572 12021 raft_consensus.cc:2804] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:54.991887 12021 raft_consensus.cc:697] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:54.993124 12021 consensus_queue.cc:237] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:54.998428 11031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "858421950e8a4552815da6611d222770"
dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
 from {username='slave'} at 127.0.0.1:52850
I20260709 13:19:54.999135 11031 raft_consensus.cc:493] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:54.999526 11031 raft_consensus.cc:3060] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.009656 11031 raft_consensus.cc:515] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:55.013242 10882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858421950e8a4552815da6611d222770" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:55.013960 10882 raft_consensus.cc:3055] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:55.014321 10882 raft_consensus.cc:740] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:55.015269 10882 consensus_queue.cc:260] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:55.016607 10882 raft_consensus.cc:3060] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.035831 11031 leader_election.cc:290] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: Requested vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:55.040683 10963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858421950e8a4552815da6611d222770" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:55.041576 10963 raft_consensus.cc:3060] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.065974 10709 catalog_manager.cc:5697] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 1 to 2, leader changed from 348b268fc1da46ac98e10bbe776b018b (127.1.250.67) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.068980 10963 raft_consensus.cc:2468] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 2.
I20260709 13:19:55.070458 11003 leader_election.cc:304] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:55.071488 11924 raft_consensus.cc:2804] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:55.071951 11924 raft_consensus.cc:697] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [term 2 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:55.072813 11924 consensus_queue.cc:237] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:55.083710 10960 raft_consensus.cc:2468] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:19:55.088476 10710 catalog_manager.cc:5697] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 1 to 2, leader changed from 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66) to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 2 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:55.046124 10882 raft_consensus.cc:2468] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 2.
I20260709 13:19:55.478317 10882 raft_consensus.cc:1275] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer 10307244fcd642b89723e4fb4ac1291a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:55.480122 12053 consensus_queue.cc:1048] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:55.497591 10963 raft_consensus.cc:1275] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:55.511049 12001 consensus_queue.cc:1048] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:55.564617 11036 raft_consensus.cc:1275] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:55.569904 12001 consensus_queue.cc:1048] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:19:55.656082 11002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 46858.7us
I20260709 13:19:55.678686 10963 raft_consensus.cc:1275] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Refusing update from remote peer 10307244fcd642b89723e4fb4ac1291a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:55.693910 12061 consensus_queue.cc:1048] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:19:55.833240  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:55.937477 11626 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:45115, user_credentials={real_user=slave}} blocked reactor thread for 47819.1us
I20260709 13:19:56.018181  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:56.077541 10884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "211db9e835d644ccb7787552caa46c93"
dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:19:56.078246 10884 raft_consensus.cc:606] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:56.085700 11031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36"
dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:58268
I20260709 13:19:56.086849 11031 raft_consensus.cc:606] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:56.088536  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:19:56.090544  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:56.140893 12061 raft_consensus.cc:993] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:56.141584 12061 raft_consensus.cc:1081] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:56.143923 11674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39398
I20260709 13:19:56.144599 11674 raft_consensus.cc:493] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:56.171765 11674 raft_consensus.cc:3060] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:56.191275 11674 raft_consensus.cc:515] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:56.195132 11674 leader_election.cc:290] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:56.196381 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:56.197162 11031 raft_consensus.cc:3055] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:56.197477 11031 raft_consensus.cc:740] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:19:56.198355 11031 consensus_queue.cc:260] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:56.204988 11031 raft_consensus.cc:3060] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:56.896622 10927 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.005s	sys 0.013s
W20260709 13:19:56.897302 10927 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.005s	sys 0.013s
W20260709 13:19:56.903780 10930 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.010s	sys 0.008s
W20260709 13:19:56.904321 10930 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.010s	sys 0.008s
I20260709 13:19:57.060698 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:57.061443 10885 raft_consensus.cc:3060] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.073333 10885 raft_consensus.cc:2468] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:57.076683 12065 raft_consensus.cc:493] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 348b268fc1da46ac98e10bbe776b018b)
I20260709 13:19:57.077344 12065 raft_consensus.cc:515] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:57.079099 11625 leader_election.cc:304] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:57.079348 12065 leader_election.cc:290] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:57.079907 12065 raft_consensus.cc:493] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 02260b9a864a4665ae3c33869adeaaf5)
I20260709 13:19:57.080338 12065 raft_consensus.cc:515] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } }
I20260709 13:19:57.086779 12073 raft_consensus.cc:2804] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:57.088207 12073 raft_consensus.cc:697] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:57.089563 12073 consensus_queue.cc:237] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:57.088258 12065 leader_election.cc:290] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
W20260709 13:19:57.096541 11031 consensus_meta.cc:287] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a: Time spent flushing consensus metadata: real 0.891s	user 0.012s	sys 0.003s
I20260709 13:19:57.096975 11031 raft_consensus.cc:2468] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:57.119714 11947 raft_consensus.cc:493] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 02260b9a864a4665ae3c33869adeaaf5)
I20260709 13:19:57.120332 11947 raft_consensus.cc:515] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:57.122393 11947 leader_election.cc:290] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:57.124159 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf66c391c2ea4f04a1eb536f28d4b170" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:57.131708 10959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023f097eceb641d18e1870dbd3a1ede3" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:57.133251 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c9c2d96172a4900bbd79e91d3cfd69a" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:19:57.162642 12021 raft_consensus.cc:993] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:57.163180 12021 raft_consensus.cc:1081] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:57.179620 11674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "211db9e835d644ccb7787552caa46c93"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39404
I20260709 13:19:57.180382 11674 raft_consensus.cc:493] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:57.180450 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf66c391c2ea4f04a1eb536f28d4b170" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:19:57.180982 11674 raft_consensus.cc:3060] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.196592  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:57.203985 10711 catalog_manager.cc:5697] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 1 to 2, leader changed from 10307244fcd642b89723e4fb4ac1291a (127.1.250.68) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:57.231343 12088 log.cc:927] Time spent T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:19:57.242923 11674 raft_consensus.cc:515] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
W20260709 13:19:57.237401 10985 debug-util.cc:398] Leaking SignalData structure 0x7b0800225160 after lost signal to thread 2028
I20260709 13:19:57.236500 11625 leader_election.cc:304] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d726aaf867ea423fa4efe8a15d1896d1; no voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a
I20260709 13:19:57.254954 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023f097eceb641d18e1870dbd3a1ede3" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:19:57.256829 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c9c2d96172a4900bbd79e91d3cfd69a" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
W20260709 13:19:57.293768 10985 debug-util.cc:398] Leaking SignalData structure 0x7b0800246b20 after lost signal to thread 10747
W20260709 13:19:57.294659 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.68:44237, user_credentials={real_user=slave}} blocked reactor thread for 58279.2us
W20260709 13:19:57.295568 10985 debug-util.cc:398] Leaking SignalData structure 0x7b08001002a0 after lost signal to thread 10914
I20260709 13:19:57.295634 12085 raft_consensus.cc:2749] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:57.297432 10985 debug-util.cc:398] Leaking SignalData structure 0x7b0800330aa0 after lost signal to thread 10988
W20260709 13:19:57.299075 10985 debug-util.cc:398] Leaking SignalData structure 0x7b08002d50a0 after lost signal to thread 11062
W20260709 13:19:57.301115 10985 debug-util.cc:398] Leaking SignalData structure 0x7b08003dbac0 after lost signal to thread 11793
I20260709 13:19:57.305244 11674 leader_election.cc:290] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:19:57.306278 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211db9e835d644ccb7787552caa46c93" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:57.321493 11032 raft_consensus.cc:3060] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.307364 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211db9e835d644ccb7787552caa46c93" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:57.325404 10884 raft_consensus.cc:3055] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:57.325788 10884 raft_consensus.cc:740] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:57.326651 10884 consensus_queue.cc:260] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:57.327636 10884 raft_consensus.cc:3060] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.339359 11032 raft_consensus.cc:2468] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:57.341040 11625 leader_election.cc:304] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:57.342517 12085 raft_consensus.cc:2804] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:57.343214 12085 raft_consensus.cc:697] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:57.343901 10884 raft_consensus.cc:2468] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 2.
I20260709 13:19:57.344228 12085 consensus_queue.cc:237] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
W20260709 13:19:57.345189 11002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 53761.5us
I20260709 13:19:57.368832 11002 leader_election.cc:304] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:57.369840 12091 raft_consensus.cc:2749] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:57.371557 11002 leader_election.cc:304] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b
I20260709 13:19:57.380741 12091 raft_consensus.cc:2749] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:57.424175  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:57.428280 10711 catalog_manager.cc:5697] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 1 to 2, leader changed from 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.496403 10884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "533e572edda34e56bb0fc3aaf49022da"
dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
mode: GRACEFUL
new_leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:19:57.497413 10884 raft_consensus.cc:606] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Received request to transfer leadership to TS d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:19:57.505241  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:19:57.508765  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:57.557250 10884 raft_consensus.cc:1275] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:57.563421 12086 consensus_queue.cc:1048] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:57.586127 12070 raft_consensus.cc:993] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5: : Instructing follower d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:57.586835 12070 raft_consensus.cc:1081] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Signalling peer d726aaf867ea423fa4efe8a15d1896d1 to start an election
I20260709 13:19:57.590747 11688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "533e572edda34e56bb0fc3aaf49022da"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
 from {username='slave'} at 127.0.0.1:39404
I20260709 13:19:57.594179 11688 raft_consensus.cc:493] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:57.594565 11688 raft_consensus.cc:3060] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:57.674355 11036 raft_consensus.cc:1275] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:57.705615 11947 consensus_queue.cc:1048] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:19:57.739344 11688 raft_consensus.cc:515] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:57.750625 11688 leader_election.cc:290] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
W20260709 13:19:57.766352 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 61755.8us
I20260709 13:19:57.772066 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533e572edda34e56bb0fc3aaf49022da" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:19:57.772874 10885 raft_consensus.cc:3055] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:57.773262 10885 raft_consensus.cc:740] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:57.774202 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533e572edda34e56bb0fc3aaf49022da" candidate_uuid: "d726aaf867ea423fa4efe8a15d1896d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:19:57.775213 11036 raft_consensus.cc:3060] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:57.785971 10885 consensus_queue.cc:260] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:57.791811 10885 raft_consensus.cc:3060] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:57.800751 10885 raft_consensus.cc:2468] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 3.
I20260709 13:19:57.802138 11036 raft_consensus.cc:2468] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d726aaf867ea423fa4efe8a15d1896d1 in term 3.
I20260709 13:19:57.806205 11625 leader_election.cc:304] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1; no voters: 
I20260709 13:19:57.807073 12073 raft_consensus.cc:2804] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:57.807559 12073 raft_consensus.cc:697] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Becoming Leader. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:57.808492 12073 consensus_queue.cc:237] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:19:57.835418 10711 catalog_manager.cc:5697] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 reported cstate change: term changed from 2 to 3, leader changed from 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66) to d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65). New cstate: current_term: 3 leader_uuid: "d726aaf867ea423fa4efe8a15d1896d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.856458 10885 raft_consensus.cc:1275] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:57.858182 12103 consensus_queue.cc:1048] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:57.891176 11032 raft_consensus.cc:1275] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:57.893016 12093 consensus_queue.cc:1048] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.341434 10884 raft_consensus.cc:1275] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:58.342989 12073 consensus_queue.cc:1048] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:58.373863 11029 raft_consensus.cc:1275] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Refusing update from remote peer d726aaf867ea423fa4efe8a15d1896d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:58.377676 12073 consensus_queue.cc:1048] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:58.511313  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:58.544358 10854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.68:44237, user_credentials={real_user=slave}} blocked reactor thread for 54971us
I20260709 13:19:58.655900  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:58.797737 11688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf"
dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
mode: GRACEFUL
new_leader_uuid: "02260b9a864a4665ae3c33869adeaaf5"
 from {username='slave'} at 127.0.0.1:50834
I20260709 13:19:58.798374 11688 raft_consensus.cc:606] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Received request to transfer leadership to TS 02260b9a864a4665ae3c33869adeaaf5
I20260709 13:19:58.800769  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:19:58.802608  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:59.014628 12073 raft_consensus.cc:993] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1: : Instructing follower 02260b9a864a4665ae3c33869adeaaf5 to start an election
I20260709 13:19:59.015175 12073 raft_consensus.cc:1081] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Signalling peer 02260b9a864a4665ae3c33869adeaaf5 to start an election
I20260709 13:19:59.016826 10885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf"
dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
 from {username='slave'} at 127.0.0.1:37590
I20260709 13:19:59.017458 10885 raft_consensus.cc:493] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:59.017818 10885 raft_consensus.cc:3060] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:59.026494 10885 raft_consensus.cc:515] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:59.030193 10885 leader_election.cc:290] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:19:59.030362 10960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:19:59.031070 10960 raft_consensus.cc:3060] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:59.032069 11688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a961ac552345e8b4c84ccdcb5ee1cf" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d726aaf867ea423fa4efe8a15d1896d1"
I20260709 13:19:59.032648 11688 raft_consensus.cc:3055] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:59.032924 11688 raft_consensus.cc:740] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d726aaf867ea423fa4efe8a15d1896d1, State: Running, Role: LEADER
I20260709 13:19:59.033680 11688 consensus_queue.cc:260] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:59.034909 11688 raft_consensus.cc:3060] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:59.038318 10960 raft_consensus.cc:2468] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 4.
I20260709 13:19:59.039753 10855 leader_election.cc:304] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:19:59.041424 12080 raft_consensus.cc:2804] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:59.041888 12080 raft_consensus.cc:697] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 4 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:19:59.042805 12080 consensus_queue.cc:237] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:19:59.046622 11688 raft_consensus.cc:2468] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 4.
I20260709 13:19:59.068207 10711 catalog_manager.cc:5697] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 3 to 4, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 4 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:59.470291 11674 raft_consensus.cc:1275] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 4 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:59.474149 12080 consensus_queue.cc:1048] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:59.494490 10960 raft_consensus.cc:1275] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:59.496037 12080 consensus_queue.cc:1048] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:59.803586  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:59.851589  2025 tablet_server.cc:179] TabletServer@127.1.250.65:37493 shutting down...
W20260709 13:19:59.863163 10930 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 266 similar messages]
W20260709 13:19:59.883285 10930 consensus_peers.cc:597] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.916803 10930 consensus_peers.cc:597] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.917176  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:59.918298  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.919754  2025 raft_consensus.cc:2243] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.920375  2025 raft_consensus.cc:2272] T 94bc42d21ce64138aec6ff49d068ab86 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.924283  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.925395  2025 raft_consensus.cc:2243] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.926497  2025 raft_consensus.cc:2272] T 92b42bdb5b9e408b8ae8b4449e21be82 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.929557  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.930547  2025 raft_consensus.cc:2243] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.931819  2025 raft_consensus.cc:2272] T b949895bff3f409b9781c118fe3c9c21 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.934643  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.935491  2025 raft_consensus.cc:2243] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.935987  2025 raft_consensus.cc:2272] T 1f7e307af3a04b85a49fcabdbdc687d5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.939781  2025 tablet_replica.cc:333] stopping tablet replica
W20260709 13:19:59.940631 11004 consensus_peers.cc:597] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.940735  2025 raft_consensus.cc:2243] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.941568  2025 raft_consensus.cc:2272] T 4a3926cff4dd4248bf3731e550fd2356 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.944715  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.945519  2025 raft_consensus.cc:2243] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.946585  2025 raft_consensus.cc:2272] T 25e873664b784f37bb216a0a11da17aa P d726aaf867ea423fa4efe8a15d1896d1 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:59.947096 10930 consensus_peers.cc:597] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.949820  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.950855  2025 raft_consensus.cc:2243] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.951380  2025 raft_consensus.cc:2272] T 52a060d27b9f4695a643036bb5223916 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.954802  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.955498  2025 raft_consensus.cc:2243] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.956008  2025 raft_consensus.cc:2272] T 5f0b6d45547e4ef89454d41c9943374f P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:59.958282 11004 consensus_peers.cc:597] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.959101  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.959944  2025 raft_consensus.cc:2243] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.960764  2025 raft_consensus.cc:2272] T 64eb7071b63a4a51bc2c3b07b243711e P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.963461  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.964112  2025 raft_consensus.cc:2243] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.965013  2025 raft_consensus.cc:2272] T 84a90e754ea44ce5b10285e034656db6 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.967530  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.968209  2025 raft_consensus.cc:2243] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.968758  2025 raft_consensus.cc:2272] T b9864e48c6a44db483a571660db1433d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.971791  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.972646  2025 raft_consensus.cc:2243] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.973762  2025 raft_consensus.cc:2272] T 0223927df5f442079c8fa526ed7eef26 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.976711  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.977578  2025 raft_consensus.cc:2243] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.978341  2025 raft_consensus.cc:2272] T c2fedddd0f2b4818ad11904281a7f444 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:59.979471 11004 consensus_peers.cc:597] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.981377  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.982555  2025 raft_consensus.cc:2243] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:19:59.983083 10930 consensus_peers.cc:597] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.983723  2025 raft_consensus.cc:2272] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:59.984835 11004 consensus_peers.cc:597] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.986624  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.987501  2025 raft_consensus.cc:2243] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.988054  2025 raft_consensus.cc:2272] T 34c729794e1e4b7bb1571a3e52c12585 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.990546  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.991197  2025 raft_consensus.cc:2243] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.991677  2025 raft_consensus.cc:2272] T 6b7600277a13475fa3c331ef52fb4d51 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.994244  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.995124  2025 raft_consensus.cc:2243] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.995695  2025 raft_consensus.cc:2272] T 9e2f9f95429447eb9cb87f21c0785a9b P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.998939  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:59.999800  2025 raft_consensus.cc:2243] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.000617  2025 raft_consensus.cc:2272] T 84aaea3ca9c0459e98df2be582872d60 P d726aaf867ea423fa4efe8a15d1896d1 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:59.999709 11004 consensus_peers.cc:597] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.003896  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.004876  2025 raft_consensus.cc:2243] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.005504  2025 raft_consensus.cc:2272] T b73cc1fc36c14e8cb8698530765f5134 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.009799  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.010885  2025 raft_consensus.cc:2243] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.011518  2025 raft_consensus.cc:2272] T b676ac3e11504dd5bc9a471a2216273f P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.012580 11004 consensus_peers.cc:597] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.015244  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.016431  2025 raft_consensus.cc:2243] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.017081  2025 raft_consensus.cc:2272] T bff1646148f04205b5383bbc084a62af P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.020033  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.021003  2025 raft_consensus.cc:2243] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.021633  2025 raft_consensus.cc:2272] T b145e95f652c4178b64b4379f53a809d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.024892  2025 tablet_replica.cc:333] stopping tablet replica
W20260709 13:20:00.025692 11004 consensus_peers.cc:597] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.025961  2025 raft_consensus.cc:2243] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:00.027334 10930 consensus_peers.cc:597] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.027876  2025 raft_consensus.cc:2272] T 61d37e6e4c06405fa84aaf770ff215bc P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.032611  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.033855  2025 raft_consensus.cc:2243] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.034909  2025 raft_consensus.cc:2272] T f7e627f9d3ca4ef68b1fbeb3f16da01a P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.042232  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.043269  2025 raft_consensus.cc:2243] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.043948  2025 raft_consensus.cc:2272] T e4b2704733d44a9f8b55a95b4c06a389 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.046945  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.047639  2025 raft_consensus.cc:2243] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.048731  2025 raft_consensus.cc:2272] T 93233fc4a74c4234ae8eb56ad603713a P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.051834  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.052743  2025 raft_consensus.cc:2243] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.053767  2025 raft_consensus.cc:2272] T 6e271b04664c496a88d89b0bbfa85c36 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.056780  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.057734  2025 raft_consensus.cc:2243] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.058264  2025 raft_consensus.cc:2272] T 2bc701e5f842459cb7e7469da45a4132 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.061209  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.062093  2025 raft_consensus.cc:2243] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.062600  2025 raft_consensus.cc:2272] T cfc5d48da62642a9a8e39ec61cfc914d P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.065927  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.067065  2025 raft_consensus.cc:2243] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.067801  2025 raft_consensus.cc:2272] T 3c926e4bc5c549a88846566915db122f P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.068118 10856 consensus_peers.cc:597] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.070742 10930 consensus_peers.cc:597] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.070786  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.073509  2025 raft_consensus.cc:2243] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.074209  2025 raft_consensus.cc:2272] T 7bf42b68842d44bbbeaf36ee573a6da0 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.077410  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.078215  2025 raft_consensus.cc:2243] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.078843  2025 raft_consensus.cc:2272] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.081637  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.082417  2025 raft_consensus.cc:2243] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.082898  2025 raft_consensus.cc:2272] T 99b759717fbb437b92f5c1e04e6e5ce7 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.085696  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.086513  2025 raft_consensus.cc:2243] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.087280  2025 raft_consensus.cc:2272] T cf66c391c2ea4f04a1eb536f28d4b170 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.089951  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.090723  2025 raft_consensus.cc:2243] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.091722  2025 raft_consensus.cc:2272] T b64ecb0ea0324b31ae37b194ad98e73a P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.094523  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.095340  2025 raft_consensus.cc:2243] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.095839  2025 raft_consensus.cc:2272] T 0005319a469f4f4e993fa7679707faa5 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.098896 10856 consensus_peers.cc:597] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.099120  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.100315  2025 raft_consensus.cc:2243] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.101193  2025 raft_consensus.cc:2272] T d09ec691f9324f94a67cc88b0a2d4522 P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.104526  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.105446  2025 raft_consensus.cc:2243] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.106122  2025 raft_consensus.cc:2272] T 06b6e17edd7f4c618e7260d4e3a65f8a P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.107878 10856 consensus_peers.cc:597] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.108836  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.109511  2025 raft_consensus.cc:2243] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.109997  2025 raft_consensus.cc:2272] T b854da4ba865432d90d6a626e5b585bf P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.112383  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.113133  2025 raft_consensus.cc:2243] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.114368  2025 raft_consensus.cc:2272] T c78decb93a9542368bf3107bc846a6f0 P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.117933  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.118517  2025 raft_consensus.cc:2243] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.119288  2025 raft_consensus.cc:2272] T 533e572edda34e56bb0fc3aaf49022da P d726aaf867ea423fa4efe8a15d1896d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.121399  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.121923  2025 raft_consensus.cc:2243] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.122372  2025 raft_consensus.cc:2272] T 34a961ac552345e8b4c84ccdcb5ee1cf P d726aaf867ea423fa4efe8a15d1896d1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.125643  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.126227  2025 raft_consensus.cc:2243] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.127130  2025 raft_consensus.cc:2272] T 2904c45fa164407791817b45928f663e P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.129693  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.130342  2025 raft_consensus.cc:2243] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.130796  2025 raft_consensus.cc:2272] T df06b225878d49589732d38cda773b7e P d726aaf867ea423fa4efe8a15d1896d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.134078  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:00.134668  2025 raft_consensus.cc:2243] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.135632  2025 raft_consensus.cc:2272] T 211db9e835d644ccb7787552caa46c93 P d726aaf867ea423fa4efe8a15d1896d1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.136943 10930 consensus_peers.cc:597] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.145385 10856 consensus_peers.cc:597] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.150250 10856 consensus_peers.cc:597] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.172456 10930 consensus_peers.cc:597] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.176476 11004 consensus_peers.cc:597] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.191462 10930 consensus_peers.cc:597] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.203267 11004 consensus_peers.cc:597] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.206041 10856 consensus_peers.cc:597] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.246763 10930 consensus_peers.cc:597] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.257028 10930 consensus_peers.cc:597] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.311537 10856 consensus_peers.cc:597] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.313915 10856 consensus_peers.cc:597] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.326548 10930 consensus_peers.cc:597] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.467039 10856 consensus_peers.cc:597] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.903715 12132 raft_consensus.cc:493] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:00.904659 12132 raft_consensus.cc:515] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:20:00.908176 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:20:00.908385 12132 leader_election.cc:290] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
W20260709 13:20:00.915378 10930 leader_election.cc:336] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:00.915923 10930 leader_election.cc:304] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:00.917237 12132 raft_consensus.cc:2749] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:01.051586 12125 raft_consensus.cc:493] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.052341 12091 raft_consensus.cc:493] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.052280 12125 raft_consensus.cc:515] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:20:01.053018 12091 raft_consensus.cc:515] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:20:01.055418 12091 leader_election.cc:290] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.056265 12125 leader_election.cc:290] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.058449 10960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0223927df5f442079c8fa526ed7eef26" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:20:01.059326 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a90e754ea44ce5b10285e034656db6" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
W20260709 13:20:01.062927 11004 leader_election.cc:336] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.063385 11004 leader_election.cc:304] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
W20260709 13:20:01.064373 11004 leader_election.cc:336] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.064817 11004 leader_election.cc:304] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.065604 12141 raft_consensus.cc:2749] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:01.065518 12125 raft_consensus.cc:2749] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:01.088055 12125 raft_consensus.cc:493] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.088936 12125 raft_consensus.cc:515] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.091131 12125 leader_election.cc:290] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:20:01.092236 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211db9e835d644ccb7787552caa46c93" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
W20260709 13:20:01.096493 11004 leader_election.cc:336] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.096931 11004 leader_election.cc:304] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.097966 12125 raft_consensus.cc:2749] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:01.107326 12135 raft_consensus.cc:493] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.108022 12135 raft_consensus.cc:515] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.112727 12080 raft_consensus.cc:493] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.113396 12080 raft_consensus.cc:515] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.110112 12135 leader_election.cc:290] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
W20260709 13:20:01.115206 10856 leader_election.cc:336] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.115938 12135 raft_consensus.cc:493] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.117259 12135 raft_consensus.cc:515] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.117952 10960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78decb93a9542368bf3107bc846a6f0" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:20:01.115999 12080 leader_election.cc:290] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:20:01.112133 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:20:01.120162 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:20:01.121460 12135 leader_election.cc:290] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.121176 10855 leader_election.cc:304] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.123489 12135 raft_consensus.cc:2749] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:20:01.125633 10856 leader_election.cc:336] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.126076 10856 leader_election.cc:304] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.126817 12135 raft_consensus.cc:2749] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:20:01.129483 10856 leader_election.cc:336] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.129876 10856 leader_election.cc:304] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.130987 12080 raft_consensus.cc:2749] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:01.165176 12135 raft_consensus.cc:493] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.165922 12135 raft_consensus.cc:515] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.168500 12135 leader_election.cc:290] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.169109 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:20:01.170542 12132 raft_consensus.cc:493] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.171128 12132 raft_consensus.cc:515] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:20:01.173069 12132 leader_election.cc:290] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.174981 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a90e754ea44ce5b10285e034656db6" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:20:01.175611 11032 raft_consensus.cc:2468] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 2.
W20260709 13:20:01.178211 10856 leader_election.cc:336] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.178761 10856 leader_election.cc:304] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.178999 10928 leader_election.cc:304] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:20:01.179560 12135 raft_consensus.cc:2749] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:20:01.179968 12140 raft_consensus.cc:493] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.180853 12018 raft_consensus.cc:2804] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:01.180583 12140 raft_consensus.cc:515] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
W20260709 13:20:01.181054 10930 leader_election.cc:336] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.181290 12018 raft_consensus.cc:493] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.181734 12018 raft_consensus.cc:3060] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.182919 12140 leader_election.cc:290] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.186733 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0223927df5f442079c8fa526ed7eef26" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:20:01.187379 11032 raft_consensus.cc:2468] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 2.
I20260709 13:20:01.189172 10928 leader_election.cc:304] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:20:01.190193 12132 raft_consensus.cc:2804] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:20:01.190317 10930 leader_election.cc:336] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.190775 12132 raft_consensus.cc:493] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.191334 12132 raft_consensus.cc:3060] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.196651 12018 raft_consensus.cc:515] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:20:01.200551 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a90e754ea44ce5b10285e034656db6" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:20:01.201155 11036 raft_consensus.cc:3060] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.202128 12116 raft_consensus.cc:493] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.202297 12124 raft_consensus.cc:493] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.202811 12116 raft_consensus.cc:515] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.202903 12124 raft_consensus.cc:515] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:20:01.205324 12124 leader_election.cc:290] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.207577 12018 leader_election.cc:290] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.208031 12116 leader_election.cc:290] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:20:01.208364 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949895bff3f409b9781c118fe3c9c21" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:20:01.208768 11036 raft_consensus.cc:2468] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 3.
I20260709 13:20:01.210659 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64eb7071b63a4a51bc2c3b07b243711e" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:20:01.211953 10928 leader_election.cc:304] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:20:01.213093 12018 raft_consensus.cc:2804] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:01.213721 12018 raft_consensus.cc:697] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 3 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:20:01.215969 12018 consensus_queue.cc:237] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:20:01.218995 12124 raft_consensus.cc:493] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.219609 12124 raft_consensus.cc:515] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.223806 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904c45fa164407791817b45928f663e" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:20:01.230165 12124 leader_election.cc:290] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:20:01.233153 12116 raft_consensus.cc:493] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.233803 12116 raft_consensus.cc:515] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
W20260709 13:20:01.234220 10930 leader_election.cc:336] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.234735 10930 leader_election.cc:304] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 10307244fcd642b89723e4fb4ac1291a, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.235420 12018 raft_consensus.cc:2749] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:20:01.235762 10930 leader_election.cc:336] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.237000 12116 leader_election.cc:290] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:20:01.239164 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:20:01.237321 12124 raft_consensus.cc:493] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
W20260709 13:20:01.240865 10856 leader_election.cc:336] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.240667 12124 raft_consensus.cc:515] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.241405 10711 catalog_manager.cc:5697] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 2 to 3, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 3 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.243989 12132 raft_consensus.cc:515] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:20:01.244982 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78decb93a9542368bf3107bc846a6f0" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:20:01.241437 10856 leader_election.cc:304] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.245625 10885 raft_consensus.cc:2468] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 3.
I20260709 13:20:01.246186 12116 raft_consensus.cc:2749] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:01.246589 10928 leader_election.cc:304] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:20:01.247426 12140 raft_consensus.cc:2804] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:01.247814 12140 raft_consensus.cc:493] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.248204 12140 raft_consensus.cc:3060] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:20:01.249089  2025 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11790)
I20260709 13:20:01.252317 12141 raft_consensus.cc:493] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.252892 12141 raft_consensus.cc:515] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:20:01.257150 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0223927df5f442079c8fa526ed7eef26" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:20:01.252741 12132 leader_election.cc:290] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.257843 11036 raft_consensus.cc:3060] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.259478 12124 leader_election.cc:290] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
W20260709 13:20:01.262079 10856 leader_election.cc:336] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.264082 12125 raft_consensus.cc:493] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.265493 12140 raft_consensus.cc:515] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.264719 12125 raft_consensus.cc:515] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
W20260709 13:20:01.266811 11004 leader_election.cc:336] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.267642 12141 leader_election.cc:290] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
W20260709 13:20:01.268299 10930 leader_election.cc:336] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.268867 10930 leader_election.cc:304] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348b268fc1da46ac98e10bbe776b018b; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.272120 12144 raft_consensus.cc:2749] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:01.273012 10961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64eb7071b63a4a51bc2c3b07b243711e" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:20:01.273803 10961 raft_consensus.cc:2468] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 2.
I20260709 13:20:01.274930 12125 leader_election.cc:290] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:20:01.275800 10856 leader_election.cc:304] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5; no voters: 348b268fc1da46ac98e10bbe776b018b, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.276258 12140 leader_election.cc:290] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:20:01.276721 12135 raft_consensus.cc:2749] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:01.279014 11003 leader_election.cc:304] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
W20260709 13:20:01.279742 11004 leader_election.cc:336] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.280129 12135 raft_consensus.cc:493] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.280442 12141 raft_consensus.cc:2804] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:01.280943 12141 raft_consensus.cc:493] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.280719 12135 raft_consensus.cc:515] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.281388 12141 raft_consensus.cc:3060] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.283082 12135 leader_election.cc:290] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.284646 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64ecb0ea0324b31ae37b194ad98e73a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:20:01.285305 11032 raft_consensus.cc:2468] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:20:01.286773 10854 leader_election.cc:304] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:20:01.287643 12091 raft_consensus.cc:493] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.287796 12135 raft_consensus.cc:2804] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:01.288353 12135 raft_consensus.cc:493] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.288205 12091 raft_consensus.cc:515] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.288825 12135 raft_consensus.cc:3060] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.289758 12141 raft_consensus.cc:515] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:20:01.290474 12091 leader_election.cc:290] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:20:01.291819 12141 leader_election.cc:290] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.295164 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64ecb0ea0324b31ae37b194ad98e73a" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:20:01.298491 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78decb93a9542368bf3107bc846a6f0" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:20:01.299074 10884 raft_consensus.cc:3060] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:20:01.299255 10930 leader_election.cc:336] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:20:01.300001 10930 leader_election.cc:336] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.301769 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:20:01.302500 11036 raft_consensus.cc:2468] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 3.
I20260709 13:20:01.302505 10890 raft_consensus.cc:2468] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 4.
I20260709 13:20:01.305938 10928 leader_election.cc:304] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.306845 12140 raft_consensus.cc:2804] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:01.307319 12140 raft_consensus.cc:697] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 3 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:20:01.307559 11002 leader_election.cc:304] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:20:01.308174 12140 consensus_queue.cc:237] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:20:01.312758 12141 raft_consensus.cc:2804] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:20:01.312790 10930 leader_election.cc:336] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.313552 12141 raft_consensus.cc:493] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.314019 12141 raft_consensus.cc:3060] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:01.314417 10959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64eb7071b63a4a51bc2c3b07b243711e" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:20:01.315193 10959 raft_consensus.cc:3060] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.318478 12124 raft_consensus.cc:493] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.319182 12124 raft_consensus.cc:515] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.321775 12124 leader_election.cc:290] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:20:01.322153 12132 raft_consensus.cc:493] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.322733 12132 raft_consensus.cc:515] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.324220 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:20:01.325004 10890 raft_consensus.cc:2468] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 3.
I20260709 13:20:01.325268 12132 leader_election.cc:290] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:20:01.327059 10928 leader_election.cc:304] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:20:01.327844 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949895bff3f409b9781c118fe3c9c21" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:20:01.328068 12124 raft_consensus.cc:2804] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:01.328661 10890 raft_consensus.cc:2468] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 2.
I20260709 13:20:01.329000 12124 raft_consensus.cc:493] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.329480 12124 raft_consensus.cc:3060] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:20:01.331200 10930 leader_election.cc:336] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:20:01.332023 10930 leader_election.cc:336] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.336577 10959 raft_consensus.cc:2468] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 3.
I20260709 13:20:01.337167 10884 raft_consensus.cc:2468] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 4.
I20260709 13:20:01.346287 12141 raft_consensus.cc:515] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.341287 12124 raft_consensus.cc:515] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
W20260709 13:20:01.344430 11004 leader_election.cc:336] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.351166 11003 leader_election.cc:304] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
W20260709 13:20:01.351723 11004 leader_election.cc:336] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.352072 12147 raft_consensus.cc:2804] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:01.352727 12147 raft_consensus.cc:697] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 3 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:20:01.352808 12141 leader_election.cc:290] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 5 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:20:01.353864 12147 consensus_queue.cc:237] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:20:01.344905 12125 raft_consensus.cc:493] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.355782 12125 raft_consensus.cc:515] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:20:01.359187 10959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:20:01.360222 10959 raft_consensus.cc:2468] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 3.
I20260709 13:20:01.361985 11003 leader_election.cc:304] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:20:01.363709 12141 raft_consensus.cc:2804] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:01.364138 12141 raft_consensus.cc:493] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.364497 12141 raft_consensus.cc:3060] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:01.368206 12125 leader_election.cc:290] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
W20260709 13:20:01.346243 10856 leader_election.cc:336] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.347293 12135 raft_consensus.cc:515] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.375022 12135 leader_election.cc:290] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.375532 10885 raft_consensus.cc:2393] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10307244fcd642b89723e4fb4ac1291a in current term 3: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
I20260709 13:20:01.375653 12135 raft_consensus.cc:493] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.376293 12135 raft_consensus.cc:515] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.376726 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64ecb0ea0324b31ae37b194ad98e73a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:20:01.377488 11036 raft_consensus.cc:3060] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.378353 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e873664b784f37bb216a0a11da17aa" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:20:01.378886 10884 raft_consensus.cc:3060] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:01.338955 10928 leader_election.cc:304] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.380707 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211db9e835d644ccb7787552caa46c93" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:20:01.382665 12140 raft_consensus.cc:2804] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:01.382682 11032 raft_consensus.cc:2468] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:20:01.383124 12140 raft_consensus.cc:493] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.384063 12140 raft_consensus.cc:3060] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.373545 10709 catalog_manager.cc:5697] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 2 to 3, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 3 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.388067 10884 raft_consensus.cc:2468] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 5.
I20260709 13:20:01.368911 10711 catalog_manager.cc:5697] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 2 to 3, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 3 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.390658 12141 raft_consensus.cc:515] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
I20260709 13:20:01.389608 10854 leader_election.cc:304] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:20:01.396093 12080 raft_consensus.cc:2804] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:01.396494 12080 raft_consensus.cc:493] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.396874 12080 raft_consensus.cc:3060] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.397456 12124 leader_election.cc:290] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:20:01.397683 12135 leader_election.cc:290] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
W20260709 13:20:01.399456 10930 leader_election.cc:336] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.399921 11002 leader_election.cc:304] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.400810 10959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b42bdb5b9e408b8ae8b4449e21be82" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:20:01.394709 12125 raft_consensus.cc:493] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.401501 10959 raft_consensus.cc:3060] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:01.401718 11002 leader_election.cc:304] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:20:01.382416 10928 leader_election.cc:304] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.403992 12132 raft_consensus.cc:2804] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:01.404479 12132 raft_consensus.cc:697] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 4 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
W20260709 13:20:01.406847 11004 leader_election.cc:336] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:20:01.409722 11004 leader_election.cc:336] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.411567 12132 consensus_queue.cc:237] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.413029 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7b60faa74f27a65a25f8e94e3fa5" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:20:01.413673 10884 raft_consensus.cc:3060] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:01.419768 12135 raft_consensus.cc:493] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.420392 12135 raft_consensus.cc:515] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
W20260709 13:20:01.425594 10856 leader_election.cc:336] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:20:01.426263 10856 leader_election.cc:336] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.428344 12152 raft_consensus.cc:2804] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:20:01.398903 12141 leader_election.cc:290] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 4 election: Requested vote from peers 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.430938 10959 raft_consensus.cc:2468] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 4.
I20260709 13:20:01.432370 12135 leader_election.cc:290] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.431845 12140 raft_consensus.cc:515] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.434583 12140 leader_election.cc:290] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:20:01.428938 12152 raft_consensus.cc:697] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 5 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:20:01.436384 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949895bff3f409b9781c118fe3c9c21" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:20:01.437124 10885 raft_consensus.cc:3060] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.436555 12152 consensus_queue.cc:237] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.444624 11003 leader_election.cc:304] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:20:01.446257 12141 raft_consensus.cc:2804] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:01.446740 12141 raft_consensus.cc:697] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 4 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:20:01.447623 12141 consensus_queue.cc:237] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } }
W20260709 13:20:01.450634 11002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.66:43287, user_credentials={real_user=slave}} blocked reactor thread for 48998.8us
I20260709 13:20:01.452410 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e627f9d3ca4ef68b1fbeb3f16da01a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:20:01.453403 10885 raft_consensus.cc:2468] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 3.
W20260709 13:20:01.454376 10930 leader_election.cc:336] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.454967 10928 leader_election.cc:304] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.456339 12132 raft_consensus.cc:2804] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:01.457037 12132 raft_consensus.cc:697] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 3 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:20:01.401674 12125 raft_consensus.cc:515] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.458019 12132 consensus_queue.cc:237] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.458825 11032 raft_consensus.cc:2468] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:20:01.459985 12125 leader_election.cc:290] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
W20260709 13:20:01.454944 10856 leader_election.cc:336] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:20:01.463392 11004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 52942.8us
I20260709 13:20:01.464769 10854 leader_election.cc:304] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.465799 12116 raft_consensus.cc:2804] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:01.466293 12116 raft_consensus.cc:493] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.466667 12116 raft_consensus.cc:3060] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.468602 11036 raft_consensus.cc:2468] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 3.
I20260709 13:20:01.460753 12125 raft_consensus.cc:493] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.469182 12091 raft_consensus.cc:2749] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:01.469383 12125 raft_consensus.cc:515] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
W20260709 13:20:01.473801 11004 leader_election.cc:336] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.482131 12125 leader_election.cc:290] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:20:01.483599 10854 leader_election.cc:304] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.489560 12135 raft_consensus.cc:2804] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:01.490187 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e627f9d3ca4ef68b1fbeb3f16da01a" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:20:01.480208 12080 raft_consensus.cc:515] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.491667 10890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533e572edda34e56bb0fc3aaf49022da" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:20:01.493011 12080 leader_election.cc:290] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
W20260709 13:20:01.488075 11004 leader_election.cc:336] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.498564 10884 raft_consensus.cc:2468] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 4.
I20260709 13:20:01.484581 12116 raft_consensus.cc:515] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.501729 10885 raft_consensus.cc:2393] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10307244fcd642b89723e4fb4ac1291a in current term 3: Already voted for candidate 02260b9a864a4665ae3c33869adeaaf5 in this term.
I20260709 13:20:01.502811 12116 leader_election.cc:290] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.509003 12080 raft_consensus.cc:493] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.509543 12080 raft_consensus.cc:515] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.518728 10959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904c45fa164407791817b45928f663e" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b" is_pre_election: true
I20260709 13:20:01.519402 10959 raft_consensus.cc:2468] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 2.
I20260709 13:20:01.520623 11002 leader_election.cc:304] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.520675 12080 leader_election.cc:290] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:20:01.521423 10855 leader_election.cc:304] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:20:01.524760 12125 raft_consensus.cc:3060] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.527669 10709 catalog_manager.cc:5697] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 3 to 4, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 4 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:01.526319 10856 leader_election.cc:336] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.529604 10709 catalog_manager.cc:5697] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 2 to 3, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 3 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.532315 12132 raft_consensus.cc:493] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.527973 12152 raft_consensus.cc:493] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.525333 12080 raft_consensus.cc:2804] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:01.533367 12080 raft_consensus.cc:493] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.532970 12132 raft_consensus.cc:515] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.533835 12080 raft_consensus.cc:3060] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.536131 12132 leader_election.cc:290] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:20:01.537241 12152 raft_consensus.cc:515] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
W20260709 13:20:01.540012 10856 leader_election.cc:336] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:20:01.549342 10856 leader_election.cc:336] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.546343 12152 leader_election.cc:290] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:20:01.551357 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:20:01.551990 10884 raft_consensus.cc:2468] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 2.
I20260709 13:20:01.551807 10711 catalog_manager.cc:5697] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 4 to 5, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 5 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.553000 11002 leader_election.cc:304] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:20:01.545826 12116 raft_consensus.cc:493] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.547557 12080 raft_consensus.cc:515] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.553825 10711 catalog_manager.cc:5697] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 3 to 4, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 4 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.554428 12116 raft_consensus.cc:515] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.556638 12116 leader_election.cc:290] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.557010 10964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904c45fa164407791817b45928f663e" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "348b268fc1da46ac98e10bbe776b018b"
I20260709 13:20:01.560724 12080 leader_election.cc:290] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115)
I20260709 13:20:01.560935 10964 raft_consensus.cc:3060] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.557403 12152 raft_consensus.cc:2804] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:01.566371 12152 raft_consensus.cc:493] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
W20260709 13:20:01.566831 10856 leader_election.cc:336] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:20:01.567603 10856 leader_election.cc:336] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.552243 12125 raft_consensus.cc:2749] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:01.569034 12152 raft_consensus.cc:3060] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.574290 10964 raft_consensus.cc:2468] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 3.
I20260709 13:20:01.574965 11036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211db9e835d644ccb7787552caa46c93" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:20:01.575628 10855 leader_election.cc:304] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.575628 11036 raft_consensus.cc:3060] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:20:01.578788 11004 leader_election.cc:336] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.579319 11004 leader_election.cc:304] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10307244fcd642b89723e4fb4ac1291a; no voters: 02260b9a864a4665ae3c33869adeaaf5, d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.580178 12158 raft_consensus.cc:2804] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:01.580752 12158 raft_consensus.cc:697] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 3 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:20:01.581544 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e627f9d3ca4ef68b1fbeb3f16da01a" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:20:01.581717 12158 consensus_queue.cc:237] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.589776 12125 raft_consensus.cc:2749] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:01.591034 10928 leader_election.cc:304] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.592001 11036 raft_consensus.cc:2468] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 3.
I20260709 13:20:01.592235 12132 raft_consensus.cc:2804] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:01.592741 12132 raft_consensus.cc:697] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 4 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:20:01.593808 12132 consensus_queue.cc:237] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.601351 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5" is_pre_election: true
I20260709 13:20:01.602087 10884 raft_consensus.cc:2468] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 3.
I20260709 13:20:01.601764 10854 leader_election.cc:304] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.604063 11029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533e572edda34e56bb0fc3aaf49022da" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a" is_pre_election: true
I20260709 13:20:01.616947 11029 raft_consensus.cc:2468] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 3.
I20260709 13:20:01.618458 12135 raft_consensus.cc:697] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:20:01.619340 10854 leader_election.cc:304] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.609562 11032 raft_consensus.cc:2468] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 3.
W20260709 13:20:01.613194 10930 leader_election.cc:336] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.621251 10928 leader_election.cc:304] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.621371 12116 raft_consensus.cc:2804] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:01.621896 12116 raft_consensus.cc:493] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.622318 12116 raft_consensus.cc:3060] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:01.613657 12152 raft_consensus.cc:515] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.623733 12132 raft_consensus.cc:2804] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:01.624176 12132 raft_consensus.cc:493] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Starting leader election (detected failure of leader d726aaf867ea423fa4efe8a15d1896d1)
I20260709 13:20:01.624596 12132 raft_consensus.cc:3060] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:01.619395 12135 consensus_queue.cc:237] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.629592 12152 leader_election.cc:290] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:20:01.629817 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e271b04664c496a88d89b0bbfa85c36" candidate_uuid: "10307244fcd642b89723e4fb4ac1291a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:20:01.630420 10884 raft_consensus.cc:3060] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.631810 12116 raft_consensus.cc:515] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.634159 12116 leader_election.cc:290] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 election: Requested vote from peers 10307244fcd642b89723e4fb4ac1291a (127.1.250.68:44237), d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493)
I20260709 13:20:01.636279 12132 raft_consensus.cc:515] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.637926 10884 raft_consensus.cc:2468] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10307244fcd642b89723e4fb4ac1291a in term 3.
I20260709 13:20:01.639554 10854 leader_election.cc:304] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: d726aaf867ea423fa4efe8a15d1896d1
I20260709 13:20:01.640168 11032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533e572edda34e56bb0fc3aaf49022da" candidate_uuid: "02260b9a864a4665ae3c33869adeaaf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "10307244fcd642b89723e4fb4ac1291a"
I20260709 13:20:01.640841 11032 raft_consensus.cc:3060] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:01.640945 12116 raft_consensus.cc:2804] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:01.641674 10709 catalog_manager.cc:5697] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 3 to 4, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 4 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.641794 12116 raft_consensus.cc:697] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:20:01.646144 12116 consensus_queue.cc:237] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.651820 11002 leader_election.cc:304] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:20:01.653119 12141 raft_consensus.cc:2804] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:01.653833 12141 raft_consensus.cc:697] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 3 LEADER]: Becoming Leader. State: Replica: 10307244fcd642b89723e4fb4ac1291a, State: Running, Role: LEADER
I20260709 13:20:01.654899 10711 catalog_manager.cc:5697] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 2 to 3, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.655079 12141 consensus_queue.cc:237] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.663053 11032 raft_consensus.cc:2468] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02260b9a864a4665ae3c33869adeaaf5 in term 4.
I20260709 13:20:01.664506 10854 leader_election.cc:304] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 10307244fcd642b89723e4fb4ac1291a; no voters: 
I20260709 13:20:01.665819 12135 raft_consensus.cc:2804] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:20:01.614703 11004 leader_election.cc:336] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:20:01.668705 11004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:37493, user_credentials={real_user=slave}} blocked reactor thread for 54028.1us
I20260709 13:20:01.666554 12135 raft_consensus.cc:697] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 4 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:20:01.670205 12135 consensus_queue.cc:237] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
W20260709 13:20:01.673239 10856 leader_election.cc:336] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.618016 12157 raft_consensus.cc:2804] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:01.679438 12157 raft_consensus.cc:697] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 LEADER]: Becoming Leader. State: Replica: 02260b9a864a4665ae3c33869adeaaf5, State: Running, Role: LEADER
I20260709 13:20:01.681236 12157 consensus_queue.cc:237] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } }
I20260709 13:20:01.685391 12132 leader_election.cc:290] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 election: Requested vote from peers d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493), 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287)
I20260709 13:20:01.686722 10884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93233fc4a74c4234ae8eb56ad603713a" candidate_uuid: "348b268fc1da46ac98e10bbe776b018b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "02260b9a864a4665ae3c33869adeaaf5"
I20260709 13:20:01.687371 10884 raft_consensus.cc:3060] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:01.698585 10884 raft_consensus.cc:2468] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348b268fc1da46ac98e10bbe776b018b in term 4.
I20260709 13:20:01.705441 10928 leader_election.cc:304] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02260b9a864a4665ae3c33869adeaaf5, 348b268fc1da46ac98e10bbe776b018b; no voters: 
I20260709 13:20:01.713788 12140 raft_consensus.cc:2804] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:01.718647 12140 raft_consensus.cc:697] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 4 LEADER]: Becoming Leader. State: Replica: 348b268fc1da46ac98e10bbe776b018b, State: Running, Role: LEADER
I20260709 13:20:01.719956 12140 consensus_queue.cc:237] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } }
I20260709 13:20:01.712215 11032 raft_consensus.cc:1275] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:01.728694 12132 consensus_queue.cc:1048] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:20:01.748806 11004 leader_election.cc:336] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
W20260709 13:20:01.752996 10930 leader_election.cc:336] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111)
I20260709 13:20:01.760208 10709 catalog_manager.cc:5697] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a reported cstate change: term changed from 2 to 3, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 10307244fcd642b89723e4fb4ac1291a (127.1.250.68). New cstate: current_term: 3 leader_uuid: "10307244fcd642b89723e4fb4ac1291a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.770452 11032 raft_consensus.cc:1275] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:20:01.774600 10930 consensus_peers.cc:597] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:01.777544 12132 consensus_queue.cc:1048] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:01.778596 10711 catalog_manager.cc:5697] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b reported cstate change: term changed from 3 to 4, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 348b268fc1da46ac98e10bbe776b018b (127.1.250.67). New cstate: current_term: 4 leader_uuid: "348b268fc1da46ac98e10bbe776b018b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.788709 10964 raft_consensus.cc:1275] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Refusing update from remote peer 10307244fcd642b89723e4fb4ac1291a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:01.794031 12141 consensus_queue.cc:1048] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:20:01.794412 10930 consensus_peers.cc:597] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:01.803292 10884 raft_consensus.cc:1275] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:01.806226 12124 consensus_queue.cc:1048] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:20:01.814596 11004 consensus_peers.cc:597] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:01.823184 10709 catalog_manager.cc:5697] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 2 to 3, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.832587 10709 catalog_manager.cc:5697] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 3 to 4, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 4 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.835258 10709 catalog_manager.cc:5697] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 2 to 3, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.837669 10709 catalog_manager.cc:5697] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 reported cstate change: term changed from 2 to 3, leader changed from d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65) to 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "02260b9a864a4665ae3c33869adeaaf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d726aaf867ea423fa4efe8a15d1896d1" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:01.850881 11004 consensus_peers.cc:597] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:01.860723 10930 consensus_peers.cc:597] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:01.938910 10964 raft_consensus.cc:1275] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Refusing update from remote peer 10307244fcd642b89723e4fb4ac1291a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:01.940151 12141 consensus_queue.cc:1048] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:20:01.968713 10930 consensus_peers.cc:597] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:01.972776 11004 consensus_peers.cc:597] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.026302 10884 raft_consensus.cc:1275] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 5 FOLLOWER]: Refusing update from remote peer 10307244fcd642b89723e4fb4ac1291a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:20:02.028254 12151 consensus_queue.cc:1048] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:20:02.037153 10930 consensus_peers.cc:597] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.057189 10884 raft_consensus.cc:1275] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:02.061182 12140 consensus_queue.cc:1048] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:02.071319 10890 raft_consensus.cc:1275] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Refusing update from remote peer 10307244fcd642b89723e4fb4ac1291a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:02.074854 12152 consensus_queue.cc:1048] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:20:02.079948 10856 consensus_peers.cc:597] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.084447 11029 raft_consensus.cc:1275] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:02.086221 12116 consensus_queue.cc:1048] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:20:02.108969 10856 consensus_peers.cc:597] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.118124 10856 consensus_peers.cc:597] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.121544 10959 raft_consensus.cc:1275] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:02.123422 12167 consensus_queue.cc:1048] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348b268fc1da46ac98e10bbe776b018b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:20:02.135434 11004 consensus_peers.cc:597] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.146695 11032 raft_consensus.cc:1275] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:02.149652 11029 raft_consensus.cc:1275] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 4 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:20:02.151340 10856 consensus_peers.cc:597] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.154371 12167 consensus_queue.cc:1048] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:02.164223 12167 consensus_queue.cc:1048] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:20:02.165601 10856 consensus_peers.cc:597] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.190793 10930 consensus_peers.cc:597] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.193487 10885 raft_consensus.cc:1275] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:02.196112 12124 consensus_queue.cc:1048] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:02.213553 10890 raft_consensus.cc:1275] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Refusing update from remote peer 348b268fc1da46ac98e10bbe776b018b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:02.217154 12124 consensus_queue.cc:1048] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02260b9a864a4665ae3c33869adeaaf5" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 43287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:20:02.221705 11029 raft_consensus.cc:1275] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Refusing update from remote peer 02260b9a864a4665ae3c33869adeaaf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:02.232870 12167 consensus_queue.cc:1048] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10307244fcd642b89723e4fb4ac1291a" member_type: VOTER last_known_addr { host: "127.1.250.68" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 13:20:02.250454  2025 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 11790)
W20260709 13:20:02.260576 10930 consensus_peers.cc:597] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.300448 11004 consensus_peers.cc:597] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.305787 11004 consensus_peers.cc:597] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.324858 10930 consensus_peers.cc:597] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.369863 10930 consensus_peers.cc:597] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.378263 10856 consensus_peers.cc:597] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.392900 10930 consensus_peers.cc:597] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.478509 11004 consensus_peers.cc:597] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.498875 11004 consensus_peers.cc:597] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.521947 11004 consensus_peers.cc:597] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.566893 10930 consensus_peers.cc:597] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.591248 10930 consensus_peers.cc:597] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.605448 10930 consensus_peers.cc:597] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.612496 10856 consensus_peers.cc:597] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.617357 10856 consensus_peers.cc:597] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.647119 11004 consensus_peers.cc:597] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.655861 11004 consensus_peers.cc:597] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.662288 10930 consensus_peers.cc:597] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.694375 11004 consensus_peers.cc:597] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.705113 10930 consensus_peers.cc:597] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.733062 11004 consensus_peers.cc:597] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.771497 10930 consensus_peers.cc:597] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.772053 10930 consensus_peers.cc:597] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.782411 10856 consensus_peers.cc:597] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.789459 10856 consensus_peers.cc:597] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.879554 10856 consensus_peers.cc:597] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.885998 10856 consensus_peers.cc:597] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.896946 10930 consensus_peers.cc:597] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.927042 10856 consensus_peers.cc:597] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.974596 10856 consensus_peers.cc:597] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:03.157889  2025 tablet_server.cc:196] TabletServer@127.1.250.65:37493 shutdown complete.
I20260709 13:20:03.261171  2025 tablet_server.cc:179] TabletServer@127.1.250.66:0 shutting down...
W20260709 13:20:03.266598 10928 consensus_peers.cc:597] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.283105 11002 consensus_peers.cc:597] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.306036 11002 consensus_peers.cc:597] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.319702  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:03.320974  2025 tablet_replica.cc:333] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.322144  2025 raft_consensus.cc:2243] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.322820  2025 raft_consensus.cc:2272] T 25e873664b784f37bb216a0a11da17aa P 02260b9a864a4665ae3c33869adeaaf5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.325376  2025 tablet_replica.cc:333] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.326303  2025 raft_consensus.cc:2243] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.327466  2025 raft_consensus.cc:2272] T 4a3926cff4dd4248bf3731e550fd2356 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.330842  2025 tablet_replica.cc:333] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.331915  2025 raft_consensus.cc:2243] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.332574  2025 raft_consensus.cc:2272] T d5bd727bd3f64651b8e9d3dae0169166 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.335752  2025 tablet_replica.cc:333] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.336745  2025 raft_consensus.cc:2243] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.337822  2025 raft_consensus.cc:2272] T 0005319a469f4f4e993fa7679707faa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.340775  2025 tablet_replica.cc:333] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.341672  2025 raft_consensus.cc:2243] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.342197  2025 raft_consensus.cc:2272] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.345295  2025 tablet_replica.cc:333] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.346339  2025 raft_consensus.cc:2243] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.347062  2025 raft_consensus.cc:2272] T 06b6e17edd7f4c618e7260d4e3a65f8a P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.350059  2025 tablet_replica.cc:333] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.351101  2025 raft_consensus.cc:2243] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.351756  2025 raft_consensus.cc:2272] T b854da4ba865432d90d6a626e5b585bf P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.354882  2025 tablet_replica.cc:333] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.355583  2025 raft_consensus.cc:2243] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.356168  2025 raft_consensus.cc:2272] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.359316  2025 tablet_replica.cc:333] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.360342  2025 raft_consensus.cc:2243] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.361505  2025 raft_consensus.cc:2272] T 585cc3c8fea2482e99b321de3dc98356 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.364210  2025 tablet_replica.cc:333] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.365170  2025 raft_consensus.cc:2243] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.365861  2025 raft_consensus.cc:2272] T 3c926e4bc5c549a88846566915db122f P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:03.367985 10928 consensus_peers.cc:597] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.368934  2025 tablet_replica.cc:333] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.369987  2025 raft_consensus.cc:2243] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.370656  2025 raft_consensus.cc:2272] T 6e271b04664c496a88d89b0bbfa85c36 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.372931  2025 tablet_replica.cc:333] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
W20260709 13:20:03.373337 11002 consensus_peers.cc:597] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.373926  2025 raft_consensus.cc:2243] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.375058  2025 raft_consensus.cc:2272] T cf66c391c2ea4f04a1eb536f28d4b170 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:03.376271 11002 consensus_peers.cc:597] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.378191  2025 tablet_replica.cc:333] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.379151  2025 raft_consensus.cc:2243] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.380192  2025 raft_consensus.cc:2272] T b64ecb0ea0324b31ae37b194ad98e73a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.382413  2025 tablet_replica.cc:333] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.383059  2025 raft_consensus.cc:2243] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.383512  2025 raft_consensus.cc:2272] T 84aaea3ca9c0459e98df2be582872d60 P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.385949  2025 tablet_replica.cc:333] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.386883  2025 raft_consensus.cc:2243] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.387812  2025 raft_consensus.cc:2272] T bb34c068418c4622b74233a46424384d P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.390596  2025 tablet_replica.cc:333] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.391286  2025 raft_consensus.cc:2243] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.392257  2025 raft_consensus.cc:2272] T c282271ee3314a2db79070b0c703e56d P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.395293  2025 tablet_replica.cc:333] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.396130  2025 raft_consensus.cc:2243] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.397171  2025 raft_consensus.cc:2272] T 6b7600277a13475fa3c331ef52fb4d51 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:03.397465 11002 consensus_peers.cc:597] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.399783  2025 tablet_replica.cc:333] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.400533  2025 raft_consensus.cc:2243] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.401026  2025 raft_consensus.cc:2272] T 34c729794e1e4b7bb1571a3e52c12585 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.403359  2025 tablet_replica.cc:333] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.403971  2025 raft_consensus.cc:2243] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.404559  2025 raft_consensus.cc:2272] T 858421950e8a4552815da6611d222770 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.407585  2025 tablet_replica.cc:333] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.408516  2025 raft_consensus.cc:2243] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.409129  2025 raft_consensus.cc:2272] T 10ebefb588f745118a0b6ec5c6519a65 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:03.411828 10928 consensus_peers.cc:597] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.412256  2025 tablet_replica.cc:333] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.413022  2025 raft_consensus.cc:2243] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.414515  2025 raft_consensus.cc:2272] T 533e572edda34e56bb0fc3aaf49022da P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.417574  2025 tablet_replica.cc:333] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.418517  2025 raft_consensus.cc:2243] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.419538  2025 raft_consensus.cc:2272] T 34a961ac552345e8b4c84ccdcb5ee1cf P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:03.421327 10928 consensus_peers.cc:597] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.422164  2025 tablet_replica.cc:333] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.422894  2025 raft_consensus.cc:2243] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.423409  2025 raft_consensus.cc:2272] T c78decb93a9542368bf3107bc846a6f0 P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.425652  2025 tablet_replica.cc:333] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.426422  2025 raft_consensus.cc:2243] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.429548  2025 raft_consensus.cc:2272] T b145e95f652c4178b64b4379f53a809d P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.432020  2025 tablet_replica.cc:333] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.432662  2025 raft_consensus.cc:2243] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.433569  2025 raft_consensus.cc:2272] T 61d37e6e4c06405fa84aaf770ff215bc P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.435609  2025 tablet_replica.cc:333] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.436208  2025 raft_consensus.cc:2243] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.436697  2025 raft_consensus.cc:2272] T bff1646148f04205b5383bbc084a62af P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.439361  2025 tablet_replica.cc:333] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.439960  2025 raft_consensus.cc:2243] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.440759  2025 raft_consensus.cc:2272] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.442803  2025 tablet_replica.cc:333] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.443394  2025 raft_consensus.cc:2243] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.444372  2025 raft_consensus.cc:2272] T 99b759717fbb437b92f5c1e04e6e5ce7 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.447422  2025 tablet_replica.cc:333] T 023f097eceb641d18e1870dbd3a1ede3 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.448300  2025 raft_consensus.cc:2243] T 023f097eceb641d18e1870dbd3a1ede3 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.448803  2025 raft_consensus.cc:2272] T 023f097eceb641d18e1870dbd3a1ede3 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.450913  2025 tablet_replica.cc:333] T b2b83744fc2a4faeb2a1ed98da1092b0 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.451498  2025 raft_consensus.cc:2243] T b2b83744fc2a4faeb2a1ed98da1092b0 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.452109  2025 raft_consensus.cc:2272] T b2b83744fc2a4faeb2a1ed98da1092b0 P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.455657  2025 tablet_replica.cc:333] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.457131  2025 raft_consensus.cc:2243] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.458145  2025 raft_consensus.cc:2272] T 6c9c2d96172a4900bbd79e91d3cfd69a P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.460424  2025 tablet_replica.cc:333] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.461051  2025 raft_consensus.cc:2243] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.461958  2025 raft_consensus.cc:2272] T 2904c45fa164407791817b45928f663e P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.464972  2025 tablet_replica.cc:333] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.465879  2025 raft_consensus.cc:2243] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.467017  2025 raft_consensus.cc:2272] T ccc6fa17f15647569501a369656211c7 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.469372  2025 tablet_replica.cc:333] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.469901  2025 raft_consensus.cc:2243] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.470274  2025 raft_consensus.cc:2272] T 2729869dbf7e461db0eacdce000b036f P 02260b9a864a4665ae3c33869adeaaf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.472469  2025 tablet_replica.cc:333] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.473282  2025 raft_consensus.cc:2243] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.473780  2025 raft_consensus.cc:2272] T 7bf42b68842d44bbbeaf36ee573a6da0 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.476087  2025 tablet_replica.cc:333] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.476692  2025 raft_consensus.cc:2243] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.477701  2025 raft_consensus.cc:2272] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:03.479874 10928 consensus_peers.cc:597] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.480528  2025 tablet_replica.cc:333] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.481475  2025 raft_consensus.cc:2243] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.482545  2025 raft_consensus.cc:2272] T e4b2704733d44a9f8b55a95b4c06a389 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.485607  2025 tablet_replica.cc:333] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
W20260709 13:20:03.486271 10928 consensus_peers.cc:597] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.486394  2025 raft_consensus.cc:2243] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.487006  2025 raft_consensus.cc:2272] T 93233fc4a74c4234ae8eb56ad603713a P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.489041  2025 tablet_replica.cc:333] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.489702  2025 raft_consensus.cc:2243] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.490541  2025 raft_consensus.cc:2272] T 4c225028946540c2ad3af7200d7f49e3 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.492740  2025 tablet_replica.cc:333] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.493482  2025 raft_consensus.cc:2243] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.494102  2025 raft_consensus.cc:2272] T b676ac3e11504dd5bc9a471a2216273f P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.496973  2025 tablet_replica.cc:333] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.497619  2025 raft_consensus.cc:2243] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.498067  2025 raft_consensus.cc:2272] T b949895bff3f409b9781c118fe3c9c21 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.501003  2025 tablet_replica.cc:333] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.501782  2025 raft_consensus.cc:2243] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.502346  2025 raft_consensus.cc:2272] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 02260b9a864a4665ae3c33869adeaaf5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.504910  2025 tablet_replica.cc:333] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
I20260709 13:20:03.505780  2025 raft_consensus.cc:2243] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.506356  2025 raft_consensus.cc:2272] T c2fedddd0f2b4818ad11904281a7f444 P 02260b9a864a4665ae3c33869adeaaf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.509253  2025 tablet_replica.cc:333] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5: stopping tablet replica
W20260709 13:20:03.509948 10928 consensus_peers.cc:597] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.509955  2025 raft_consensus.cc:2243] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:20:03.511336 10928 consensus_peers.cc:597] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.511938  2025 raft_consensus.cc:2272] T 211db9e835d644ccb7787552caa46c93 P 02260b9a864a4665ae3c33869adeaaf5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:03.527621 11002 consensus_peers.cc:597] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.528416 11002 consensus_peers.cc:597] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.533946 10928 consensus_peers.cc:597] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.542457 11002 consensus_peers.cc:597] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.585528 11002 consensus_peers.cc:597] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:43287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.596787  2025 tablet_server.cc:196] TabletServer@127.1.250.66:0 shutdown complete.
W20260709 13:20:03.632203 10928 consensus_peers.cc:597] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:43287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.666409 11002 consensus_peers.cc:597] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:43287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.681031  2025 tablet_server.cc:179] TabletServer@127.1.250.67:0 shutting down...
W20260709 13:20:03.685874 11002 consensus_peers.cc:597] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:43287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.688271 11003 consensus_peers.cc:597] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a -> Peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Couldn't send request to peer 348b268fc1da46ac98e10bbe776b018b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.713766 10928 consensus_peers.cc:597] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:43287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.737877  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:03.738703  2025 tablet_replica.cc:333] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.739440  2025 raft_consensus.cc:2243] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.740439  2025 raft_consensus.cc:2272] T 0223927df5f442079c8fa526ed7eef26 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.743299  2025 tablet_replica.cc:333] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.744254  2025 raft_consensus.cc:2243] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.745491  2025 raft_consensus.cc:2272] T 0a3e7b60faa74f27a65a25f8e94e3fa5 P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.747766  2025 tablet_replica.cc:333] T 4a3926cff4dd4248bf3731e550fd2356 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.748418  2025 raft_consensus.cc:2243] T 4a3926cff4dd4248bf3731e550fd2356 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.748912  2025 raft_consensus.cc:2272] T 4a3926cff4dd4248bf3731e550fd2356 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.751266  2025 tablet_replica.cc:333] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.751933  2025 raft_consensus.cc:2243] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.752398  2025 raft_consensus.cc:2272] T df06b225878d49589732d38cda773b7e P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.754675  2025 tablet_replica.cc:333] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.755304  2025 raft_consensus.cc:2243] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.756171  2025 raft_consensus.cc:2272] T 52a060d27b9f4695a643036bb5223916 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.758910  2025 tablet_replica.cc:333] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.759800  2025 raft_consensus.cc:2243] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.760815  2025 raft_consensus.cc:2272] T 84a90e754ea44ce5b10285e034656db6 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.762933  2025 tablet_replica.cc:333] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.763602  2025 raft_consensus.cc:2243] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.764113  2025 raft_consensus.cc:2272] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.766371  2025 tablet_replica.cc:333] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.767192  2025 raft_consensus.cc:2243] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.768157  2025 raft_consensus.cc:2272] T b854da4ba865432d90d6a626e5b585bf P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.770848  2025 tablet_replica.cc:333] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.771411  2025 raft_consensus.cc:2243] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.772189  2025 raft_consensus.cc:2272] T 2bc701e5f842459cb7e7469da45a4132 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.774333  2025 tablet_replica.cc:333] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.774911  2025 raft_consensus.cc:2243] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.775367  2025 raft_consensus.cc:2272] T 585cc3c8fea2482e99b321de3dc98356 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.777900  2025 tablet_replica.cc:333] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.778543  2025 raft_consensus.cc:2243] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.779392  2025 raft_consensus.cc:2272] T 3c926e4bc5c549a88846566915db122f P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.781544  2025 tablet_replica.cc:333] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.782171  2025 raft_consensus.cc:2243] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.783077  2025 raft_consensus.cc:2272] T cfc5d48da62642a9a8e39ec61cfc914d P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.785265  2025 tablet_replica.cc:333] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.785852  2025 raft_consensus.cc:2243] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.786295  2025 raft_consensus.cc:2272] T 4c225028946540c2ad3af7200d7f49e3 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.788367  2025 tablet_replica.cc:333] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.788969  2025 raft_consensus.cc:2243] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.789954  2025 raft_consensus.cc:2272] T b73cc1fc36c14e8cb8698530765f5134 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.792040  2025 tablet_replica.cc:333] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.792763  2025 raft_consensus.cc:2243] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.794003  2025 raft_consensus.cc:2272] T 84aaea3ca9c0459e98df2be582872d60 P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:03.797050 11003 consensus_peers.cc:597] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a -> Peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Couldn't send request to peer 348b268fc1da46ac98e10bbe776b018b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.797108  2025 tablet_replica.cc:333] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.798331  2025 raft_consensus.cc:2243] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.798897  2025 raft_consensus.cc:2272] T bb34c068418c4622b74233a46424384d P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.801908  2025 tablet_replica.cc:333] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
W20260709 13:20:03.802425 11002 consensus_peers.cc:597] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:43287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.802736  2025 raft_consensus.cc:2243] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.803331  2025 raft_consensus.cc:2272] T c282271ee3314a2db79070b0c703e56d P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.805413  2025 tablet_replica.cc:333] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.805987  2025 raft_consensus.cc:2243] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.806404  2025 raft_consensus.cc:2272] T 858421950e8a4552815da6611d222770 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.808230  2025 tablet_replica.cc:333] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.808786  2025 raft_consensus.cc:2243] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.809680  2025 raft_consensus.cc:2272] T 10ebefb588f745118a0b6ec5c6519a65 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.811637  2025 tablet_replica.cc:333] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.812222  2025 raft_consensus.cc:2243] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.812629  2025 raft_consensus.cc:2272] T 34a961ac552345e8b4c84ccdcb5ee1cf P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.814518  2025 tablet_replica.cc:333] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.815091  2025 raft_consensus.cc:2243] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.815907  2025 raft_consensus.cc:2272] T c78decb93a9542368bf3107bc846a6f0 P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.817917  2025 tablet_replica.cc:333] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.818715  2025 raft_consensus.cc:2243] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.819149  2025 raft_consensus.cc:2272] T d5bd727bd3f64651b8e9d3dae0169166 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.821930  2025 tablet_replica.cc:333] T 5f0b6d45547e4ef89454d41c9943374f P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.823184  2025 raft_consensus.cc:2243] T 5f0b6d45547e4ef89454d41c9943374f P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.823752  2025 raft_consensus.cc:2272] T 5f0b6d45547e4ef89454d41c9943374f P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.827452  2025 tablet_replica.cc:333] T 6c9c2d96172a4900bbd79e91d3cfd69a P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
W20260709 13:20:03.827229 11003 consensus_peers.cc:597] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a -> Peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Couldn't send request to peer 348b268fc1da46ac98e10bbe776b018b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.828331  2025 raft_consensus.cc:2243] T 6c9c2d96172a4900bbd79e91d3cfd69a P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.828873  2025 raft_consensus.cc:2272] T 6c9c2d96172a4900bbd79e91d3cfd69a P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.831600  2025 tablet_replica.cc:333] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
W20260709 13:20:03.832221 11002 consensus_peers.cc:597] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a -> Peer 02260b9a864a4665ae3c33869adeaaf5 (127.1.250.66:43287): Couldn't send request to peer 02260b9a864a4665ae3c33869adeaaf5. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:43287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.832396  2025 raft_consensus.cc:2243] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.833050  2025 raft_consensus.cc:2272] T 64eb7071b63a4a51bc2c3b07b243711e P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.835413  2025 tablet_replica.cc:333] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.835989  2025 raft_consensus.cc:2243] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.836453  2025 raft_consensus.cc:2272] T 6b7600277a13475fa3c331ef52fb4d51 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.838616  2025 tablet_replica.cc:333] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.839432  2025 raft_consensus.cc:2243] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.839893  2025 raft_consensus.cc:2272] T 5f0bdc10add5473a94bcb1e1e5d2d1bc P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.842036  2025 tablet_replica.cc:333] T b2b83744fc2a4faeb2a1ed98da1092b0 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.842607  2025 raft_consensus.cc:2243] T b2b83744fc2a4faeb2a1ed98da1092b0 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.843042  2025 raft_consensus.cc:2272] T b2b83744fc2a4faeb2a1ed98da1092b0 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.845301  2025 tablet_replica.cc:333] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.845878  2025 raft_consensus.cc:2243] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.846719  2025 raft_consensus.cc:2272] T 023f097eceb641d18e1870dbd3a1ede3 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.848807  2025 tablet_replica.cc:333] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.849431  2025 raft_consensus.cc:2243] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.850314  2025 raft_consensus.cc:2272] T bff1646148f04205b5383bbc084a62af P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.852900  2025 tablet_replica.cc:333] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.853832  2025 raft_consensus.cc:2243] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.854374  2025 raft_consensus.cc:2272] T 2904c45fa164407791817b45928f663e P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.856971  2025 tablet_replica.cc:333] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.857673  2025 raft_consensus.cc:2243] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.858201  2025 raft_consensus.cc:2272] T ccc6fa17f15647569501a369656211c7 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.860767  2025 tablet_replica.cc:333] T 94bc42d21ce64138aec6ff49d068ab86 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.861481  2025 raft_consensus.cc:2243] T 94bc42d21ce64138aec6ff49d068ab86 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:03.861546 11003 consensus_peers.cc:597] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a -> Peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Couldn't send request to peer 348b268fc1da46ac98e10bbe776b018b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.862026  2025 raft_consensus.cc:2272] T 94bc42d21ce64138aec6ff49d068ab86 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.864148  2025 tablet_replica.cc:333] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.864653  2025 raft_consensus.cc:2243] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.865056  2025 raft_consensus.cc:2272] T 9e2f9f95429447eb9cb87f21c0785a9b P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.867007  2025 tablet_replica.cc:333] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.867501  2025 raft_consensus.cc:2243] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.867851  2025 raft_consensus.cc:2272] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.869889  2025 tablet_replica.cc:333] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.870543  2025 raft_consensus.cc:2243] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.871565  2025 raft_consensus.cc:2272] T b9864e48c6a44db483a571660db1433d P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.874300  2025 tablet_replica.cc:333] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
W20260709 13:20:03.874868 11003 consensus_peers.cc:597] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a -> Peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Couldn't send request to peer 348b268fc1da46ac98e10bbe776b018b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.875226  2025 raft_consensus.cc:2243] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.875881  2025 raft_consensus.cc:2272] T 92b42bdb5b9e408b8ae8b4449e21be82 P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.878293  2025 tablet_replica.cc:333] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.879025  2025 raft_consensus.cc:2243] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.880066  2025 raft_consensus.cc:2272] T b949895bff3f409b9781c118fe3c9c21 P 348b268fc1da46ac98e10bbe776b018b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.882620  2025 tablet_replica.cc:333] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.883212  2025 raft_consensus.cc:2243] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.884208  2025 raft_consensus.cc:2272] T 1f7e307af3a04b85a49fcabdbdc687d5 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.886911  2025 tablet_replica.cc:333] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.887606  2025 raft_consensus.cc:2243] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.888638  2025 raft_consensus.cc:2272] T d09ec691f9324f94a67cc88b0a2d4522 P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:03.888801 11003 consensus_peers.cc:597] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a -> Peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Couldn't send request to peer 348b268fc1da46ac98e10bbe776b018b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.889873 11003 consensus_peers.cc:597] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a -> Peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Couldn't send request to peer 348b268fc1da46ac98e10bbe776b018b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.890911  2025 tablet_replica.cc:333] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.891512  2025 raft_consensus.cc:2243] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.892267  2025 raft_consensus.cc:2272] T 93233fc4a74c4234ae8eb56ad603713a P 348b268fc1da46ac98e10bbe776b018b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.894433  2025 tablet_replica.cc:333] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.895146  2025 raft_consensus.cc:2243] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.895743  2025 raft_consensus.cc:2272] T e4b2704733d44a9f8b55a95b4c06a389 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.898346  2025 tablet_replica.cc:333] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.898875  2025 raft_consensus.cc:2243] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.899320  2025 raft_consensus.cc:2272] T 2729869dbf7e461db0eacdce000b036f P 348b268fc1da46ac98e10bbe776b018b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.901253  2025 tablet_replica.cc:333] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b: stopping tablet replica
I20260709 13:20:03.901695  2025 raft_consensus.cc:2243] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.902436  2025 raft_consensus.cc:2272] T 7bf42b68842d44bbbeaf36ee573a6da0 P 348b268fc1da46ac98e10bbe776b018b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:03.927416 11003 consensus_peers.cc:597] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a -> Peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Couldn't send request to peer 348b268fc1da46ac98e10bbe776b018b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.934566 11003 consensus_peers.cc:597] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a -> Peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Couldn't send request to peer 348b268fc1da46ac98e10bbe776b018b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.991734 11003 consensus_peers.cc:597] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a -> Peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Couldn't send request to peer 348b268fc1da46ac98e10bbe776b018b. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.67:45115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.014202  2025 tablet_server.cc:196] TabletServer@127.1.250.67:0 shutdown complete.
W20260709 13:20:04.095047 11004 consensus_peers.cc:597] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a -> Peer d726aaf867ea423fa4efe8a15d1896d1 (127.1.250.65:37493): Couldn't send request to peer d726aaf867ea423fa4efe8a15d1896d1. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:37493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:04.101450  2025 tablet_server.cc:179] TabletServer@127.1.250.68:0 shutting down...
W20260709 13:20:04.146652 11003 consensus_peers.cc:597] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a -> Peer 348b268fc1da46ac98e10bbe776b018b (127.1.250.67:45115): Couldn't send request to peer 348b268fc1da46ac98e10bbe776b018b. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.67:45115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.149943  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:04.150977  2025 tablet_replica.cc:333] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.151794  2025 raft_consensus.cc:2243] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.152671  2025 raft_consensus.cc:2272] T 80d3cc9c0f484ffd9e1b216fa14990e8 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.154793  2025 tablet_replica.cc:333] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.155408  2025 raft_consensus.cc:2243] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.156181  2025 raft_consensus.cc:2272] T 06b6e17edd7f4c618e7260d4e3a65f8a P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.158004  2025 tablet_replica.cc:333] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.158553  2025 raft_consensus.cc:2243] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.159349  2025 raft_consensus.cc:2272] T 25e873664b784f37bb216a0a11da17aa P 10307244fcd642b89723e4fb4ac1291a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.161268  2025 tablet_replica.cc:333] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.161820  2025 raft_consensus.cc:2243] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.162580  2025 raft_consensus.cc:2272] T df06b225878d49589732d38cda773b7e P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.164578  2025 tablet_replica.cc:333] T 0005319a469f4f4e993fa7679707faa5 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.165338  2025 raft_consensus.cc:2243] T 0005319a469f4f4e993fa7679707faa5 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.165839  2025 raft_consensus.cc:2272] T 0005319a469f4f4e993fa7679707faa5 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.168188  2025 tablet_replica.cc:333] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.168872  2025 raft_consensus.cc:2243] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.169430  2025 raft_consensus.cc:2272] T 52a060d27b9f4695a643036bb5223916 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.172039  2025 tablet_replica.cc:333] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.172664  2025 raft_consensus.cc:2243] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.173233  2025 raft_consensus.cc:2272] T 84a90e754ea44ce5b10285e034656db6 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.175285  2025 tablet_replica.cc:333] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.175870  2025 raft_consensus.cc:2243] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.176318  2025 raft_consensus.cc:2272] T 2bc701e5f842459cb7e7469da45a4132 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.178397  2025 tablet_replica.cc:333] T 585cc3c8fea2482e99b321de3dc98356 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.178975  2025 raft_consensus.cc:2243] T 585cc3c8fea2482e99b321de3dc98356 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.179410  2025 raft_consensus.cc:2272] T 585cc3c8fea2482e99b321de3dc98356 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.181458  2025 tablet_replica.cc:333] T cfc5d48da62642a9a8e39ec61cfc914d P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.182063  2025 raft_consensus.cc:2243] T cfc5d48da62642a9a8e39ec61cfc914d P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.182508  2025 raft_consensus.cc:2272] T cfc5d48da62642a9a8e39ec61cfc914d P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.184420  2025 tablet_replica.cc:333] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.184998  2025 raft_consensus.cc:2243] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.186031  2025 raft_consensus.cc:2272] T 6e271b04664c496a88d89b0bbfa85c36 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.187844  2025 tablet_replica.cc:333] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.188372  2025 raft_consensus.cc:2243] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.189180  2025 raft_consensus.cc:2272] T 2729869dbf7e461db0eacdce000b036f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.191020  2025 tablet_replica.cc:333] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.191565  2025 raft_consensus.cc:2243] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.191972  2025 raft_consensus.cc:2272] T b73cc1fc36c14e8cb8698530765f5134 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.193828  2025 tablet_replica.cc:333] T cf66c391c2ea4f04a1eb536f28d4b170 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.194514  2025 raft_consensus.cc:2243] T cf66c391c2ea4f04a1eb536f28d4b170 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.194922  2025 raft_consensus.cc:2272] T cf66c391c2ea4f04a1eb536f28d4b170 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.196826  2025 tablet_replica.cc:333] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.197441  2025 raft_consensus.cc:2243] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.197818  2025 raft_consensus.cc:2272] T b64ecb0ea0324b31ae37b194ad98e73a P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.199477  2025 tablet_replica.cc:333] T d09ec691f9324f94a67cc88b0a2d4522 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.199982  2025 raft_consensus.cc:2243] T d09ec691f9324f94a67cc88b0a2d4522 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.200338  2025 raft_consensus.cc:2272] T d09ec691f9324f94a67cc88b0a2d4522 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.202015  2025 tablet_replica.cc:333] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.202498  2025 raft_consensus.cc:2243] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.202888  2025 raft_consensus.cc:2272] T bb34c068418c4622b74233a46424384d P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.204677  2025 tablet_replica.cc:333] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.205166  2025 raft_consensus.cc:2243] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.205515  2025 raft_consensus.cc:2272] T c282271ee3314a2db79070b0c703e56d P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.207155  2025 tablet_replica.cc:333] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.207634  2025 raft_consensus.cc:2243] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.208628  2025 raft_consensus.cc:2272] T 34c729794e1e4b7bb1571a3e52c12585 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.210844  2025 tablet_replica.cc:333] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.211558  2025 raft_consensus.cc:2243] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.212304  2025 raft_consensus.cc:2272] T 858421950e8a4552815da6611d222770 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.214404  2025 tablet_replica.cc:333] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.214919  2025 raft_consensus.cc:2243] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.215337  2025 raft_consensus.cc:2272] T 6c9c2d96172a4900bbd79e91d3cfd69a P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.217253  2025 tablet_replica.cc:333] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.217732  2025 raft_consensus.cc:2243] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.218470  2025 raft_consensus.cc:2272] T 64eb7071b63a4a51bc2c3b07b243711e P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.220263  2025 tablet_replica.cc:333] T 99b759717fbb437b92f5c1e04e6e5ce7 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.220734  2025 raft_consensus.cc:2243] T 99b759717fbb437b92f5c1e04e6e5ce7 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.221127  2025 raft_consensus.cc:2272] T 99b759717fbb437b92f5c1e04e6e5ce7 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.223027  2025 tablet_replica.cc:333] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.223510  2025 raft_consensus.cc:2243] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.224202  2025 raft_consensus.cc:2272] T b2b83744fc2a4faeb2a1ed98da1092b0 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.226678  2025 tablet_replica.cc:333] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.227396  2025 raft_consensus.cc:2243] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.227819  2025 raft_consensus.cc:2272] T 023f097eceb641d18e1870dbd3a1ede3 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.230193  2025 tablet_replica.cc:333] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.230734  2025 raft_consensus.cc:2243] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.231426  2025 raft_consensus.cc:2272] T b145e95f652c4178b64b4379f53a809d P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.233299  2025 tablet_replica.cc:333] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.233855  2025 raft_consensus.cc:2243] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.234229  2025 raft_consensus.cc:2272] T 61d37e6e4c06405fa84aaf770ff215bc P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.236012  2025 tablet_replica.cc:333] T 10ebefb588f745118a0b6ec5c6519a65 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.236496  2025 raft_consensus.cc:2243] T 10ebefb588f745118a0b6ec5c6519a65 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.236851  2025 raft_consensus.cc:2272] T 10ebefb588f745118a0b6ec5c6519a65 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.238608  2025 tablet_replica.cc:333] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.239089  2025 raft_consensus.cc:2243] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.239414  2025 raft_consensus.cc:2272] T 533e572edda34e56bb0fc3aaf49022da P 10307244fcd642b89723e4fb4ac1291a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.241060  2025 tablet_replica.cc:333] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.241631  2025 raft_consensus.cc:2243] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.242388  2025 raft_consensus.cc:2272] T d5bd727bd3f64651b8e9d3dae0169166 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.244215  2025 tablet_replica.cc:333] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.244668  2025 raft_consensus.cc:2243] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.245584  2025 raft_consensus.cc:2272] T 5f0b6d45547e4ef89454d41c9943374f P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.247969  2025 tablet_replica.cc:333] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.248678  2025 raft_consensus.cc:2243] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.249275  2025 raft_consensus.cc:2272] T 4c225028946540c2ad3af7200d7f49e3 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.251603  2025 tablet_replica.cc:333] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.252183  2025 raft_consensus.cc:2243] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.253165  2025 raft_consensus.cc:2272] T b676ac3e11504dd5bc9a471a2216273f P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.255798  2025 tablet_replica.cc:333] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.256542  2025 raft_consensus.cc:2243] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.257473  2025 raft_consensus.cc:2272] T 94bc42d21ce64138aec6ff49d068ab86 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.259454  2025 tablet_replica.cc:333] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.260047  2025 raft_consensus.cc:2243] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.260768  2025 raft_consensus.cc:2272] T 9e2f9f95429447eb9cb87f21c0785a9b P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.262655  2025 tablet_replica.cc:333] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.263152  2025 raft_consensus.cc:2243] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.263485  2025 raft_consensus.cc:2272] T f7e627f9d3ca4ef68b1fbeb3f16da01a P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.265407  2025 tablet_replica.cc:333] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.265913  2025 raft_consensus.cc:2243] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.266695  2025 raft_consensus.cc:2272] T 8eb72b7a1eed4df08c0414cdb29fb6f1 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.268532  2025 tablet_replica.cc:333] T b9864e48c6a44db483a571660db1433d P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.269052  2025 raft_consensus.cc:2243] T b9864e48c6a44db483a571660db1433d P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.269517  2025 raft_consensus.cc:2272] T b9864e48c6a44db483a571660db1433d P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.271404  2025 tablet_replica.cc:333] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.271910  2025 raft_consensus.cc:2243] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.272735  2025 raft_consensus.cc:2272] T 92b42bdb5b9e408b8ae8b4449e21be82 P 10307244fcd642b89723e4fb4ac1291a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.274633  2025 tablet_replica.cc:333] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.275146  2025 raft_consensus.cc:2243] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.275547  2025 raft_consensus.cc:2272] T 1f7e307af3a04b85a49fcabdbdc687d5 P 10307244fcd642b89723e4fb4ac1291a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.277699  2025 tablet_replica.cc:333] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.278198  2025 raft_consensus.cc:2243] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.278618  2025 raft_consensus.cc:2272] T 0223927df5f442079c8fa526ed7eef26 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.280423  2025 tablet_replica.cc:333] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.280917  2025 raft_consensus.cc:2243] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.281718  2025 raft_consensus.cc:2272] T c2fedddd0f2b4818ad11904281a7f444 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.283527  2025 tablet_replica.cc:333] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.283996  2025 raft_consensus.cc:2243] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.284396  2025 raft_consensus.cc:2272] T 211db9e835d644ccb7787552caa46c93 P 10307244fcd642b89723e4fb4ac1291a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.286157  2025 tablet_replica.cc:333] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a: stopping tablet replica
I20260709 13:20:04.286599  2025 raft_consensus.cc:2243] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.286993  2025 raft_consensus.cc:2272] T ccc6fa17f15647569501a369656211c7 P 10307244fcd642b89723e4fb4ac1291a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.447268  2025 tablet_server.cc:196] TabletServer@127.1.250.68:0 shutdown complete.
I20260709 13:20:04.549556  2025 master.cc:562] Master@127.1.250.126:41433 shutting down...
I20260709 13:20:04.580328  2025 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.581216  2025 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.581600  2025 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2a38c5fcfa734219bf695f7f43a1393b: stopping tablet replica
I20260709 13:20:04.628851  2025 master.cc:584] Master@127.1.250.126:41433 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (43143 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:20:04.742544  2025 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.250.126:38073
I20260709 13:20:04.743845  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:04.751029 12196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:04.751101 12197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:04.751817 12199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:04.752139  2025 server_base.cc:1061] running on GCE node
I20260709 13:20:04.753857  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:04.754038  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:04.754240  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603204754220 us; error 0 us; skew 500 ppm
I20260709 13:20:04.754787  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:04.757342  2025 webserver.cc:533] Webserver started at http://127.1.250.126:35593/ using document root <none> and password file <none>
I20260709 13:20:04.757824  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:04.757982  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:04.758296  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:04.759509  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/master-0-root/instance:
uuid: "0f3f604879434c309786b262331e14e5"
format_stamp: "Formatted at 2026-07-09 13:20:04 on dist-test-slave-g4pn"
I20260709 13:20:04.764232  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:20:04.768236 12204 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:04.769068  2025 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:04.769426  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/master-0-root
uuid: "0f3f604879434c309786b262331e14e5"
format_stamp: "Formatted at 2026-07-09 13:20:04 on dist-test-slave-g4pn"
I20260709 13:20:04.769712  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:04.781320  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:04.782644  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:04.825876  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.126:38073
I20260709 13:20:04.826067 12255 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.126:38073 every 8 connection(s)
I20260709 13:20:04.830332 12256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:04.843117 12256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5: Bootstrap starting.
I20260709 13:20:04.848796 12256 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:04.853585 12256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5: No bootstrap required, opened a new log
I20260709 13:20:04.856037 12256 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f3f604879434c309786b262331e14e5" member_type: VOTER }
I20260709 13:20:04.856539 12256 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:04.856781 12256 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3f604879434c309786b262331e14e5, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.857580 12256 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f3f604879434c309786b262331e14e5" member_type: VOTER }
I20260709 13:20:04.858131 12256 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:04.858389 12256 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:04.858741 12256 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:04.864050 12256 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f3f604879434c309786b262331e14e5" member_type: VOTER }
I20260709 13:20:04.864629 12256 leader_election.cc:304] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f3f604879434c309786b262331e14e5; no voters: 
I20260709 13:20:04.866077 12256 leader_election.cc:290] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:04.866642 12259 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:04.868259 12259 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3f604879434c309786b262331e14e5, State: Running, Role: LEADER
I20260709 13:20:04.869022 12259 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f3f604879434c309786b262331e14e5" member_type: VOTER }
I20260709 13:20:04.869500 12256 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:04.876060 12261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f3f604879434c309786b262331e14e5. Latest consensus state: current_term: 1 leader_uuid: "0f3f604879434c309786b262331e14e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f3f604879434c309786b262331e14e5" member_type: VOTER } }
I20260709 13:20:04.877065 12261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:04.876868 12260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f3f604879434c309786b262331e14e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f3f604879434c309786b262331e14e5" member_type: VOTER } }
I20260709 13:20:04.877898 12260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:04.883399 12267 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:04.892107 12267 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:04.893370  2025 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:04.902532 12267 catalog_manager.cc:1383] Generated new cluster ID: 10c84006e6f842b69adee18c260cd01a
I20260709 13:20:04.902907 12267 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:04.927244 12267 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:04.928730 12267 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:04.949426 12267 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5: Generated new TSK 0
I20260709 13:20:04.950090 12267 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:04.960249  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:04.966743 12277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:04.967796 12278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:04.969118 12280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:04.969889  2025 server_base.cc:1061] running on GCE node
I20260709 13:20:04.971072  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:04.971251  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:04.971429  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603204971414 us; error 0 us; skew 500 ppm
I20260709 13:20:04.972054  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:04.974449  2025 webserver.cc:533] Webserver started at http://127.1.250.65:40085/ using document root <none> and password file <none>
I20260709 13:20:04.974936  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:04.975129  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:04.975415  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:04.976547  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-0-root/instance:
uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
format_stamp: "Formatted at 2026-07-09 13:20:04 on dist-test-slave-g4pn"
I20260709 13:20:04.981280  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:20:04.984800 12285 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:04.985630  2025 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:04.985913  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-0-root
uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
format_stamp: "Formatted at 2026-07-09 13:20:04 on dist-test-slave-g4pn"
I20260709 13:20:04.986214  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:04.999961  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:05.001325  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:05.002895  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:05.005378  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:05.005604  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.005864  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:05.006069  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.049105  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.65:35583
I20260709 13:20:05.049372 12347 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.65:35583 every 8 connection(s)
I20260709 13:20:05.054458  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:05.062273 12352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:05.065769 12353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:05.066793 12355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:05.067950  2025 server_base.cc:1061] running on GCE node
I20260709 13:20:05.070329  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:05.070654  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:05.070888  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603205070861 us; error 0 us; skew 500 ppm
I20260709 13:20:05.071915  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:05.074038 12348 heartbeater.cc:344] Connected to a master server at 127.1.250.126:38073
I20260709 13:20:05.074460 12348 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:05.074877  2025 webserver.cc:533] Webserver started at http://127.1.250.66:34023/ using document root <none> and password file <none>
I20260709 13:20:05.075363 12348 heartbeater.cc:507] Master 127.1.250.126:38073 requested a full tablet report, sending...
I20260709 13:20:05.075479  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:05.075857  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:05.076139  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:05.077621  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-1-root/instance:
uuid: "ca092e525ac14dac8866a3deb22a318d"
format_stamp: "Formatted at 2026-07-09 13:20:05 on dist-test-slave-g4pn"
I20260709 13:20:05.077699 12221 ts_manager.cc:194] Registered new tserver with Master: 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583)
I20260709 13:20:05.079641 12221 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38580
I20260709 13:20:05.083225  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:20:05.087000 12360 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.087913  2025 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:20:05.088292  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-1-root
uuid: "ca092e525ac14dac8866a3deb22a318d"
format_stamp: "Formatted at 2026-07-09 13:20:05 on dist-test-slave-g4pn"
I20260709 13:20:05.088652  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:05.108753  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:05.110190  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:05.111899  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:05.114892  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:05.115159  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.115518  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:05.115746  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.160403  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.66:46843
I20260709 13:20:05.160557 12422 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.66:46843 every 8 connection(s)
I20260709 13:20:05.165434  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:05.174821 12426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:05.175776 12427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:05.178929  2025 server_base.cc:1061] running on GCE node
W20260709 13:20:05.179514 12429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:05.180150 12423 heartbeater.cc:344] Connected to a master server at 127.1.250.126:38073
I20260709 13:20:05.180578 12423 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:05.180635  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:05.180974  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:05.181218  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603205181200 us; error 0 us; skew 500 ppm
I20260709 13:20:05.181592 12423 heartbeater.cc:507] Master 127.1.250.126:38073 requested a full tablet report, sending...
I20260709 13:20:05.181874  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:05.183967 12221 ts_manager.cc:194] Registered new tserver with Master: ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:05.184831  2025 webserver.cc:533] Webserver started at http://127.1.250.67:32785/ using document root <none> and password file <none>
I20260709 13:20:05.185441  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:05.185658  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:05.185724 12221 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38594
I20260709 13:20:05.185950  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:05.187343  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-2-root/instance:
uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
format_stamp: "Formatted at 2026-07-09 13:20:05 on dist-test-slave-g4pn"
I20260709 13:20:05.192296  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:20:05.195752 12434 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.196636  2025 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:20:05.196892  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-2-root
uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
format_stamp: "Formatted at 2026-07-09 13:20:05 on dist-test-slave-g4pn"
I20260709 13:20:05.197185  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:05.214100  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:05.215303  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:05.216764  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:05.219131  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:05.219309  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.219592  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:05.219769  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.263443  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.67:35085
I20260709 13:20:05.263588 12496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.67:35085 every 8 connection(s)
I20260709 13:20:05.279539 12497 heartbeater.cc:344] Connected to a master server at 127.1.250.126:38073
I20260709 13:20:05.280022 12497 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:05.280757 12497 heartbeater.cc:507] Master 127.1.250.126:38073 requested a full tablet report, sending...
I20260709 13:20:05.282800 12221 ts_manager.cc:194] Registered new tserver with Master: 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:05.283682  2025 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016164602s
I20260709 13:20:05.284368 12221 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38598
I20260709 13:20:05.312171 12221 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38612:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:05.315114 12221 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:05.390338 12387 tablet_service.cc:1511] Processing CreateTablet for tablet db554a7dc73a4920b3db70a660396b7d (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:20:05.391956 12387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db554a7dc73a4920b3db70a660396b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.392792 12386 tablet_service.cc:1511] Processing CreateTablet for tablet 57e9a9ee5d784c2bbbfb49f140e7ceb3 (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:20:05.394454 12386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e9a9ee5d784c2bbbfb49f140e7ceb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.390434 12388 tablet_service.cc:1511] Processing CreateTablet for tablet b9748c924ca94ce99a4f3ce8aa2ebd10 (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:20:05.398380 12385 tablet_service.cc:1511] Processing CreateTablet for tablet 12bc17194ffa4b5284fee3d042ba5492 (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:20:05.398460 12388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9748c924ca94ce99a4f3ce8aa2ebd10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.401836 12385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bc17194ffa4b5284fee3d042ba5492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.411551 12310 tablet_service.cc:1511] Processing CreateTablet for tablet 12bc17194ffa4b5284fee3d042ba5492 (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:20:05.412860 12312 tablet_service.cc:1511] Processing CreateTablet for tablet db554a7dc73a4920b3db70a660396b7d (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:20:05.415431 12311 tablet_service.cc:1511] Processing CreateTablet for tablet 57e9a9ee5d784c2bbbfb49f140e7ceb3 (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:20:05.411551 12313 tablet_service.cc:1511] Processing CreateTablet for tablet b9748c924ca94ce99a4f3ce8aa2ebd10 (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:20:05.417565 12384 tablet_service.cc:1511] Processing CreateTablet for tablet 9afb220cc0f449c195437d83ce43913a (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:20:05.419104 12384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9afb220cc0f449c195437d83ce43913a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.419842 12309 tablet_service.cc:1511] Processing CreateTablet for tablet 9afb220cc0f449c195437d83ce43913a (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:20:05.423138 12308 tablet_service.cc:1511] Processing CreateTablet for tablet 43e6e65e31f74d60b78598fbb5cd7baf (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:20:05.425480 12383 tablet_service.cc:1511] Processing CreateTablet for tablet 43e6e65e31f74d60b78598fbb5cd7baf (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:20:05.427124 12383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e6e65e31f74d60b78598fbb5cd7baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.430783 12307 tablet_service.cc:1511] Processing CreateTablet for tablet 256f4ed4031c49ba9ce877b8d1c04a6c (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:20:05.413403 12310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bc17194ffa4b5284fee3d042ba5492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.433552 12382 tablet_service.cc:1511] Processing CreateTablet for tablet 256f4ed4031c49ba9ce877b8d1c04a6c (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:20:05.435140 12382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 256f4ed4031c49ba9ce877b8d1c04a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.438774 12306 tablet_service.cc:1511] Processing CreateTablet for tablet 423d78828e084f679d430e1c47b6110f (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:20:05.440340 12306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423d78828e084f679d430e1c47b6110f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.441525 12307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 256f4ed4031c49ba9ce877b8d1c04a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.441609 12381 tablet_service.cc:1511] Processing CreateTablet for tablet 423d78828e084f679d430e1c47b6110f (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:20:05.443203 12381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423d78828e084f679d430e1c47b6110f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.449559 12308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e6e65e31f74d60b78598fbb5cd7baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.449401 12380 tablet_service.cc:1511] Processing CreateTablet for tablet 10cb30155bf64748afc95ba6646a8f0d (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:20:05.450896 12380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10cb30155bf64748afc95ba6646a8f0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.451939 12309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9afb220cc0f449c195437d83ce43913a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.454327 12312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db554a7dc73a4920b3db70a660396b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.456296 12379 tablet_service.cc:1511] Processing CreateTablet for tablet 59b7dcf7884044a39cc3ee1c9399c4a8 (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:20:05.457454 12311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e9a9ee5d784c2bbbfb49f140e7ceb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.457914 12379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b7dcf7884044a39cc3ee1c9399c4a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.461476 12313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9748c924ca94ce99a4f3ce8aa2ebd10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.466981 12305 tablet_service.cc:1511] Processing CreateTablet for tablet 10cb30155bf64748afc95ba6646a8f0d (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:20:05.468582 12305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10cb30155bf64748afc95ba6646a8f0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.470793 12304 tablet_service.cc:1511] Processing CreateTablet for tablet 59b7dcf7884044a39cc3ee1c9399c4a8 (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:20:05.472328 12304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b7dcf7884044a39cc3ee1c9399c4a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.504633 12512 tablet_bootstrap.cc:492] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d: Bootstrap starting.
I20260709 13:20:05.512187 12512 tablet_bootstrap.cc:654] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.549602 12513 tablet_bootstrap.cc:492] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:05.558971 12513 tablet_bootstrap.cc:654] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.567715 12512 tablet_bootstrap.cc:492] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d: No bootstrap required, opened a new log
I20260709 13:20:05.568334 12512 ts_tablet_manager.cc:1403] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.017s
I20260709 13:20:05.571790 12512 raft_consensus.cc:359] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.572566 12512 raft_consensus.cc:385] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.573246 12512 raft_consensus.cc:740] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.575342 12512 consensus_queue.cc:260] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.587987 12423 heartbeater.cc:499] Master 127.1.250.126:38073 was elected leader, sending a full tablet report...
I20260709 13:20:05.589916 12512 ts_tablet_manager.cc:1434] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.010s
I20260709 13:20:05.591356 12512 tablet_bootstrap.cc:492] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d: Bootstrap starting.
I20260709 13:20:05.598546 12461 tablet_service.cc:1511] Processing CreateTablet for tablet db554a7dc73a4920b3db70a660396b7d (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:20:05.600123 12461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db554a7dc73a4920b3db70a660396b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.602443 12513 tablet_bootstrap.cc:492] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013: No bootstrap required, opened a new log
I20260709 13:20:05.603039 12513 ts_tablet_manager.cc:1403] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.004s
I20260709 13:20:05.603853 12460 tablet_service.cc:1511] Processing CreateTablet for tablet 57e9a9ee5d784c2bbbfb49f140e7ceb3 (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:20:05.605489 12460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e9a9ee5d784c2bbbfb49f140e7ceb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.606227 12513 raft_consensus.cc:359] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.607014 12513 raft_consensus.cc:385] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.607314 12513 raft_consensus.cc:740] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.610316 12462 tablet_service.cc:1511] Processing CreateTablet for tablet b9748c924ca94ce99a4f3ce8aa2ebd10 (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:20:05.610828 12513 consensus_queue.cc:260] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.612089 12462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9748c924ca94ce99a4f3ce8aa2ebd10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.613488 12348 heartbeater.cc:499] Master 127.1.250.126:38073 was elected leader, sending a full tablet report...
I20260709 13:20:05.613934 12513 ts_tablet_manager.cc:1434] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.008s
I20260709 13:20:05.614802 12513 tablet_bootstrap.cc:492] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:05.615139 12458 tablet_service.cc:1511] Processing CreateTablet for tablet 9afb220cc0f449c195437d83ce43913a (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:20:05.602305 12459 tablet_service.cc:1511] Processing CreateTablet for tablet 12bc17194ffa4b5284fee3d042ba5492 (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:20:05.617487 12457 tablet_service.cc:1511] Processing CreateTablet for tablet 43e6e65e31f74d60b78598fbb5cd7baf (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:20:05.620442 12458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9afb220cc0f449c195437d83ce43913a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.620569 12513 tablet_bootstrap.cc:654] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.629266 12457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e6e65e31f74d60b78598fbb5cd7baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.633503 12459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bc17194ffa4b5284fee3d042ba5492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.634496 12455 tablet_service.cc:1511] Processing CreateTablet for tablet 423d78828e084f679d430e1c47b6110f (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:20:05.636077 12455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423d78828e084f679d430e1c47b6110f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.638290 12453 tablet_service.cc:1511] Processing CreateTablet for tablet 59b7dcf7884044a39cc3ee1c9399c4a8 (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:20:05.640846 12454 tablet_service.cc:1511] Processing CreateTablet for tablet 10cb30155bf64748afc95ba6646a8f0d (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:20:05.642108 12456 tablet_service.cc:1511] Processing CreateTablet for tablet 256f4ed4031c49ba9ce877b8d1c04a6c (DEFAULT_TABLE table=test-workload [id=827915d90a754d428fbd1f552366c81b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:20:05.645462 12453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b7dcf7884044a39cc3ee1c9399c4a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.649468 12454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10cb30155bf64748afc95ba6646a8f0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.653638 12456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 256f4ed4031c49ba9ce877b8d1c04a6c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:20:05.664832 12424 tablet.cc:2406] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:20:05.670456 12512 tablet_bootstrap.cc:654] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.682375 12519 tablet_bootstrap.cc:492] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1: Bootstrap starting.
I20260709 13:20:05.687170 12513 tablet_bootstrap.cc:492] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013: No bootstrap required, opened a new log
I20260709 13:20:05.687783 12513 ts_tablet_manager.cc:1403] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.004s
I20260709 13:20:05.691290 12513 raft_consensus.cc:359] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.692118 12513 raft_consensus.cc:385] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.692454 12513 raft_consensus.cc:740] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.693502 12513 consensus_queue.cc:260] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.698640 12513 ts_tablet_manager.cc:1434] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:20:05.702544 12513 tablet_bootstrap.cc:492] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:05.706173 12519 tablet_bootstrap.cc:654] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.708127 12513 tablet_bootstrap.cc:654] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.713642 12512 tablet_bootstrap.cc:492] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d: No bootstrap required, opened a new log
I20260709 13:20:05.714351 12512 ts_tablet_manager.cc:1403] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d: Time spent bootstrapping tablet: real 0.123s	user 0.007s	sys 0.007s
I20260709 13:20:05.717945 12512 raft_consensus.cc:359] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.718571 12512 raft_consensus.cc:385] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.718920 12512 raft_consensus.cc:740] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.719247 12519 tablet_bootstrap.cc:492] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1: No bootstrap required, opened a new log
I20260709 13:20:05.719883 12519 ts_tablet_manager.cc:1403] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.005s
I20260709 13:20:05.719774 12512 consensus_queue.cc:260] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.723773 12519 raft_consensus.cc:359] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.724754 12519 raft_consensus.cc:385] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.725153 12519 raft_consensus.cc:740] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.726418 12512 ts_tablet_manager.cc:1434] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:20:05.726159 12519 consensus_queue.cc:260] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.727636 12512 tablet_bootstrap.cc:492] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d: Bootstrap starting.
I20260709 13:20:05.737751 12512 tablet_bootstrap.cc:654] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.738950 12519 ts_tablet_manager.cc:1434] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.013s
I20260709 13:20:05.739614 12513 tablet_bootstrap.cc:492] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013: No bootstrap required, opened a new log
I20260709 13:20:05.739800 12497 heartbeater.cc:499] Master 127.1.250.126:38073 was elected leader, sending a full tablet report...
I20260709 13:20:05.740183 12513 ts_tablet_manager.cc:1403] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.008s
I20260709 13:20:05.741179 12519 tablet_bootstrap.cc:492] T 43e6e65e31f74d60b78598fbb5cd7baf P 818426ff43bc437bbf6fdd5be13ab9d1: Bootstrap starting.
I20260709 13:20:05.743330 12513 raft_consensus.cc:359] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.744117 12513 raft_consensus.cc:385] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.744413 12513 raft_consensus.cc:740] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.745229 12513 consensus_queue.cc:260] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.749532 12513 ts_tablet_manager.cc:1434] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:20:05.750658 12513 tablet_bootstrap.cc:492] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:05.751511 12519 tablet_bootstrap.cc:654] T 43e6e65e31f74d60b78598fbb5cd7baf P 818426ff43bc437bbf6fdd5be13ab9d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.757274 12513 tablet_bootstrap.cc:654] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.770150 12513 tablet_bootstrap.cc:492] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013: No bootstrap required, opened a new log
I20260709 13:20:05.770440 12512 tablet_bootstrap.cc:492] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d: No bootstrap required, opened a new log
I20260709 13:20:05.770890 12513 ts_tablet_manager.cc:1403] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:20:05.771183 12512 ts_tablet_manager.cc:1403] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.011s
I20260709 13:20:05.772660 12519 tablet_bootstrap.cc:492] T 43e6e65e31f74d60b78598fbb5cd7baf P 818426ff43bc437bbf6fdd5be13ab9d1: No bootstrap required, opened a new log
I20260709 13:20:05.773331 12519 ts_tablet_manager.cc:1403] T 43e6e65e31f74d60b78598fbb5cd7baf P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent bootstrapping tablet: real 0.033s	user 0.025s	sys 0.006s
I20260709 13:20:05.773737 12513 raft_consensus.cc:359] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.774339 12513 raft_consensus.cc:385] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.774598 12513 raft_consensus.cc:740] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.774726 12512 raft_consensus.cc:359] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.775360 12513 consensus_queue.cc:260] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.775636 12512 raft_consensus.cc:385] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.776135 12512 raft_consensus.cc:740] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.776686 12519 raft_consensus.cc:359] T 43e6e65e31f74d60b78598fbb5cd7baf P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.777534 12519 raft_consensus.cc:385] T 43e6e65e31f74d60b78598fbb5cd7baf P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.777055 12512 consensus_queue.cc:260] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.777738 12513 ts_tablet_manager.cc:1434] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:20:05.777863 12519 raft_consensus.cc:740] T 43e6e65e31f74d60b78598fbb5cd7baf P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.778967 12519 consensus_queue.cc:260] T 43e6e65e31f74d60b78598fbb5cd7baf P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.779016 12513 tablet_bootstrap.cc:492] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:05.781832 12519 ts_tablet_manager.cc:1434] T 43e6e65e31f74d60b78598fbb5cd7baf P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:05.782954 12519 tablet_bootstrap.cc:492] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1: Bootstrap starting.
I20260709 13:20:05.787410 12512 ts_tablet_manager.cc:1434] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 13:20:05.787736 12513 tablet_bootstrap.cc:654] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.790263 12519 tablet_bootstrap.cc:654] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.795491 12515 raft_consensus.cc:493] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.796059 12515 raft_consensus.cc:515] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.787568 12517 raft_consensus.cc:493] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.799525 12517 raft_consensus.cc:515] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.800319 12515 leader_election.cc:290] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:05.811551 12517 leader_election.cc:290] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:05.812526 12512 tablet_bootstrap.cc:492] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d: Bootstrap starting.
I20260709 13:20:05.847169 12519 tablet_bootstrap.cc:492] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1: No bootstrap required, opened a new log
I20260709 13:20:05.847862 12519 ts_tablet_manager.cc:1403] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent bootstrapping tablet: real 0.065s	user 0.037s	sys 0.024s
I20260709 13:20:05.851397 12519 raft_consensus.cc:359] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.852238 12519 raft_consensus.cc:385] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.852581 12519 raft_consensus.cc:740] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.853646 12519 consensus_queue.cc:260] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.854866 12513 tablet_bootstrap.cc:492] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013: No bootstrap required, opened a new log
I20260709 13:20:05.855433 12513 ts_tablet_manager.cc:1403] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.077s	user 0.024s	sys 0.012s
I20260709 13:20:05.854621 12512 tablet_bootstrap.cc:654] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.858340 12519 ts_tablet_manager.cc:1434] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.008s
I20260709 13:20:05.859654 12519 tablet_bootstrap.cc:492] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1: Bootstrap starting.
I20260709 13:20:05.860935 12513 raft_consensus.cc:359] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.861713 12513 raft_consensus.cc:385] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.862020 12513 raft_consensus.cc:740] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.867154 12513 consensus_queue.cc:260] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.878314 12519 tablet_bootstrap.cc:654] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.879151 12513 ts_tablet_manager.cc:1434] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
W20260709 13:20:05.884742 12269 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:05.888705 12513 tablet_bootstrap.cc:492] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:05.901644 12517 raft_consensus.cc:493] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.902359 12517 raft_consensus.cc:515] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.904595 12517 leader_election.cc:290] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:05.914019 12517 raft_consensus.cc:493] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.914949 12517 raft_consensus.cc:515] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.917225 12517 leader_election.cc:290] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:05.930299 12512 tablet_bootstrap.cc:492] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d: No bootstrap required, opened a new log
I20260709 13:20:05.930531 12519 tablet_bootstrap.cc:492] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1: No bootstrap required, opened a new log
I20260709 13:20:05.931073 12512 ts_tablet_manager.cc:1403] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d: Time spent bootstrapping tablet: real 0.119s	user 0.042s	sys 0.037s
I20260709 13:20:05.931277 12519 ts_tablet_manager.cc:1403] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.011s
I20260709 13:20:05.935134 12512 raft_consensus.cc:359] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.936148 12512 raft_consensus.cc:385] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.936523 12512 raft_consensus.cc:740] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.937657 12512 consensus_queue.cc:260] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.938058 12519 raft_consensus.cc:359] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.938998 12519 raft_consensus.cc:385] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.939226 12519 raft_consensus.cc:740] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.939994 12519 consensus_queue.cc:260] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.941570 12513 tablet_bootstrap.cc:654] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.944348 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" is_pre_election: true
I20260709 13:20:05.944757 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d78828e084f679d430e1c47b6110f" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:05.945526 12398 raft_consensus.cc:2468] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 0.
W20260709 13:20:05.946156 12364 leader_election.cc:343] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:05.946803 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256f4ed4031c49ba9ce877b8d1c04a6c" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:05.947232 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d78828e084f679d430e1c47b6110f" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:05.947480 12289 leader_election.cc:304] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:05.946827 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:05.948446 12512 ts_tablet_manager.cc:1434] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 13:20:05.948611 12396 raft_consensus.cc:2468] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 0.
I20260709 13:20:05.948832 12471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256f4ed4031c49ba9ce877b8d1c04a6c" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:05.949545 12512 tablet_bootstrap.cc:492] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d: Bootstrap starting.
I20260709 13:20:05.946786 12513 tablet_bootstrap.cc:492] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013: No bootstrap required, opened a new log
I20260709 13:20:05.950059 12517 raft_consensus.cc:2804] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:05.950481 12517 raft_consensus.cc:493] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.950474 12513 ts_tablet_manager.cc:1403] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.002s
I20260709 13:20:05.951004 12517 raft_consensus.cc:3060] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:05.953501 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:05.954303 12513 raft_consensus.cc:359] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.954877 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:05.955202 12513 raft_consensus.cc:385] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.947976 12472 raft_consensus.cc:2468] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 0.
I20260709 13:20:05.957393 12519 ts_tablet_manager.cc:1434] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.003s
I20260709 13:20:05.958420 12512 tablet_bootstrap.cc:654] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:05.960850 12289 leader_election.cc:343] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:05.961691 12289 leader_election.cc:304] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:05.962097 12519 tablet_bootstrap.cc:492] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1: Bootstrap starting.
W20260709 13:20:05.962613 12286 leader_election.cc:343] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:05.963116 12286 leader_election.cc:304] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013; no voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d
W20260709 13:20:05.961966 12361 leader_election.cc:343] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:05.964249 12361 leader_election.cc:304] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:05.965054 12515 raft_consensus.cc:2749] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:05.955595 12513 raft_consensus.cc:740] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.972223 12540 raft_consensus.cc:2804] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:05.972736 12540 raft_consensus.cc:493] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.973436 12540 raft_consensus.cc:3060] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:05.973686 12539 raft_consensus.cc:2749] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:20:05.973933 12286 leader_election.cc:343] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:05.974561 12539 raft_consensus.cc:493] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.975356 12519 tablet_bootstrap.cc:654] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.972636 12513 consensus_queue.cc:260] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.975092 12539 raft_consensus.cc:515] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.977861 12513 ts_tablet_manager.cc:1434] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:20:05.968127 12517 raft_consensus.cc:515] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.981026 12517 leader_election.cc:290] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Requested vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:05.981457 12512 tablet_bootstrap.cc:492] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d: No bootstrap required, opened a new log
I20260709 13:20:05.982220 12512 ts_tablet_manager.cc:1403] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.005s
I20260709 13:20:05.985489 12517 raft_consensus.cc:493] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.986290 12539 leader_election.cc:290] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:05.986217 12517 raft_consensus.cc:515] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.987720 12513 tablet_bootstrap.cc:492] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:05.987571 12512 raft_consensus.cc:359] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.988052 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:05.988443 12512 raft_consensus.cc:385] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.988821 12512 raft_consensus.cc:740] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.989809 12515 raft_consensus.cc:493] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.989707 12512 consensus_queue.cc:260] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.990326 12515 raft_consensus.cc:515] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:05.991227 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d78828e084f679d430e1c47b6110f" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:05.991885 12517 leader_election.cc:290] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:05.992097 12396 raft_consensus.cc:3060] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:05.992417 12515 leader_election.cc:290] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:05.994256 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db554a7dc73a4920b3db70a660396b7d" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
W20260709 13:20:05.995700 12361 leader_election.cc:343] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.000339 12513 tablet_bootstrap.cc:654] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.005036 12396 raft_consensus.cc:2468] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 1.
I20260709 13:20:06.006631 12512 ts_tablet_manager.cc:1434] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d: Time spent starting tablet: real 0.024s	user 0.018s	sys 0.005s
I20260709 13:20:06.009228 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d78828e084f679d430e1c47b6110f" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:06.013937 12540 raft_consensus.cc:515] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.014374 12472 raft_consensus.cc:3060] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.009661 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db554a7dc73a4920b3db70a660396b7d" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" is_pre_election: true
I20260709 13:20:06.009887 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:06.016163 12469 raft_consensus.cc:2468] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 0.
I20260709 13:20:06.016433 12540 leader_election.cc:290] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Requested vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:06.010234 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:06.016996 12512 tablet_bootstrap.cc:492] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d: Bootstrap starting.
W20260709 13:20:06.010277 12289 leader_election.cc:343] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.010582 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:06.019104 12397 raft_consensus.cc:2468] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 0.
I20260709 13:20:06.007513 12513 tablet_bootstrap.cc:492] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013: No bootstrap required, opened a new log
I20260709 13:20:06.021693 12513 ts_tablet_manager.cc:1403] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.002s
I20260709 13:20:06.023262 12472 raft_consensus.cc:2468] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 1.
I20260709 13:20:06.006796 12519 tablet_bootstrap.cc:492] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1: No bootstrap required, opened a new log
I20260709 13:20:06.024755 12512 tablet_bootstrap.cc:654] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.024890 12519 ts_tablet_manager.cc:1403] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.013s
W20260709 13:20:06.027076 12364 leader_election.cc:343] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.026268 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:06.018692 12289 leader_election.cc:304] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:06.027570 12364 leader_election.cc:304] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:06.028636 12543 raft_consensus.cc:2749] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:06.025728 12286 leader_election.cc:304] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1; no voters: ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:06.029673 12541 raft_consensus.cc:2804] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:20:06.029999 12286 leader_election.cc:343] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.030172 12541 raft_consensus.cc:697] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Running, Role: LEADER
W20260709 13:20:06.031234 12286 leader_election.cc:343] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.031069 12541 consensus_queue.cc:237] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.026613 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:06.032371 12397 raft_consensus.cc:3060] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.031980 12519 raft_consensus.cc:359] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.032959 12517 raft_consensus.cc:2804] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:06.033228 12519 raft_consensus.cc:385] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.033505 12517 raft_consensus.cc:493] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.033978 12517 raft_consensus.cc:3060] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.033829 12519 raft_consensus.cc:740] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.024720 12513 raft_consensus.cc:359] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.035951 12513 raft_consensus.cc:385] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.035426 12519 consensus_queue.cc:260] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.036316 12513 raft_consensus.cc:740] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.036382 12289 leader_election.cc:304] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:06.037305 12513 consensus_queue.cc:260] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.038554 12539 raft_consensus.cc:2804] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:06.038973 12539 raft_consensus.cc:493] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.039371 12539 raft_consensus.cc:3060] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.039948 12513 ts_tablet_manager.cc:1434] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:20:06.041850 12513 tablet_bootstrap.cc:492] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:06.046546 12517 raft_consensus.cc:515] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.048163 12513 tablet_bootstrap.cc:654] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.049108 12519 ts_tablet_manager.cc:1434] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.002s
I20260709 13:20:06.049530 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:06.050299 12519 tablet_bootstrap.cc:492] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1: Bootstrap starting.
I20260709 13:20:06.051626 12539 raft_consensus.cc:515] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
W20260709 13:20:06.053355 12289 leader_election.cc:343] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.055747 12517 leader_election.cc:290] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Requested vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:06.057585 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:06.058288 12396 raft_consensus.cc:3060] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.058996 12513 tablet_bootstrap.cc:492] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013: No bootstrap required, opened a new log
I20260709 13:20:06.058876 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:06.059536 12513 ts_tablet_manager.cc:1403] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.009s
I20260709 13:20:06.059629 12472 raft_consensus.cc:3060] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.062085 12512 tablet_bootstrap.cc:492] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d: No bootstrap required, opened a new log
I20260709 13:20:06.062671 12512 ts_tablet_manager.cc:1403] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.010s
I20260709 13:20:06.062501 12513 raft_consensus.cc:359] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.063234 12513 raft_consensus.cc:385] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.063522 12513 raft_consensus.cc:740] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.064317 12513 consensus_queue.cc:260] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.065594 12539 leader_election.cc:290] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Requested vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:06.067183 12512 raft_consensus.cc:359] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.067191 12513 ts_tablet_manager.cc:1434] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:20:06.068331 12539 raft_consensus.cc:493] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.067209 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:06.068859 12539 raft_consensus.cc:515] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.069007 12470 raft_consensus.cc:3060] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.069855 12513 tablet_bootstrap.cc:492] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:06.068373 12512 raft_consensus.cc:385] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.071166 12512 raft_consensus.cc:740] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.072190 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:06.072953 12398 raft_consensus.cc:2468] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 0.
I20260709 13:20:06.073863 12539 leader_election.cc:290] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:06.072126 12512 consensus_queue.cc:260] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.074582 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:06.074497 12289 leader_election.cc:304] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
W20260709 13:20:06.076495 12286 leader_election.cc:343] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.078645 12512 ts_tablet_manager.cc:1434] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:20:06.078857 12541 raft_consensus.cc:2804] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:06.081306 12541 raft_consensus.cc:493] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.066721 12396 raft_consensus.cc:2468] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 1.
I20260709 13:20:06.081670 12541 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.082805 12512 tablet_bootstrap.cc:492] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d: Bootstrap starting.
I20260709 13:20:06.085096 12470 raft_consensus.cc:2468] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 1.
I20260709 13:20:06.085290 12397 raft_consensus.cc:2468] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 1.
I20260709 13:20:06.086726 12286 leader_election.cc:304] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1; no voters: 
I20260709 13:20:06.084645 12513 tablet_bootstrap.cc:654] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.080924 12472 raft_consensus.cc:2468] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 1.
I20260709 13:20:06.088474 12289 leader_election.cc:304] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:06.089509 12286 leader_election.cc:304] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1; no voters: ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:06.089805 12517 raft_consensus.cc:2804] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.090477 12517 raft_consensus.cc:697] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Running, Role: LEADER
I20260709 13:20:06.090621 12540 raft_consensus.cc:2804] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.090739 12537 raft_consensus.cc:2804] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.091450 12517 consensus_queue.cc:237] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.092723 12540 raft_consensus.cc:697] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Running, Role: LEADER
I20260709 13:20:06.093750 12540 consensus_queue.cc:237] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.094098 12220 catalog_manager.cc:5697] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.097730 12512 tablet_bootstrap.cc:654] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.102123 12537 raft_consensus.cc:697] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Running, Role: LEADER
I20260709 13:20:06.103550 12537 consensus_queue.cc:237] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.105732 12513 tablet_bootstrap.cc:492] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013: No bootstrap required, opened a new log
I20260709 13:20:06.106269 12513 ts_tablet_manager.cc:1403] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.005s
I20260709 13:20:06.109182 12513 raft_consensus.cc:359] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.109822 12513 raft_consensus.cc:385] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.110090 12513 raft_consensus.cc:740] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.110911 12513 consensus_queue.cc:260] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.111119 12541 raft_consensus.cc:515] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.112964 12512 tablet_bootstrap.cc:492] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d: No bootstrap required, opened a new log
I20260709 13:20:06.113619 12512 ts_tablet_manager.cc:1403] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.008s
I20260709 13:20:06.114179 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:06.114843 12397 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.116926 12512 raft_consensus.cc:359] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.117988 12512 raft_consensus.cc:385] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.118412 12512 raft_consensus.cc:740] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.119554 12512 consensus_queue.cc:260] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.121590 12513 ts_tablet_manager.cc:1434] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:20:06.116345 12519 tablet_bootstrap.cc:654] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.123075 12513 tablet_bootstrap.cc:492] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:06.125128 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:06.125260 12541 leader_election.cc:290] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Requested vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:06.125130 12512 ts_tablet_manager.cc:1434] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
W20260709 13:20:06.126575 12286 leader_election.cc:343] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.127378 12512 tablet_bootstrap.cc:492] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d: Bootstrap starting.
I20260709 13:20:06.129941 12519 tablet_bootstrap.cc:492] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1: No bootstrap required, opened a new log
I20260709 13:20:06.130460 12519 ts_tablet_manager.cc:1403] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.001s
I20260709 13:20:06.133634 12519 raft_consensus.cc:359] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.134388 12519 raft_consensus.cc:385] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.134693 12519 raft_consensus.cc:740] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.135696 12541 raft_consensus.cc:493] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.135445 12519 consensus_queue.cc:260] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.136189 12541 raft_consensus.cc:515] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.139041 12519 ts_tablet_manager.cc:1434] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:20:06.139137 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afb220cc0f449c195437d83ce43913a" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:06.139880 12512 tablet_bootstrap.cc:654] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.140196 12519 tablet_bootstrap.cc:492] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1: Bootstrap starting.
W20260709 13:20:06.140686 12289 leader_election.cc:343] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.144016 12397 raft_consensus.cc:2468] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 1.
I20260709 13:20:06.134109 12513 tablet_bootstrap.cc:654] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.145431 12289 leader_election.cc:304] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:06.147720 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afb220cc0f449c195437d83ce43913a" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:06.148779 12519 tablet_bootstrap.cc:654] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.148978 12472 raft_consensus.cc:2468] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 0.
I20260709 13:20:06.149945 12537 raft_consensus.cc:2804] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.150477 12537 raft_consensus.cc:697] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Running, Role: LEADER
I20260709 13:20:06.146440 12523 raft_consensus.cc:493] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.148161 12541 leader_election.cc:290] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:06.151932 12523 raft_consensus.cc:515] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.152272 12286 leader_election.cc:304] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1; no voters: ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:06.151371 12537 consensus_queue.cc:237] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.160264 12523 leader_election.cc:290] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583)
I20260709 13:20:06.172413 12541 raft_consensus.cc:2804] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:06.173061 12541 raft_consensus.cc:493] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.173609 12541 raft_consensus.cc:3060] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.176257 12513 tablet_bootstrap.cc:492] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013: No bootstrap required, opened a new log
I20260709 13:20:06.176985 12513 ts_tablet_manager.cc:1403] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.012s
I20260709 13:20:06.184239 12512 tablet_bootstrap.cc:492] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d: No bootstrap required, opened a new log
I20260709 13:20:06.184792 12512 ts_tablet_manager.cc:1403] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d: Time spent bootstrapping tablet: real 0.058s	user 0.024s	sys 0.019s
I20260709 13:20:06.185135 12513 raft_consensus.cc:359] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.186407 12513 raft_consensus.cc:385] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.186738 12513 raft_consensus.cc:740] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.187661 12512 raft_consensus.cc:359] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.187610 12513 consensus_queue.cc:260] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.188453 12512 raft_consensus.cc:385] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.188758 12512 raft_consensus.cc:740] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.190670 12513 ts_tablet_manager.cc:1434] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:20:06.192884 12512 consensus_queue.cc:260] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.199517 12512 ts_tablet_manager.cc:1434] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:20:06.200301 12512 tablet_bootstrap.cc:492] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d: Bootstrap starting.
I20260709 13:20:06.205874 12519 tablet_bootstrap.cc:492] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1: No bootstrap required, opened a new log
I20260709 13:20:06.206490 12519 ts_tablet_manager.cc:1403] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent bootstrapping tablet: real 0.067s	user 0.027s	sys 0.005s
I20260709 13:20:06.209443 12512 tablet_bootstrap.cc:654] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.209590 12519 raft_consensus.cc:359] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.215652 12519 raft_consensus.cc:385] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.215973 12519 raft_consensus.cc:740] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.216751 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9748c924ca94ce99a4f3ce8aa2ebd10" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:06.216732 12519 consensus_queue.cc:260] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
W20260709 13:20:06.218693 12438 leader_election.cc:343] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.219175 12519 ts_tablet_manager.cc:1434] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:20:06.220376 12519 tablet_bootstrap.cc:492] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1: Bootstrap starting.
I20260709 13:20:06.220682 12541 raft_consensus.cc:515] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.226316 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9748c924ca94ce99a4f3ce8aa2ebd10" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" is_pre_election: true
I20260709 13:20:06.226784 12519 tablet_bootstrap.cc:654] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.227061 12323 raft_consensus.cc:2468] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 0.
I20260709 13:20:06.227077 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afb220cc0f449c195437d83ce43913a" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
W20260709 13:20:06.228609 12289 leader_election.cc:343] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.228751 12438 leader_election.cc:304] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1; no voters: ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:06.229774 12523 raft_consensus.cc:2804] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:06.230155 12523 raft_consensus.cc:493] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.230551 12523 raft_consensus.cc:3060] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.230334 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afb220cc0f449c195437d83ce43913a" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:06.231180 12472 raft_consensus.cc:3060] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.239174 12512 tablet_bootstrap.cc:492] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d: No bootstrap required, opened a new log
I20260709 13:20:06.239761 12512 ts_tablet_manager.cc:1403] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:20:06.240248 12523 raft_consensus.cc:515] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.242672 12523 leader_election.cc:290] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 1 election: Requested vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583)
I20260709 13:20:06.242751 12512 raft_consensus.cc:359] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.243599 12512 raft_consensus.cc:385] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.243870 12472 raft_consensus.cc:2468] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 1.
I20260709 13:20:06.244005 12541 leader_election.cc:290] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Requested vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:06.243861 12512 raft_consensus.cc:740] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.245468 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9748c924ca94ce99a4f3ce8aa2ebd10" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:06.246588 12286 leader_election.cc:304] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1; no voters: ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:06.246155 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9748c924ca94ce99a4f3ce8aa2ebd10" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:06.247208 12512 consensus_queue.cc:260] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.247990 12323 raft_consensus.cc:3060] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.248901 12543 raft_consensus.cc:493] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.249454 12543 raft_consensus.cc:515] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.252056 12543 leader_election.cc:290] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:06.254343 12322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e6e65e31f74d60b78598fbb5cd7baf" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" is_pre_election: true
I20260709 13:20:06.254693 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e6e65e31f74d60b78598fbb5cd7baf" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:06.255364 12322 raft_consensus.cc:2468] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 0.
I20260709 13:20:06.255502 12472 raft_consensus.cc:2468] T 43e6e65e31f74d60b78598fbb5cd7baf P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 0.
I20260709 13:20:06.254984 12512 ts_tablet_manager.cc:1434] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:20:06.257248 12364 leader_election.cc:304] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:06.255585 12220 catalog_manager.cc:5697] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.258361 12512 tablet_bootstrap.cc:492] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d: Bootstrap starting.
I20260709 13:20:06.258391 12543 raft_consensus.cc:2804] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:06.258910 12543 raft_consensus.cc:493] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.259244 12543 raft_consensus.cc:3060] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:06.254278 12438 leader_election.cc:343] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.263195 12541 raft_consensus.cc:2804] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.265604 12512 tablet_bootstrap.cc:654] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.265784 12220 catalog_manager.cc:5697] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.268323 12323 raft_consensus.cc:2468] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 1.
I20260709 13:20:06.267668 12220 catalog_manager.cc:5697] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.270759 12541 raft_consensus.cc:697] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Running, Role: LEADER
I20260709 13:20:06.273236 12541 consensus_queue.cc:237] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.270098 12438 leader_election.cc:304] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1; no voters: ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:06.278100 12523 raft_consensus.cc:2804] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.270172 12220 catalog_manager.cc:5697] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.286330 12519 tablet_bootstrap.cc:492] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1: No bootstrap required, opened a new log
I20260709 13:20:06.286617 12512 tablet_bootstrap.cc:492] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d: No bootstrap required, opened a new log
I20260709 13:20:06.286892 12519 ts_tablet_manager.cc:1403] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent bootstrapping tablet: real 0.067s	user 0.025s	sys 0.039s
I20260709 13:20:06.287319 12512 ts_tablet_manager.cc:1403] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.007s
I20260709 13:20:06.290462 12512 raft_consensus.cc:359] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.291162 12512 raft_consensus.cc:385] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.291019 12519 raft_consensus.cc:359] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.291555 12512 raft_consensus.cc:740] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.291837 12519 raft_consensus.cc:385] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.292169 12519 raft_consensus.cc:740] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.292307 12512 consensus_queue.cc:260] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.293028 12519 consensus_queue.cc:260] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.282539 12543 raft_consensus.cc:515] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.295442 12523 raft_consensus.cc:697] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 LEADER]: Becoming Leader. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:06.295703 12512 ts_tablet_manager.cc:1434] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:06.296587 12523 consensus_queue.cc:237] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.297546 12543 leader_election.cc:290] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:06.299582 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e6e65e31f74d60b78598fbb5cd7baf" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:06.300100 12519 ts_tablet_manager.cc:1434] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:20:06.300413 12323 raft_consensus.cc:3060] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.301298 12519 tablet_bootstrap.cc:492] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1: Bootstrap starting.
I20260709 13:20:06.299583 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e6e65e31f74d60b78598fbb5cd7baf" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:06.305871 12472 raft_consensus.cc:3060] T 43e6e65e31f74d60b78598fbb5cd7baf P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.310573 12519 tablet_bootstrap.cc:654] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.311594 12218 catalog_manager.cc:5697] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.319434 12323 raft_consensus.cc:2468] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 1.
I20260709 13:20:06.321273 12364 leader_election.cc:304] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:06.322257 12543 raft_consensus.cc:2804] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.322772 12543 raft_consensus.cc:697] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [term 1 LEADER]: Becoming Leader. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:06.323609 12543 consensus_queue.cc:237] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.330967 12472 raft_consensus.cc:2468] T 43e6e65e31f74d60b78598fbb5cd7baf P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 1.
I20260709 13:20:06.330274 12221 catalog_manager.cc:5697] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:06.332049 12519 tablet_bootstrap.cc:492] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1: No bootstrap required, opened a new log
I20260709 13:20:06.332599 12519 ts_tablet_manager.cc:1403] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent bootstrapping tablet: real 0.032s	user 0.026s	sys 0.003s
I20260709 13:20:06.336014 12519 raft_consensus.cc:359] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.336752 12519 raft_consensus.cc:385] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.337162 12519 raft_consensus.cc:740] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.337932 12519 consensus_queue.cc:260] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.340188 12519 ts_tablet_manager.cc:1434] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:06.341164 12519 tablet_bootstrap.cc:492] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1: Bootstrap starting.
I20260709 13:20:06.346275 12519 tablet_bootstrap.cc:654] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.351850 12519 tablet_bootstrap.cc:492] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1: No bootstrap required, opened a new log
I20260709 13:20:06.352607 12519 ts_tablet_manager.cc:1403] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:20:06.351842 12221 catalog_manager.cc:5697] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d reported cstate change: term changed from 0 to 1, leader changed from <none> to ca092e525ac14dac8866a3deb22a318d (127.1.250.66). New cstate: current_term: 1 leader_uuid: "ca092e525ac14dac8866a3deb22a318d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.355162 12519 raft_consensus.cc:359] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.355880 12519 raft_consensus.cc:385] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.356163 12519 raft_consensus.cc:740] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.356998 12519 consensus_queue.cc:260] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.359146 12519 ts_tablet_manager.cc:1434] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:20:06.366357 12543 raft_consensus.cc:493] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.366902 12543 raft_consensus.cc:515] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.369237 12543 leader_election.cc:290] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:06.370105 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9748c924ca94ce99a4f3ce8aa2ebd10" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" is_pre_election: true
I20260709 13:20:06.370513 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9748c924ca94ce99a4f3ce8aa2ebd10" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:06.370810 12323 raft_consensus.cc:2393] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca092e525ac14dac8866a3deb22a318d in current term 1: Already voted for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in this term.
I20260709 13:20:06.372052 12361 leader_election.cc:304] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:06.372692 12543 raft_consensus.cc:3060] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.378827 12543 raft_consensus.cc:2749] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:06.428042 12541 consensus_queue.cc:1048] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.431574 12523 raft_consensus.cc:493] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.432142 12523 raft_consensus.cc:515] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.434499 12543 raft_consensus.cc:493] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.434551 12523 leader_election.cc:290] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:06.435232 12543 raft_consensus.cc:515] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.436337 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" is_pre_election: true
I20260709 13:20:06.437795 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:06.438180 12543 leader_election.cc:290] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:06.438645 12397 raft_consensus.cc:2393] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 818426ff43bc437bbf6fdd5be13ab9d1 in current term 1: Already voted for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in this term.
I20260709 13:20:06.440824 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256f4ed4031c49ba9ce877b8d1c04a6c" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:06.441524 12472 raft_consensus.cc:2468] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 0.
I20260709 13:20:06.443430 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256f4ed4031c49ba9ce877b8d1c04a6c" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" is_pre_election: true
I20260709 13:20:06.444154 12323 raft_consensus.cc:2468] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 0.
I20260709 13:20:06.444640 12438 leader_election.cc:304] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:06.445569 12364 leader_election.cc:304] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:06.446023 12523 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.445855 12540 consensus_queue.cc:1048] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:06.447078 12543 raft_consensus.cc:2804] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:06.447503 12543 raft_consensus.cc:493] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.447873 12543 raft_consensus.cc:3060] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.454560 12523 raft_consensus.cc:2749] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:06.458139 12543 raft_consensus.cc:515] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.461266 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256f4ed4031c49ba9ce877b8d1c04a6c" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:06.461691 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256f4ed4031c49ba9ce877b8d1c04a6c" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:06.462349 12470 raft_consensus.cc:3060] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.462854 12543 leader_election.cc:290] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:06.461838 12323 raft_consensus.cc:3060] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.473666 12323 raft_consensus.cc:2468] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 1.
I20260709 13:20:06.474659 12470 raft_consensus.cc:2468] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 1.
I20260709 13:20:06.474793 12364 leader_election.cc:304] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:06.475703 12543 raft_consensus.cc:2804] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.476226 12543 raft_consensus.cc:697] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 1 LEADER]: Becoming Leader. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:06.476963 12543 consensus_queue.cc:237] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.485517 12221 catalog_manager.cc:5697] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d reported cstate change: term changed from 0 to 1, leader changed from <none> to ca092e525ac14dac8866a3deb22a318d (127.1.250.66). New cstate: current_term: 1 leader_uuid: "ca092e525ac14dac8866a3deb22a318d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.488729 12523 raft_consensus.cc:493] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.489362 12523 raft_consensus.cc:515] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.491415 12523 leader_election.cc:290] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:06.492311 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" is_pre_election: true
I20260709 13:20:06.492636 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:06.494020 12397 raft_consensus.cc:2393] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 818426ff43bc437bbf6fdd5be13ab9d1 in current term 1: Already voted for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in this term.
I20260709 13:20:06.494987 12438 leader_election.cc:304] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:06.495755 12523 raft_consensus.cc:3060] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.502096 12523 raft_consensus.cc:2749] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:06.519649 12540 raft_consensus.cc:493] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.520277 12540 raft_consensus.cc:515] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.520864 12543 raft_consensus.cc:493] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.521389 12543 raft_consensus.cc:515] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.522185 12540 leader_election.cc:290] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:06.523393 12543 leader_election.cc:290] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:06.523123 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db554a7dc73a4920b3db70a660396b7d" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:06.524076 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" is_pre_election: true
I20260709 13:20:06.524283 12397 raft_consensus.cc:2468] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 0.
I20260709 13:20:06.524540 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db554a7dc73a4920b3db70a660396b7d" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:06.524621 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:06.525358 12470 raft_consensus.cc:2468] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 0.
I20260709 13:20:06.525599 12472 raft_consensus.cc:2393] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca092e525ac14dac8866a3deb22a318d in current term 1: Already voted for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in this term.
I20260709 13:20:06.525830 12289 leader_election.cc:304] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:06.526800 12540 raft_consensus.cc:2804] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:06.526969 12361 leader_election.cc:304] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:06.527287 12540 raft_consensus.cc:493] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.527748 12540 raft_consensus.cc:3060] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.527897 12543 raft_consensus.cc:3060] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.535826 12543 raft_consensus.cc:2749] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:06.535828 12540 raft_consensus.cc:515] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.537140 12541 consensus_queue.cc:1048] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.538370 12540 leader_election.cc:290] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Requested vote from peers ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:06.539088 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db554a7dc73a4920b3db70a660396b7d" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:06.539669 12397 raft_consensus.cc:3060] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.546015 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db554a7dc73a4920b3db70a660396b7d" candidate_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:06.546693 12472 raft_consensus.cc:3060] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.552193 12537 consensus_queue.cc:1048] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:06.553900 12472 raft_consensus.cc:2468] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 1.
I20260709 13:20:06.555090 12286 leader_election.cc:304] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1; no voters: 
I20260709 13:20:06.555778 12537 consensus_queue.cc:1048] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.557221 12537 raft_consensus.cc:2804] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.558374 12537 raft_consensus.cc:697] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Running, Role: LEADER
I20260709 13:20:06.559283 12537 consensus_queue.cc:237] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.557389 12397 raft_consensus.cc:2468] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in term 1.
I20260709 13:20:06.570354 12218 catalog_manager.cc:5697] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.576385 12541 consensus_queue.cc:1048] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:06.581241 12540 consensus_queue.cc:1048] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.595593  2025 ts_manager.cc:295] Set tserver state for 4b7a49af3f6c4d8eb4fda787bbc21013 to MAINTENANCE_MODE
I20260709 13:20:06.596529  2025 tablet_server.cc:179] TabletServer@127.1.250.65:0 shutting down...
I20260709 13:20:06.609149 12537 consensus_queue.cc:1048] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.627406 12537 consensus_queue.cc:1048] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:06.639578 12537 consensus_queue.cc:1048] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.649258  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:06.653765  2025 tablet_replica.cc:333] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013: stopping tablet replica
I20260709 13:20:06.657608  2025 raft_consensus.cc:2243] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.658177  2025 raft_consensus.cc:2272] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.660861  2025 tablet_replica.cc:333] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013: stopping tablet replica
I20260709 13:20:06.661616  2025 raft_consensus.cc:2243] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.662407  2025 raft_consensus.cc:2272] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.664532  2025 tablet_replica.cc:333] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013: stopping tablet replica
I20260709 13:20:06.665138  2025 raft_consensus.cc:2243] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.665940  2025 raft_consensus.cc:2272] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.668027  2025 tablet_replica.cc:333] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013: stopping tablet replica
I20260709 13:20:06.668569  2025 raft_consensus.cc:2243] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.669473  2025 raft_consensus.cc:2272] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.671715  2025 tablet_replica.cc:333] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013: stopping tablet replica
I20260709 13:20:06.672300  2025 raft_consensus.cc:2243] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.672650  2025 raft_consensus.cc:2272] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.674626  2025 tablet_replica.cc:333] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013: stopping tablet replica
I20260709 13:20:06.675146  2025 raft_consensus.cc:2243] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.675822  2025 pending_rounds.cc:70] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013: Trying to abort 1 pending ops.
I20260709 13:20:06.676012  2025 pending_rounds.cc:77] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305638732908236800 op_type: NO_OP noop_request { }
I20260709 13:20:06.676373  2025 raft_consensus.cc:2889] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:06.676731  2025 raft_consensus.cc:2272] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.679498  2025 tablet_replica.cc:333] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013: stopping tablet replica
I20260709 13:20:06.680238  2025 raft_consensus.cc:2243] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.681149  2025 raft_consensus.cc:2272] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.683323  2025 tablet_replica.cc:333] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013: stopping tablet replica
I20260709 13:20:06.683845  2025 raft_consensus.cc:2243] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.684418  2025 pending_rounds.cc:70] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013: Trying to abort 1 pending ops.
I20260709 13:20:06.684623  2025 pending_rounds.cc:77] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305638734080458752 op_type: NO_OP noop_request { }
I20260709 13:20:06.684898  2025 raft_consensus.cc:2889] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:06.685288  2025 raft_consensus.cc:2272] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.687311  2025 tablet_replica.cc:333] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013: stopping tablet replica
I20260709 13:20:06.687958  2025 raft_consensus.cc:2243] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.688359  2025 raft_consensus.cc:2272] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.690215  2025 tablet_replica.cc:333] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013: stopping tablet replica
I20260709 13:20:06.690667  2025 raft_consensus.cc:2243] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.691538  2025 raft_consensus.cc:2272] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:06.714080 12364 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111) [suppressed 393 similar messages]
I20260709 13:20:06.716648  2025 tablet_server.cc:196] TabletServer@127.1.250.65:0 shutdown complete.
I20260709 13:20:06.718434 12543 consensus_queue.cc:1048] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:06.720033 12364 consensus_peers.cc:597] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:06.724398 12569 consensus_queue.cc:1048] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.733603 12543 raft_consensus.cc:493] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.734082 12543 raft_consensus.cc:515] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:06.737347 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afb220cc0f449c195437d83ce43913a" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:06.738273 12469 raft_consensus.cc:2393] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca092e525ac14dac8866a3deb22a318d in current term 1: Already voted for candidate 4b7a49af3f6c4d8eb4fda787bbc21013 in this term.
I20260709 13:20:06.749655 12543 leader_election.cc:290] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
W20260709 13:20:06.756487 12364 leader_election.cc:336] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:06.757246 12364 leader_election.cc:304] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:06.758194 12593 raft_consensus.cc:3060] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:06.763556 12438 consensus_peers.cc:597] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:06.765753 12593 raft_consensus.cc:2749] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:20:06.886368 12269 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:20:06.930130 12364 consensus_peers.cc:597] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:06.951303 12593 consensus_queue.cc:1048] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:07.887660 12269 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:07.946954 12523 raft_consensus.cc:493] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
I20260709 13:20:07.947646 12523 raft_consensus.cc:515] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:07.949515 12523 leader_election.cc:290] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:07.950986 12543 raft_consensus.cc:493] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
I20260709 13:20:07.951102 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d78828e084f679d430e1c47b6110f" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:07.951655 12543 raft_consensus.cc:515] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:07.952520 12396 raft_consensus.cc:2468] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 1.
W20260709 13:20:07.953233 12438 leader_election.cc:336] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:07.953691 12543 leader_election.cc:290] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:07.954317 12438 leader_election.cc:304] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013
I20260709 13:20:07.954687 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d78828e084f679d430e1c47b6110f" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:07.955245 12523 raft_consensus.cc:2804] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:07.955636 12523 raft_consensus.cc:493] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
I20260709 13:20:07.955991 12523 raft_consensus.cc:3060] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:07.958227 12364 leader_election.cc:336] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:07.962411 12523 raft_consensus.cc:515] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:07.963711 12470 raft_consensus.cc:2393] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca092e525ac14dac8866a3deb22a318d in current term 2: Already voted for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in this term.
I20260709 13:20:07.964766 12523 leader_election.cc:290] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:07.966421 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d78828e084f679d430e1c47b6110f" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:07.967054 12396 raft_consensus.cc:3060] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:07.967563 12361 leader_election.cc:304] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1
W20260709 13:20:07.969429 12438 leader_election.cc:336] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:07.974627 12396 raft_consensus.cc:2468] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 2.
I20260709 13:20:07.975149 12543 raft_consensus.cc:2749] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:07.975716 12438 leader_election.cc:304] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013
I20260709 13:20:07.976473 12523 raft_consensus.cc:2804] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:07.977486 12523 raft_consensus.cc:697] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Becoming Leader. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:07.978298 12523 consensus_queue.cc:237] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:07.985819 12219 catalog_manager.cc:5697] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 reported cstate change: term changed from 1 to 2, leader changed from 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65) to 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:08.049245 12543 raft_consensus.cc:493] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
I20260709 13:20:08.049908 12543 raft_consensus.cc:515] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.052213 12543 leader_election.cc:290] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:08.053601 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
W20260709 13:20:08.056850 12364 leader_election.cc:336] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.057351 12523 raft_consensus.cc:493] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
I20260709 13:20:08.057477 12364 leader_election.cc:304] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:08.058408 12543 raft_consensus.cc:2749] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:08.058121 12523 raft_consensus.cc:515] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.060415 12523 leader_election.cc:290] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:08.061937 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:08.062533 12396 raft_consensus.cc:2468] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 1.
I20260709 13:20:08.064049 12438 leader_election.cc:304] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:08.064899 12523 raft_consensus.cc:2804] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:20:08.064940 12438 leader_election.cc:336] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.065346 12523 raft_consensus.cc:493] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
I20260709 13:20:08.065733 12523 raft_consensus.cc:3060] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.071573 12523 raft_consensus.cc:515] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.073494 12523 leader_election.cc:290] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:08.075229 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:08.075832 12396 raft_consensus.cc:3060] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:08.077667 12438 leader_election.cc:336] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.082461 12396 raft_consensus.cc:2468] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 2.
I20260709 13:20:08.083653 12438 leader_election.cc:304] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013
I20260709 13:20:08.084615 12523 raft_consensus.cc:2804] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:08.085067 12523 raft_consensus.cc:697] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Becoming Leader. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:08.086313 12523 consensus_queue.cc:237] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.092473 12543 raft_consensus.cc:493] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
I20260709 13:20:08.092721 12523 raft_consensus.cc:493] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
I20260709 13:20:08.093211 12543 raft_consensus.cc:515] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.093225 12523 raft_consensus.cc:515] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.094448 12219 catalog_manager.cc:5697] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 reported cstate change: term changed from 1 to 2, leader changed from 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65) to 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:08.095528 12523 leader_election.cc:290] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:08.095579 12543 leader_election.cc:290] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:08.097031 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:08.097700 12470 raft_consensus.cc:2468] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 1.
I20260709 13:20:08.098429 12523 raft_consensus.cc:493] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
I20260709 13:20:08.099061 12523 raft_consensus.cc:515] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.099370 12361 leader_election.cc:304] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:08.101241 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:08.102020 12396 raft_consensus.cc:2468] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 1.
I20260709 13:20:08.103329 12543 raft_consensus.cc:2804] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:08.103899 12543 raft_consensus.cc:493] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
W20260709 13:20:08.104367 12364 leader_election.cc:336] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.104389 12543 raft_consensus.cc:3060] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:08.105527 12438 leader_election.cc:336] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.106819 12438 leader_election.cc:304] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013
I20260709 13:20:08.107789 12523 leader_election.cc:290] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:08.107903 12598 raft_consensus.cc:2804] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:08.108466 12598 raft_consensus.cc:493] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
I20260709 13:20:08.108919 12598 raft_consensus.cc:3060] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.109998 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
W20260709 13:20:08.113756 12438 leader_election.cc:336] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.114226 12438 leader_election.cc:304] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:08.114480 12543 raft_consensus.cc:515] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.115062 12523 raft_consensus.cc:2749] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:08.116652 12543 leader_election.cc:290] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:08.117909 12543 raft_consensus.cc:493] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
I20260709 13:20:08.117700 12598 raft_consensus.cc:515] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.118073 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:08.118498 12543 raft_consensus.cc:515] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.119024 12470 raft_consensus.cc:2393] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca092e525ac14dac8866a3deb22a318d in current term 2: Already voted for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in this term.
I20260709 13:20:08.120218 12598 leader_election.cc:290] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:08.120903 12543 leader_election.cc:290] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:08.122504 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:08.123212 12470 raft_consensus.cc:2468] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 1.
I20260709 13:20:08.123659 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
W20260709 13:20:08.123821 12364 leader_election.cc:336] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.124701 12361 leader_election.cc:304] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:08.125031 12396 raft_consensus.cc:2393] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 818426ff43bc437bbf6fdd5be13ab9d1 in current term 2: Already voted for candidate ca092e525ac14dac8866a3deb22a318d in this term.
I20260709 13:20:08.124850 12364 leader_election.cc:304] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:08.126125 12543 raft_consensus.cc:2804] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:08.126319 12604 raft_consensus.cc:2749] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:08.126521 12543 raft_consensus.cc:493] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
I20260709 13:20:08.126958 12543 raft_consensus.cc:3060] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:08.127336 12438 leader_election.cc:336] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.127776 12438 leader_election.cc:304] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:08.128441 12598 raft_consensus.cc:2749] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:20:08.129395 12364 leader_election.cc:336] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.133328 12543 raft_consensus.cc:515] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.135141 12543 leader_election.cc:290] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:08.136427 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:08.137224 12470 raft_consensus.cc:3060] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:08.139849 12364 leader_election.cc:336] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.144474 12470 raft_consensus.cc:2468] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 2.
I20260709 13:20:08.146031 12361 leader_election.cc:304] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013
I20260709 13:20:08.147087 12543 raft_consensus.cc:2804] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:08.147610 12543 raft_consensus.cc:697] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 2 LEADER]: Becoming Leader. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:08.148448 12543 consensus_queue.cc:237] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.150802 12604 raft_consensus.cc:493] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
I20260709 13:20:08.151410 12604 raft_consensus.cc:515] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.154099 12604 leader_election.cc:290] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:08.154175 12598 raft_consensus.cc:493] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
I20260709 13:20:08.154856 12598 raft_consensus.cc:515] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.155869 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:08.156566 12470 raft_consensus.cc:2468] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 1.
I20260709 13:20:08.157254 12598 leader_election.cc:290] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:08.157886 12361 leader_election.cc:304] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:08.157675 12219 catalog_manager.cc:5697] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d reported cstate change: term changed from 1 to 2, leader changed from 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65) to ca092e525ac14dac8866a3deb22a318d (127.1.250.66). New cstate: current_term: 2 leader_uuid: "ca092e525ac14dac8866a3deb22a318d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.159248 12604 raft_consensus.cc:2804] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:20:08.159751 12364 leader_election.cc:336] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.160166 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:08.159787 12604 raft_consensus.cc:493] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b7a49af3f6c4d8eb4fda787bbc21013)
I20260709 13:20:08.162426 12604 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:08.164140 12438 leader_election.cc:336] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.170272 12604 raft_consensus.cc:515] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.171433 12396 raft_consensus.cc:2393] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 818426ff43bc437bbf6fdd5be13ab9d1 in current term 2: Already voted for candidate ca092e525ac14dac8866a3deb22a318d in this term.
I20260709 13:20:08.172381 12604 leader_election.cc:290] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:08.173844 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:08.174088 12438 leader_election.cc:304] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:08.174485 12470 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:08.176528 12364 leader_election.cc:336] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.180423 12470 raft_consensus.cc:2468] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 2.
I20260709 13:20:08.180894 12598 raft_consensus.cc:2749] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:08.181663 12361 leader_election.cc:304] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013
I20260709 13:20:08.182466 12604 raft_consensus.cc:2804] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:08.183138 12604 raft_consensus.cc:697] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 2 LEADER]: Becoming Leader. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:08.184059 12604 consensus_queue.cc:237] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.189055 12598 raft_consensus.cc:493] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.189697 12598 raft_consensus.cc:515] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.191745 12598 leader_election.cc:290] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:08.192317 12219 catalog_manager.cc:5697] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d reported cstate change: term changed from 1 to 2, leader changed from 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65) to ca092e525ac14dac8866a3deb22a318d (127.1.250.66). New cstate: current_term: 2 leader_uuid: "ca092e525ac14dac8866a3deb22a318d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.193653 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afb220cc0f449c195437d83ce43913a" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:08.194391 12396 raft_consensus.cc:2468] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 1.
I20260709 13:20:08.195504 12438 leader_election.cc:304] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 
W20260709 13:20:08.196358 12438 leader_election.cc:336] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.196375 12598 raft_consensus.cc:2804] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:08.196972 12598 raft_consensus.cc:493] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.197358 12598 raft_consensus.cc:3060] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.204608 12598 raft_consensus.cc:515] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.206233 12598 leader_election.cc:290] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:08.207782 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afb220cc0f449c195437d83ce43913a" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:08.208442 12396 raft_consensus.cc:3060] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:08.209775 12438 leader_election.cc:336] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.214681 12396 raft_consensus.cc:2468] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 2.
I20260709 13:20:08.216212 12438 leader_election.cc:304] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013
I20260709 13:20:08.216917 12598 raft_consensus.cc:2804] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:08.217423 12598 raft_consensus.cc:697] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Becoming Leader. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:08.218289 12598 consensus_queue.cc:237] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.226161 12219 catalog_manager.cc:5697] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 reported cstate change: term changed from 1 to 2, leader changed from 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65) to 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:08.432328 12396 raft_consensus.cc:1275] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:08.433647 12598 consensus_queue.cc:1048] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:08.450809 12438 consensus_peers.cc:597] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:08.504200 12612 raft_consensus.cc:493] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.504835 12612 raft_consensus.cc:515] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.506817 12612 leader_election.cc:290] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:08.508669 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db554a7dc73a4920b3db70a660396b7d" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d" is_pre_election: true
I20260709 13:20:08.509452 12396 raft_consensus.cc:2468] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 1.
I20260709 13:20:08.510439 12438 leader_election.cc:304] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:08.511389 12612 raft_consensus.cc:2804] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:20:08.511423 12438 leader_election.cc:336] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.511790 12612 raft_consensus.cc:493] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.512246 12612 raft_consensus.cc:3060] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.518163 12612 raft_consensus.cc:515] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.519910 12612 leader_election.cc:290] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:08.521973 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db554a7dc73a4920b3db70a660396b7d" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:08.522747 12396 raft_consensus.cc:3060] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:08.524034 12438 leader_election.cc:336] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:08.528970 12396 raft_consensus.cc:2468] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 2.
I20260709 13:20:08.530340 12438 leader_election.cc:304] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013
I20260709 13:20:08.531164 12612 raft_consensus.cc:2804] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:08.531764 12612 raft_consensus.cc:697] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Becoming Leader. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:08.532694 12612 consensus_queue.cc:237] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:08.540515 12221 catalog_manager.cc:5697] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 reported cstate change: term changed from 1 to 2, leader changed from 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65) to 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:08.549808 12438 consensus_peers.cc:597] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:08.599886 12364 consensus_peers.cc:597] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:08.618644 12470 raft_consensus.cc:1275] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:08.620263 12604 consensus_queue.cc:1048] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:08.632333 12396 raft_consensus.cc:1275] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:20:08.634925 12612 consensus_queue.cc:1048] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:08.638911 12364 consensus_peers.cc:597] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:08.654279 12438 consensus_peers.cc:597] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:08.658144 12396 raft_consensus.cc:1275] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:08.659430 12619 consensus_queue.cc:1048] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:08.711306 12470 raft_consensus.cc:1275] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:08.712802 12604 consensus_queue.cc:1048] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:08.889024 12269 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:09.004421 12396 raft_consensus.cc:1275] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:20:09.006067 12612 consensus_queue.cc:1048] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:09.021932 12438 consensus_peers.cc:597] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:09.022513 12438 consensus_peers.cc:597] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:09.294704 12364 consensus_peers.cc:597] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:09.410542 12364 consensus_peers.cc:597] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:09.890102 12269 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:10.140776 12604 raft_consensus.cc:493] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.141505 12604 raft_consensus.cc:515] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:10.143615 12604 leader_election.cc:290] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:10.144979 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" is_pre_election: true
I20260709 13:20:10.145697 12470 raft_consensus.cc:2468] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 2.
I20260709 13:20:10.146792 12361 leader_election.cc:304] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:10.147583 12604 raft_consensus.cc:2804] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:20:10.147557 12364 leader_election.cc:336] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:10.148039 12604 raft_consensus.cc:493] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.148411 12604 raft_consensus.cc:3060] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:10.153861 12604 raft_consensus.cc:515] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:10.155623 12604 leader_election.cc:290] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 3 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:10.156950 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:10.157858 12470 raft_consensus.cc:3060] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:20:10.159636 12364 leader_election.cc:336] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111)
I20260709 13:20:10.164161 12470 raft_consensus.cc:2468] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 3.
I20260709 13:20:10.165360 12361 leader_election.cc:304] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 4b7a49af3f6c4d8eb4fda787bbc21013
I20260709 13:20:10.166041 12604 raft_consensus.cc:2804] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:10.166893 12604 raft_consensus.cc:697] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Becoming Leader. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:10.167780 12604 consensus_queue.cc:237] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:10.178399 12221 catalog_manager.cc:5697] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d reported cstate change: term changed from 1 to 3, leader changed from 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65) to ca092e525ac14dac8866a3deb22a318d (127.1.250.66). New cstate: current_term: 3 leader_uuid: "ca092e525ac14dac8866a3deb22a318d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:10.594249 12470 raft_consensus.cc:1275] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:10.595620 12623 consensus_queue.cc:1048] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:10.616572 12364 consensus_peers.cc:597] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:10.891240 12269 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:20:10.986840 12438 consensus_peers.cc:597] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:11.083400 12438 consensus_peers.cc:597] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:11.125813 12364 consensus_peers.cc:597] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:11.192147 12438 consensus_peers.cc:597] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:11.261972 12364 consensus_peers.cc:597] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:11.585634 12438 consensus_peers.cc:597] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:11.654134 12438 consensus_peers.cc:597] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:11.752064  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:11.759259 12636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:11.759413 12635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:11.760753 12638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:11.761565  2025 server_base.cc:1061] running on GCE node
I20260709 13:20:11.762681  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:11.762945  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:11.763128  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603211763112 us; error 0 us; skew 500 ppm
I20260709 13:20:11.763733  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:11.766199  2025 webserver.cc:533] Webserver started at http://127.1.250.65:40085/ using document root <none> and password file <none>
I20260709 13:20:11.766685  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:11.766884  2025 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:20:11.770489  2025 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:20:11.774441 12643 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:11.775470  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:20:11.775930  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-0-root
uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
format_stamp: "Formatted at 2026-07-09 13:20:04 on dist-test-slave-g4pn"
I20260709 13:20:11.776296  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602894180814-2025-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:20:11.776418 12438 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111) [suppressed 95 similar messages]
I20260709 13:20:11.798173  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:11.799322  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:11.800776  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:11.804426 12650 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:20:11.854100  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:20:11.854374  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.051s	user 0.003s	sys 0.000s
I20260709 13:20:11.854615  2025 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:20:11.860420 12650 tablet_bootstrap.cc:492] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
W20260709 13:20:11.860965 12364 consensus_peers.cc:597] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:11.872617 12364 consensus_peers.cc:597] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:11.874311 12650 tablet_bootstrap.cc:492] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:11.875171 12650 tablet_bootstrap.cc:492] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap complete.
I20260709 13:20:11.875753 12650 ts_tablet_manager.cc:1403] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:20:11.878561 12650 raft_consensus.cc:359] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:11.879106 12650 raft_consensus.cc:740] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:11.880060 12650 consensus_queue.cc:260] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:11.882684 12650 ts_tablet_manager.cc:1434] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:20:11.883562 12650 tablet_bootstrap.cc:492] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
W20260709 13:20:11.892378 12269 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:11.897236 12650 tablet_bootstrap.cc:492] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:11.898346 12650 tablet_bootstrap.cc:492] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap complete.
I20260709 13:20:11.899016 12650 ts_tablet_manager.cc:1403] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:20:11.901371 12650 raft_consensus.cc:359] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:11.901958 12650 raft_consensus.cc:740] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:11.902853  2025 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:20:11.902606 12650 consensus_queue.cc:260] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:11.903187  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.049s	user 0.043s	sys 0.004s
I20260709 13:20:11.904537 12650 ts_tablet_manager.cc:1434] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:20:11.905529 12650 tablet_bootstrap.cc:492] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:11.920912 12650 tablet_bootstrap.cc:492] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:20:11.922274 12650 tablet_bootstrap.cc:492] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap complete.
I20260709 13:20:11.923076 12650 ts_tablet_manager.cc:1403] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:20:11.926146 12650 raft_consensus.cc:359] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:11.927039 12650 raft_consensus.cc:740] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:11.927776 12650 consensus_queue.cc:260] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:11.929857 12650 ts_tablet_manager.cc:1434] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:20:11.930661 12650 tablet_bootstrap.cc:492] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:11.942457 12650 tablet_bootstrap.cc:492] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:20:11.943256 12650 tablet_bootstrap.cc:492] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap complete.
I20260709 13:20:11.943799 12650 ts_tablet_manager.cc:1403] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:20:11.946264 12650 raft_consensus.cc:359] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:11.947232 12650 raft_consensus.cc:740] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:11.948069 12650 consensus_queue.cc:260] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:11.950387 12650 ts_tablet_manager.cc:1434] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:11.951326 12650 tablet_bootstrap.cc:492] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:11.966020 12650 tablet_bootstrap.cc:492] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:11.966840 12650 tablet_bootstrap.cc:492] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap complete.
I20260709 13:20:11.967456 12650 ts_tablet_manager.cc:1403] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:20:11.968497  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.65:35583
I20260709 13:20:11.968616 12712 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.65:35583 every 8 connection(s)
I20260709 13:20:11.969815 12650 raft_consensus.cc:359] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:11.970396 12650 raft_consensus.cc:740] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:11.971078 12650 consensus_queue.cc:260] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:11.973201 12650 ts_tablet_manager.cc:1434] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:20:11.973600  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:11.974138 12650 tablet_bootstrap.cc:492] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:11.990948 12650 tablet_bootstrap.cc:492] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:11.992228 12650 tablet_bootstrap.cc:492] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap complete.
I20260709 13:20:11.993137 12650 ts_tablet_manager.cc:1403] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:20:11.996284 12650 raft_consensus.cc:359] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:11.996745 12650 raft_consensus.cc:740] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:11.997467 12650 consensus_queue.cc:260] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:11.999714 12650 ts_tablet_manager.cc:1434] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:20:12.000720 12650 tablet_bootstrap.cc:492] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:12.005556 12713 heartbeater.cc:344] Connected to a master server at 127.1.250.126:38073
I20260709 13:20:12.006069 12713 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:12.006995 12713 heartbeater.cc:507] Master 127.1.250.126:38073 requested a full tablet report, sending...
I20260709 13:20:12.008001 12396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d"
dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
mode: GRACEFUL
new_leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:35732
I20260709 13:20:12.008718 12396 raft_consensus.cc:606] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 2 LEADER]: Received request to transfer leadership to TS 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:12.014747 12221 ts_manager.cc:194] Re-registered known tserver with Master: 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583)
I20260709 13:20:12.016238 12650 tablet_bootstrap.cc:492] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:12.017258 12650 tablet_bootstrap.cc:492] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap complete.
I20260709 13:20:12.017817 12650 ts_tablet_manager.cc:1403] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.006s
I20260709 13:20:12.020002 12650 raft_consensus.cc:359] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.020721 12650 raft_consensus.cc:740] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.022070 12650 consensus_queue.cc:260] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.024073 12650 ts_tablet_manager.cc:1434] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:20:12.024904 12650 tablet_bootstrap.cc:492] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:12.025296 12470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "423d78828e084f679d430e1c47b6110f"
dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
mode: GRACEFUL
new_leader_uuid: "ca092e525ac14dac8866a3deb22a318d"
 from {username='slave'} at 127.0.0.1:54882
I20260709 13:20:12.025990 12470 raft_consensus.cc:606] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Received request to transfer leadership to TS ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:12.026346 12221 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48538
I20260709 13:20:12.031251 12396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3"
dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
mode: GRACEFUL
new_leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:35732
I20260709 13:20:12.031782 12396 raft_consensus.cc:606] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 2 LEADER]: Received request to transfer leadership to TS 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:12.032307 12713 heartbeater.cc:499] Master 127.1.250.126:38073 was elected leader, sending a full tablet report...
I20260709 13:20:12.033231  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:20:12.033913  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:12.034579  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:12.038498 12650 tablet_bootstrap.cc:492] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:12.039389 12650 tablet_bootstrap.cc:492] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap complete.
I20260709 13:20:12.040102 12650 ts_tablet_manager.cc:1403] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 13:20:12.040800 12687 raft_consensus.cc:3060] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.043030 12650 raft_consensus.cc:359] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.043762 12650 raft_consensus.cc:740] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.044482 12650 consensus_queue.cc:260] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.046787 12650 ts_tablet_manager.cc:1434] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:12.047680 12650 tablet_bootstrap.cc:492] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:12.049896 12687 pending_rounds.cc:85] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013: Aborting all ops after (but not including) 0
I20260709 13:20:12.050297 12687 pending_rounds.cc:107] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:20:12.050608 12687 raft_consensus.cc:2889] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:12.065659 12650 tablet_bootstrap.cc:492] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:12.066516 12650 tablet_bootstrap.cc:492] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap complete.
I20260709 13:20:12.067318 12650 ts_tablet_manager.cc:1403] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:20:12.069449 12650 raft_consensus.cc:359] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.069944 12650 raft_consensus.cc:740] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.070560 12650 consensus_queue.cc:260] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.072685 12650 ts_tablet_manager.cc:1434] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:20:12.073482 12650 tablet_bootstrap.cc:492] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap starting.
I20260709 13:20:12.085851 12650 tablet_bootstrap.cc:492] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:12.086711 12650 tablet_bootstrap.cc:492] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013: Bootstrap complete.
I20260709 13:20:12.087224 12650 ts_tablet_manager.cc:1403] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:20:12.088953 12650 raft_consensus.cc:359] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.089422 12650 raft_consensus.cc:740] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7a49af3f6c4d8eb4fda787bbc21013, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.090000 12650 consensus_queue.cc:260] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.091852 12650 ts_tablet_manager.cc:1434] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:12.133232 12687 raft_consensus.cc:3060] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:20:12.150741 12687 raft_consensus.cc:3060] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.220705 12687 raft_consensus.cc:3060] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.225977 12687 pending_rounds.cc:85] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013: Aborting all ops after (but not including) 0
I20260709 13:20:12.226198 12687 pending_rounds.cc:107] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:20:12.226483 12687 raft_consensus.cc:2889] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:12.273176 12687 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.308010 12634 raft_consensus.cc:993] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d: : Instructing follower 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:12.308602 12732 raft_consensus.cc:1081] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 2 LEADER]: Signalling peer 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:12.310359 12470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3"
dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:37656
I20260709 13:20:12.310928 12470 raft_consensus.cc:493] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:12.311275 12470 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:12.317395 12470 raft_consensus.cc:515] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.319271 12470 leader_election.cc:290] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 3 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:12.320158 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:12.320348 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:12.320827 12687 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:12.321023 12396 raft_consensus.cc:3055] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:12.321509 12396 raft_consensus.cc:740] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:12.322296 12396 consensus_queue.cc:260] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.323462 12396 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:12.326478 12687 raft_consensus.cc:2468] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 3.
I20260709 13:20:12.327816 12438 leader_election.cc:304] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1; no voters: 
I20260709 13:20:12.328594 12629 raft_consensus.cc:2804] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:12.329247 12396 raft_consensus.cc:2468] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 3.
I20260709 13:20:12.329872 12629 raft_consensus.cc:697] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 LEADER]: Becoming Leader. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:12.330689 12629 consensus_queue.cc:237] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.337400 12221 catalog_manager.cc:5697] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 reported cstate change: term changed from 2 to 3, leader changed from ca092e525ac14dac8866a3deb22a318d (127.1.250.66) to 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67). New cstate: current_term: 3 leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:12.354491 12687 raft_consensus.cc:3060] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.453810 12733 raft_consensus.cc:993] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1: : Instructing follower ca092e525ac14dac8866a3deb22a318d to start an election
I20260709 13:20:12.454515 12629 raft_consensus.cc:1081] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Signalling peer ca092e525ac14dac8866a3deb22a318d to start an election
I20260709 13:20:12.456342 12396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "423d78828e084f679d430e1c47b6110f"
dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
 from {username='slave'} at 127.0.0.1:38392
I20260709 13:20:12.456833 12396 raft_consensus.cc:493] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:12.457162 12396 raft_consensus.cc:3060] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:12.461869 12396 raft_consensus.cc:515] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.464149 12396 leader_election.cc:290] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 3 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:12.464432 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d78828e084f679d430e1c47b6110f" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:12.464847 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d78828e084f679d430e1c47b6110f" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:12.465544 12470 raft_consensus.cc:3055] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:12.465083 12687 raft_consensus.cc:3060] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:12.465860 12470 raft_consensus.cc:740] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:12.467124 12470 consensus_queue.cc:260] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.468812 12470 raft_consensus.cc:3060] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:12.475049 12687 raft_consensus.cc:2468] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 3.
I20260709 13:20:12.476682 12364 leader_election.cc:304] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:12.477553 12470 raft_consensus.cc:2468] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 3.
I20260709 13:20:12.477633 12732 raft_consensus.cc:2804] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:12.478437 12732 raft_consensus.cc:697] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Becoming Leader. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:12.479312 12732 consensus_queue.cc:237] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.487071 12221 catalog_manager.cc:5697] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d reported cstate change: term changed from 2 to 3, leader changed from 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67) to ca092e525ac14dac8866a3deb22a318d (127.1.250.66). New cstate: current_term: 3 leader_uuid: "ca092e525ac14dac8866a3deb22a318d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:12.536598 12732 raft_consensus.cc:993] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d: : Instructing follower 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:12.537205 12634 raft_consensus.cc:1081] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 2 LEADER]: Signalling peer 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:12.538797 12470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d"
dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:37656
I20260709 13:20:12.539245 12470 raft_consensus.cc:493] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:12.539551 12470 raft_consensus.cc:3060] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:12.544165 12470 raft_consensus.cc:515] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.545558 12470 leader_election.cc:290] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 3 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:12.546440 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:12.546622 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:12.547128 12687 raft_consensus.cc:3060] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:12.547236 12396 raft_consensus.cc:3055] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:12.547617 12396 raft_consensus.cc:740] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:12.548216 12396 consensus_queue.cc:260] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.549194 12396 raft_consensus.cc:3060] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:12.553341 12687 raft_consensus.cc:2468] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 3.
I20260709 13:20:12.554379 12438 leader_election.cc:304] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1; no voters: 
I20260709 13:20:12.554881 12396 raft_consensus.cc:2468] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 3.
I20260709 13:20:12.555226 12629 raft_consensus.cc:2804] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:12.555833 12629 raft_consensus.cc:697] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 LEADER]: Becoming Leader. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:12.556684 12629 consensus_queue.cc:237] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:12.564018 12221 catalog_manager.cc:5697] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 reported cstate change: term changed from 2 to 3, leader changed from ca092e525ac14dac8866a3deb22a318d (127.1.250.66) to 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67). New cstate: current_term: 3 leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:12.572392 12687 raft_consensus.cc:3060] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.711488 12687 raft_consensus.cc:1275] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:12.712860 12745 consensus_queue.cc:1048] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:12.722930 12396 raft_consensus.cc:1275] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:12.724144 12745 consensus_queue.cc:1048] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:20:12.893518 12269 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:12.934650 12687 raft_consensus.cc:1275] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:12.936198 12747 consensus_queue.cc:1048] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:12.944176 12470 raft_consensus.cc:1275] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:12.946599 12751 consensus_queue.cc:1048] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:13.047677 12396 raft_consensus.cc:1275] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:13.048870 12629 consensus_queue.cc:1048] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:13.049857  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:13.059051 12687 raft_consensus.cc:1275] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:13.060883 12470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d"
dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
mode: GRACEFUL
new_leader_uuid: "ca092e525ac14dac8866a3deb22a318d"
 from {username='slave'} at 127.0.0.1:54882
I20260709 13:20:13.061522 12470 raft_consensus.cc:606] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 LEADER]: Received request to transfer leadership to TS ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:13.063215 12745 consensus_queue.cc:1048] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:13.064906 12396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "256f4ed4031c49ba9ce877b8d1c04a6c"
dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
mode: GRACEFUL
new_leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:35732
I20260709 13:20:13.065632 12396 raft_consensus.cc:606] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 1 LEADER]: Received request to transfer leadership to TS 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:13.065680 12745 raft_consensus.cc:993] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1: : Instructing follower ca092e525ac14dac8866a3deb22a318d to start an election
I20260709 13:20:13.068019 12629 raft_consensus.cc:1081] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 LEADER]: Signalling peer ca092e525ac14dac8866a3deb22a318d to start an election
I20260709 13:20:13.069713 12396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d"
dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
 from {username='slave'} at 127.0.0.1:38392
I20260709 13:20:13.070232 12396 raft_consensus.cc:493] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.070333 12470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3"
dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
mode: GRACEFUL
new_leader_uuid: "ca092e525ac14dac8866a3deb22a318d"
 from {username='slave'} at 127.0.0.1:54882
I20260709 13:20:13.070679 12396 raft_consensus.cc:3060] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:13.071064 12470 raft_consensus.cc:606] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 LEADER]: Received request to transfer leadership to TS ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:13.072320  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:20:13.072948  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:13.073725  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:13.076607 12396 raft_consensus.cc:515] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:13.078531 12396 leader_election.cc:290] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 4 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:13.079869 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:13.079869 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cb30155bf64748afc95ba6646a8f0d" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:13.080689 12687 raft_consensus.cc:3060] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:13.080698 12470 raft_consensus.cc:3055] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:13.081236 12470 raft_consensus.cc:740] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:13.082002 12470 consensus_queue.cc:260] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:13.083109 12470 raft_consensus.cc:3060] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:13.087991 12687 raft_consensus.cc:2468] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 4.
I20260709 13:20:13.089159 12364 leader_election.cc:304] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:13.089850 12751 raft_consensus.cc:2804] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:13.089818 12470 raft_consensus.cc:2468] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 4.
I20260709 13:20:13.090512 12751 raft_consensus.cc:697] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 4 LEADER]: Becoming Leader. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:13.091416 12751 consensus_queue.cc:237] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:13.097175 12219 catalog_manager.cc:5697] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d reported cstate change: term changed from 3 to 4, leader changed from 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67) to ca092e525ac14dac8866a3deb22a318d (127.1.250.66). New cstate: current_term: 4 leader_uuid: "ca092e525ac14dac8866a3deb22a318d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:13.212575 12634 raft_consensus.cc:993] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d: : Instructing follower 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:13.213045 12751 raft_consensus.cc:1081] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 1 LEADER]: Signalling peer 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:13.214618 12470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "256f4ed4031c49ba9ce877b8d1c04a6c"
dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:37656
I20260709 13:20:13.215029 12470 raft_consensus.cc:493] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.215273 12470 raft_consensus.cc:3060] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.221599 12470 raft_consensus.cc:515] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:13.223172 12470 leader_election.cc:290] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:13.224323 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256f4ed4031c49ba9ce877b8d1c04a6c" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:13.224077 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256f4ed4031c49ba9ce877b8d1c04a6c" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:13.224906 12396 raft_consensus.cc:3055] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:13.225198 12687 raft_consensus.cc:3060] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.225279 12396 raft_consensus.cc:740] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:13.226243 12396 consensus_queue.cc:260] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:13.227216 12396 raft_consensus.cc:3060] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.232355 12687 raft_consensus.cc:2468] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 2.
I20260709 13:20:13.233696 12396 raft_consensus.cc:2468] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 2.
I20260709 13:20:13.233829 12438 leader_election.cc:304] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1; no voters: 
I20260709 13:20:13.234819 12733 raft_consensus.cc:2804] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:13.235308 12733 raft_consensus.cc:697] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Becoming Leader. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:13.236431 12733 consensus_queue.cc:237] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:13.244459 12219 catalog_manager.cc:5697] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 reported cstate change: term changed from 1 to 2, leader changed from ca092e525ac14dac8866a3deb22a318d (127.1.250.66) to 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:13.250025 12745 raft_consensus.cc:993] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1: : Instructing follower ca092e525ac14dac8866a3deb22a318d to start an election
I20260709 13:20:13.250651 12733 raft_consensus.cc:1081] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 LEADER]: Signalling peer ca092e525ac14dac8866a3deb22a318d to start an election
I20260709 13:20:13.252131 12396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3"
dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
 from {username='slave'} at 127.0.0.1:38392
I20260709 13:20:13.252548 12396 raft_consensus.cc:493] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.252837 12396 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:13.260393 12396 raft_consensus.cc:515] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:13.262701 12396 leader_election.cc:290] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 4 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:13.262975 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:13.263733 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:13.263736 12687 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:13.264282 12470 raft_consensus.cc:3055] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:13.264631 12470 raft_consensus.cc:740] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:13.265290 12470 consensus_queue.cc:260] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:13.266162 12470 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:13.270233 12687 raft_consensus.cc:2468] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 4.
I20260709 13:20:13.271332 12470 raft_consensus.cc:2468] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 4.
I20260709 13:20:13.271361 12364 leader_election.cc:304] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:13.272428 12751 raft_consensus.cc:2804] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:13.272897 12751 raft_consensus.cc:697] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 4 LEADER]: Becoming Leader. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:13.273769 12751 consensus_queue.cc:237] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:13.281258 12219 catalog_manager.cc:5697] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d reported cstate change: term changed from 3 to 4, leader changed from 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67) to ca092e525ac14dac8866a3deb22a318d (127.1.250.66). New cstate: current_term: 4 leader_uuid: "ca092e525ac14dac8866a3deb22a318d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:13.508069 12470 raft_consensus.cc:1275] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:13.509565 12751 consensus_queue.cc:1048] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:13.517424 12687 raft_consensus.cc:1275] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:13.519474 12634 consensus_queue.cc:1048] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:13.623422 12687 raft_consensus.cc:1275] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 2 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.624665 12733 consensus_queue.cc:1048] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.636324 12396 raft_consensus.cc:1275] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.637851 12759 consensus_queue.cc:1048] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.709010 12687 raft_consensus.cc:1275] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:13.710386 12634 consensus_queue.cc:1048] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:13.718670 12470 raft_consensus.cc:1275] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:13.720443 12751 consensus_queue.cc:1048] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:20:13.894629 12269 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:14.083745  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:14.092077 12470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "256f4ed4031c49ba9ce877b8d1c04a6c"
dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
mode: GRACEFUL
new_leader_uuid: "ca092e525ac14dac8866a3deb22a318d"
 from {username='slave'} at 127.0.0.1:54882
I20260709 13:20:14.092645 12470 raft_consensus.cc:606] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Received request to transfer leadership to TS ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:14.095293 12396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "423d78828e084f679d430e1c47b6110f"
dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
mode: GRACEFUL
new_leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:35732
I20260709 13:20:14.095741 12396 raft_consensus.cc:606] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Received request to transfer leadership to TS 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:14.098241 12396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3"
dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
mode: GRACEFUL
new_leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:35732
I20260709 13:20:14.098749 12396 raft_consensus.cc:606] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 4 LEADER]: Received request to transfer leadership to TS 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:14.099746  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:20:14.100261  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:14.100819  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:14.193617 12751 raft_consensus.cc:993] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d: : Instructing follower 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:14.194170 12634 raft_consensus.cc:1081] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 4 LEADER]: Signalling peer 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:14.195789 12470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3"
dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:37656
I20260709 13:20:14.196327 12470 raft_consensus.cc:493] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:14.196763 12470 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:14.201542 12470 raft_consensus.cc:515] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:14.202925 12470 leader_election.cc:290] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 5 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:14.204042 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:14.204049 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:14.204604 12687 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:14.204816 12396 raft_consensus.cc:3055] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:20:14.205181 12396 raft_consensus.cc:740] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:14.205952 12396 consensus_queue.cc:260] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:14.207016 12396 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:14.209872 12687 raft_consensus.cc:2468] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 5.
I20260709 13:20:14.211014 12438 leader_election.cc:304] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1; no voters: 
I20260709 13:20:14.211683 12759 raft_consensus.cc:2804] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:20:14.211993 12396 raft_consensus.cc:2468] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 5.
I20260709 13:20:14.212200 12759 raft_consensus.cc:697] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 5 LEADER]: Becoming Leader. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:14.213128 12759 consensus_queue.cc:237] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:14.219755 12221 catalog_manager.cc:5697] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 reported cstate change: term changed from 4 to 5, leader changed from ca092e525ac14dac8866a3deb22a318d (127.1.250.66) to 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67). New cstate: current_term: 5 leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:14.536064 12751 raft_consensus.cc:993] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d: : Instructing follower 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:14.537187 12634 raft_consensus.cc:1081] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Signalling peer 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:14.539099 12470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "423d78828e084f679d430e1c47b6110f"
dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:37656
I20260709 13:20:14.539721 12470 raft_consensus.cc:493] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:14.540280 12470 raft_consensus.cc:3060] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:14.548309 12759 raft_consensus.cc:993] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1: : Instructing follower ca092e525ac14dac8866a3deb22a318d to start an election
I20260709 13:20:14.549487 12733 raft_consensus.cc:1081] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Signalling peer ca092e525ac14dac8866a3deb22a318d to start an election
I20260709 13:20:14.551863 12396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "256f4ed4031c49ba9ce877b8d1c04a6c"
dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
 from {username='slave'} at 127.0.0.1:38392
I20260709 13:20:14.552544 12396 raft_consensus.cc:493] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:14.553195 12396 raft_consensus.cc:3060] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:14.554041 12470 raft_consensus.cc:515] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:14.556491 12470 leader_election.cc:290] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 4 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:14.558689 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d78828e084f679d430e1c47b6110f" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:14.559722 12687 raft_consensus.cc:3060] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:14.560479 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d78828e084f679d430e1c47b6110f" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:14.561251 12397 raft_consensus.cc:3055] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:14.561619 12397 raft_consensus.cc:740] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:14.563074 12397 consensus_queue.cc:260] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:14.565646 12397 raft_consensus.cc:3060] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:14.566143 12396 raft_consensus.cc:515] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:14.570318 12396 leader_election.cc:290] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 3 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:14.570592 12686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256f4ed4031c49ba9ce877b8d1c04a6c" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:14.571820 12686 raft_consensus.cc:3060] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:14.572154 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256f4ed4031c49ba9ce877b8d1c04a6c" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:14.572800 12470 raft_consensus.cc:3055] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:14.573036 12470 raft_consensus.cc:740] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:14.574668 12470 consensus_queue.cc:260] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:14.577098 12470 raft_consensus.cc:3060] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:14.579983 12687 raft_consensus.cc:2468] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 4.
I20260709 13:20:14.580351 12397 raft_consensus.cc:2468] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 4.
I20260709 13:20:14.583150 12438 leader_election.cc:304] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 818426ff43bc437bbf6fdd5be13ab9d1, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:14.584116 12733 raft_consensus.cc:2804] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:14.584753 12733 raft_consensus.cc:697] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 LEADER]: Becoming Leader. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:14.585114 12686 raft_consensus.cc:2468] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 3.
I20260709 13:20:14.587157 12364 leader_election.cc:304] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:14.586534 12733 consensus_queue.cc:237] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:14.587714 12470 raft_consensus.cc:2468] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 3.
I20260709 13:20:14.588236 12634 raft_consensus.cc:2804] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:14.588994 12634 raft_consensus.cc:697] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Becoming Leader. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:14.590332 12634 consensus_queue.cc:237] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:14.600725 12219 catalog_manager.cc:5697] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 reported cstate change: term changed from 3 to 4, leader changed from ca092e525ac14dac8866a3deb22a318d (127.1.250.66) to 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67). New cstate: current_term: 4 leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:14.600775 12221 catalog_manager.cc:5697] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d reported cstate change: term changed from 2 to 3, leader changed from 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67) to ca092e525ac14dac8866a3deb22a318d (127.1.250.66). New cstate: current_term: 3 leader_uuid: "ca092e525ac14dac8866a3deb22a318d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:14.680392 12397 raft_consensus.cc:1275] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 5 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:20:14.681746 12733 consensus_queue.cc:1048] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:14.695382 12686 raft_consensus.cc:1275] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 5 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:20:14.697477 12733 consensus_queue.cc:1048] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:20:14.895905 12269 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:14.995548 12686 raft_consensus.cc:1275] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:14.996886 12634 consensus_queue.cc:1048] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:15.007905 12470 raft_consensus.cc:1275] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:15.009553 12751 consensus_queue.cc:1048] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:15.066347 12397 raft_consensus.cc:1275] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:15.067819 12769 consensus_queue.cc:1048] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:15.077633 12686 raft_consensus.cc:1275] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:15.079607 12769 consensus_queue.cc:1048] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:15.108188  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:15.117791 12470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492"
dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
mode: GRACEFUL
new_leader_uuid: "ca092e525ac14dac8866a3deb22a318d"
 from {username='slave'} at 127.0.0.1:54882
I20260709 13:20:15.118516 12470 raft_consensus.cc:606] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Received request to transfer leadership to TS ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:15.121625 12470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3"
dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
mode: GRACEFUL
new_leader_uuid: "ca092e525ac14dac8866a3deb22a318d"
 from {username='slave'} at 127.0.0.1:54882
I20260709 13:20:15.122126 12470 raft_consensus.cc:606] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 5 LEADER]: Received request to transfer leadership to TS ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:15.124626 12397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8"
dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
mode: GRACEFUL
new_leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:35732
I20260709 13:20:15.125440 12397 raft_consensus.cc:606] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Received request to transfer leadership to TS 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:15.126909  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:20:15.127502  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:15.128237  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:15.180248 12769 raft_consensus.cc:993] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1: : Instructing follower ca092e525ac14dac8866a3deb22a318d to start an election
I20260709 13:20:15.180975 12777 raft_consensus.cc:1081] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Signalling peer ca092e525ac14dac8866a3deb22a318d to start an election
I20260709 13:20:15.182668 12397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492"
dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
 from {username='slave'} at 127.0.0.1:38392
I20260709 13:20:15.183219 12397 raft_consensus.cc:493] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:15.183492 12397 raft_consensus.cc:3060] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:15.189632 12397 raft_consensus.cc:515] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:15.191373 12397 leader_election.cc:290] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 3 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:15.192473 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:15.192473 12686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:15.193427 12470 raft_consensus.cc:3055] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:15.193527 12686 raft_consensus.cc:3060] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:15.193698 12470 raft_consensus.cc:740] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:15.194757 12470 consensus_queue.cc:260] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:15.195741 12470 raft_consensus.cc:3060] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:15.200258 12686 raft_consensus.cc:2468] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 3.
I20260709 13:20:15.201292 12470 raft_consensus.cc:2468] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 3.
I20260709 13:20:15.201723 12364 leader_election.cc:304] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:15.202663 12751 raft_consensus.cc:2804] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:15.203195 12751 raft_consensus.cc:697] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Becoming Leader. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:15.203709 12777 raft_consensus.cc:993] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1: : Instructing follower ca092e525ac14dac8866a3deb22a318d to start an election
I20260709 13:20:15.204376 12759 raft_consensus.cc:1081] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 5 LEADER]: Signalling peer ca092e525ac14dac8866a3deb22a318d to start an election
I20260709 13:20:15.204413 12751 consensus_queue.cc:237] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:15.206102 12397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3"
dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
 from {username='slave'} at 127.0.0.1:38392
I20260709 13:20:15.206760 12397 raft_consensus.cc:493] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:15.207149 12397 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:15.214195 12221 catalog_manager.cc:5697] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d reported cstate change: term changed from 2 to 3, leader changed from 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67) to ca092e525ac14dac8866a3deb22a318d (127.1.250.66). New cstate: current_term: 3 leader_uuid: "ca092e525ac14dac8866a3deb22a318d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:15.218286 12397 raft_consensus.cc:515] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:15.220582 12397 leader_election.cc:290] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 6 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:15.221354 12686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:15.222002 12686 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:15.222790 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:15.223685 12469 raft_consensus.cc:3055] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:20:15.224120 12469 raft_consensus.cc:740] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:15.225386 12469 consensus_queue.cc:260] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:15.227368 12469 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:15.229591 12686 raft_consensus.cc:2468] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 6.
I20260709 13:20:15.230895 12364 leader_election.cc:304] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:15.231592 12751 raft_consensus.cc:2804] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:20:15.232072 12751 raft_consensus.cc:697] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 6 LEADER]: Becoming Leader. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:15.233240 12751 consensus_queue.cc:237] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:15.235910 12469 raft_consensus.cc:2468] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 6.
I20260709 13:20:15.239889 12221 catalog_manager.cc:5697] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d reported cstate change: term changed from 5 to 6, leader changed from 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67) to ca092e525ac14dac8866a3deb22a318d (127.1.250.66). New cstate: current_term: 6 leader_uuid: "ca092e525ac14dac8866a3deb22a318d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:15.584887 12774 raft_consensus.cc:993] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d: : Instructing follower 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:15.586536 12774 raft_consensus.cc:1081] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Signalling peer 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:15.588630 12469 raft_consensus.cc:1275] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:15.588647 12470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8"
dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:37656
I20260709 13:20:15.589675 12470 raft_consensus.cc:493] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:15.590129 12470 raft_consensus.cc:3060] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:15.590636 12774 consensus_queue.cc:1048] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:15.596975 12470 raft_consensus.cc:515] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:15.601308 12686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:15.602161 12686 raft_consensus.cc:3060] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:15.601827 12470 leader_election.cc:290] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 4 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:15.603358 12687 raft_consensus.cc:1275] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:15.604734 12783 consensus_queue.cc:1048] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:15.606379 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b7dcf7884044a39cc3ee1c9399c4a8" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:15.607052 12397 raft_consensus.cc:3055] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:15.607321 12397 raft_consensus.cc:740] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:15.608115 12397 consensus_queue.cc:260] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:15.609349 12397 raft_consensus.cc:3060] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:15.611428 12686 raft_consensus.cc:2468] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 4.
I20260709 13:20:15.613143 12438 leader_election.cc:304] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1; no voters: 
I20260709 13:20:15.614176 12759 raft_consensus.cc:2804] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:15.615093 12759 raft_consensus.cc:697] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 LEADER]: Becoming Leader. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:15.616328 12759 consensus_queue.cc:237] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:15.626344 12686 raft_consensus.cc:1275] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 6 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:20:15.628535 12783 consensus_queue.cc:1048] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:15.640461 12219 catalog_manager.cc:5697] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 reported cstate change: term changed from 3 to 4, leader changed from ca092e525ac14dac8866a3deb22a318d (127.1.250.66) to 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67). New cstate: current_term: 4 leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:15.643730 12397 raft_consensus.cc:2468] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 4.
I20260709 13:20:15.649348 12472 raft_consensus.cc:1275] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 6 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:20:15.651232 12751 consensus_queue.cc:1048] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:20:15.897035 12269 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:16.135258  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:16.143784 12397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492"
dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
mode: GRACEFUL
new_leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:35732
I20260709 13:20:16.144424 12397 raft_consensus.cc:606] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Received request to transfer leadership to TS 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:16.147475 12397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3"
dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
mode: GRACEFUL
new_leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:35732
I20260709 13:20:16.148314 12397 raft_consensus.cc:606] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 6 LEADER]: Received request to transfer leadership to TS 818426ff43bc437bbf6fdd5be13ab9d1
I20260709 13:20:16.151851 12687 raft_consensus.cc:1275] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:16.152648 12472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9afb220cc0f449c195437d83ce43913a"
dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
mode: GRACEFUL
new_leader_uuid: "ca092e525ac14dac8866a3deb22a318d"
 from {username='slave'} at 127.0.0.1:54882
I20260709 13:20:16.153333 12769 consensus_queue.cc:1048] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:16.154281 12472 raft_consensus.cc:606] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Received request to transfer leadership to TS ca092e525ac14dac8866a3deb22a318d
I20260709 13:20:16.156057  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:20:16.156787  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:16.157534  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:16.166477 12397 raft_consensus.cc:1275] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:16.169426 12759 consensus_queue.cc:1048] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:16.497548 12769 raft_consensus.cc:993] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1: : Instructing follower ca092e525ac14dac8866a3deb22a318d to start an election
I20260709 13:20:16.498044 12769 raft_consensus.cc:1081] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Signalling peer ca092e525ac14dac8866a3deb22a318d to start an election
I20260709 13:20:16.499719 12397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9afb220cc0f449c195437d83ce43913a"
dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
 from {username='slave'} at 127.0.0.1:38392
I20260709 13:20:16.500409 12397 raft_consensus.cc:493] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:16.500751 12397 raft_consensus.cc:3060] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:16.506651 12397 raft_consensus.cc:515] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:16.508319 12397 leader_election.cc:290] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 3 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67:35085)
I20260709 13:20:16.509331 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afb220cc0f449c195437d83ce43913a" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:16.509377 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9afb220cc0f449c195437d83ce43913a" candidate_uuid: "ca092e525ac14dac8866a3deb22a318d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
I20260709 13:20:16.510025 12687 raft_consensus.cc:3060] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:16.510079 12470 raft_consensus.cc:3055] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:16.510437 12470 raft_consensus.cc:740] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:16.511193 12470 consensus_queue.cc:260] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:16.512154 12470 raft_consensus.cc:3060] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:16.515774 12687 raft_consensus.cc:2468] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 3.
I20260709 13:20:16.516937 12470 raft_consensus.cc:2468] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca092e525ac14dac8866a3deb22a318d in term 3.
I20260709 13:20:16.517043 12364 leader_election.cc:304] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, ca092e525ac14dac8866a3deb22a318d; no voters: 
I20260709 13:20:16.517975 12751 raft_consensus.cc:2804] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:16.518488 12751 raft_consensus.cc:697] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Becoming Leader. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:16.519548 12751 consensus_queue.cc:237] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:16.526247 12221 catalog_manager.cc:5697] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d reported cstate change: term changed from 2 to 3, leader changed from 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67) to ca092e525ac14dac8866a3deb22a318d (127.1.250.66). New cstate: current_term: 3 leader_uuid: "ca092e525ac14dac8866a3deb22a318d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:16.647478 12774 raft_consensus.cc:993] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d: : Instructing follower 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:16.648088 12751 raft_consensus.cc:1081] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Signalling peer 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:16.649782 12470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492"
dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:37656
I20260709 13:20:16.650202 12470 raft_consensus.cc:493] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:16.650425 12470 raft_consensus.cc:3060] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:16.655347 12774 raft_consensus.cc:993] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d: : Instructing follower 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:16.655900 12751 raft_consensus.cc:1081] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 6 LEADER]: Signalling peer 818426ff43bc437bbf6fdd5be13ab9d1 to start an election
I20260709 13:20:16.656750 12470 raft_consensus.cc:515] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:16.657660 12472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3"
dest_uuid: "818426ff43bc437bbf6fdd5be13ab9d1"
 from {username='slave'} at 127.0.0.1:37656
I20260709 13:20:16.658278 12472 raft_consensus.cc:493] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:16.658736 12472 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:16.658798 12470 leader_election.cc:290] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 4 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:16.659530 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:16.660151 12687 raft_consensus.cc:3060] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:16.660175 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc17194ffa4b5284fee3d042ba5492" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:16.660852 12397 raft_consensus.cc:3055] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:16.661197 12397 raft_consensus.cc:740] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:16.662017 12397 consensus_queue.cc:260] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:16.663453 12397 raft_consensus.cc:3060] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:16.666729 12472 raft_consensus.cc:515] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:16.670907 12685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013"
I20260709 13:20:16.671681 12685 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:16.671816 12472 leader_election.cc:290] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 7 election: Requested vote from peers 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583), ca092e525ac14dac8866a3deb22a318d (127.1.250.66:46843)
I20260709 13:20:16.672556 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e9a9ee5d784c2bbbfb49f140e7ceb3" candidate_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "ca092e525ac14dac8866a3deb22a318d"
I20260709 13:20:16.672590 12397 raft_consensus.cc:2468] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 4.
I20260709 13:20:16.673249 12396 raft_consensus.cc:3055] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:20:16.673579 12396 raft_consensus.cc:740] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca092e525ac14dac8866a3deb22a318d, State: Running, Role: LEADER
I20260709 13:20:16.669711 12687 raft_consensus.cc:2468] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 4.
I20260709 13:20:16.674405 12396 consensus_queue.cc:260] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:16.675741 12396 raft_consensus.cc:3060] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:16.675904 12438 leader_election.cc:304] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1; no voters: 
I20260709 13:20:16.677662 12769 raft_consensus.cc:2804] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:16.678278 12769 raft_consensus.cc:697] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 LEADER]: Becoming Leader. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:16.679520 12769 consensus_queue.cc:237] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:16.684849 12685 raft_consensus.cc:2468] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 7.
I20260709 13:20:16.685883 12396 raft_consensus.cc:2468] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 818426ff43bc437bbf6fdd5be13ab9d1 in term 7.
I20260709 13:20:16.686419 12438 leader_election.cc:304] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7a49af3f6c4d8eb4fda787bbc21013, 818426ff43bc437bbf6fdd5be13ab9d1; no voters: 
I20260709 13:20:16.688158 12759 raft_consensus.cc:2804] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:20:16.689682 12759 raft_consensus.cc:697] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 7 LEADER]: Becoming Leader. State: Replica: 818426ff43bc437bbf6fdd5be13ab9d1, State: Running, Role: LEADER
I20260709 13:20:16.690542 12759 consensus_queue.cc:237] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } }
I20260709 13:20:16.692868 12221 catalog_manager.cc:5697] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 reported cstate change: term changed from 3 to 4, leader changed from ca092e525ac14dac8866a3deb22a318d (127.1.250.66) to 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67). New cstate: current_term: 4 leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.705736 12221 catalog_manager.cc:5697] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 reported cstate change: term changed from 6 to 7, leader changed from ca092e525ac14dac8866a3deb22a318d (127.1.250.66) to 818426ff43bc437bbf6fdd5be13ab9d1 (127.1.250.67). New cstate: current_term: 7 leader_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:16.898214 12269 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:16.932117 12685 raft_consensus.cc:1275] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:16.933431 12751 consensus_queue.cc:1048] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:16.940140 12472 raft_consensus.cc:1275] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Refusing update from remote peer ca092e525ac14dac8866a3deb22a318d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:16.941874 12774 consensus_queue.cc:1048] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [LEADER]: Connected to new peer: Peer: permanent_uuid: "818426ff43bc437bbf6fdd5be13ab9d1" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:17.068630 12685 raft_consensus.cc:1275] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:17.069892 12759 consensus_queue.cc:1048] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:17.079504 12397 raft_consensus.cc:1275] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:17.081545 12759 consensus_queue.cc:1048] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:17.163491 12685 raft_consensus.cc:1275] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 7 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:20:17.164811 12759 consensus_queue.cc:1048] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7a49af3f6c4d8eb4fda787bbc21013" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:17.169420  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:17.176196 12397 raft_consensus.cc:1275] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 7 FOLLOWER]: Refusing update from remote peer 818426ff43bc437bbf6fdd5be13ab9d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:20:17.178365 12759 consensus_queue.cc:1048] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca092e525ac14dac8866a3deb22a318d" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:17.216053  2025 tablet_server.cc:179] TabletServer@127.1.250.65:35583 shutting down...
I20260709 13:20:17.246623  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:17.247529  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:17.248524  2025 raft_consensus.cc:2243] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.249040  2025 raft_consensus.cc:2272] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.251443  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:17.252045  2025 raft_consensus.cc:2243] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.252552  2025 raft_consensus.cc:2272] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.255370  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:17.255975  2025 raft_consensus.cc:2243] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.256521  2025 raft_consensus.cc:2272] T 10cb30155bf64748afc95ba6646a8f0d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.258884  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:17.259513  2025 raft_consensus.cc:2243] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.259999  2025 raft_consensus.cc:2272] T 256f4ed4031c49ba9ce877b8d1c04a6c P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.262247  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:17.262857  2025 raft_consensus.cc:2243] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.263345  2025 raft_consensus.cc:2272] T db554a7dc73a4920b3db70a660396b7d P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.265722  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:17.266283  2025 raft_consensus.cc:2243] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.266731  2025 raft_consensus.cc:2272] T 423d78828e084f679d430e1c47b6110f P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.269160  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:17.269672  2025 raft_consensus.cc:2243] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.270154  2025 raft_consensus.cc:2272] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.272710  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:17.273275  2025 raft_consensus.cc:2243] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.273828  2025 raft_consensus.cc:2272] T 9afb220cc0f449c195437d83ce43913a P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.277165  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:17.277841  2025 raft_consensus.cc:2243] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.278339  2025 raft_consensus.cc:2272] T 12bc17194ffa4b5284fee3d042ba5492 P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.281037  2025 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:17.281661  2025 raft_consensus.cc:2243] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.282202  2025 raft_consensus.cc:2272] T 43e6e65e31f74d60b78598fbb5cd7baf P 4b7a49af3f6c4d8eb4fda787bbc21013 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:17.304992 12364 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20260709 13:20:17.308545 12364 consensus_peers.cc:597] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:17.316777  2025 tablet_server.cc:196] TabletServer@127.1.250.65:35583 shutdown complete.
W20260709 13:20:17.331059 12364 consensus_peers.cc:597] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:17.347816  2025 tablet_server.cc:179] TabletServer@127.1.250.66:0 shutting down...
W20260709 13:20:17.364629 12438 consensus_peers.cc:597] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:17.380316  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:17.381309  2025 tablet_replica.cc:333] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d: stopping tablet replica
I20260709 13:20:17.382562  2025 raft_consensus.cc:2243] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:17.383941  2025 raft_consensus.cc:2272] T 43e6e65e31f74d60b78598fbb5cd7baf P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.387701  2025 tablet_replica.cc:333] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d: stopping tablet replica
I20260709 13:20:17.388787  2025 raft_consensus.cc:2243] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.389597  2025 raft_consensus.cc:2272] T b9748c924ca94ce99a4f3ce8aa2ebd10 P ca092e525ac14dac8866a3deb22a318d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.392601  2025 tablet_replica.cc:333] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d: stopping tablet replica
I20260709 13:20:17.393249  2025 raft_consensus.cc:2243] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:17.393993  2025 raft_consensus.cc:2272] T 9afb220cc0f449c195437d83ce43913a P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.396538  2025 tablet_replica.cc:333] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d: stopping tablet replica
I20260709 13:20:17.397162  2025 raft_consensus.cc:2243] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.397598  2025 raft_consensus.cc:2272] T 423d78828e084f679d430e1c47b6110f P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.399531  2025 tablet_replica.cc:333] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d: stopping tablet replica
I20260709 13:20:17.400012  2025 raft_consensus.cc:2243] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.400369  2025 raft_consensus.cc:2272] T 59b7dcf7884044a39cc3ee1c9399c4a8 P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.402645  2025 tablet_replica.cc:333] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d: stopping tablet replica
I20260709 13:20:17.403168  2025 raft_consensus.cc:2243] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.403523  2025 raft_consensus.cc:2272] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P ca092e525ac14dac8866a3deb22a318d [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.405921  2025 tablet_replica.cc:333] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d: stopping tablet replica
I20260709 13:20:17.406509  2025 raft_consensus.cc:2243] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.406878  2025 raft_consensus.cc:2272] T 12bc17194ffa4b5284fee3d042ba5492 P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.409583  2025 tablet_replica.cc:333] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d: stopping tablet replica
I20260709 13:20:17.410126  2025 raft_consensus.cc:2243] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:17.410908  2025 raft_consensus.cc:2272] T 10cb30155bf64748afc95ba6646a8f0d P ca092e525ac14dac8866a3deb22a318d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.413235  2025 tablet_replica.cc:333] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d: stopping tablet replica
I20260709 13:20:17.413712  2025 raft_consensus.cc:2243] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:17.414477  2025 raft_consensus.cc:2272] T 256f4ed4031c49ba9ce877b8d1c04a6c P ca092e525ac14dac8866a3deb22a318d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.416584  2025 tablet_replica.cc:333] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d: stopping tablet replica
I20260709 13:20:17.417018  2025 raft_consensus.cc:2243] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.417508  2025 raft_consensus.cc:2272] T db554a7dc73a4920b3db70a660396b7d P ca092e525ac14dac8866a3deb22a318d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.452735  2025 tablet_server.cc:196] TabletServer@127.1.250.66:0 shutdown complete.
W20260709 13:20:17.456660 12438 consensus_peers.cc:597] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:17.459385 12438 consensus_peers.cc:597] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 -> Peer 4b7a49af3f6c4d8eb4fda787bbc21013 (127.1.250.65:35583): Couldn't send request to peer 4b7a49af3f6c4d8eb4fda787bbc21013. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:35583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:17.483702  2025 tablet_server.cc:179] TabletServer@127.1.250.67:0 shutting down...
I20260709 13:20:17.518318  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:17.519158  2025 tablet_replica.cc:333] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1: stopping tablet replica
I20260709 13:20:17.520470  2025 raft_consensus.cc:2243] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.521378  2025 raft_consensus.cc:2272] T 10cb30155bf64748afc95ba6646a8f0d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.523869  2025 tablet_replica.cc:333] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1: stopping tablet replica
I20260709 13:20:17.524981  2025 raft_consensus.cc:2243] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.525642  2025 raft_consensus.cc:2272] T 256f4ed4031c49ba9ce877b8d1c04a6c P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.527978  2025 tablet_replica.cc:333] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1: stopping tablet replica
I20260709 13:20:17.528514  2025 raft_consensus.cc:2243] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:17.529480  2025 raft_consensus.cc:2272] T db554a7dc73a4920b3db70a660396b7d P 818426ff43bc437bbf6fdd5be13ab9d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.531601  2025 tablet_replica.cc:333] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1: stopping tablet replica
I20260709 13:20:17.532112  2025 raft_consensus.cc:2243] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:17.532950  2025 raft_consensus.cc:2272] T b9748c924ca94ce99a4f3ce8aa2ebd10 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.535118  2025 tablet_replica.cc:333] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1: stopping tablet replica
I20260709 13:20:17.535624  2025 raft_consensus.cc:2243] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.535984  2025 raft_consensus.cc:2272] T 9afb220cc0f449c195437d83ce43913a P 818426ff43bc437bbf6fdd5be13ab9d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.538514  2025 tablet_replica.cc:333] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1: stopping tablet replica
I20260709 13:20:17.539037  2025 raft_consensus.cc:2243] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:17.539769  2025 raft_consensus.cc:2272] T 423d78828e084f679d430e1c47b6110f P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.541988  2025 tablet_replica.cc:333] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1: stopping tablet replica
I20260709 13:20:17.542470  2025 raft_consensus.cc:2243] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:17.543228  2025 raft_consensus.cc:2272] T 12bc17194ffa4b5284fee3d042ba5492 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.545630  2025 tablet_replica.cc:333] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1: stopping tablet replica
I20260709 13:20:17.546170  2025 raft_consensus.cc:2243] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:20:17.546926  2025 raft_consensus.cc:2272] T 57e9a9ee5d784c2bbbfb49f140e7ceb3 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.549201  2025 tablet_replica.cc:333] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1: stopping tablet replica
I20260709 13:20:17.549834  2025 raft_consensus.cc:2243] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:17.550551  2025 raft_consensus.cc:2272] T 59b7dcf7884044a39cc3ee1c9399c4a8 P 818426ff43bc437bbf6fdd5be13ab9d1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.552525  2025 tablet_replica.cc:333] T 43e6e65e31f74d60b78598fbb5cd7baf P 818426ff43bc437bbf6fdd5be13ab9d1: stopping tablet replica
I20260709 13:20:17.552973  2025 raft_consensus.cc:2243] T 43e6e65e31f74d60b78598fbb5cd7baf P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.553424  2025 raft_consensus.cc:2272] T 43e6e65e31f74d60b78598fbb5cd7baf P 818426ff43bc437bbf6fdd5be13ab9d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.586452  2025 tablet_server.cc:196] TabletServer@127.1.250.67:0 shutdown complete.
I20260709 13:20:17.613533  2025 master.cc:562] Master@127.1.250.126:38073 shutting down...
I20260709 13:20:17.639767  2025 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:17.640368  2025 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.640702  2025 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0f3f604879434c309786b262331e14e5: stopping tablet replica
I20260709 13:20:17.662283  2025 master.cc:584] Master@127.1.250.126:38073 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12968 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:20:17.710806  2025 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.250.126:38575
I20260709 13:20:17.711992  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:17.718549 12821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:17.718546 12822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:17.721632  2025 server_base.cc:1061] running on GCE node
W20260709 13:20:17.721606 12824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:17.723098  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:17.723367  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:17.723532  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603217723504 us; error 0 us; skew 500 ppm
I20260709 13:20:17.724102  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:17.732491  2025 webserver.cc:533] Webserver started at http://127.1.250.126:33653/ using document root <none> and password file <none>
I20260709 13:20:17.733034  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:17.733314  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:17.733635  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:17.734835  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/master-0-root/instance:
uuid: "a1588d6099f54b79a3752a4c9a8236e0"
format_stamp: "Formatted at 2026-07-09 13:20:17 on dist-test-slave-g4pn"
I20260709 13:20:17.741362  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:20:17.745021 12829 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:17.746040  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:20:17.746326  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/master-0-root
uuid: "a1588d6099f54b79a3752a4c9a8236e0"
format_stamp: "Formatted at 2026-07-09 13:20:17 on dist-test-slave-g4pn"
I20260709 13:20:17.746583  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:17.761549  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:17.762815  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:17.821997  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.126:38575
I20260709 13:20:17.822239 12880 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.126:38575 every 8 connection(s)
I20260709 13:20:17.827502 12881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:17.846125 12881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0: Bootstrap starting.
I20260709 13:20:17.851414 12881 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:17.856060 12881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0: No bootstrap required, opened a new log
I20260709 13:20:17.858420 12881 raft_consensus.cc:359] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1588d6099f54b79a3752a4c9a8236e0" member_type: VOTER }
I20260709 13:20:17.858973 12881 raft_consensus.cc:385] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:17.859350 12881 raft_consensus.cc:740] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1588d6099f54b79a3752a4c9a8236e0, State: Initialized, Role: FOLLOWER
I20260709 13:20:17.860013 12881 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1588d6099f54b79a3752a4c9a8236e0" member_type: VOTER }
I20260709 13:20:17.860479 12881 raft_consensus.cc:399] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:17.860684 12881 raft_consensus.cc:493] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:17.860976 12881 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.866590 12881 raft_consensus.cc:515] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1588d6099f54b79a3752a4c9a8236e0" member_type: VOTER }
I20260709 13:20:17.867154 12881 leader_election.cc:304] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1588d6099f54b79a3752a4c9a8236e0; no voters: 
I20260709 13:20:17.868425 12881 leader_election.cc:290] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:17.868810 12884 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:17.870390 12884 raft_consensus.cc:697] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [term 1 LEADER]: Becoming Leader. State: Replica: a1588d6099f54b79a3752a4c9a8236e0, State: Running, Role: LEADER
I20260709 13:20:17.871130 12884 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1588d6099f54b79a3752a4c9a8236e0" member_type: VOTER }
I20260709 13:20:17.871683 12881 sys_catalog.cc:565] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:17.877813 12885 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1588d6099f54b79a3752a4c9a8236e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1588d6099f54b79a3752a4c9a8236e0" member_type: VOTER } }
I20260709 13:20:17.878559 12885 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:17.879647 12886 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1588d6099f54b79a3752a4c9a8236e0. Latest consensus state: current_term: 1 leader_uuid: "a1588d6099f54b79a3752a4c9a8236e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1588d6099f54b79a3752a4c9a8236e0" member_type: VOTER } }
I20260709 13:20:17.880409 12886 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:17.887818 12893 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:17.895764 12893 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:17.896874  2025 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:17.905452 12893 catalog_manager.cc:1383] Generated new cluster ID: 349072bc84ee4220b32a200a5f9420b9
I20260709 13:20:17.905763 12893 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:17.921002 12893 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:17.922562 12893 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:17.939476 12893 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0: Generated new TSK 0
I20260709 13:20:17.940142 12893 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:17.963871  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:17.970242 12902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:17.970880 12903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:17.972990  2025 server_base.cc:1061] running on GCE node
W20260709 13:20:17.972771 12905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:17.974223  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:17.974406  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:17.974606  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603217974574 us; error 0 us; skew 500 ppm
I20260709 13:20:17.975198  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:17.978047  2025 webserver.cc:533] Webserver started at http://127.1.250.65:46599/ using document root <none> and password file <none>
I20260709 13:20:17.978564  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:17.978760  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:17.979041  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:17.980343  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/ts-0-root/instance:
uuid: "61e000f22f5b4ecb827819ded5bec228"
format_stamp: "Formatted at 2026-07-09 13:20:17 on dist-test-slave-g4pn"
I20260709 13:20:17.986699  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:20:17.990590 12910 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:17.991679  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:20:17.992084  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/ts-0-root
uuid: "61e000f22f5b4ecb827819ded5bec228"
format_stamp: "Formatted at 2026-07-09 13:20:17 on dist-test-slave-g4pn"
I20260709 13:20:17.992585  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:18.027998  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:18.029452  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:18.031024  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:18.033435  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:18.033684  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:18.033949  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:18.034155  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:18.078533  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.65:37847
I20260709 13:20:18.078649 12972 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.65:37847 every 8 connection(s)
I20260709 13:20:18.083968  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:18.091950 12977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:18.092391 12978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:18.097061 12973 heartbeater.cc:344] Connected to a master server at 127.1.250.126:38575
W20260709 13:20:18.097246 12980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:18.097791 12973 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:18.097851  2025 server_base.cc:1061] running on GCE node
I20260709 13:20:18.098857 12973 heartbeater.cc:507] Master 127.1.250.126:38575 requested a full tablet report, sending...
I20260709 13:20:18.099208  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:18.099480  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:18.099660  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603218099640 us; error 0 us; skew 500 ppm
I20260709 13:20:18.100394  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:18.101432 12846 ts_manager.cc:194] Registered new tserver with Master: 61e000f22f5b4ecb827819ded5bec228 (127.1.250.65:37847)
I20260709 13:20:18.103365  2025 webserver.cc:533] Webserver started at http://127.1.250.66:46095/ using document root <none> and password file <none>
I20260709 13:20:18.104101  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:18.104238 12846 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39850
I20260709 13:20:18.104351  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:18.104838  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:18.106411  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/ts-1-root/instance:
uuid: "dffc3c8d17e5467b8e0fe12de58c9d62"
format_stamp: "Formatted at 2026-07-09 13:20:18 on dist-test-slave-g4pn"
I20260709 13:20:18.111557  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:20:18.115430 12985 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:18.116487  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:20:18.116775  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/ts-1-root
uuid: "dffc3c8d17e5467b8e0fe12de58c9d62"
format_stamp: "Formatted at 2026-07-09 13:20:18 on dist-test-slave-g4pn"
I20260709 13:20:18.117023  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:18.146425  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:18.147704  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:18.149555  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:18.152139  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:18.152390  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:18.152675  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:18.152875  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:18.199596  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.66:42989
I20260709 13:20:18.199724 13047 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.66:42989 every 8 connection(s)
I20260709 13:20:18.204811  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:18.212917 13051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:18.213387 13052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:18.216542 13054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:18.216964  2025 server_base.cc:1061] running on GCE node
I20260709 13:20:18.218044 13048 heartbeater.cc:344] Connected to a master server at 127.1.250.126:38575
I20260709 13:20:18.218600  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:20:18.218645 13048 heartbeater.cc:461] Registering TS with master...
W20260709 13:20:18.218900  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:18.219194  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603218219161 us; error 0 us; skew 500 ppm
I20260709 13:20:18.219736 13048 heartbeater.cc:507] Master 127.1.250.126:38575 requested a full tablet report, sending...
I20260709 13:20:18.219843  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:18.221974 12846 ts_manager.cc:194] Registered new tserver with Master: dffc3c8d17e5467b8e0fe12de58c9d62 (127.1.250.66:42989)
I20260709 13:20:18.223083  2025 webserver.cc:533] Webserver started at http://127.1.250.67:39761/ using document root <none> and password file <none>
I20260709 13:20:18.223657  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:18.223677 12846 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39852
I20260709 13:20:18.223917  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:18.224285  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:18.225714  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/ts-2-root/instance:
uuid: "7e85d87d947e4889a9226e02264e505b"
format_stamp: "Formatted at 2026-07-09 13:20:18 on dist-test-slave-g4pn"
I20260709 13:20:18.230564  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:20:18.234751 13059 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:18.235855  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:20:18.236135  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/ts-2-root
uuid: "7e85d87d947e4889a9226e02264e505b"
format_stamp: "Formatted at 2026-07-09 13:20:18 on dist-test-slave-g4pn"
I20260709 13:20:18.236394  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602894180814-2025-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:18.269951  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:18.271162  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:18.272619  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:18.275061  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:18.275255  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:18.275563  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:18.275709  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:18.323647  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.67:40429
I20260709 13:20:18.324000 13121 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.67:40429 every 8 connection(s)
I20260709 13:20:18.339699 13122 heartbeater.cc:344] Connected to a master server at 127.1.250.126:38575
I20260709 13:20:18.340364 13122 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:18.341243 13122 heartbeater.cc:507] Master 127.1.250.126:38575 requested a full tablet report, sending...
I20260709 13:20:18.343389 12846 ts_manager.cc:194] Registered new tserver with Master: 7e85d87d947e4889a9226e02264e505b (127.1.250.67:40429)
I20260709 13:20:18.343570  2025 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01659325s
I20260709 13:20:18.344875 12846 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39866
I20260709 13:20:18.374781 12846 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39874:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:18.377107 12846 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:18.426944 12938 tablet_service.cc:1511] Processing CreateTablet for tablet cc67bb9ba72940308bda5074f3e66109 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=60d27e88583b40148590d2f8a3852bad]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:18.428486 12938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc67bb9ba72940308bda5074f3e66109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:18.431027 12937 tablet_service.cc:1511] Processing CreateTablet for tablet 7c7bf2c2f52c4ebc8238ebd34015623e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=60d27e88583b40148590d2f8a3852bad]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:18.432466 12937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c7bf2c2f52c4ebc8238ebd34015623e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:18.437398 13013 tablet_service.cc:1511] Processing CreateTablet for tablet cc67bb9ba72940308bda5074f3e66109 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=60d27e88583b40148590d2f8a3852bad]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:18.438063 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 7c7bf2c2f52c4ebc8238ebd34015623e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=60d27e88583b40148590d2f8a3852bad]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:18.438926 13013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc67bb9ba72940308bda5074f3e66109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:18.439594 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c7bf2c2f52c4ebc8238ebd34015623e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:18.443313 13087 tablet_service.cc:1511] Processing CreateTablet for tablet cc67bb9ba72940308bda5074f3e66109 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=60d27e88583b40148590d2f8a3852bad]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:18.443658 13086 tablet_service.cc:1511] Processing CreateTablet for tablet 7c7bf2c2f52c4ebc8238ebd34015623e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=60d27e88583b40148590d2f8a3852bad]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:18.444708 13087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc67bb9ba72940308bda5074f3e66109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:18.445550 13086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c7bf2c2f52c4ebc8238ebd34015623e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:18.467394 13137 tablet_bootstrap.cc:492] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228: Bootstrap starting.
I20260709 13:20:18.471628 13138 tablet_bootstrap.cc:492] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b: Bootstrap starting.
I20260709 13:20:18.474943 13137 tablet_bootstrap.cc:654] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:18.479594 13138 tablet_bootstrap.cc:654] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:18.487087 13139 tablet_bootstrap.cc:492] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62: Bootstrap starting.
I20260709 13:20:18.488363 13137 tablet_bootstrap.cc:492] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228: No bootstrap required, opened a new log
I20260709 13:20:18.489028 13137 ts_tablet_manager.cc:1403] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:20:18.490291 13138 tablet_bootstrap.cc:492] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b: No bootstrap required, opened a new log
I20260709 13:20:18.490844 13138 ts_tablet_manager.cc:1403] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.012s
I20260709 13:20:18.492367 13137 raft_consensus.cc:359] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.493191 13137 raft_consensus.cc:385] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:18.493484 13137 raft_consensus.cc:740] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61e000f22f5b4ecb827819ded5bec228, State: Initialized, Role: FOLLOWER
I20260709 13:20:18.493578 13139 tablet_bootstrap.cc:654] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:18.493861 13138 raft_consensus.cc:359] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.494650 13138 raft_consensus.cc:385] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:18.494310 13137 consensus_queue.cc:260] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.494952 13138 raft_consensus.cc:740] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e85d87d947e4889a9226e02264e505b, State: Initialized, Role: FOLLOWER
I20260709 13:20:18.496126 13138 consensus_queue.cc:260] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.497213 13137 ts_tablet_manager.cc:1434] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:18.498262 12973 heartbeater.cc:499] Master 127.1.250.126:38575 was elected leader, sending a full tablet report...
I20260709 13:20:18.503167 13137 tablet_bootstrap.cc:492] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228: Bootstrap starting.
I20260709 13:20:18.505878 13139 tablet_bootstrap.cc:492] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62: No bootstrap required, opened a new log
I20260709 13:20:18.506487 13139 ts_tablet_manager.cc:1403] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.010s
I20260709 13:20:18.509876 13139 raft_consensus.cc:359] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.510623 13139 raft_consensus.cc:385] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:18.510906 13139 raft_consensus.cc:740] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dffc3c8d17e5467b8e0fe12de58c9d62, State: Initialized, Role: FOLLOWER
I20260709 13:20:18.511890 13139 consensus_queue.cc:260] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.514889 13138 ts_tablet_manager.cc:1434] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.016s
I20260709 13:20:18.515668 13122 heartbeater.cc:499] Master 127.1.250.126:38575 was elected leader, sending a full tablet report...
I20260709 13:20:18.516008 13138 tablet_bootstrap.cc:492] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b: Bootstrap starting.
I20260709 13:20:18.521270 13137 tablet_bootstrap.cc:654] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:18.522776 13138 tablet_bootstrap.cc:654] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:18.527837 13139 ts_tablet_manager.cc:1434] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.014s
I20260709 13:20:18.528734 13048 heartbeater.cc:499] Master 127.1.250.126:38575 was elected leader, sending a full tablet report...
I20260709 13:20:18.529367 13139 tablet_bootstrap.cc:492] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62: Bootstrap starting.
I20260709 13:20:18.540230 13139 tablet_bootstrap.cc:654] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:18.541658 13137 tablet_bootstrap.cc:492] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228: No bootstrap required, opened a new log
I20260709 13:20:18.542375 13137 ts_tablet_manager.cc:1403] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.008s
I20260709 13:20:18.546355 13137 raft_consensus.cc:359] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.547438 13137 raft_consensus.cc:385] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:18.547981 13137 raft_consensus.cc:740] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61e000f22f5b4ecb827819ded5bec228, State: Initialized, Role: FOLLOWER
I20260709 13:20:18.549156 13137 consensus_queue.cc:260] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.551911 13137 ts_tablet_manager.cc:1434] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:18.552260 13139 tablet_bootstrap.cc:492] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62: No bootstrap required, opened a new log
I20260709 13:20:18.552826 13139 ts_tablet_manager.cc:1403] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.009s
I20260709 13:20:18.555166 13139 raft_consensus.cc:359] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.555727 13139 raft_consensus.cc:385] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:18.556056 13139 raft_consensus.cc:740] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dffc3c8d17e5467b8e0fe12de58c9d62, State: Initialized, Role: FOLLOWER
I20260709 13:20:18.556864 13139 consensus_queue.cc:260] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.559329 13138 tablet_bootstrap.cc:492] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b: No bootstrap required, opened a new log
I20260709 13:20:18.559479 13139 ts_tablet_manager.cc:1434] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:20:18.560066 13138 ts_tablet_manager.cc:1403] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b: Time spent bootstrapping tablet: real 0.044s	user 0.030s	sys 0.013s
I20260709 13:20:18.562906 13138 raft_consensus.cc:359] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.563468 13138 raft_consensus.cc:385] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:18.563715 13138 raft_consensus.cc:740] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e85d87d947e4889a9226e02264e505b, State: Initialized, Role: FOLLOWER
I20260709 13:20:18.564371 13138 consensus_queue.cc:260] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.566367 13138 ts_tablet_manager.cc:1434] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:18.582278 13145 raft_consensus.cc:493] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.582870 13145 raft_consensus.cc:515] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.585381 13145 leader_election.cc:290] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61e000f22f5b4ecb827819ded5bec228 (127.1.250.65:37847), 7e85d87d947e4889a9226e02264e505b (127.1.250.67:40429)
I20260709 13:20:18.595469 12948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7bf2c2f52c4ebc8238ebd34015623e" candidate_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61e000f22f5b4ecb827819ded5bec228" is_pre_election: true
I20260709 13:20:18.596400 12948 raft_consensus.cc:2468] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dffc3c8d17e5467b8e0fe12de58c9d62 in term 0.
I20260709 13:20:18.597692 12986 leader_election.cc:304] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61e000f22f5b4ecb827819ded5bec228, dffc3c8d17e5467b8e0fe12de58c9d62; no voters: 
I20260709 13:20:18.598488 13145 raft_consensus.cc:2804] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:18.598275 13097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7bf2c2f52c4ebc8238ebd34015623e" candidate_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e85d87d947e4889a9226e02264e505b" is_pre_election: true
I20260709 13:20:18.598937 13145 raft_consensus.cc:493] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.599185 13097 raft_consensus.cc:2468] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dffc3c8d17e5467b8e0fe12de58c9d62 in term 0.
I20260709 13:20:18.599398 13145 raft_consensus.cc:3060] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:18.605540 13145 raft_consensus.cc:515] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.607317 13145 leader_election.cc:290] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [CANDIDATE]: Term 1 election: Requested vote from peers 61e000f22f5b4ecb827819ded5bec228 (127.1.250.65:37847), 7e85d87d947e4889a9226e02264e505b (127.1.250.67:40429)
I20260709 13:20:18.608234 12948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7bf2c2f52c4ebc8238ebd34015623e" candidate_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61e000f22f5b4ecb827819ded5bec228"
I20260709 13:20:18.608557 13097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7bf2c2f52c4ebc8238ebd34015623e" candidate_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e85d87d947e4889a9226e02264e505b"
I20260709 13:20:18.608815 12948 raft_consensus.cc:3060] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:18.609241 13097 raft_consensus.cc:3060] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:18.614344 12948 raft_consensus.cc:2468] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dffc3c8d17e5467b8e0fe12de58c9d62 in term 1.
I20260709 13:20:18.614625 13097 raft_consensus.cc:2468] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dffc3c8d17e5467b8e0fe12de58c9d62 in term 1.
I20260709 13:20:18.615636 12986 leader_election.cc:304] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61e000f22f5b4ecb827819ded5bec228, dffc3c8d17e5467b8e0fe12de58c9d62; no voters: 
I20260709 13:20:18.616452 13145 raft_consensus.cc:2804] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:18.617475 13145 raft_consensus.cc:697] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 LEADER]: Becoming Leader. State: Replica: dffc3c8d17e5467b8e0fe12de58c9d62, State: Running, Role: LEADER
I20260709 13:20:18.618188 13145 consensus_queue.cc:237] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.626972 12846 catalog_manager.cc:5697] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 reported cstate change: term changed from 0 to 1, leader changed from <none> to dffc3c8d17e5467b8e0fe12de58c9d62 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:18.884895 13145 raft_consensus.cc:493] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:18.885520 12894 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:18.885703 13145 raft_consensus.cc:515] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.887495 13145 leader_election.cc:290] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61e000f22f5b4ecb827819ded5bec228 (127.1.250.65:37847), 7e85d87d947e4889a9226e02264e505b (127.1.250.67:40429)
I20260709 13:20:18.888428 12948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc67bb9ba72940308bda5074f3e66109" candidate_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61e000f22f5b4ecb827819ded5bec228" is_pre_election: true
I20260709 13:20:18.888586 13097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc67bb9ba72940308bda5074f3e66109" candidate_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e85d87d947e4889a9226e02264e505b" is_pre_election: true
I20260709 13:20:18.889048 12948 raft_consensus.cc:2468] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dffc3c8d17e5467b8e0fe12de58c9d62 in term 0.
I20260709 13:20:18.889473 13097 raft_consensus.cc:2468] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dffc3c8d17e5467b8e0fe12de58c9d62 in term 0.
I20260709 13:20:18.890184 12986 leader_election.cc:304] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61e000f22f5b4ecb827819ded5bec228, dffc3c8d17e5467b8e0fe12de58c9d62; no voters: 
I20260709 13:20:18.891108 13145 raft_consensus.cc:2804] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:18.891495 13145 raft_consensus.cc:493] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.891810 13145 raft_consensus.cc:3060] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:18.897521 13145 raft_consensus.cc:515] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.899266 13145 leader_election.cc:290] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [CANDIDATE]: Term 1 election: Requested vote from peers 61e000f22f5b4ecb827819ded5bec228 (127.1.250.65:37847), 7e85d87d947e4889a9226e02264e505b (127.1.250.67:40429)
I20260709 13:20:18.900012 12948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc67bb9ba72940308bda5074f3e66109" candidate_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61e000f22f5b4ecb827819ded5bec228"
I20260709 13:20:18.900327 13097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc67bb9ba72940308bda5074f3e66109" candidate_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e85d87d947e4889a9226e02264e505b"
I20260709 13:20:18.900604 12948 raft_consensus.cc:3060] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:18.901069 13097 raft_consensus.cc:3060] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:18.906939 12948 raft_consensus.cc:2468] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dffc3c8d17e5467b8e0fe12de58c9d62 in term 1.
I20260709 13:20:18.907294 13097 raft_consensus.cc:2468] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dffc3c8d17e5467b8e0fe12de58c9d62 in term 1.
I20260709 13:20:18.908631 12986 leader_election.cc:304] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61e000f22f5b4ecb827819ded5bec228, dffc3c8d17e5467b8e0fe12de58c9d62; no voters: 
I20260709 13:20:18.909731 13145 raft_consensus.cc:2804] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:18.910208 13145 raft_consensus.cc:697] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 LEADER]: Becoming Leader. State: Replica: dffc3c8d17e5467b8e0fe12de58c9d62, State: Running, Role: LEADER
I20260709 13:20:18.911114 13145 consensus_queue.cc:237] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:18.918905 12846 catalog_manager.cc:5697] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 reported cstate change: term changed from 0 to 1, leader changed from <none> to dffc3c8d17e5467b8e0fe12de58c9d62 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:18.998703 13145 consensus_queue.cc:1048] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:19.011665 13150 consensus_queue.cc:1048] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:19.050545 12844 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39878:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:19.052527 12844 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:19.077153 12938 tablet_service.cc:1511] Processing CreateTablet for tablet a723094e750d42599bf6ca9149c6e175 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=22c24403a62e469ab0aeabe39b654863]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:19.078639 12938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a723094e750d42599bf6ca9149c6e175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:19.078490 13012 tablet_service.cc:1511] Processing CreateTablet for tablet a723094e750d42599bf6ca9149c6e175 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=22c24403a62e469ab0aeabe39b654863]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:19.079878 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a723094e750d42599bf6ca9149c6e175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:19.080765 13086 tablet_service.cc:1511] Processing CreateTablet for tablet a723094e750d42599bf6ca9149c6e175 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=22c24403a62e469ab0aeabe39b654863]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:19.082233 13086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a723094e750d42599bf6ca9149c6e175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:19.083580 12937 tablet_service.cc:1511] Processing CreateTablet for tablet a500d930202e4841af7453a86d72cf2a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=22c24403a62e469ab0aeabe39b654863]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:19.085304 12937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a500d930202e4841af7453a86d72cf2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:19.089955 13013 tablet_service.cc:1511] Processing CreateTablet for tablet a500d930202e4841af7453a86d72cf2a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=22c24403a62e469ab0aeabe39b654863]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:19.091975 13013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a500d930202e4841af7453a86d72cf2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:19.104390 13087 tablet_service.cc:1511] Processing CreateTablet for tablet a500d930202e4841af7453a86d72cf2a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=22c24403a62e469ab0aeabe39b654863]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:19.106027 13087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a500d930202e4841af7453a86d72cf2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:19.124312 13165 tablet_bootstrap.cc:492] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b: Bootstrap starting.
I20260709 13:20:19.126017 13166 tablet_bootstrap.cc:492] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62: Bootstrap starting.
I20260709 13:20:19.132079 13165 tablet_bootstrap.cc:654] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:19.139454 13166 tablet_bootstrap.cc:654] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:19.150758 13166 tablet_bootstrap.cc:492] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62: No bootstrap required, opened a new log
I20260709 13:20:19.151293 13166 ts_tablet_manager.cc:1403] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:20:19.151357 13165 tablet_bootstrap.cc:492] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b: No bootstrap required, opened a new log
I20260709 13:20:19.151907 13165 ts_tablet_manager.cc:1403] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.012s
I20260709 13:20:19.154250 13166 raft_consensus.cc:359] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.154570 13165 raft_consensus.cc:359] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.155095 13166 raft_consensus.cc:385] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:19.155268 13165 raft_consensus.cc:385] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:19.155444 13166 raft_consensus.cc:740] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dffc3c8d17e5467b8e0fe12de58c9d62, State: Initialized, Role: FOLLOWER
I20260709 13:20:19.155612 13165 raft_consensus.cc:740] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e85d87d947e4889a9226e02264e505b, State: Initialized, Role: FOLLOWER
I20260709 13:20:19.156302 13166 consensus_queue.cc:260] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.157145 13168 tablet_bootstrap.cc:492] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228: Bootstrap starting.
I20260709 13:20:19.158638 13166 ts_tablet_manager.cc:1434] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:19.157433 13165 consensus_queue.cc:260] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.161299 13144 raft_consensus.cc:493] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.161775 13144 raft_consensus.cc:515] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.173568 13144 leader_election.cc:290] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61e000f22f5b4ecb827819ded5bec228 (127.1.250.65:37847), dffc3c8d17e5467b8e0fe12de58c9d62 (127.1.250.66:42989)
I20260709 13:20:19.173609 13168 tablet_bootstrap.cc:654] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:19.181604 13165 ts_tablet_manager.cc:1434] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b: Time spent starting tablet: real 0.029s	user 0.016s	sys 0.014s
I20260709 13:20:19.182216 13166 tablet_bootstrap.cc:492] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62: Bootstrap starting.
I20260709 13:20:19.183297 13165 tablet_bootstrap.cc:492] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b: Bootstrap starting.
I20260709 13:20:19.194998 13165 tablet_bootstrap.cc:654] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:19.202828 13168 tablet_bootstrap.cc:492] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228: No bootstrap required, opened a new log
I20260709 13:20:19.203428 13168 ts_tablet_manager.cc:1403] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228: Time spent bootstrapping tablet: real 0.047s	user 0.026s	sys 0.012s
I20260709 13:20:19.208603 13168 raft_consensus.cc:359] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.210376 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a723094e750d42599bf6ca9149c6e175" candidate_uuid: "7e85d87d947e4889a9226e02264e505b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" is_pre_election: true
I20260709 13:20:19.211459 13023 raft_consensus.cc:2468] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e85d87d947e4889a9226e02264e505b in term 0.
I20260709 13:20:19.212296 13168 raft_consensus.cc:385] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:19.212697 13168 raft_consensus.cc:740] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61e000f22f5b4ecb827819ded5bec228, State: Initialized, Role: FOLLOWER
I20260709 13:20:19.213018 13061 leader_election.cc:304] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e85d87d947e4889a9226e02264e505b, dffc3c8d17e5467b8e0fe12de58c9d62; no voters: 
I20260709 13:20:19.213826 13165 tablet_bootstrap.cc:492] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b: No bootstrap required, opened a new log
I20260709 13:20:19.213654 13168 consensus_queue.cc:260] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.214185 13170 raft_consensus.cc:2804] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:19.214438 13165 ts_tablet_manager.cc:1403] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.000s
I20260709 13:20:19.214705 13170 raft_consensus.cc:493] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.215106 13170 raft_consensus.cc:3060] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:19.216010 12948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a723094e750d42599bf6ca9149c6e175" candidate_uuid: "7e85d87d947e4889a9226e02264e505b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61e000f22f5b4ecb827819ded5bec228" is_pre_election: true
I20260709 13:20:19.216292 13168 ts_tablet_manager.cc:1434] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:20:19.216739 12948 raft_consensus.cc:2468] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e85d87d947e4889a9226e02264e505b in term 0.
I20260709 13:20:19.217546 13168 tablet_bootstrap.cc:492] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228: Bootstrap starting.
I20260709 13:20:19.219455 13165 raft_consensus.cc:359] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.220248 13165 raft_consensus.cc:385] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:19.220551 13165 raft_consensus.cc:740] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e85d87d947e4889a9226e02264e505b, State: Initialized, Role: FOLLOWER
I20260709 13:20:19.221360 13165 consensus_queue.cc:260] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.223713 13165 ts_tablet_manager.cc:1434] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:19.225106 13166 tablet_bootstrap.cc:654] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:19.226042 13168 tablet_bootstrap.cc:654] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:19.231675 13170 raft_consensus.cc:515] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.232374 13168 tablet_bootstrap.cc:492] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228: No bootstrap required, opened a new log
I20260709 13:20:19.233042 13166 tablet_bootstrap.cc:492] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62: No bootstrap required, opened a new log
I20260709 13:20:19.233234 13168 ts_tablet_manager.cc:1403] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:20:19.233942 13166 ts_tablet_manager.cc:1403] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.003s
I20260709 13:20:19.235391 12948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a723094e750d42599bf6ca9149c6e175" candidate_uuid: "7e85d87d947e4889a9226e02264e505b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61e000f22f5b4ecb827819ded5bec228"
I20260709 13:20:19.236030 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a723094e750d42599bf6ca9149c6e175" candidate_uuid: "7e85d87d947e4889a9226e02264e505b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62"
I20260709 13:20:19.236699 13023 raft_consensus.cc:3060] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:19.236071 12948 raft_consensus.cc:3060] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:19.236802 13168 raft_consensus.cc:359] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.237814 13168 raft_consensus.cc:385] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:19.237423 13166 raft_consensus.cc:359] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.238369 13166 raft_consensus.cc:385] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:19.238212 13168 raft_consensus.cc:740] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61e000f22f5b4ecb827819ded5bec228, State: Initialized, Role: FOLLOWER
I20260709 13:20:19.238710 13166 raft_consensus.cc:740] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dffc3c8d17e5467b8e0fe12de58c9d62, State: Initialized, Role: FOLLOWER
I20260709 13:20:19.239435 13168 consensus_queue.cc:260] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.239504 13166 consensus_queue.cc:260] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.242317 13166 ts_tablet_manager.cc:1434] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:19.244995 13168 ts_tablet_manager.cc:1434] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:20:19.246515 12948 raft_consensus.cc:2468] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e85d87d947e4889a9226e02264e505b in term 1.
I20260709 13:20:19.247112 13170 leader_election.cc:290] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [CANDIDATE]: Term 1 election: Requested vote from peers 61e000f22f5b4ecb827819ded5bec228 (127.1.250.65:37847), dffc3c8d17e5467b8e0fe12de58c9d62 (127.1.250.66:42989)
I20260709 13:20:19.248878 13060 leader_election.cc:304] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61e000f22f5b4ecb827819ded5bec228, 7e85d87d947e4889a9226e02264e505b; no voters: 
I20260709 13:20:19.248920 13023 raft_consensus.cc:2468] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e85d87d947e4889a9226e02264e505b in term 1.
I20260709 13:20:19.250041 13170 raft_consensus.cc:2804] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:19.250591 13170 raft_consensus.cc:697] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 1 LEADER]: Becoming Leader. State: Replica: 7e85d87d947e4889a9226e02264e505b, State: Running, Role: LEADER
I20260709 13:20:19.252354 13170 consensus_queue.cc:237] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.254729 13144 raft_consensus.cc:493] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.255630 13144 raft_consensus.cc:515] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.258201 13144 leader_election.cc:290] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61e000f22f5b4ecb827819ded5bec228 (127.1.250.65:37847), dffc3c8d17e5467b8e0fe12de58c9d62 (127.1.250.66:42989)
I20260709 13:20:19.259752 12948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a500d930202e4841af7453a86d72cf2a" candidate_uuid: "7e85d87d947e4889a9226e02264e505b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61e000f22f5b4ecb827819ded5bec228" is_pre_election: true
I20260709 13:20:19.259763 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a500d930202e4841af7453a86d72cf2a" candidate_uuid: "7e85d87d947e4889a9226e02264e505b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" is_pre_election: true
I20260709 13:20:19.260862 12948 raft_consensus.cc:2468] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e85d87d947e4889a9226e02264e505b in term 0.
I20260709 13:20:19.260872 13023 raft_consensus.cc:2468] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e85d87d947e4889a9226e02264e505b in term 0.
I20260709 13:20:19.262198 13060 leader_election.cc:304] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61e000f22f5b4ecb827819ded5bec228, 7e85d87d947e4889a9226e02264e505b; no voters: 
I20260709 13:20:19.261740 12844 catalog_manager.cc:5697] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e85d87d947e4889a9226e02264e505b (127.1.250.67). New cstate: current_term: 1 leader_uuid: "7e85d87d947e4889a9226e02264e505b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:19.263046 13170 raft_consensus.cc:2804] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:19.263444 13170 raft_consensus.cc:493] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.263777 13170 raft_consensus.cc:3060] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:19.270403 13170 raft_consensus.cc:515] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.272387 13170 leader_election.cc:290] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [CANDIDATE]: Term 1 election: Requested vote from peers 61e000f22f5b4ecb827819ded5bec228 (127.1.250.65:37847), dffc3c8d17e5467b8e0fe12de58c9d62 (127.1.250.66:42989)
I20260709 13:20:19.273634 12948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a500d930202e4841af7453a86d72cf2a" candidate_uuid: "7e85d87d947e4889a9226e02264e505b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61e000f22f5b4ecb827819ded5bec228"
I20260709 13:20:19.273864 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a500d930202e4841af7453a86d72cf2a" candidate_uuid: "7e85d87d947e4889a9226e02264e505b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62"
I20260709 13:20:19.274267 12948 raft_consensus.cc:3060] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:19.274475 13023 raft_consensus.cc:3060] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:19.280323 13023 raft_consensus.cc:2468] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e85d87d947e4889a9226e02264e505b in term 1.
I20260709 13:20:19.280478 12948 raft_consensus.cc:2468] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e85d87d947e4889a9226e02264e505b in term 1.
I20260709 13:20:19.281442 13061 leader_election.cc:304] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e85d87d947e4889a9226e02264e505b, dffc3c8d17e5467b8e0fe12de58c9d62; no voters: 
I20260709 13:20:19.282272 13170 raft_consensus.cc:2804] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:19.282716 13170 raft_consensus.cc:697] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 1 LEADER]: Becoming Leader. State: Replica: 7e85d87d947e4889a9226e02264e505b, State: Running, Role: LEADER
I20260709 13:20:19.283432 13170 consensus_queue.cc:237] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.290781 12844 catalog_manager.cc:5697] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e85d87d947e4889a9226e02264e505b (127.1.250.67). New cstate: current_term: 1 leader_uuid: "7e85d87d947e4889a9226e02264e505b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:19.308059 13150 consensus_queue.cc:1048] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:19.319993 13145 consensus_queue.cc:1048] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:19.341485 13023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc67bb9ba72940308bda5074f3e66109"
dest_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62"
mode: GRACEFUL
new_leader_uuid: "61e000f22f5b4ecb827819ded5bec228"
 from {username='slave'} at 127.0.0.1:58886
I20260709 13:20:19.342046 13023 raft_consensus.cc:606] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 LEADER]: Received request to transfer leadership to TS 61e000f22f5b4ecb827819ded5bec228
I20260709 13:20:19.347251 13023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c7bf2c2f52c4ebc8238ebd34015623e"
dest_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62"
mode: GRACEFUL
new_leader_uuid: "7e85d87d947e4889a9226e02264e505b"
 from {username='slave'} at 127.0.0.1:58886
I20260709 13:20:19.347823 13023 raft_consensus.cc:606] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 LEADER]: Received request to transfer leadership to TS 7e85d87d947e4889a9226e02264e505b
I20260709 13:20:19.362406 13097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a723094e750d42599bf6ca9149c6e175"
dest_uuid: "7e85d87d947e4889a9226e02264e505b"
mode: GRACEFUL
new_leader_uuid: "61e000f22f5b4ecb827819ded5bec228"
 from {username='slave'} at 127.0.0.1:52738
I20260709 13:20:19.363009 13097 raft_consensus.cc:606] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 1 LEADER]: Received request to transfer leadership to TS 61e000f22f5b4ecb827819ded5bec228
I20260709 13:20:19.368587 13097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a500d930202e4841af7453a86d72cf2a"
dest_uuid: "7e85d87d947e4889a9226e02264e505b"
mode: GRACEFUL
new_leader_uuid: "61e000f22f5b4ecb827819ded5bec228"
 from {username='slave'} at 127.0.0.1:52738
I20260709 13:20:19.369220 13097 raft_consensus.cc:606] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 1 LEADER]: Received request to transfer leadership to TS 61e000f22f5b4ecb827819ded5bec228
I20260709 13:20:19.398422 13155 raft_consensus.cc:993] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62: : Instructing follower 7e85d87d947e4889a9226e02264e505b to start an election
I20260709 13:20:19.398983 13145 raft_consensus.cc:1081] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 LEADER]: Signalling peer 7e85d87d947e4889a9226e02264e505b to start an election
I20260709 13:20:19.400535 13097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c7bf2c2f52c4ebc8238ebd34015623e"
dest_uuid: "7e85d87d947e4889a9226e02264e505b"
 from {username='slave'} at 127.0.0.1:52724
I20260709 13:20:19.401153 13097 raft_consensus.cc:493] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:19.401546 13097 raft_consensus.cc:3060] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:19.408761 13097 raft_consensus.cc:515] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.410874 13097 leader_election.cc:290] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [CANDIDATE]: Term 2 election: Requested vote from peers 61e000f22f5b4ecb827819ded5bec228 (127.1.250.65:37847), dffc3c8d17e5467b8e0fe12de58c9d62 (127.1.250.66:42989)
I20260709 13:20:19.411589 12948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7bf2c2f52c4ebc8238ebd34015623e" candidate_uuid: "7e85d87d947e4889a9226e02264e505b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61e000f22f5b4ecb827819ded5bec228"
I20260709 13:20:19.412058 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7bf2c2f52c4ebc8238ebd34015623e" candidate_uuid: "7e85d87d947e4889a9226e02264e505b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62"
I20260709 13:20:19.412377 12948 raft_consensus.cc:3060] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:19.412662 13023 raft_consensus.cc:3055] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:19.413115 13023 raft_consensus.cc:740] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dffc3c8d17e5467b8e0fe12de58c9d62, State: Running, Role: LEADER
I20260709 13:20:19.413941 13023 consensus_queue.cc:260] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.414969 13023 raft_consensus.cc:3060] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:19.419765 12948 raft_consensus.cc:2468] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e85d87d947e4889a9226e02264e505b in term 2.
I20260709 13:20:19.420944 13060 leader_election.cc:304] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61e000f22f5b4ecb827819ded5bec228, 7e85d87d947e4889a9226e02264e505b; no voters: 
I20260709 13:20:19.421743 13170 raft_consensus.cc:2804] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:19.422196 13170 raft_consensus.cc:697] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [term 2 LEADER]: Becoming Leader. State: Replica: 7e85d87d947e4889a9226e02264e505b, State: Running, Role: LEADER
I20260709 13:20:19.422287 13023 raft_consensus.cc:2468] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e85d87d947e4889a9226e02264e505b in term 2.
I20260709 13:20:19.423101 13170 consensus_queue.cc:237] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.430006 12844 catalog_manager.cc:5697] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b reported cstate change: term changed from 1 to 2, leader changed from dffc3c8d17e5467b8e0fe12de58c9d62 (127.1.250.66) to 7e85d87d947e4889a9226e02264e505b (127.1.250.67). New cstate: current_term: 2 leader_uuid: "7e85d87d947e4889a9226e02264e505b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:19.664937 13170 consensus_queue.cc:1048] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [LEADER]: Connected to new peer: Peer: permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:19.672192 13144 raft_consensus.cc:993] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b: : Instructing follower 61e000f22f5b4ecb827819ded5bec228 to start an election
I20260709 13:20:19.674437 13170 raft_consensus.cc:1081] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 1 LEADER]: Signalling peer 61e000f22f5b4ecb827819ded5bec228 to start an election
I20260709 13:20:19.676523 12948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a500d930202e4841af7453a86d72cf2a"
dest_uuid: "61e000f22f5b4ecb827819ded5bec228"
 from {username='slave'} at 127.0.0.1:42344
I20260709 13:20:19.677318 12948 raft_consensus.cc:493] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:19.677795 12948 raft_consensus.cc:3060] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:19.680899 13170 consensus_queue.cc:1048] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:19.687539 12948 raft_consensus.cc:515] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.691264 12948 leader_election.cc:290] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [CANDIDATE]: Term 2 election: Requested vote from peers dffc3c8d17e5467b8e0fe12de58c9d62 (127.1.250.66:42989), 7e85d87d947e4889a9226e02264e505b (127.1.250.67:40429)
I20260709 13:20:19.704769 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a500d930202e4841af7453a86d72cf2a" candidate_uuid: "61e000f22f5b4ecb827819ded5bec228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62"
I20260709 13:20:19.704905 13097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a500d930202e4841af7453a86d72cf2a" candidate_uuid: "61e000f22f5b4ecb827819ded5bec228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e85d87d947e4889a9226e02264e505b"
I20260709 13:20:19.705360 13023 raft_consensus.cc:3060] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:19.705859 13097 raft_consensus.cc:3055] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:19.706130 13097 raft_consensus.cc:740] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e85d87d947e4889a9226e02264e505b, State: Running, Role: LEADER
I20260709 13:20:19.706977 13097 consensus_queue.cc:260] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.708032 13097 raft_consensus.cc:3060] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:19.712201 13023 raft_consensus.cc:2468] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61e000f22f5b4ecb827819ded5bec228 in term 2.
I20260709 13:20:19.713721 12912 leader_election.cc:304] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61e000f22f5b4ecb827819ded5bec228, dffc3c8d17e5467b8e0fe12de58c9d62; no voters: 
I20260709 13:20:19.714692 13142 raft_consensus.cc:2804] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:19.714809 13097 raft_consensus.cc:2468] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61e000f22f5b4ecb827819ded5bec228 in term 2.
I20260709 13:20:19.715824 13142 raft_consensus.cc:697] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [term 2 LEADER]: Becoming Leader. State: Replica: 61e000f22f5b4ecb827819ded5bec228, State: Running, Role: LEADER
I20260709 13:20:19.716706 13142 consensus_queue.cc:237] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.722760 12844 catalog_manager.cc:5697] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 reported cstate change: term changed from 1 to 2, leader changed from 7e85d87d947e4889a9226e02264e505b (127.1.250.67) to 61e000f22f5b4ecb827819ded5bec228 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "61e000f22f5b4ecb827819ded5bec228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:19.806952 13145 raft_consensus.cc:993] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62: : Instructing follower 61e000f22f5b4ecb827819ded5bec228 to start an election
I20260709 13:20:19.807489 13150 raft_consensus.cc:1081] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 LEADER]: Signalling peer 61e000f22f5b4ecb827819ded5bec228 to start an election
I20260709 13:20:19.809532 12947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc67bb9ba72940308bda5074f3e66109"
dest_uuid: "61e000f22f5b4ecb827819ded5bec228"
 from {username='slave'} at 127.0.0.1:42332
I20260709 13:20:19.810195 12947 raft_consensus.cc:493] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:19.810640 12947 raft_consensus.cc:3060] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:19.810798 13170 consensus_queue.cc:1048] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [LEADER]: Connected to new peer: Peer: permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:19.819294 12947 raft_consensus.cc:515] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.820511 13186 raft_consensus.cc:993] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b: : Instructing follower 61e000f22f5b4ecb827819ded5bec228 to start an election
I20260709 13:20:19.821044 13144 raft_consensus.cc:1081] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 1 LEADER]: Signalling peer 61e000f22f5b4ecb827819ded5bec228 to start an election
I20260709 13:20:19.822662 12946 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a723094e750d42599bf6ca9149c6e175"
dest_uuid: "61e000f22f5b4ecb827819ded5bec228"
 from {username='slave'} at 127.0.0.1:42344
I20260709 13:20:19.823279 12946 raft_consensus.cc:493] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:19.823643 12946 raft_consensus.cc:3060] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:19.826031 13144 consensus_queue.cc:1048] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:19.828274 12947 leader_election.cc:290] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [CANDIDATE]: Term 2 election: Requested vote from peers dffc3c8d17e5467b8e0fe12de58c9d62 (127.1.250.66:42989), 7e85d87d947e4889a9226e02264e505b (127.1.250.67:40429)
I20260709 13:20:19.828864 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc67bb9ba72940308bda5074f3e66109" candidate_uuid: "61e000f22f5b4ecb827819ded5bec228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62"
I20260709 13:20:19.829558 13023 raft_consensus.cc:3055] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:19.829881 13023 raft_consensus.cc:740] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dffc3c8d17e5467b8e0fe12de58c9d62, State: Running, Role: LEADER
I20260709 13:20:19.830742 13097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc67bb9ba72940308bda5074f3e66109" candidate_uuid: "61e000f22f5b4ecb827819ded5bec228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e85d87d947e4889a9226e02264e505b"
I20260709 13:20:19.830673 13023 consensus_queue.cc:260] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.831460 13097 raft_consensus.cc:3060] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:19.832013 13023 raft_consensus.cc:3060] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:19.832789 12946 raft_consensus.cc:515] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.833863 12948 raft_consensus.cc:1240] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 2 FOLLOWER]: Rejecting Update request from peer 7e85d87d947e4889a9226e02264e505b for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:19.837877 13144 consensus_queue.cc:1059] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:19.838635 12946 leader_election.cc:290] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [CANDIDATE]: Term 2 election: Requested vote from peers dffc3c8d17e5467b8e0fe12de58c9d62 (127.1.250.66:42989), 7e85d87d947e4889a9226e02264e505b (127.1.250.67:40429)
I20260709 13:20:19.838979 13170 raft_consensus.cc:3055] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:19.839370 13170 raft_consensus.cc:740] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e85d87d947e4889a9226e02264e505b, State: Running, Role: LEADER
I20260709 13:20:19.840236 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a723094e750d42599bf6ca9149c6e175" candidate_uuid: "61e000f22f5b4ecb827819ded5bec228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e85d87d947e4889a9226e02264e505b"
I20260709 13:20:19.840273 13170 consensus_queue.cc:260] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.842252 13170 raft_consensus.cc:3060] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:19.844971 13097 raft_consensus.cc:2468] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61e000f22f5b4ecb827819ded5bec228 in term 2.
I20260709 13:20:19.846334 12914 leader_election.cc:304] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61e000f22f5b4ecb827819ded5bec228, 7e85d87d947e4889a9226e02264e505b; no voters: 
I20260709 13:20:19.847186 13142 raft_consensus.cc:2804] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:19.847677 13142 raft_consensus.cc:697] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [term 2 LEADER]: Becoming Leader. State: Replica: 61e000f22f5b4ecb827819ded5bec228, State: Running, Role: LEADER
I20260709 13:20:19.848479 13142 consensus_queue.cc:237] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.851428 13022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a723094e750d42599bf6ca9149c6e175" candidate_uuid: "61e000f22f5b4ecb827819ded5bec228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62"
I20260709 13:20:19.852106 13022 raft_consensus.cc:3060] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:19.855325 12948 raft_consensus.cc:1275] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228 [term 2 FOLLOWER]: Refusing update from remote peer 7e85d87d947e4889a9226e02264e505b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:19.857158 13144 consensus_queue.cc:1048] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [LEADER]: Connected to new peer: Peer: permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:19.857939 13096 raft_consensus.cc:2468] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61e000f22f5b4ecb827819ded5bec228 in term 2.
I20260709 13:20:19.857455 12843 catalog_manager.cc:5697] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 reported cstate change: term changed from 1 to 2, leader changed from dffc3c8d17e5467b8e0fe12de58c9d62 (127.1.250.66) to 61e000f22f5b4ecb827819ded5bec228 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "61e000f22f5b4ecb827819ded5bec228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:19.859989 12914 leader_election.cc:304] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61e000f22f5b4ecb827819ded5bec228, 7e85d87d947e4889a9226e02264e505b; no voters: 
I20260709 13:20:19.860638 13022 raft_consensus.cc:2468] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61e000f22f5b4ecb827819ded5bec228 in term 2.
I20260709 13:20:19.861256 13190 raft_consensus.cc:2804] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:19.861764 13190 raft_consensus.cc:697] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 2 LEADER]: Becoming Leader. State: Replica: 61e000f22f5b4ecb827819ded5bec228, State: Running, Role: LEADER
I20260709 13:20:19.862632 13190 consensus_queue.cc:237] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:19.867086 13023 raft_consensus.cc:2468] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61e000f22f5b4ecb827819ded5bec228 in term 2.
I20260709 13:20:19.868428 13021 raft_consensus.cc:1275] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Refusing update from remote peer 7e85d87d947e4889a9226e02264e505b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:19.871171 13170 consensus_queue.cc:1048] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:19.883749 12845 catalog_manager.cc:5697] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 reported cstate change: term changed from 1 to 2, leader changed from 7e85d87d947e4889a9226e02264e505b (127.1.250.67) to 61e000f22f5b4ecb827819ded5bec228 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "61e000f22f5b4ecb827819ded5bec228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:20.124720 13021 raft_consensus.cc:1275] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Refusing update from remote peer 61e000f22f5b4ecb827819ded5bec228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:20.126031 13190 consensus_queue.cc:1048] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:20.134128 13096 raft_consensus.cc:1275] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 2 FOLLOWER]: Refusing update from remote peer 61e000f22f5b4ecb827819ded5bec228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:20.135746 13190 consensus_queue.cc:1048] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:20.159108  2025 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:20:20.160773  2025 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:20:20.161203  2025 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:20:20.172961 12946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a723094e750d42599bf6ca9149c6e175"
dest_uuid: "61e000f22f5b4ecb827819ded5bec228"
mode: GRACEFUL
new_leader_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62"
 from {username='slave'} at 127.0.0.1:42352
I20260709 13:20:20.173565 12946 raft_consensus.cc:606] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 2 LEADER]: Received request to transfer leadership to TS dffc3c8d17e5467b8e0fe12de58c9d62
I20260709 13:20:20.174546  2025 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:20:20.296625 13021 raft_consensus.cc:1275] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Refusing update from remote peer 61e000f22f5b4ecb827819ded5bec228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:20.297941 13190 consensus_queue.cc:1048] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:20.309012 13096 raft_consensus.cc:1275] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b [term 2 FOLLOWER]: Refusing update from remote peer 61e000f22f5b4ecb827819ded5bec228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:20.310662 13142 consensus_queue.cc:1048] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:20.358074 13021 raft_consensus.cc:1275] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Refusing update from remote peer 61e000f22f5b4ecb827819ded5bec228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:20.359351 13142 consensus_queue.cc:1048] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:20.365272 13193 raft_consensus.cc:993] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228: : Instructing follower dffc3c8d17e5467b8e0fe12de58c9d62 to start an election
I20260709 13:20:20.365818 13190 raft_consensus.cc:1081] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 2 LEADER]: Signalling peer dffc3c8d17e5467b8e0fe12de58c9d62 to start an election
I20260709 13:20:20.369917 13096 raft_consensus.cc:1275] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 2 FOLLOWER]: Refusing update from remote peer 61e000f22f5b4ecb827819ded5bec228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:20.370970 13021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a723094e750d42599bf6ca9149c6e175"
dest_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62"
 from {username='slave'} at 127.0.0.1:58888
I20260709 13:20:20.371677 13021 raft_consensus.cc:493] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:20.372097 13021 raft_consensus.cc:3060] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:20.372479 13190 consensus_queue.cc:1048] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:20.383292 13021 raft_consensus.cc:515] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:20.386468 12946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a723094e750d42599bf6ca9149c6e175" candidate_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61e000f22f5b4ecb827819ded5bec228"
I20260709 13:20:20.387144 12946 raft_consensus.cc:3055] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:20.387468 12946 raft_consensus.cc:740] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 61e000f22f5b4ecb827819ded5bec228, State: Running, Role: LEADER
I20260709 13:20:20.388085 13021 leader_election.cc:290] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [CANDIDATE]: Term 3 election: Requested vote from peers 61e000f22f5b4ecb827819ded5bec228 (127.1.250.65:37847), 7e85d87d947e4889a9226e02264e505b (127.1.250.67:40429)
I20260709 13:20:20.388406 12946 consensus_queue.cc:260] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:20.389264 13096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a723094e750d42599bf6ca9149c6e175" candidate_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e85d87d947e4889a9226e02264e505b"
I20260709 13:20:20.389905 13096 raft_consensus.cc:3060] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:20.389896 12946 raft_consensus.cc:3060] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:20.397234 13096 raft_consensus.cc:2468] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dffc3c8d17e5467b8e0fe12de58c9d62 in term 3.
I20260709 13:20:20.398500 12989 leader_election.cc:304] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e85d87d947e4889a9226e02264e505b, dffc3c8d17e5467b8e0fe12de58c9d62; no voters: 
I20260709 13:20:20.399286 13150 raft_consensus.cc:2804] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:20.399575 12946 raft_consensus.cc:2468] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dffc3c8d17e5467b8e0fe12de58c9d62 in term 3.
I20260709 13:20:20.400259 13150 raft_consensus.cc:697] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 3 LEADER]: Becoming Leader. State: Replica: dffc3c8d17e5467b8e0fe12de58c9d62, State: Running, Role: LEADER
I20260709 13:20:20.401197 13150 consensus_queue.cc:237] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } }
I20260709 13:20:20.407155 12845 catalog_manager.cc:5697] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 reported cstate change: term changed from 2 to 3, leader changed from 61e000f22f5b4ecb827819ded5bec228 (127.1.250.65) to dffc3c8d17e5467b8e0fe12de58c9d62 (127.1.250.66). New cstate: current_term: 3 leader_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61e000f22f5b4ecb827819ded5bec228" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dffc3c8d17e5467b8e0fe12de58c9d62" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 42989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e85d87d947e4889a9226e02264e505b" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 40429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:20.539045  2025 tablet_server.cc:179] TabletServer@127.1.250.65:0 shutting down...
I20260709 13:20:20.559635  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:20.560402  2025 tablet_replica.cc:333] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228: stopping tablet replica
I20260709 13:20:20.561128  2025 raft_consensus.cc:2243] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.561661  2025 raft_consensus.cc:2272] T a723094e750d42599bf6ca9149c6e175 P 61e000f22f5b4ecb827819ded5bec228 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.564043  2025 tablet_replica.cc:333] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228: stopping tablet replica
I20260709 13:20:20.564641  2025 raft_consensus.cc:2243] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:20.565541  2025 raft_consensus.cc:2272] T a500d930202e4841af7453a86d72cf2a P 61e000f22f5b4ecb827819ded5bec228 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.567956  2025 tablet_replica.cc:333] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228: stopping tablet replica
I20260709 13:20:20.568512  2025 raft_consensus.cc:2243] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:20.569416  2025 raft_consensus.cc:2272] T cc67bb9ba72940308bda5074f3e66109 P 61e000f22f5b4ecb827819ded5bec228 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.571940  2025 tablet_replica.cc:333] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228: stopping tablet replica
I20260709 13:20:20.572559  2025 raft_consensus.cc:2243] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.573210  2025 raft_consensus.cc:2272] T 7c7bf2c2f52c4ebc8238ebd34015623e P 61e000f22f5b4ecb827819ded5bec228 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.598783  2025 tablet_server.cc:196] TabletServer@127.1.250.65:0 shutdown complete.
I20260709 13:20:20.611820  2025 tablet_server.cc:179] TabletServer@127.1.250.66:0 shutting down...
I20260709 13:20:20.633188  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:20.633834  2025 tablet_replica.cc:333] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62: stopping tablet replica
I20260709 13:20:20.634572  2025 raft_consensus.cc:2243] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:20.635185  2025 pending_rounds.cc:70] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62: Trying to abort 1 pending ops.
I20260709 13:20:20.635350  2025 pending_rounds.cc:77] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638790770483200 op_type: NO_OP noop_request { }
I20260709 13:20:20.635594  2025 raft_consensus.cc:2889] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:20.635828  2025 raft_consensus.cc:2272] T a723094e750d42599bf6ca9149c6e175 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.638028  2025 tablet_replica.cc:333] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62: stopping tablet replica
I20260709 13:20:20.638593  2025 raft_consensus.cc:2243] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.639055  2025 raft_consensus.cc:2272] T 7c7bf2c2f52c4ebc8238ebd34015623e P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.641395  2025 tablet_replica.cc:333] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62: stopping tablet replica
I20260709 13:20:20.641850  2025 raft_consensus.cc:2243] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.642210  2025 raft_consensus.cc:2272] T a500d930202e4841af7453a86d72cf2a P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.644515  2025 tablet_replica.cc:333] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62: stopping tablet replica
I20260709 13:20:20.645179  2025 raft_consensus.cc:2243] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.645589  2025 raft_consensus.cc:2272] T cc67bb9ba72940308bda5074f3e66109 P dffc3c8d17e5467b8e0fe12de58c9d62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.669404  2025 tablet_server.cc:196] TabletServer@127.1.250.66:0 shutdown complete.
I20260709 13:20:20.682660  2025 tablet_server.cc:179] TabletServer@127.1.250.67:0 shutting down...
I20260709 13:20:20.703505  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:20.704149  2025 tablet_replica.cc:333] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b: stopping tablet replica
I20260709 13:20:20.704732  2025 raft_consensus.cc:2243] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.705333  2025 raft_consensus.cc:2272] T a723094e750d42599bf6ca9149c6e175 P 7e85d87d947e4889a9226e02264e505b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.707687  2025 tablet_replica.cc:333] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b: stopping tablet replica
I20260709 13:20:20.708431  2025 raft_consensus.cc:2243] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.708853  2025 raft_consensus.cc:2272] T a500d930202e4841af7453a86d72cf2a P 7e85d87d947e4889a9226e02264e505b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.710986  2025 tablet_replica.cc:333] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b: stopping tablet replica
I20260709 13:20:20.711469  2025 raft_consensus.cc:2243] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.711841  2025 raft_consensus.cc:2272] T cc67bb9ba72940308bda5074f3e66109 P 7e85d87d947e4889a9226e02264e505b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.714061  2025 tablet_replica.cc:333] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b: stopping tablet replica
I20260709 13:20:20.714570  2025 raft_consensus.cc:2243] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:20.715281  2025 raft_consensus.cc:2272] T 7c7bf2c2f52c4ebc8238ebd34015623e P 7e85d87d947e4889a9226e02264e505b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.740470  2025 tablet_server.cc:196] TabletServer@127.1.250.67:0 shutdown complete.
I20260709 13:20:20.755309  2025 master.cc:562] Master@127.1.250.126:38575 shutting down...
I20260709 13:20:20.771616  2025 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:20.772200  2025 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.772524  2025 tablet_replica.cc:333] T 00000000000000000000000000000000 P a1588d6099f54b79a3752a4c9a8236e0: stopping tablet replica
I20260709 13:20:20.791435  2025 master.cc:584] Master@127.1.250.126:38575 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3110 ms)
[----------] 6 tests from LeaderRebalancerTest (326465 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:20:20.821771  2025 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.250.126:37373
I20260709 13:20:20.822886  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:20.827811 13202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.828012 13203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.830418 13205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.831221  2025 server_base.cc:1061] running on GCE node
I20260709 13:20:20.832155  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:20.832325  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:20.832525  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603220832493 us; error 0 us; skew 500 ppm
I20260709 13:20:20.833206  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:20.835726  2025 webserver.cc:533] Webserver started at http://127.1.250.126:37649/ using document root <none> and password file <none>
I20260709 13:20:20.836231  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:20.836412  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:20.836707  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:20.837834  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/master-0-root/instance:
uuid: "0d95385a17ae44959415021aef51ec3a"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-g4pn"
I20260709 13:20:20.842350  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:20.846268 13211 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.847184  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:20:20.847532  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/master-0-root
uuid: "0d95385a17ae44959415021aef51ec3a"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-g4pn"
I20260709 13:20:20.847899  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:20.876745  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:20.877846  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:20.920243  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.126:37373
I20260709 13:20:20.920362 13262 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.126:37373 every 8 connection(s)
I20260709 13:20:20.924223 13263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.935424 13263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a: Bootstrap starting.
I20260709 13:20:20.939867 13263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.944254 13263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a: No bootstrap required, opened a new log
I20260709 13:20:20.946853 13263 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d95385a17ae44959415021aef51ec3a" member_type: VOTER }
I20260709 13:20:20.947253 13263 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:20.947526 13263 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d95385a17ae44959415021aef51ec3a, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.948359 13263 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d95385a17ae44959415021aef51ec3a" member_type: VOTER }
I20260709 13:20:20.948899 13263 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:20.949200 13263 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:20.949589 13263 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:20.955554 13263 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d95385a17ae44959415021aef51ec3a" member_type: VOTER }
I20260709 13:20:20.956053 13263 leader_election.cc:304] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d95385a17ae44959415021aef51ec3a; no voters: 
I20260709 13:20:20.957526 13263 leader_election.cc:290] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:20.957908 13266 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:20.959676 13266 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [term 1 LEADER]: Becoming Leader. State: Replica: 0d95385a17ae44959415021aef51ec3a, State: Running, Role: LEADER
I20260709 13:20:20.960464 13266 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d95385a17ae44959415021aef51ec3a" member_type: VOTER }
I20260709 13:20:20.960769 13263 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:20.963816 13268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d95385a17ae44959415021aef51ec3a. Latest consensus state: current_term: 1 leader_uuid: "0d95385a17ae44959415021aef51ec3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d95385a17ae44959415021aef51ec3a" member_type: VOTER } }
I20260709 13:20:20.963728 13267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d95385a17ae44959415021aef51ec3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d95385a17ae44959415021aef51ec3a" member_type: VOTER } }
I20260709 13:20:20.964694 13268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:20.964911 13267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:20.968473 13271 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:20.977198 13271 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:20.978469  2025 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:20.987838 13271 catalog_manager.cc:1383] Generated new cluster ID: fc8e8cef8dc0437491b98b8d59d7098b
I20260709 13:20:20.988232 13271 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:21.014020 13271 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:21.015338 13271 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:21.026759 13271 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a: Generated new TSK 0
I20260709 13:20:21.027438 13271 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:21.045135  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:21.051236 13284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:21.052454 13285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:21.054296 13287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:21.056573  2025 server_base.cc:1061] running on GCE node
I20260709 13:20:21.057658  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:21.057861  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:21.058099  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603221058056 us; error 0 us; skew 500 ppm
I20260709 13:20:21.058698  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:21.061288  2025 webserver.cc:533] Webserver started at http://127.1.250.65:39501/ using document root <none> and password file <none>
I20260709 13:20:21.061801  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:21.062004  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:21.062305  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:21.063566  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/ts-0-root/instance:
uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
format_stamp: "Formatted at 2026-07-09 13:20:21 on dist-test-slave-g4pn"
I20260709 13:20:21.068382  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:20:21.072175 13292 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:21.072994  2025 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:21.073398  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/ts-0-root
uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
format_stamp: "Formatted at 2026-07-09 13:20:21 on dist-test-slave-g4pn"
I20260709 13:20:21.073719  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:21.090231  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:21.091760  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:21.093300  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:21.095717  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:21.095933  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:21.096246  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:21.096400  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:21.138908  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.65:40967
I20260709 13:20:21.139106 13354 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.65:40967 every 8 connection(s)
I20260709 13:20:21.144419  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:21.151891 13359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:21.152853 13360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:21.159284 13355 heartbeater.cc:344] Connected to a master server at 127.1.250.126:37373
W20260709 13:20:21.159821 13362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:21.159875  2025 server_base.cc:1061] running on GCE node
I20260709 13:20:21.159926 13355 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:21.161257 13355 heartbeater.cc:507] Master 127.1.250.126:37373 requested a full tablet report, sending...
I20260709 13:20:21.161800  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:21.162066  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:21.162254  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603221162231 us; error 0 us; skew 500 ppm
I20260709 13:20:21.162900  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:21.163638 13228 ts_manager.cc:194] Registered new tserver with Master: cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967)
I20260709 13:20:21.165484  2025 webserver.cc:533] Webserver started at http://127.1.250.66:37497/ using document root <none> and password file <none>
I20260709 13:20:21.165997  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:21.165951 13228 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49092
I20260709 13:20:21.166440  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:21.166755  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:21.167941  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/ts-1-root/instance:
uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
format_stamp: "Formatted at 2026-07-09 13:20:21 on dist-test-slave-g4pn"
I20260709 13:20:21.172413  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:20:21.175814 13367 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:21.176697  2025 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:20:21.176985  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/ts-1-root
uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
format_stamp: "Formatted at 2026-07-09 13:20:21 on dist-test-slave-g4pn"
I20260709 13:20:21.177356  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:21.193918  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:21.195042  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:21.196518  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:21.198951  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:21.199199  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:21.199479  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:21.199672  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:21.240070  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.66:34003
I20260709 13:20:21.240197 13429 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.66:34003 every 8 connection(s)
I20260709 13:20:21.245007  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:21.252832 13434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:21.254563 13433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:21.258769 13430 heartbeater.cc:344] Connected to a master server at 127.1.250.126:37373
I20260709 13:20:21.259258 13430 heartbeater.cc:461] Registering TS with master...
W20260709 13:20:21.259497 13436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:21.260246  2025 server_base.cc:1061] running on GCE node
I20260709 13:20:21.260267 13430 heartbeater.cc:507] Master 127.1.250.126:37373 requested a full tablet report, sending...
I20260709 13:20:21.261335  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:21.261569  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:21.261750  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603221261727 us; error 0 us; skew 500 ppm
I20260709 13:20:21.262409  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:21.262758 13228 ts_manager.cc:194] Registered new tserver with Master: ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:21.264475 13228 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49108
I20260709 13:20:21.265025  2025 webserver.cc:533] Webserver started at http://127.1.250.67:32955/ using document root <none> and password file <none>
I20260709 13:20:21.265635  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:21.265842  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:21.266110  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:21.267185  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/ts-2-root/instance:
uuid: "7e10c77aaefa4ca282e71044a2c0f759"
format_stamp: "Formatted at 2026-07-09 13:20:21 on dist-test-slave-g4pn"
I20260709 13:20:21.271574  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:21.274973 13441 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:21.275816  2025 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260709 13:20:21.276109  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/ts-2-root
uuid: "7e10c77aaefa4ca282e71044a2c0f759"
format_stamp: "Formatted at 2026-07-09 13:20:21 on dist-test-slave-g4pn"
I20260709 13:20:21.276394  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602894180814-2025-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:21.289510  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:21.290680  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:21.292234  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:21.294673  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:21.294934  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:21.295204  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:21.295405  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:21.336931  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.67:33517
I20260709 13:20:21.337189 13503 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.67:33517 every 8 connection(s)
I20260709 13:20:21.351114 13504 heartbeater.cc:344] Connected to a master server at 127.1.250.126:37373
I20260709 13:20:21.351567 13504 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:21.352248 13504 heartbeater.cc:507] Master 127.1.250.126:37373 requested a full tablet report, sending...
I20260709 13:20:21.354224 13228 ts_manager.cc:194] Registered new tserver with Master: 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:21.354929  2025 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014643334s
I20260709 13:20:21.355659 13228 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49124
I20260709 13:20:21.381801 13228 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49136:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:21.384336 13228 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:21.458051 13320 tablet_service.cc:1511] Processing CreateTablet for tablet e77725ae01e740148beb2ff3260cabc9 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:21.458194 13319 tablet_service.cc:1511] Processing CreateTablet for tablet 274bd992d2474f4a97baf74cd6c15f60 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:21.459550 13320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77725ae01e740148beb2ff3260cabc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.461652 13319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 274bd992d2474f4a97baf74cd6c15f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.471421 13469 tablet_service.cc:1511] Processing CreateTablet for tablet e77725ae01e740148beb2ff3260cabc9 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:21.471866 13468 tablet_service.cc:1511] Processing CreateTablet for tablet 274bd992d2474f4a97baf74cd6c15f60 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:21.471997 13318 tablet_service.cc:1511] Processing CreateTablet for tablet 6f66ce72872a4a239fd486c1163436f8 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:21.473124 13469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77725ae01e740148beb2ff3260cabc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.473450 13318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f66ce72872a4a239fd486c1163436f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.473852 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 274bd992d2474f4a97baf74cd6c15f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.477747 13395 tablet_service.cc:1511] Processing CreateTablet for tablet e77725ae01e740148beb2ff3260cabc9 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:21.478770 13467 tablet_service.cc:1511] Processing CreateTablet for tablet 6f66ce72872a4a239fd486c1163436f8 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:21.479363 13395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77725ae01e740148beb2ff3260cabc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.480324 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f66ce72872a4a239fd486c1163436f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.494526 13317 tablet_service.cc:1511] Processing CreateTablet for tablet 1dc56481aa6146eda2ef7d0202cb3e18 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:21.496194 13317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc56481aa6146eda2ef7d0202cb3e18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.503420 13393 tablet_service.cc:1511] Processing CreateTablet for tablet 6f66ce72872a4a239fd486c1163436f8 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:21.503549 13394 tablet_service.cc:1511] Processing CreateTablet for tablet 274bd992d2474f4a97baf74cd6c15f60 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:21.505102 13393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f66ce72872a4a239fd486c1163436f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.505997 13394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 274bd992d2474f4a97baf74cd6c15f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.514137 13392 tablet_service.cc:1511] Processing CreateTablet for tablet 1dc56481aa6146eda2ef7d0202cb3e18 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:21.515761 13392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc56481aa6146eda2ef7d0202cb3e18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.522341 13519 tablet_bootstrap.cc:492] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:21.524093 13467 tablet_service.cc:1511] Processing CreateTablet for tablet 1dc56481aa6146eda2ef7d0202cb3e18 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:21.532725 13316 tablet_service.cc:1511] Processing CreateTablet for tablet 9270b20602874b468e7a2e81aa8a7634 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:21.535099 13316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9270b20602874b468e7a2e81aa8a7634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.537572 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc56481aa6146eda2ef7d0202cb3e18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.539887 13519 tablet_bootstrap.cc:654] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.539655 13391 tablet_service.cc:1511] Processing CreateTablet for tablet 9270b20602874b468e7a2e81aa8a7634 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:21.541050 13391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9270b20602874b468e7a2e81aa8a7634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.541819 13469 tablet_service.cc:1511] Processing CreateTablet for tablet 9270b20602874b468e7a2e81aa8a7634 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:21.543119 13469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9270b20602874b468e7a2e81aa8a7634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.549427 13390 tablet_service.cc:1511] Processing CreateTablet for tablet 0a92e3bed61c42038559ef6437c26524 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:21.550809 13390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a92e3bed61c42038559ef6437c26524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.550709 13319 tablet_service.cc:1511] Processing CreateTablet for tablet 0a92e3bed61c42038559ef6437c26524 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:21.552168 13319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a92e3bed61c42038559ef6437c26524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.553784 13520 tablet_bootstrap.cc:492] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:21.555019 13468 tablet_service.cc:1511] Processing CreateTablet for tablet 0a92e3bed61c42038559ef6437c26524 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:21.563162 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a92e3bed61c42038559ef6437c26524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.585153 13522 tablet_bootstrap.cc:492] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:21.592721 13522 tablet_bootstrap.cc:654] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.593595 13316 tablet_service.cc:1511] Processing CreateTablet for tablet e5df601bbb544e56bf2bab6b83e6eefa (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:21.595199 13316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5df601bbb544e56bf2bab6b83e6eefa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.599007 13519 tablet_bootstrap.cc:492] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:21.601956 13519 ts_tablet_manager.cc:1403] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.010s
I20260709 13:20:21.605049 13522 tablet_bootstrap.cc:492] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:21.604869 13519 raft_consensus.cc:359] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.605636 13519 raft_consensus.cc:385] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.605695 13522 ts_tablet_manager.cc:1403] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:20:21.606074 13519 raft_consensus.cc:740] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.607005 13519 consensus_queue.cc:260] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.608820 13392 tablet_service.cc:1511] Processing CreateTablet for tablet e5df601bbb544e56bf2bab6b83e6eefa (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:21.609496 13522 raft_consensus.cc:359] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.611357 13504 heartbeater.cc:499] Master 127.1.250.126:37373 was elected leader, sending a full tablet report...
I20260709 13:20:21.617969 13520 tablet_bootstrap.cc:654] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.613893 13317 tablet_service.cc:1511] Processing CreateTablet for tablet a3b4d9d0e7894d3fb39494067103dcfa (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:21.619462 13317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b4d9d0e7894d3fb39494067103dcfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.612196 13468 tablet_service.cc:1511] Processing CreateTablet for tablet e5df601bbb544e56bf2bab6b83e6eefa (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:21.614383 13519 ts_tablet_manager.cc:1434] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:20:21.618034 13392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5df601bbb544e56bf2bab6b83e6eefa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.621062 13467 tablet_service.cc:1511] Processing CreateTablet for tablet a3b4d9d0e7894d3fb39494067103dcfa (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:21.622334 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5df601bbb544e56bf2bab6b83e6eefa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.622454 13393 tablet_service.cc:1511] Processing CreateTablet for tablet a3b4d9d0e7894d3fb39494067103dcfa (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:21.627772 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b4d9d0e7894d3fb39494067103dcfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.628237 13393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b4d9d0e7894d3fb39494067103dcfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.621490 13522 raft_consensus.cc:385] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.630065 13522 raft_consensus.cc:740] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.630869 13522 consensus_queue.cc:260] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.624531 13519 tablet_bootstrap.cc:492] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:21.626642 13319 tablet_service.cc:1511] Processing CreateTablet for tablet 92c9aeccadd4498da1f0e880c9b63864 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:21.633692 13319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c9aeccadd4498da1f0e880c9b63864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.634330 13395 tablet_service.cc:1511] Processing CreateTablet for tablet 92c9aeccadd4498da1f0e880c9b63864 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:21.635666 13395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c9aeccadd4498da1f0e880c9b63864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.639356 13469 tablet_service.cc:1511] Processing CreateTablet for tablet 92c9aeccadd4498da1f0e880c9b63864 (DEFAULT_TABLE table=test-workload [id=f0680c6d2bca4293a10155945c1fdc10]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:21.640040 13519 tablet_bootstrap.cc:654] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.642669 13469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c9aeccadd4498da1f0e880c9b63864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.667760 13430 heartbeater.cc:499] Master 127.1.250.126:37373 was elected leader, sending a full tablet report...
I20260709 13:20:21.671789 13522 ts_tablet_manager.cc:1434] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.065s	user 0.013s	sys 0.005s
I20260709 13:20:21.673022 13522 tablet_bootstrap.cc:492] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:21.680747 13522 tablet_bootstrap.cc:654] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.686074 13520 tablet_bootstrap.cc:492] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:21.686560 13520 ts_tablet_manager.cc:1403] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.133s	user 0.008s	sys 0.007s
I20260709 13:20:21.692128 13520 raft_consensus.cc:359] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.692854 13520 raft_consensus.cc:385] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.701836 13520 raft_consensus.cc:740] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.702764 13520 consensus_queue.cc:260] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.703430 13519 tablet_bootstrap.cc:492] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:21.704102 13519 ts_tablet_manager.cc:1403] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.080s	user 0.008s	sys 0.019s
I20260709 13:20:21.707157 13519 raft_consensus.cc:359] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.708123 13519 raft_consensus.cc:385] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.708442 13519 raft_consensus.cc:740] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.709457 13519 consensus_queue.cc:260] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.711540 13355 heartbeater.cc:499] Master 127.1.250.126:37373 was elected leader, sending a full tablet report...
I20260709 13:20:21.712725 13520 ts_tablet_manager.cc:1434] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:20:21.713863 13520 tablet_bootstrap.cc:492] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:21.720378 13520 tablet_bootstrap.cc:654] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.726037 13519 ts_tablet_manager.cc:1434] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:20:21.728873 13520 tablet_bootstrap.cc:492] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:21.729549 13519 tablet_bootstrap.cc:492] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:21.731467 13522 tablet_bootstrap.cc:492] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:21.732120 13522 ts_tablet_manager.cc:1403] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.008s
I20260709 13:20:21.734984 13522 raft_consensus.cc:359] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.735605 13522 raft_consensus.cc:385] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.735877 13522 raft_consensus.cc:740] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.736558 13522 consensus_queue.cc:260] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.737393 13519 tablet_bootstrap.cc:654] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.738559 13522 ts_tablet_manager.cc:1434] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:21.739575 13522 tablet_bootstrap.cc:492] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:21.729565 13520 ts_tablet_manager.cc:1403] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:20:21.743600 13520 raft_consensus.cc:359] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.744374 13520 raft_consensus.cc:385] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.744697 13520 raft_consensus.cc:740] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.745640 13520 consensus_queue.cc:260] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.748306 13520 ts_tablet_manager.cc:1434] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:21.748940 13524 raft_consensus.cc:493] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.749405 13522 tablet_bootstrap.cc:654] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.749527 13524 raft_consensus.cc:515] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.749423 13520 tablet_bootstrap.cc:492] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:21.759471 13519 tablet_bootstrap.cc:492] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:21.759879 13524 leader_election.cc:290] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:21.760176 13519 ts_tablet_manager.cc:1403] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.016s
I20260709 13:20:21.764417 13519 raft_consensus.cc:359] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } }
I20260709 13:20:21.760175 13520 tablet_bootstrap.cc:654] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.765857 13519 raft_consensus.cc:385] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.769809 13519 raft_consensus.cc:740] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.770994 13519 consensus_queue.cc:260] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } }
I20260709 13:20:21.774197 13519 ts_tablet_manager.cc:1434] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:20:21.775887 13519 tablet_bootstrap.cc:492] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:21.778924 13522 tablet_bootstrap.cc:492] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:21.779663 13522 ts_tablet_manager.cc:1403] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.010s
I20260709 13:20:21.782750 13522 raft_consensus.cc:359] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } }
I20260709 13:20:21.783504 13522 raft_consensus.cc:385] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.783797 13522 raft_consensus.cc:740] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.784857 13519 tablet_bootstrap.cc:654] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.787827 13522 consensus_queue.cc:260] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } }
I20260709 13:20:21.790339 13522 ts_tablet_manager.cc:1434] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:20:21.797339 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274bd992d2474f4a97baf74cd6c15f60" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" is_pre_election: true
I20260709 13:20:21.798028 13405 raft_consensus.cc:2468] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 0.
I20260709 13:20:21.799090 13520 tablet_bootstrap.cc:492] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:21.799839 13520 ts_tablet_manager.cc:1403] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.007s
I20260709 13:20:21.801894 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274bd992d2474f4a97baf74cd6c15f60" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
I20260709 13:20:21.802702 13330 raft_consensus.cc:2468] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 0.
I20260709 13:20:21.803821 13520 raft_consensus.cc:359] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.804831 13520 raft_consensus.cc:385] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.805130 13520 raft_consensus.cc:740] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.804147 13522 tablet_bootstrap.cc:492] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:21.805886 13520 consensus_queue.cc:260] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.806630 13445 leader_election.cc:304] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:21.807189 13519 tablet_bootstrap.cc:492] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:21.807783 13519 ts_tablet_manager.cc:1403] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.032s	user 0.024s	sys 0.003s
I20260709 13:20:21.807690 13524 raft_consensus.cc:2804] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.808350 13524 raft_consensus.cc:493] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.808722 13524 raft_consensus.cc:3060] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.811167 13519 raft_consensus.cc:359] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.812026 13519 raft_consensus.cc:385] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.812430 13519 raft_consensus.cc:740] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.812117 13522 tablet_bootstrap.cc:654] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.813392 13519 consensus_queue.cc:260] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.815322 13520 ts_tablet_manager.cc:1434] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:20:21.819005 13520 tablet_bootstrap.cc:492] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:21.817683 13526 raft_consensus.cc:493] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.825750 13526 raft_consensus.cc:515] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } }
I20260709 13:20:21.827414 13520 tablet_bootstrap.cc:654] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.829105 13522 tablet_bootstrap.cc:492] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:21.829766 13522 ts_tablet_manager.cc:1403] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.002s
I20260709 13:20:21.833456 13522 raft_consensus.cc:359] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.834632 13522 raft_consensus.cc:385] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.835021 13522 raft_consensus.cc:740] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.837575 13526 leader_election.cc:290] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:21.841365 13522 consensus_queue.cc:260] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.844223 13522 ts_tablet_manager.cc:1434] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:20:21.845647 13522 tablet_bootstrap.cc:492] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:21.817657 13524 raft_consensus.cc:515] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.858551 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274bd992d2474f4a97baf74cd6c15f60" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:21.859416 13330 raft_consensus.cc:3060] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.858552 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274bd992d2474f4a97baf74cd6c15f60" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:21.861989 13405 raft_consensus.cc:3060] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.866707 13522 tablet_bootstrap.cc:654] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.871490 13524 leader_election.cc:290] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:21.875084 13524 raft_consensus.cc:493] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.875602 13524 raft_consensus.cc:515] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.879201 13405 raft_consensus.cc:2468] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 1.
I20260709 13:20:21.876742 13330 raft_consensus.cc:2468] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 1.
I20260709 13:20:21.884675 13445 leader_election.cc:304] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:21.886436 13522 tablet_bootstrap.cc:492] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:21.886991 13522 ts_tablet_manager.cc:1403] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.000s
I20260709 13:20:21.890960 13522 raft_consensus.cc:359] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.891883 13522 raft_consensus.cc:385] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.892256 13522 raft_consensus.cc:740] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.899070 13524 leader_election.cc:290] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:21.899978 13524 raft_consensus.cc:2804] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.900348 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9270b20602874b468e7a2e81aa8a7634" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
I20260709 13:20:21.900949 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9270b20602874b468e7a2e81aa8a7634" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" is_pre_election: true
I20260709 13:20:21.901146 13330 raft_consensus.cc:2468] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 0.
I20260709 13:20:21.901850 13405 raft_consensus.cc:2468] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 0.
I20260709 13:20:21.900900 13522 consensus_queue.cc:260] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.902710 13445 leader_election.cc:304] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:21.900413 13524 raft_consensus.cc:697] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Becoming Leader. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:21.905418 13524 consensus_queue.cc:237] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.904297 13522 ts_tablet_manager.cc:1434] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:20:21.907400 13522 tablet_bootstrap.cc:492] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:21.912426 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77725ae01e740148beb2ff3260cabc9" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
W20260709 13:20:21.914633 13371 leader_election.cc:343] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.922055 13522 tablet_bootstrap.cc:654] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.930266 13536 raft_consensus.cc:2804] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.930955 13536 raft_consensus.cc:493] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.931281 13519 ts_tablet_manager.cc:1434] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.123s	user 0.026s	sys 0.046s
I20260709 13:20:21.931411 13536 raft_consensus.cc:3060] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.933262 13519 tablet_bootstrap.cc:492] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:21.934463 13526 raft_consensus.cc:493] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.935081 13526 raft_consensus.cc:515] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.936124 13520 tablet_bootstrap.cc:492] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:21.936713 13520 ts_tablet_manager.cc:1403] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.118s	user 0.034s	sys 0.034s
I20260709 13:20:21.937064 13479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77725ae01e740148beb2ff3260cabc9" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
I20260709 13:20:21.937821 13479 raft_consensus.cc:2468] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 0.
I20260709 13:20:21.937275 13526 leader_election.cc:290] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:21.938714 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a92e3bed61c42038559ef6437c26524" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
I20260709 13:20:21.939244 13370 leader_election.cc:304] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: cc1ec065bcaa4dcaa2ec70061c146122
W20260709 13:20:21.940117 13371 leader_election.cc:343] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.940574 13526 raft_consensus.cc:2804] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.940194 13520 raft_consensus.cc:359] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } }
I20260709 13:20:21.941103 13526 raft_consensus.cc:493] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.941184 13520 raft_consensus.cc:385] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.941634 13526 raft_consensus.cc:3060] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.941677 13520 raft_consensus.cc:740] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.944239 13520 consensus_queue.cc:260] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } }
I20260709 13:20:21.944690 13536 raft_consensus.cc:515] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.947355 13519 tablet_bootstrap.cc:654] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.947508 13536 leader_election.cc:290] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:21.948663 13479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a92e3bed61c42038559ef6437c26524" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
W20260709 13:20:21.950340 13370 leader_election.cc:343] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.950860 13370 leader_election.cc:304] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce954fb530b1486ab6d791f2ce7de4e3; no voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122
I20260709 13:20:21.951363 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9270b20602874b468e7a2e81aa8a7634" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:21.951995 13330 raft_consensus.cc:3060] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.952070 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9270b20602874b468e7a2e81aa8a7634" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:21.952678 13405 raft_consensus.cc:3060] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.954594 13520 ts_tablet_manager.cc:1434] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 13:20:21.955734 13520 tablet_bootstrap.cc:492] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:21.960131 13330 raft_consensus.cc:2468] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 1.
I20260709 13:20:21.963552 13520 tablet_bootstrap.cc:654] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.964798 13445 leader_election.cc:304] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:21.965894 13524 raft_consensus.cc:2804] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.966457 13524 raft_consensus.cc:697] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Becoming Leader. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:21.969501 13524 consensus_queue.cc:237] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.968150 13405 raft_consensus.cc:2468] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 1.
I20260709 13:20:21.976399 13522 tablet_bootstrap.cc:492] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:21.977317 13522 ts_tablet_manager.cc:1403] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.000s
W20260709 13:20:21.979295 13276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:21.979821 13529 raft_consensus.cc:493] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.980346 13529 raft_consensus.cc:515] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.981639 13522 raft_consensus.cc:359] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.980742 13228 catalog_manager.cc:5697] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:21.982463 13522 raft_consensus.cc:385] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.982954 13522 raft_consensus.cc:740] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.983886 13522 consensus_queue.cc:260] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.989283 13536 raft_consensus.cc:493] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.990123 13536 raft_consensus.cc:515] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:21.990787 13529 leader_election.cc:290] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:21.993468 13536 leader_election.cc:290] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:21.994268 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f66ce72872a4a239fd486c1163436f8" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
I20260709 13:20:21.995172 13330 raft_consensus.cc:2468] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 0.
I20260709 13:20:22.000746 13445 leader_election.cc:304] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:22.002089 13536 raft_consensus.cc:2804] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:22.002655 13536 raft_consensus.cc:493] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.003149 13536 raft_consensus.cc:3060] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.005393 13519 tablet_bootstrap.cc:492] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:22.005990 13519 ts_tablet_manager.cc:1403] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.073s	user 0.023s	sys 0.008s
I20260709 13:20:22.006090 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f66ce72872a4a239fd486c1163436f8" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" is_pre_election: true
I20260709 13:20:22.013495 13405 raft_consensus.cc:2468] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 0.
I20260709 13:20:22.016939 13522 ts_tablet_manager.cc:1434] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.004s
I20260709 13:20:22.019196 13522 tablet_bootstrap.cc:492] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:22.002302 13546 raft_consensus.cc:2749] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:20:22.017797 13370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.67:33517, user_credentials={real_user=slave}} blocked reactor thread for 67491.5us
I20260709 13:20:22.024267 13536 raft_consensus.cc:515] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.028075 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f66ce72872a4a239fd486c1163436f8" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:22.028757 13330 raft_consensus.cc:3060] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.029682 13526 raft_consensus.cc:515] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } }
I20260709 13:20:22.034125 13526 leader_election.cc:290] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.034355 13479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77725ae01e740148beb2ff3260cabc9" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:22.034562 13329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77725ae01e740148beb2ff3260cabc9" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:22.035192 13479 raft_consensus.cc:3060] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.035346 13329 raft_consensus.cc:3060] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.037981 13520 tablet_bootstrap.cc:492] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:22.038599 13520 ts_tablet_manager.cc:1403] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.083s	user 0.025s	sys 0.053s
I20260709 13:20:22.042501 13520 raft_consensus.cc:359] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.043351 13520 raft_consensus.cc:385] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.042996 13519 raft_consensus.cc:359] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.043731 13520 raft_consensus.cc:740] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.044750 13520 consensus_queue.cc:260] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.047099 13330 raft_consensus.cc:2468] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 1.
I20260709 13:20:22.047392 13520 ts_tablet_manager.cc:1434] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:22.055130 13520 tablet_bootstrap.cc:492] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:22.056810 13478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f66ce72872a4a239fd486c1163436f8" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
I20260709 13:20:22.050628 13329 raft_consensus.cc:2468] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 1.
I20260709 13:20:22.052909 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f66ce72872a4a239fd486c1163436f8" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:22.053514 13479 raft_consensus.cc:2468] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 1.
I20260709 13:20:22.057798 13405 raft_consensus.cc:3060] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.057902 13478 raft_consensus.cc:2393] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc1ec065bcaa4dcaa2ec70061c146122 in current term 1: Already voted for candidate 7e10c77aaefa4ca282e71044a2c0f759 in this term.
I20260709 13:20:22.058991 13370 leader_election.cc:304] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:22.053836 13536 leader_election.cc:290] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:22.054960 13445 leader_election.cc:304] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:22.059806 13526 raft_consensus.cc:2804] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:22.060371 13526 raft_consensus.cc:697] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Becoming Leader. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:22.061460 13526 consensus_queue.cc:237] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } }
I20260709 13:20:22.051023 13522 tablet_bootstrap.cc:654] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:22.060426 13536 raft_consensus.cc:2804] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:22.065984 13405 raft_consensus.cc:2468] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 1.
I20260709 13:20:22.066330 13536 raft_consensus.cc:697] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Becoming Leader. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:22.043855 13519 raft_consensus.cc:385] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.067358 13536 consensus_queue.cc:237] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.068877 13404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f66ce72872a4a239fd486c1163436f8" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" is_pre_election: true
I20260709 13:20:22.069861 13404 raft_consensus.cc:2393] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc1ec065bcaa4dcaa2ec70061c146122 in current term 1: Already voted for candidate 7e10c77aaefa4ca282e71044a2c0f759 in this term.
I20260709 13:20:22.072871 13520 tablet_bootstrap.cc:654] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:22.072893 13296 leader_election.cc:304] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122; no voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3
I20260709 13:20:22.074448 13529 raft_consensus.cc:2749] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:22.067396 13519 raft_consensus.cc:740] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.071286 13228 catalog_manager.cc:5697] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:22.086337 13227 catalog_manager.cc:5697] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:22.095803 13519 consensus_queue.cc:260] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.098555 13519 ts_tablet_manager.cc:1434] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.002s
I20260709 13:20:22.099718 13519 tablet_bootstrap.cc:492] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:22.110594 13522 tablet_bootstrap.cc:492] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:22.111521 13522 ts_tablet_manager.cc:1403] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.093s	user 0.019s	sys 0.018s
I20260709 13:20:22.115195 13522 raft_consensus.cc:359] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.115971 13522 raft_consensus.cc:385] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.116256 13522 raft_consensus.cc:740] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.116976 13522 consensus_queue.cc:260] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.118655 13519 tablet_bootstrap.cc:654] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:22.119422 13520 tablet_bootstrap.cc:492] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:22.119953 13520 ts_tablet_manager.cc:1403] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.005s
I20260709 13:20:22.120828 13228 catalog_manager.cc:5697] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:22.123142 13520 raft_consensus.cc:359] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.123911 13520 raft_consensus.cc:385] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.124209 13520 raft_consensus.cc:740] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.124934 13520 consensus_queue.cc:260] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.126458 13522 ts_tablet_manager.cc:1434] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:20:22.127216 13520 ts_tablet_manager.cc:1434] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:22.128830 13520 tablet_bootstrap.cc:492] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:22.135821 13520 tablet_bootstrap.cc:654] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:22.138408 13522 tablet_bootstrap.cc:492] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:22.141369 13520 tablet_bootstrap.cc:492] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:22.141909 13520 ts_tablet_manager.cc:1403] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:20:22.142416 13519 tablet_bootstrap.cc:492] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:22.142942 13519 ts_tablet_manager.cc:1403] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.006s
I20260709 13:20:22.144536 13520 raft_consensus.cc:359] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.145159 13520 raft_consensus.cc:385] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.145453 13520 raft_consensus.cc:740] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.146010 13519 raft_consensus.cc:359] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.146209 13520 consensus_queue.cc:260] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.146806 13519 raft_consensus.cc:385] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.147148 13519 raft_consensus.cc:740] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.148087 13520 ts_tablet_manager.cc:1434] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:22.148936 13520 tablet_bootstrap.cc:492] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:22.152452 13522 tablet_bootstrap.cc:654] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:22.153439 13519 consensus_queue.cc:260] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.154516 13520 tablet_bootstrap.cc:654] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:22.156112 13519 ts_tablet_manager.cc:1434] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:20:22.157251 13519 tablet_bootstrap.cc:492] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:22.161379 13520 tablet_bootstrap.cc:492] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:22.162067 13520 ts_tablet_manager.cc:1403] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:20:22.164258 13519 tablet_bootstrap.cc:654] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:22.165899 13520 raft_consensus.cc:359] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.167021 13520 raft_consensus.cc:385] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.167398 13520 raft_consensus.cc:740] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.168510 13520 consensus_queue.cc:260] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.172888 13520 ts_tablet_manager.cc:1434] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:20:22.173947 13520 tablet_bootstrap.cc:492] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:22.173959 13522 tablet_bootstrap.cc:492] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:22.174638 13522 ts_tablet_manager.cc:1403] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.015s
I20260709 13:20:22.176546 13519 tablet_bootstrap.cc:492] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:22.177158 13519 ts_tablet_manager.cc:1403] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 13:20:22.177651 13522 raft_consensus.cc:359] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.178654 13522 raft_consensus.cc:385] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.178928 13522 raft_consensus.cc:740] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.179701 13522 consensus_queue.cc:260] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.181371 13520 tablet_bootstrap.cc:654] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:22.180955 13519 raft_consensus.cc:359] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.181885 13519 raft_consensus.cc:385] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.182266 13519 raft_consensus.cc:740] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.183425 13519 consensus_queue.cc:260] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.188277 13522 ts_tablet_manager.cc:1434] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:20:22.189311 13522 tablet_bootstrap.cc:492] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:22.192816 13519 ts_tablet_manager.cc:1434] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:20:22.195274 13522 tablet_bootstrap.cc:654] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:22.196741 13519 tablet_bootstrap.cc:492] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:22.206388 13519 tablet_bootstrap.cc:654] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:22.207011 13522 tablet_bootstrap.cc:492] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:22.207576 13522 ts_tablet_manager.cc:1403] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:20:22.208343 13520 tablet_bootstrap.cc:492] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:22.208945 13520 ts_tablet_manager.cc:1403] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.022s
I20260709 13:20:22.210683 13522 raft_consensus.cc:359] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.211649 13522 raft_consensus.cc:385] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.211786 13520 raft_consensus.cc:359] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.212024 13522 raft_consensus.cc:740] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.212543 13520 raft_consensus.cc:385] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.212858 13520 raft_consensus.cc:740] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.213505 13520 consensus_queue.cc:260] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.213248 13522 consensus_queue.cc:260] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.215705 13520 ts_tablet_manager.cc:1434] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:22.218371 13522 ts_tablet_manager.cc:1434] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:20:22.219075 13519 tablet_bootstrap.cc:492] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:22.219586 13519 ts_tablet_manager.cc:1403] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.013s
I20260709 13:20:22.222599 13519 raft_consensus.cc:359] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.223266 13519 raft_consensus.cc:385] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.223506 13519 raft_consensus.cc:740] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.224217 13519 consensus_queue.cc:260] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.226490 13519 ts_tablet_manager.cc:1434] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:22.227536 13519 tablet_bootstrap.cc:492] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:22.233421 13519 tablet_bootstrap.cc:654] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:22.237614 13519 tablet_bootstrap.cc:492] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:22.238056 13519 ts_tablet_manager.cc:1403] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:20:22.240288 13519 raft_consensus.cc:359] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.240835 13519 raft_consensus.cc:385] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.241117 13519 raft_consensus.cc:740] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.241703 13519 consensus_queue.cc:260] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.243227 13519 ts_tablet_manager.cc:1434] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:22.278879 13526 raft_consensus.cc:493] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.279645 13526 raft_consensus.cc:515] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.281586 13526 leader_election.cc:290] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.282256 13329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc56481aa6146eda2ef7d0202cb3e18" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
I20260709 13:20:22.282542 13478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc56481aa6146eda2ef7d0202cb3e18" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
I20260709 13:20:22.282944 13329 raft_consensus.cc:2468] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 0.
I20260709 13:20:22.283321 13478 raft_consensus.cc:2468] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 0.
I20260709 13:20:22.283895 13371 leader_election.cc:304] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:22.284848 13526 raft_consensus.cc:2804] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:22.285442 13526 raft_consensus.cc:493] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.285838 13526 raft_consensus.cc:3060] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.291476 13526 raft_consensus.cc:515] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.293931 13526 leader_election.cc:290] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.294692 13329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc56481aa6146eda2ef7d0202cb3e18" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:22.294975 13478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc56481aa6146eda2ef7d0202cb3e18" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:22.295279 13329 raft_consensus.cc:3060] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.295655 13478 raft_consensus.cc:3060] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.300467 13329 raft_consensus.cc:2468] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 1.
I20260709 13:20:22.301568 13371 leader_election.cc:304] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:22.301699 13478 raft_consensus.cc:2468] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 1.
I20260709 13:20:22.302284 13526 raft_consensus.cc:2804] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:22.302762 13526 raft_consensus.cc:697] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Becoming Leader. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:22.303593 13526 consensus_queue.cc:237] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.310850 13226 catalog_manager.cc:5697] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.337273 13529 raft_consensus.cc:493] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.337821 13529 raft_consensus.cc:515] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.339552 13529 leader_election.cc:290] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.340396 13404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a92e3bed61c42038559ef6437c26524" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" is_pre_election: true
I20260709 13:20:22.340617 13478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a92e3bed61c42038559ef6437c26524" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
I20260709 13:20:22.341038 13404 raft_consensus.cc:2468] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 0.
I20260709 13:20:22.341251 13478 raft_consensus.cc:2468] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 0.
I20260709 13:20:22.342176 13296 leader_election.cc:304] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:22.342861 13529 raft_consensus.cc:2804] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:22.343276 13529 raft_consensus.cc:493] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.343549 13529 raft_consensus.cc:3060] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.348743 13529 raft_consensus.cc:515] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.350507 13529 leader_election.cc:290] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 election: Requested vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.351567 13478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a92e3bed61c42038559ef6437c26524" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:22.351486 13404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a92e3bed61c42038559ef6437c26524" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:22.352391 13478 raft_consensus.cc:3060] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.352437 13404 raft_consensus.cc:3060] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.360534 13478 raft_consensus.cc:2468] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 1.
I20260709 13:20:22.360528 13404 raft_consensus.cc:2468] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 1.
I20260709 13:20:22.362058 13296 leader_election.cc:304] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:22.362924 13529 raft_consensus.cc:2804] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:22.363875 13529 raft_consensus.cc:697] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Becoming Leader. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:22.364643 13529 consensus_queue.cc:237] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.366742 13570 raft_consensus.cc:493] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.367355 13570 raft_consensus.cc:515] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.370256 13570 leader_election.cc:290] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.371091 13404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b4d9d0e7894d3fb39494067103dcfa" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" is_pre_election: true
I20260709 13:20:22.371672 13478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b4d9d0e7894d3fb39494067103dcfa" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
I20260709 13:20:22.371865 13404 raft_consensus.cc:2468] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 0.
I20260709 13:20:22.372406 13478 raft_consensus.cc:2468] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 0.
I20260709 13:20:22.373662 13226 catalog_manager.cc:5697] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.374125 13295 leader_election.cc:304] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:22.375190 13570 raft_consensus.cc:2804] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:22.375560 13570 raft_consensus.cc:493] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.375912 13570 raft_consensus.cc:3060] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.382261 13570 raft_consensus.cc:515] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.384007 13570 leader_election.cc:290] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 election: Requested vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.384874 13404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b4d9d0e7894d3fb39494067103dcfa" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:22.385149 13478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b4d9d0e7894d3fb39494067103dcfa" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:22.385716 13404 raft_consensus.cc:3060] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.385807 13478 raft_consensus.cc:3060] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.390997 13478 raft_consensus.cc:2468] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 1.
I20260709 13:20:22.391345 13404 raft_consensus.cc:2468] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 1.
I20260709 13:20:22.391996 13295 leader_election.cc:304] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:22.392979 13570 raft_consensus.cc:2804] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:22.393564 13570 raft_consensus.cc:697] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Becoming Leader. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:22.394585 13570 consensus_queue.cc:237] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.406308 13536 consensus_queue.cc:1048] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.407303 13226 catalog_manager.cc:5697] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.419286 13536 consensus_queue.cc:1048] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.455508 13526 raft_consensus.cc:493] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.456111 13526 raft_consensus.cc:515] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.458069 13526 leader_election.cc:290] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.459054 13329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c9aeccadd4498da1f0e880c9b63864" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
I20260709 13:20:22.459318 13478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c9aeccadd4498da1f0e880c9b63864" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
I20260709 13:20:22.459677 13329 raft_consensus.cc:2468] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 0.
I20260709 13:20:22.460033 13478 raft_consensus.cc:2468] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 0.
I20260709 13:20:22.460830 13371 leader_election.cc:304] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:22.461772 13526 raft_consensus.cc:2804] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:22.462237 13526 raft_consensus.cc:493] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.462631 13526 raft_consensus.cc:3060] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.467613 13546 consensus_queue.cc:1048] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.468122 13536 consensus_queue.cc:1048] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.469966 13526 raft_consensus.cc:515] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.473409 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c9aeccadd4498da1f0e880c9b63864" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:22.474268 13330 raft_consensus.cc:3060] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.482400 13580 consensus_queue.cc:1048] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.482673 13570 raft_consensus.cc:493] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.483544 13570 raft_consensus.cc:515] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.487303 13570 leader_election.cc:290] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.487326 13404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5df601bbb544e56bf2bab6b83e6eefa" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" is_pre_election: true
I20260709 13:20:22.488169 13404 raft_consensus.cc:2468] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 0.
I20260709 13:20:22.488427 13478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5df601bbb544e56bf2bab6b83e6eefa" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
I20260709 13:20:22.489173 13478 raft_consensus.cc:2468] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 0.
I20260709 13:20:22.489409 13296 leader_election.cc:304] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:22.490299 13570 raft_consensus.cc:2804] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:22.490759 13570 raft_consensus.cc:493] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.491261 13570 raft_consensus.cc:3060] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.493834 13526 leader_election.cc:290] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.495095 13478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c9aeccadd4498da1f0e880c9b63864" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:22.495790 13330 raft_consensus.cc:2468] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 1.
I20260709 13:20:22.496549 13478 raft_consensus.cc:3060] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.506271 13478 raft_consensus.cc:2468] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 1.
I20260709 13:20:22.507586 13370 leader_election.cc:304] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:22.508460 13580 raft_consensus.cc:2804] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:22.509012 13580 raft_consensus.cc:697] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Becoming Leader. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:22.510025 13580 consensus_queue.cc:237] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.510439 13524 consensus_queue.cc:1048] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.511298 13570 raft_consensus.cc:515] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.514428 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5df601bbb544e56bf2bab6b83e6eefa" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:22.515080 13405 raft_consensus.cc:3060] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.525615 13405 raft_consensus.cc:2468] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 1.
I20260709 13:20:22.526211 13570 leader_election.cc:290] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 election: Requested vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.526877 13296 leader_election.cc:304] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:22.527799 13570 raft_consensus.cc:2804] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:22.528133 13478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5df601bbb544e56bf2bab6b83e6eefa" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:22.528702 13570 raft_consensus.cc:697] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Becoming Leader. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:22.528846 13478 raft_consensus.cc:3060] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.529874 13570 consensus_queue.cc:237] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.545063 13478 raft_consensus.cc:2468] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 1.
I20260709 13:20:22.547178 13524 consensus_queue.cc:1048] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.548321 13228 catalog_manager.cc:5697] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.565141 13226 catalog_manager.cc:5697] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.570132 13524 consensus_queue.cc:1048] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.599330 13404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e77725ae01e740148beb2ff3260cabc9"
dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
mode: GRACEFUL
new_leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
 from {username='slave'} at 127.0.0.1:37482
I20260709 13:20:22.599949 13404 raft_consensus.cc:606] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Received request to transfer leadership to TS cc1ec065bcaa4dcaa2ec70061c146122
I20260709 13:20:22.615214 13478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "274bd992d2474f4a97baf74cd6c15f60"
dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
mode: GRACEFUL
new_leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
 from {username='slave'} at 127.0.0.1:50502
I20260709 13:20:22.615821 13478 raft_consensus.cc:606] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Received request to transfer leadership to TS cc1ec065bcaa4dcaa2ec70061c146122
I20260709 13:20:22.621739 13478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f66ce72872a4a239fd486c1163436f8"
dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
mode: GRACEFUL
new_leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
 from {username='slave'} at 127.0.0.1:50502
I20260709 13:20:22.622337 13478 raft_consensus.cc:606] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Received request to transfer leadership to TS cc1ec065bcaa4dcaa2ec70061c146122
I20260709 13:20:22.628561 13404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dc56481aa6146eda2ef7d0202cb3e18"
dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
mode: GRACEFUL
new_leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
 from {username='slave'} at 127.0.0.1:37482
I20260709 13:20:22.629323 13404 raft_consensus.cc:606] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Received request to transfer leadership to TS cc1ec065bcaa4dcaa2ec70061c146122
I20260709 13:20:22.634733 13478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9270b20602874b468e7a2e81aa8a7634"
dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
mode: GRACEFUL
new_leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
 from {username='slave'} at 127.0.0.1:50502
I20260709 13:20:22.635295 13478 raft_consensus.cc:606] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Received request to transfer leadership to TS ce954fb530b1486ab6d791f2ce7de4e3
I20260709 13:20:22.650007 13329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a92e3bed61c42038559ef6437c26524"
dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
mode: GRACEFUL
new_leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
 from {username='slave'} at 127.0.0.1:39344
I20260709 13:20:22.650553 13329 raft_consensus.cc:606] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Received request to transfer leadership to TS ce954fb530b1486ab6d791f2ce7de4e3
I20260709 13:20:22.657157 13329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5df601bbb544e56bf2bab6b83e6eefa"
dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
mode: GRACEFUL
new_leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
 from {username='slave'} at 127.0.0.1:39344
I20260709 13:20:22.657706 13329 raft_consensus.cc:606] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Received request to transfer leadership to TS ce954fb530b1486ab6d791f2ce7de4e3
I20260709 13:20:22.663502 13329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3b4d9d0e7894d3fb39494067103dcfa"
dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
mode: GRACEFUL
new_leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
 from {username='slave'} at 127.0.0.1:39344
I20260709 13:20:22.664013 13329 raft_consensus.cc:606] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Received request to transfer leadership to TS ce954fb530b1486ab6d791f2ce7de4e3
I20260709 13:20:22.669486 13404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92c9aeccadd4498da1f0e880c9b63864"
dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
mode: GRACEFUL
new_leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
 from {username='slave'} at 127.0.0.1:37482
I20260709 13:20:22.670040 13404 raft_consensus.cc:606] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Received request to transfer leadership to TS 7e10c77aaefa4ca282e71044a2c0f759
I20260709 13:20:22.753041 13580 consensus_queue.cc:1048] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.761416 13549 raft_consensus.cc:993] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3: : Instructing follower cc1ec065bcaa4dcaa2ec70061c146122 to start an election
I20260709 13:20:22.762001 13526 raft_consensus.cc:1081] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Signalling peer cc1ec065bcaa4dcaa2ec70061c146122 to start an election
I20260709 13:20:22.763845 13330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dc56481aa6146eda2ef7d0202cb3e18"
dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
 from {username='slave'} at 127.0.0.1:39334
I20260709 13:20:22.764964 13330 raft_consensus.cc:493] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:22.765436 13330 raft_consensus.cc:3060] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.768256 13580 consensus_queue.cc:1048] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.773993 13330 raft_consensus.cc:515] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.776460 13330 leader_election.cc:290] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 2 election: Requested vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.778651 13478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc56481aa6146eda2ef7d0202cb3e18" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:22.778908 13404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc56481aa6146eda2ef7d0202cb3e18" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:22.779419 13478 raft_consensus.cc:3060] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.779531 13404 raft_consensus.cc:3055] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:22.779969 13404 raft_consensus.cc:740] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:22.780866 13404 consensus_queue.cc:260] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.782302 13404 raft_consensus.cc:3060] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.787940 13478 raft_consensus.cc:2468] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 2.
I20260709 13:20:22.789358 13295 leader_election.cc:304] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:22.790309 13570 raft_consensus.cc:2804] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:22.790854 13570 raft_consensus.cc:697] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Becoming Leader. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:22.791109 13404 raft_consensus.cc:2468] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 2.
I20260709 13:20:22.791793 13570 consensus_queue.cc:237] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.799211 13227 catalog_manager.cc:5697] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 reported cstate change: term changed from 1 to 2, leader changed from ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66) to cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.846261 13570 consensus_queue.cc:1048] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.853482 13529 raft_consensus.cc:993] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122: : Instructing follower ce954fb530b1486ab6d791f2ce7de4e3 to start an election
I20260709 13:20:22.855552 13529 raft_consensus.cc:1081] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Signalling peer ce954fb530b1486ab6d791f2ce7de4e3 to start an election
I20260709 13:20:22.858744 13404 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a92e3bed61c42038559ef6437c26524"
dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
 from {username='slave'} at 127.0.0.1:37468
I20260709 13:20:22.859565 13404 raft_consensus.cc:493] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:22.860008 13404 raft_consensus.cc:3060] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.861829 13529 consensus_queue.cc:1048] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.868779 13404 raft_consensus.cc:515] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.871848 13404 leader_election.cc:290] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 2 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.872040 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a92e3bed61c42038559ef6437c26524" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:22.872772 13330 raft_consensus.cc:3055] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:22.873158 13330 raft_consensus.cc:740] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:22.873217 13478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a92e3bed61c42038559ef6437c26524" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:22.873901 13478 raft_consensus.cc:3060] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.874133 13330 consensus_queue.cc:260] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.875680 13330 raft_consensus.cc:3060] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.877717 13594 consensus_queue.cc:1048] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.882611 13478 raft_consensus.cc:2468] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 2.
I20260709 13:20:22.884002 13330 raft_consensus.cc:2468] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 2.
I20260709 13:20:22.887439 13536 raft_consensus.cc:993] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759: : Instructing follower ce954fb530b1486ab6d791f2ce7de4e3 to start an election
I20260709 13:20:22.887976 13536 raft_consensus.cc:1081] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Signalling peer ce954fb530b1486ab6d791f2ce7de4e3 to start an election
I20260709 13:20:22.888780 13370 leader_election.cc:304] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:22.890110 13404 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9270b20602874b468e7a2e81aa8a7634"
dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
 from {username='slave'} at 127.0.0.1:37464
I20260709 13:20:22.890515 13580 raft_consensus.cc:2804] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:22.890784 13404 raft_consensus.cc:493] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:22.891368 13404 raft_consensus.cc:3060] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.891314 13580 raft_consensus.cc:697] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 LEADER]: Becoming Leader. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:22.892804 13580 consensus_queue.cc:237] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.900229 13404 raft_consensus.cc:515] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.903358 13404 leader_election.cc:290] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 2 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.908226 13329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9270b20602874b468e7a2e81aa8a7634" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:22.908967 13329 raft_consensus.cc:3060] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.910852 13479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9270b20602874b468e7a2e81aa8a7634" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:22.911549 13479 raft_consensus.cc:3055] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:22.911877 13479 raft_consensus.cc:740] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:22.913199 13479 consensus_queue.cc:260] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.917831 13479 raft_consensus.cc:3060] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.918812 13329 raft_consensus.cc:2468] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 2.
I20260709 13:20:22.918601 13570 consensus_queue.cc:1048] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.922832 13546 raft_consensus.cc:993] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3: : Instructing follower cc1ec065bcaa4dcaa2ec70061c146122 to start an election
I20260709 13:20:22.923395 13546 raft_consensus.cc:1081] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Signalling peer cc1ec065bcaa4dcaa2ec70061c146122 to start an election
I20260709 13:20:22.923333 13226 catalog_manager.cc:5697] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 reported cstate change: term changed from 1 to 2, leader changed from cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65) to ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.925810 13330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e77725ae01e740148beb2ff3260cabc9"
dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
 from {username='slave'} at 127.0.0.1:39334
I20260709 13:20:22.926196 13371 leader_election.cc:304] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:22.926432 13330 raft_consensus.cc:493] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:22.927699 13330 raft_consensus.cc:3060] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.930852 13479 raft_consensus.cc:2468] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 2.
I20260709 13:20:22.933101 13580 raft_consensus.cc:2804] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:22.933910 13580 raft_consensus.cc:697] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 LEADER]: Becoming Leader. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:22.934863 13580 consensus_queue.cc:237] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.935779 13330 raft_consensus.cc:515] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } }
I20260709 13:20:22.939451 13529 raft_consensus.cc:993] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122: : Instructing follower ce954fb530b1486ab6d791f2ce7de4e3 to start an election
I20260709 13:20:22.940004 13570 raft_consensus.cc:1081] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Signalling peer ce954fb530b1486ab6d791f2ce7de4e3 to start an election
I20260709 13:20:22.940277 13330 leader_election.cc:290] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 2 election: Requested vote from peers 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:22.940290 13479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77725ae01e740148beb2ff3260cabc9" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:22.941382 13479 raft_consensus.cc:3060] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.942694 13541 raft_consensus.cc:993] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759: : Instructing follower cc1ec065bcaa4dcaa2ec70061c146122 to start an election
I20260709 13:20:22.942926 13405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3b4d9d0e7894d3fb39494067103dcfa"
dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
 from {username='slave'} at 127.0.0.1:37468
I20260709 13:20:22.943241 13541 raft_consensus.cc:1081] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Signalling peer cc1ec065bcaa4dcaa2ec70061c146122 to start an election
I20260709 13:20:22.943646 13405 raft_consensus.cc:493] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:22.944106 13405 raft_consensus.cc:3060] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.945286 13329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "274bd992d2474f4a97baf74cd6c15f60"
dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
 from {username='slave'} at 127.0.0.1:39320
I20260709 13:20:22.945958 13329 raft_consensus.cc:493] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:22.946336 13329 raft_consensus.cc:3060] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.949645 13404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77725ae01e740148beb2ff3260cabc9" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:22.949990 13479 raft_consensus.cc:2468] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 2.
I20260709 13:20:22.950459 13404 raft_consensus.cc:3055] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:22.950870 13404 raft_consensus.cc:740] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:22.951395 13295 leader_election.cc:304] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:22.951685 13405 raft_consensus.cc:515] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.951903 13404 consensus_queue.cc:260] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } }
I20260709 13:20:22.952438 13570 raft_consensus.cc:2804] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:22.953100 13570 raft_consensus.cc:697] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Becoming Leader. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:22.953382 13404 raft_consensus.cc:3060] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.953994 13570 consensus_queue.cc:237] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } }
I20260709 13:20:22.954237 13329 raft_consensus.cc:515] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.956648 13329 leader_election.cc:290] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 2 election: Requested vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.958423 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274bd992d2474f4a97baf74cd6c15f60" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:22.958904 13478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274bd992d2474f4a97baf74cd6c15f60" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:22.959117 13403 raft_consensus.cc:3060] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.959625 13478 raft_consensus.cc:3055] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:22.960006 13478 raft_consensus.cc:740] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:22.961341 13405 leader_election.cc:290] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 2 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:22.960965 13478 consensus_queue.cc:260] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.962617 13478 raft_consensus.cc:3060] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.965600 13404 raft_consensus.cc:2468] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 2.
I20260709 13:20:22.966225 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b4d9d0e7894d3fb39494067103dcfa" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:22.966897 13477 raft_consensus.cc:3060] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.967953 13329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b4d9d0e7894d3fb39494067103dcfa" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:22.960538 13226 catalog_manager.cc:5697] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 reported cstate change: term changed from 1 to 2, leader changed from 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67) to ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.969798 13403 raft_consensus.cc:2468] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 2.
I20260709 13:20:22.970726 13478 raft_consensus.cc:2468] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 2.
I20260709 13:20:22.971148 13296 leader_election.cc:304] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:22.972211 13570 raft_consensus.cc:2804] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:22.968647 13329 raft_consensus.cc:3055] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:22.972738 13570 raft_consensus.cc:697] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Becoming Leader. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:22.972975 13329 raft_consensus.cc:740] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:22.973727 13570 consensus_queue.cc:237] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.973989 13329 consensus_queue.cc:260] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.975428 13329 raft_consensus.cc:3060] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.976075 13228 catalog_manager.cc:5697] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 reported cstate change: term changed from 1 to 2, leader changed from ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66) to cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.984081 13329 raft_consensus.cc:2468] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 2.
I20260709 13:20:22.985412 13371 leader_election.cc:304] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:22.986104 13477 raft_consensus.cc:2468] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 2.
I20260709 13:20:22.986287 13580 raft_consensus.cc:2804] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:22.986932 13580 raft_consensus.cc:697] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 LEADER]: Becoming Leader. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:22.987962 13580 consensus_queue.cc:237] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:22.996364 13226 catalog_manager.cc:5697] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 reported cstate change: term changed from 1 to 2, leader changed from cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65) to ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.996574 13228 catalog_manager.cc:5697] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 reported cstate change: term changed from 1 to 2, leader changed from 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67) to cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:23.010118 13570 consensus_queue.cc:1048] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:23.011044 13580 consensus_queue.cc:1048] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:23.030154 13594 consensus_queue.cc:1048] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:23.031477 13580 consensus_queue.cc:1048] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:23.038197 13541 raft_consensus.cc:993] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759: : Instructing follower cc1ec065bcaa4dcaa2ec70061c146122 to start an election
I20260709 13:20:23.038751 13541 raft_consensus.cc:1081] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Signalling peer cc1ec065bcaa4dcaa2ec70061c146122 to start an election
I20260709 13:20:23.041121 13329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f66ce72872a4a239fd486c1163436f8"
dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
 from {username='slave'} at 127.0.0.1:39320
I20260709 13:20:23.041762 13329 raft_consensus.cc:493] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:23.042207 13329 raft_consensus.cc:3060] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.045399 13546 raft_consensus.cc:993] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3: : Instructing follower 7e10c77aaefa4ca282e71044a2c0f759 to start an election
I20260709 13:20:23.045976 13546 raft_consensus.cc:1081] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Signalling peer 7e10c77aaefa4ca282e71044a2c0f759 to start an election
I20260709 13:20:23.048105 13477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92c9aeccadd4498da1f0e880c9b63864"
dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
 from {username='slave'} at 127.0.0.1:50476
I20260709 13:20:23.048782 13477 raft_consensus.cc:493] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:23.049276 13477 raft_consensus.cc:3060] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.050871 13329 raft_consensus.cc:515] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:23.053678 13594 raft_consensus.cc:993] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122: : Instructing follower ce954fb530b1486ab6d791f2ce7de4e3 to start an election
I20260709 13:20:23.054231 13594 raft_consensus.cc:1081] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Signalling peer ce954fb530b1486ab6d791f2ce7de4e3 to start an election
I20260709 13:20:23.054450 13478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f66ce72872a4a239fd486c1163436f8" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:23.055126 13478 raft_consensus.cc:3055] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:23.055478 13478 raft_consensus.cc:740] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:23.055990 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f66ce72872a4a239fd486c1163436f8" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:23.056413 13478 consensus_queue.cc:260] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:23.056804 13404 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5df601bbb544e56bf2bab6b83e6eefa"
dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
 from {username='slave'} at 127.0.0.1:37468
I20260709 13:20:23.057595 13404 raft_consensus.cc:493] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:23.057780 13478 raft_consensus.cc:3060] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.058017 13404 raft_consensus.cc:3060] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.058475 13329 leader_election.cc:290] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 2 election: Requested vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:23.060091 13403 raft_consensus.cc:3060] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.065698 13477 raft_consensus.cc:515] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:23.066931 13478 raft_consensus.cc:2468] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 2.
I20260709 13:20:23.068393 13403 raft_consensus.cc:2468] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 2.
I20260709 13:20:23.068466 13295 leader_election.cc:304] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:23.069583 13570 raft_consensus.cc:2804] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.070093 13570 raft_consensus.cc:697] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Becoming Leader. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:23.071082 13570 consensus_queue.cc:237] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:23.077683 13329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c9aeccadd4498da1f0e880c9b63864" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:23.078007 13477 leader_election.cc:290] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 2 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:23.078509 13329 raft_consensus.cc:3060] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.079037 13404 raft_consensus.cc:515] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:23.081677 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c9aeccadd4498da1f0e880c9b63864" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:23.082417 13403 raft_consensus.cc:3055] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:23.082666 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5df601bbb544e56bf2bab6b83e6eefa" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:23.082882 13403 raft_consensus.cc:740] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:23.083515 13330 raft_consensus.cc:3055] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:23.083925 13330 raft_consensus.cc:740] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:23.084316 13403 consensus_queue.cc:260] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:23.084775 13330 consensus_queue.cc:260] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:23.086004 13403 raft_consensus.cc:3060] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.086231 13330 raft_consensus.cc:3060] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.086988 13329 raft_consensus.cc:2468] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 2.
I20260709 13:20:23.088104 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5df601bbb544e56bf2bab6b83e6eefa" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:23.088335 13445 leader_election.cc:304] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:23.088790 13477 raft_consensus.cc:3060] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.089445 13536 raft_consensus.cc:2804] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.086252 13227 catalog_manager.cc:5697] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 reported cstate change: term changed from 1 to 2, leader changed from 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67) to cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:23.090031 13536 raft_consensus.cc:697] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 LEADER]: Becoming Leader. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:23.091733 13404 leader_election.cc:290] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 2 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:23.091919 13536 consensus_queue.cc:237] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:23.095109 13403 raft_consensus.cc:2468] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 2.
I20260709 13:20:23.100689 13477 raft_consensus.cc:2468] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 2.
I20260709 13:20:23.103379 13370 leader_election.cc:304] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:23.105290 13580 raft_consensus.cc:2804] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.104694 13228 catalog_manager.cc:5697] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 reported cstate change: term changed from 1 to 2, leader changed from ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66) to 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.105844 13580 raft_consensus.cc:697] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 LEADER]: Becoming Leader. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:23.106835 13580 consensus_queue.cc:237] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:23.111524 13330 raft_consensus.cc:2468] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 2.
I20260709 13:20:23.123112 13226 catalog_manager.cc:5697] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 reported cstate change: term changed from 1 to 2, leader changed from cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65) to ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:23.201604 13477 raft_consensus.cc:1275] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Refusing update from remote peer cc1ec065bcaa4dcaa2ec70061c146122: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.202945 13570 consensus_queue.cc:1048] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.211663 13403 raft_consensus.cc:1275] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Refusing update from remote peer cc1ec065bcaa4dcaa2ec70061c146122: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.213383 13594 consensus_queue.cc:1048] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.347775 13330 raft_consensus.cc:1275] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Refusing update from remote peer ce954fb530b1486ab6d791f2ce7de4e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.349216 13580 consensus_queue.cc:1048] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.357753 13478 raft_consensus.cc:1275] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Refusing update from remote peer ce954fb530b1486ab6d791f2ce7de4e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.357753 13477 raft_consensus.cc:1275] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Refusing update from remote peer cc1ec065bcaa4dcaa2ec70061c146122: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.359582 13546 consensus_queue.cc:1048] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.360684 13594 consensus_queue.cc:1048] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.366168 13479 raft_consensus.cc:1275] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Refusing update from remote peer cc1ec065bcaa4dcaa2ec70061c146122: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.367820 13594 consensus_queue.cc:1048] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.374840 13403 raft_consensus.cc:1275] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Refusing update from remote peer cc1ec065bcaa4dcaa2ec70061c146122: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.376327 13570 consensus_queue.cc:1048] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.380925 13404 raft_consensus.cc:1275] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Refusing update from remote peer cc1ec065bcaa4dcaa2ec70061c146122: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.382495 13594 consensus_queue.cc:1048] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.386675 13477 raft_consensus.cc:1275] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Refusing update from remote peer ce954fb530b1486ab6d791f2ce7de4e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.386902 13330 raft_consensus.cc:1275] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Refusing update from remote peer ce954fb530b1486ab6d791f2ce7de4e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.388573 13526 consensus_queue.cc:1048] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.389345 13549 consensus_queue.cc:1048] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.495975 13330 raft_consensus.cc:1275] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Refusing update from remote peer 7e10c77aaefa4ca282e71044a2c0f759: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.497586 13541 consensus_queue.cc:1048] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.506860 13403 raft_consensus.cc:1275] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Refusing update from remote peer 7e10c77aaefa4ca282e71044a2c0f759: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.508945 13604 consensus_queue.cc:1048] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:23.538136 13477 raft_consensus.cc:1275] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Refusing update from remote peer ce954fb530b1486ab6d791f2ce7de4e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.539585 13580 consensus_queue.cc:1048] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.548748 13330 raft_consensus.cc:1275] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Refusing update from remote peer ce954fb530b1486ab6d791f2ce7de4e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.550671 13477 raft_consensus.cc:1275] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Refusing update from remote peer cc1ec065bcaa4dcaa2ec70061c146122: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.551266 13580 consensus_queue.cc:1048] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.552851 13403 raft_consensus.cc:1275] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Refusing update from remote peer cc1ec065bcaa4dcaa2ec70061c146122: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.554011 13594 consensus_queue.cc:1048] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.554744 13570 consensus_queue.cc:1048] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.613319 13330 raft_consensus.cc:1275] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Refusing update from remote peer ce954fb530b1486ab6d791f2ce7de4e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.614842 13580 consensus_queue.cc:1048] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.623129 13477 raft_consensus.cc:1275] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Refusing update from remote peer ce954fb530b1486ab6d791f2ce7de4e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.625349 13580 consensus_queue.cc:1048] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:25.704890 13227 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49142:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:25.709257 13227 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:25.771981 13317 tablet_service.cc:1511] Processing CreateTablet for tablet d0b290df474a492db4a6f3f4fad3c6c7 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:25.773265 13393 tablet_service.cc:1511] Processing CreateTablet for tablet d0b290df474a492db4a6f3f4fad3c6c7 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:25.774032 13317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b290df474a492db4a6f3f4fad3c6c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.775286 13467 tablet_service.cc:1511] Processing CreateTablet for tablet d0b290df474a492db4a6f3f4fad3c6c7 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:25.777073 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b290df474a492db4a6f3f4fad3c6c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.782850 13469 tablet_service.cc:1511] Processing CreateTablet for tablet 63767942a864468b9b92f958327cd29e (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:25.786852 13468 tablet_service.cc:1511] Processing CreateTablet for tablet 64148c1248744360aac836cae6721a49 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:25.809274 13316 tablet_service.cc:1511] Processing CreateTablet for tablet 64148c1248744360aac836cae6721a49 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:25.810849 13316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64148c1248744360aac836cae6721a49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.810866 13469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63767942a864468b9b92f958327cd29e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.812168 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64148c1248744360aac836cae6721a49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.789744 13392 tablet_service.cc:1511] Processing CreateTablet for tablet 64148c1248744360aac836cae6721a49 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:25.798291 13465 tablet_service.cc:1511] Processing CreateTablet for tablet 3135b8a2b7fb4bf193c6cfbd59a61a46 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:25.819906 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3135b8a2b7fb4bf193c6cfbd59a61a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.800989 13391 tablet_service.cc:1511] Processing CreateTablet for tablet 3135b8a2b7fb4bf193c6cfbd59a61a46 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:25.792233 13319 tablet_service.cc:1511] Processing CreateTablet for tablet 63767942a864468b9b92f958327cd29e (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:25.821995 13319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63767942a864468b9b92f958327cd29e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.793742 13466 tablet_service.cc:1511] Processing CreateTablet for tablet 6a4a456b852a43cbaefa6af8ca085ac6 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:25.803900 13464 tablet_service.cc:1511] Processing CreateTablet for tablet 699587f5d5914572a41c3d5623876e89 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:25.794449 13390 tablet_service.cc:1511] Processing CreateTablet for tablet 6a4a456b852a43cbaefa6af8ca085ac6 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:25.777446 13393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b290df474a492db4a6f3f4fad3c6c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.826504 13392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64148c1248744360aac836cae6721a49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.807337 13463 tablet_service.cc:1511] Processing CreateTablet for tablet 3cf6e878e39844f7b4b2ab2f74f1af53 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:25.827724 13390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a4a456b852a43cbaefa6af8ca085ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.828258 13462 tablet_service.cc:1511] Processing CreateTablet for tablet 19cb4f740e82464a8c3f94974d85c467 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:25.829839 13391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3135b8a2b7fb4bf193c6cfbd59a61a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.835451 13461 tablet_service.cc:1511] Processing CreateTablet for tablet c1b39e10afea4f3aa6474ca5b12f5d4f (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:25.840714 13320 tablet_service.cc:1511] Processing CreateTablet for tablet 6a4a456b852a43cbaefa6af8ca085ac6 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:25.843166 13320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a4a456b852a43cbaefa6af8ca085ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.850951 13394 tablet_service.cc:1511] Processing CreateTablet for tablet 699587f5d5914572a41c3d5623876e89 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:25.852607 13394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 699587f5d5914572a41c3d5623876e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.853479 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a4a456b852a43cbaefa6af8ca085ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.854697 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19cb4f740e82464a8c3f94974d85c467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.855784 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cf6e878e39844f7b4b2ab2f74f1af53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.856197 13317 tablet_service.cc:1511] Processing CreateTablet for tablet 3135b8a2b7fb4bf193c6cfbd59a61a46 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:25.856922 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b39e10afea4f3aa6474ca5b12f5d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.857666 13317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3135b8a2b7fb4bf193c6cfbd59a61a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.858263 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 699587f5d5914572a41c3d5623876e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.808920 13618 tablet_bootstrap.cc:492] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:25.788780 13395 tablet_service.cc:1511] Processing CreateTablet for tablet 63767942a864468b9b92f958327cd29e (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:25.862295 13395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63767942a864468b9b92f958327cd29e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.865562 13318 tablet_service.cc:1511] Processing CreateTablet for tablet 699587f5d5914572a41c3d5623876e89 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:25.867149 13318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 699587f5d5914572a41c3d5623876e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.870448 13315 tablet_service.cc:1511] Processing CreateTablet for tablet 3cf6e878e39844f7b4b2ab2f74f1af53 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:25.872175 13315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cf6e878e39844f7b4b2ab2f74f1af53. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:20:25.910848 13215 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.1.250.65:40967, user_credentials={real_user=slave}} blocked reactor thread for 45623.5us
I20260709 13:20:25.911899 13314 tablet_service.cc:1511] Processing CreateTablet for tablet 19cb4f740e82464a8c3f94974d85c467 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:25.914515 13313 tablet_service.cc:1511] Processing CreateTablet for tablet c1b39e10afea4f3aa6474ca5b12f5d4f (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:25.915951 13313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b39e10afea4f3aa6474ca5b12f5d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.917982 13314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19cb4f740e82464a8c3f94974d85c467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.920398 13619 tablet_bootstrap.cc:492] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:25.928238 13619 tablet_bootstrap.cc:654] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:25.931865 13389 tablet_service.cc:1511] Processing CreateTablet for tablet 3cf6e878e39844f7b4b2ab2f74f1af53 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:25.933449 13389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cf6e878e39844f7b4b2ab2f74f1af53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.954957 13388 tablet_service.cc:1511] Processing CreateTablet for tablet 19cb4f740e82464a8c3f94974d85c467 (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:25.956733 13388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19cb4f740e82464a8c3f94974d85c467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.982666 13391 tablet_service.cc:1511] Processing CreateTablet for tablet c1b39e10afea4f3aa6474ca5b12f5d4f (DEFAULT_TABLE table=soft_deleted_table [id=0e15067884794d38a717f45522d45d22]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:25.986285 13391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b39e10afea4f3aa6474ca5b12f5d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.984733 13621 tablet_bootstrap.cc:492] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:26.003201 13621 tablet_bootstrap.cc:654] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.005533 13618 tablet_bootstrap.cc:654] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.028905 13621 tablet_bootstrap.cc:492] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:26.029850 13621 ts_tablet_manager.cc:1403] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.007s
W20260709 13:20:26.035599 13276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:26.039996 13619 tablet_bootstrap.cc:492] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:26.040584 13619 ts_tablet_manager.cc:1403] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.121s	user 0.043s	sys 0.043s
I20260709 13:20:26.041043 13621 raft_consensus.cc:359] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.042160 13621 raft_consensus.cc:385] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.042536 13621 raft_consensus.cc:740] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.043475 13621 consensus_queue.cc:260] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.043983 13619 raft_consensus.cc:359] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.044790 13619 raft_consensus.cc:385] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.045145 13619 raft_consensus.cc:740] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.046013 13619 consensus_queue.cc:260] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.046591 13621 ts_tablet_manager.cc:1434] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:20:26.047802 13621 tablet_bootstrap.cc:492] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:26.048668 13619 ts_tablet_manager.cc:1434] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:26.049732 13619 tablet_bootstrap.cc:492] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:26.082216 13621 tablet_bootstrap.cc:654] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.083916 13619 tablet_bootstrap.cc:654] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.085755 13618 tablet_bootstrap.cc:492] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:26.086655 13618 ts_tablet_manager.cc:1403] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.278s	user 0.016s	sys 0.003s
I20260709 13:20:26.101774 13618 raft_consensus.cc:359] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.108035 13618 raft_consensus.cc:385] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.108371 13618 raft_consensus.cc:740] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.109184 13618 consensus_queue.cc:260] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.122499 13618 ts_tablet_manager.cc:1434] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.036s	user 0.001s	sys 0.007s
I20260709 13:20:26.133517 13594 raft_consensus.cc:493] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.134152 13594 raft_consensus.cc:515] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.136516 13594 leader_election.cc:290] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:26.137003 13580 raft_consensus.cc:493] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.137535 13580 raft_consensus.cc:515] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.138413 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b290df474a492db4a6f3f4fad3c6c7" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" is_pre_election: true
I20260709 13:20:26.139853 13580 leader_election.cc:290] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:26.141022 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b290df474a492db4a6f3f4fad3c6c7" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
W20260709 13:20:26.143801 13296 leader_election.cc:343] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:26.144714 13295 leader_election.cc:343] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.145149 13295 leader_election.cc:304] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122; no voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3
I20260709 13:20:26.147034 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3135b8a2b7fb4bf193c6cfbd59a61a46" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
I20260709 13:20:26.148516 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3135b8a2b7fb4bf193c6cfbd59a61a46" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
W20260709 13:20:26.150311 13370 leader_election.cc:343] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.151262 13594 raft_consensus.cc:2749] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:20:26.151265 13371 leader_election.cc:343] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.152520 13371 leader_election.cc:304] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce954fb530b1486ab6d791f2ce7de4e3; no voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122
I20260709 13:20:26.153788 13580 raft_consensus.cc:2749] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:26.161739 13618 tablet_bootstrap.cc:492] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:26.173843 13618 tablet_bootstrap.cc:654] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.188721 13621 tablet_bootstrap.cc:492] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:26.189206 13619 tablet_bootstrap.cc:492] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:26.189544 13621 ts_tablet_manager.cc:1403] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.142s	user 0.041s	sys 0.059s
I20260709 13:20:26.189863 13619 ts_tablet_manager.cc:1403] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.140s	user 0.041s	sys 0.075s
I20260709 13:20:26.192466 13619 raft_consensus.cc:359] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.193043 13619 raft_consensus.cc:385] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.193351 13619 raft_consensus.cc:740] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.194166 13621 raft_consensus.cc:359] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.194237 13619 consensus_queue.cc:260] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.195241 13621 raft_consensus.cc:385] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.195639 13621 raft_consensus.cc:740] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.196409 13618 tablet_bootstrap.cc:492] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:26.197211 13618 ts_tablet_manager.cc:1403] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.009s
I20260709 13:20:26.196765 13621 consensus_queue.cc:260] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.197540 13619 ts_tablet_manager.cc:1434] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:26.198614 13619 tablet_bootstrap.cc:492] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:26.199887 13621 ts_tablet_manager.cc:1434] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:20:26.200996 13621 tablet_bootstrap.cc:492] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:26.201357 13618 raft_consensus.cc:359] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.202412 13618 raft_consensus.cc:385] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.202867 13618 raft_consensus.cc:740] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.203822 13618 consensus_queue.cc:260] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.205205 13619 tablet_bootstrap.cc:654] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.208933 13621 tablet_bootstrap.cc:654] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.211627 13618 ts_tablet_manager.cc:1434] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 13:20:26.213110 13618 tablet_bootstrap.cc:492] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:26.224738 13619 tablet_bootstrap.cc:492] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:26.227928 13619 ts_tablet_manager.cc:1403] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.006s
I20260709 13:20:26.227954 13621 tablet_bootstrap.cc:492] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:26.228762 13621 ts_tablet_manager.cc:1403] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.012s
I20260709 13:20:26.227332 13618 tablet_bootstrap.cc:654] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.231647 13619 raft_consensus.cc:359] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.231842 13621 raft_consensus.cc:359] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.232501 13619 raft_consensus.cc:385] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.232692 13621 raft_consensus.cc:385] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.233165 13619 raft_consensus.cc:740] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.233263 13621 raft_consensus.cc:740] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.234177 13619 consensus_queue.cc:260] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.234316 13621 consensus_queue.cc:260] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.236860 13619 ts_tablet_manager.cc:1434] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:26.236934 13621 ts_tablet_manager.cc:1434] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:26.237906 13621 tablet_bootstrap.cc:492] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:26.239136 13619 tablet_bootstrap.cc:492] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:26.244905 13621 tablet_bootstrap.cc:654] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.247130 13619 tablet_bootstrap.cc:654] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.257984 13621 tablet_bootstrap.cc:492] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:26.258117 13619 tablet_bootstrap.cc:492] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:26.258549 13621 ts_tablet_manager.cc:1403] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:20:26.258846 13619 ts_tablet_manager.cc:1403] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.001s
I20260709 13:20:26.261896 13621 raft_consensus.cc:359] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.262717 13621 raft_consensus.cc:385] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.263021 13621 raft_consensus.cc:740] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.270390 13619 raft_consensus.cc:359] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.271191 13619 raft_consensus.cc:385] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.271466 13619 raft_consensus.cc:740] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.272245 13619 consensus_queue.cc:260] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.274693 13619 ts_tablet_manager.cc:1434] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:20:26.279624 13619 tablet_bootstrap.cc:492] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:26.286623 13619 tablet_bootstrap.cc:654] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.286242 13621 consensus_queue.cc:260] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.288724 13621 ts_tablet_manager.cc:1434] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.003s
I20260709 13:20:26.289937 13621 tablet_bootstrap.cc:492] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:26.292351 13618 tablet_bootstrap.cc:492] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:26.293056 13618 ts_tablet_manager.cc:1403] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.080s	user 0.026s	sys 0.034s
I20260709 13:20:26.297111 13618 raft_consensus.cc:359] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.298097 13618 raft_consensus.cc:385] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.298498 13618 raft_consensus.cc:740] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.298722 13619 tablet_bootstrap.cc:492] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:26.299293 13619 ts_tablet_manager.cc:1403] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.008s
I20260709 13:20:26.299474 13618 consensus_queue.cc:260] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.302361 13618 ts_tablet_manager.cc:1434] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:20:26.302454 13619 raft_consensus.cc:359] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.303224 13619 raft_consensus.cc:385] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.303508 13619 raft_consensus.cc:740] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.303886 13618 tablet_bootstrap.cc:492] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:26.304431 13619 consensus_queue.cc:260] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.306866 13619 ts_tablet_manager.cc:1434] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:20:26.307835 13619 tablet_bootstrap.cc:492] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:26.312445 13618 tablet_bootstrap.cc:654] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.314283 13621 tablet_bootstrap.cc:654] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.314390 13619 tablet_bootstrap.cc:654] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.325809 13621 tablet_bootstrap.cc:492] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:26.325812 13618 tablet_bootstrap.cc:492] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:26.326478 13621 ts_tablet_manager.cc:1403] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.004s
I20260709 13:20:26.326645 13618 ts_tablet_manager.cc:1403] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.015s
I20260709 13:20:26.330209 13621 raft_consensus.cc:359] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.330425 13618 raft_consensus.cc:359] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.331084 13621 raft_consensus.cc:385] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.331430 13618 raft_consensus.cc:385] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.331454 13621 raft_consensus.cc:740] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.332398 13618 raft_consensus.cc:740] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.333010 13621 consensus_queue.cc:260] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.333593 13618 consensus_queue.cc:260] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.335114 13619 tablet_bootstrap.cc:492] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:26.335983 13619 ts_tablet_manager.cc:1403] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.004s
I20260709 13:20:26.336470 13621 ts_tablet_manager.cc:1434] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:20:26.337410 13618 ts_tablet_manager.cc:1434] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:20:26.337747 13621 tablet_bootstrap.cc:492] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:26.338732 13618 tablet_bootstrap.cc:492] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:26.339428 13619 raft_consensus.cc:359] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.340281 13619 raft_consensus.cc:385] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.340615 13619 raft_consensus.cc:740] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.341470 13619 consensus_queue.cc:260] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.344619 13619 ts_tablet_manager.cc:1434] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:26.344933 13621 tablet_bootstrap.cc:654] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.345806 13619 tablet_bootstrap.cc:492] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:26.348503 13618 tablet_bootstrap.cc:654] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.353842 13619 tablet_bootstrap.cc:654] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.355127 13604 raft_consensus.cc:493] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.355721 13604 raft_consensus.cc:515] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.358528 13604 leader_election.cc:290] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:26.359081 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b290df474a492db4a6f3f4fad3c6c7" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
I20260709 13:20:26.359844 13330 raft_consensus.cc:2468] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 0.
I20260709 13:20:26.362170 13445 leader_election.cc:304] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:26.364051 13604 raft_consensus.cc:2804] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.364078 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b290df474a492db4a6f3f4fad3c6c7" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" is_pre_election: true
I20260709 13:20:26.364495 13604 raft_consensus.cc:493] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.364833 13403 raft_consensus.cc:2468] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 0.
I20260709 13:20:26.364861 13604 raft_consensus.cc:3060] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.373963 13604 raft_consensus.cc:515] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.380575 13604 leader_election.cc:290] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:26.381332 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b290df474a492db4a6f3f4fad3c6c7" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:26.384356 13330 raft_consensus.cc:3060] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.383273 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b290df474a492db4a6f3f4fad3c6c7" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:26.389498 13403 raft_consensus.cc:3060] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.396539 13403 raft_consensus.cc:2468] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 1.
I20260709 13:20:26.397912 13445 leader_election.cc:304] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:26.398023 13330 raft_consensus.cc:2468] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 1.
I20260709 13:20:26.400709 13619 tablet_bootstrap.cc:492] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:26.399483 13639 raft_consensus.cc:493] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.401832 13619 ts_tablet_manager.cc:1403] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.056s	user 0.022s	sys 0.028s
I20260709 13:20:26.401685 13639 raft_consensus.cc:515] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.398864 13604 raft_consensus.cc:2804] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.400725 13621 tablet_bootstrap.cc:492] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:26.404469 13621 ts_tablet_manager.cc:1403] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.067s	user 0.007s	sys 0.012s
I20260709 13:20:26.404950 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63767942a864468b9b92f958327cd29e" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" is_pre_election: true
W20260709 13:20:26.406491 13296 leader_election.cc:343] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.406266 13619 raft_consensus.cc:359] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.407019 13619 raft_consensus.cc:385] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.407348 13619 raft_consensus.cc:740] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.407763 13621 raft_consensus.cc:359] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.408217 13619 consensus_queue.cc:260] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.408761 13621 raft_consensus.cc:385] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.409265 13621 raft_consensus.cc:740] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.410125 13621 consensus_queue.cc:260] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.410689 13604 raft_consensus.cc:697] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Becoming Leader. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:26.411891 13604 consensus_queue.cc:237] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.412675 13621 ts_tablet_manager.cc:1434] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:20:26.413560 13639 leader_election.cc:290] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:26.417470 13621 tablet_bootstrap.cc:492] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:26.417619 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63767942a864468b9b92f958327cd29e" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
I20260709 13:20:26.418350 13477 raft_consensus.cc:2468] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 0.
I20260709 13:20:26.419369 13632 raft_consensus.cc:493] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.419909 13619 ts_tablet_manager.cc:1434] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.017s	user 0.014s	sys 0.001s
I20260709 13:20:26.419786 13295 leader_election.cc:304] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: ce954fb530b1486ab6d791f2ce7de4e3
I20260709 13:20:26.419885 13632 raft_consensus.cc:515] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.421360 13619 tablet_bootstrap.cc:492] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:26.421016 13639 raft_consensus.cc:2804] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.421842 13639 raft_consensus.cc:493] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.422397 13639 raft_consensus.cc:3060] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.425881 13632 leader_election.cc:290] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:26.427505 13479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64148c1248744360aac836cae6721a49" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
I20260709 13:20:26.427834 13619 tablet_bootstrap.cc:654] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.428324 13479 raft_consensus.cc:2468] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 0.
I20260709 13:20:26.429880 13370 leader_election.cc:304] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:26.430033 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64148c1248744360aac836cae6721a49" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
I20260709 13:20:26.431238 13330 raft_consensus.cc:2468] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 0.
I20260709 13:20:26.434300 13618 tablet_bootstrap.cc:492] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:26.435114 13618 ts_tablet_manager.cc:1403] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.097s	user 0.045s	sys 0.014s
I20260709 13:20:26.435159 13632 raft_consensus.cc:2804] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.437392 13632 raft_consensus.cc:493] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.437621 13642 raft_consensus.cc:493] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.437924 13632 raft_consensus.cc:3060] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.438221 13642 raft_consensus.cc:515] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.439713 13618 raft_consensus.cc:359] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.440752 13618 raft_consensus.cc:385] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.441161 13618 raft_consensus.cc:740] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.441617 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf6e878e39844f7b4b2ab2f74f1af53" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
I20260709 13:20:26.442162 13618 consensus_queue.cc:260] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
W20260709 13:20:26.443310 13445 leader_election.cc:343] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.450069 13621 tablet_bootstrap.cc:654] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.447377 13639 raft_consensus.cc:515] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.455047 13642 leader_election.cc:290] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:26.455267 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf6e878e39844f7b4b2ab2f74f1af53" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" is_pre_election: true
I20260709 13:20:26.455806 13618 ts_tablet_manager.cc:1434] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
W20260709 13:20:26.456676 13445 leader_election.cc:343] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.457267 13445 leader_election.cc:304] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759; no voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3
I20260709 13:20:26.457283 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63767942a864468b9b92f958327cd29e" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:26.458629 13642 raft_consensus.cc:2749] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:20:26.459056 13296 leader_election.cc:343] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.460275 13618 tablet_bootstrap.cc:492] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:26.466344 13639 leader_election.cc:290] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 election: Requested vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:26.469848 13632 raft_consensus.cc:515] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.471164 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63767942a864468b9b92f958327cd29e" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:26.474176 13477 raft_consensus.cc:3060] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.473325 13642 raft_consensus.cc:493] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.489447 13642 raft_consensus.cc:515] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.490844 13619 tablet_bootstrap.cc:492] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:26.491382 13619 ts_tablet_manager.cc:1403] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.070s	user 0.035s	sys 0.028s
I20260709 13:20:26.491683 13642 leader_election.cc:290] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:26.493747 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a4a456b852a43cbaefa6af8ca085ac6" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
I20260709 13:20:26.494400 13619 raft_consensus.cc:359] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.494547 13330 raft_consensus.cc:2468] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 0.
I20260709 13:20:26.495113 13619 raft_consensus.cc:385] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.495460 13619 raft_consensus.cc:740] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.494628 13477 raft_consensus.cc:2468] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 1.
I20260709 13:20:26.496649 13619 consensus_queue.cc:260] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.496357 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a4a456b852a43cbaefa6af8ca085ac6" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" is_pre_election: true
I20260709 13:20:26.498556 13403 raft_consensus.cc:2468] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 0.
I20260709 13:20:26.500244 13632 leader_election.cc:290] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:26.496486 13618 tablet_bootstrap.cc:654] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.500840 13619 ts_tablet_manager.cc:1434] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:20:26.501211 13621 tablet_bootstrap.cc:492] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:26.501041 13295 leader_election.cc:304] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: ce954fb530b1486ab6d791f2ce7de4e3
I20260709 13:20:26.501744 13621 ts_tablet_manager.cc:1403] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.011s
I20260709 13:20:26.501953 13619 tablet_bootstrap.cc:492] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759: Bootstrap starting.
I20260709 13:20:26.503427 13445 leader_election.cc:304] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:26.504549 13594 raft_consensus.cc:2804] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.505416 13604 raft_consensus.cc:2804] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.506258 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64148c1248744360aac836cae6721a49" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:26.506886 13330 raft_consensus.cc:3060] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.507068 13621 raft_consensus.cc:359] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.507819 13621 raft_consensus.cc:385] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.508101 13621 raft_consensus.cc:740] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.506300 13604 raft_consensus.cc:493] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.509696 13604 raft_consensus.cc:3060] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.508843 13621 consensus_queue.cc:260] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.513230 13642 raft_consensus.cc:493] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.513705 13642 raft_consensus.cc:515] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.516651 13329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699587f5d5914572a41c3d5623876e89" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
I20260709 13:20:26.517314 13329 raft_consensus.cc:2468] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 0.
I20260709 13:20:26.519855 13445 leader_election.cc:304] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:26.520969 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64148c1248744360aac836cae6721a49" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:26.521654 13641 raft_consensus.cc:2804] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.522764 13621 ts_tablet_manager.cc:1434] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:20:26.522347 13642 leader_election.cc:290] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:26.522977 13641 raft_consensus.cc:493] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.525928 13641 raft_consensus.cc:3060] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.522950 13477 raft_consensus.cc:3060] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.532512 13330 raft_consensus.cc:2468] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 1.
I20260709 13:20:26.540261 13371 leader_election.cc:304] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:26.541563 13632 raft_consensus.cc:2804] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.542258 13632 raft_consensus.cc:697] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Becoming Leader. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:26.543432 13632 consensus_queue.cc:237] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.552824 13580 raft_consensus.cc:493] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.553551 13580 raft_consensus.cc:515] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.557132 13621 tablet_bootstrap.cc:492] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:26.557474 13580 leader_election.cc:290] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:26.557235 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b39e10afea4f3aa6474ca5b12f5d4f" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
I20260709 13:20:26.557214 13479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b39e10afea4f3aa6474ca5b12f5d4f" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
I20260709 13:20:26.558599 13479 raft_consensus.cc:2468] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 0.
W20260709 13:20:26.558862 13371 leader_election.cc:343] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.560036 13370 leader_election.cc:304] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: cc1ec065bcaa4dcaa2ec70061c146122
I20260709 13:20:26.561522 13580 raft_consensus.cc:2804] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.562074 13580 raft_consensus.cc:493] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.562525 13580 raft_consensus.cc:3060] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.509671 13226 catalog_manager.cc:5697] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:26.571447 13619 tablet_bootstrap.cc:654] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.556129 13604 raft_consensus.cc:515] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.582499 13621 tablet_bootstrap.cc:654] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.573621 13594 raft_consensus.cc:697] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Becoming Leader. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:26.586761 13594 consensus_queue.cc:237] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.588827 13228 catalog_manager.cc:5697] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:26.584426 13580 raft_consensus.cc:515] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
W20260709 13:20:26.576015 13445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:34003, user_credentials={real_user=slave}} blocked reactor thread for 53495.6us
I20260709 13:20:26.596410 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699587f5d5914572a41c3d5623876e89" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" is_pre_election: true
I20260709 13:20:26.597342 13618 tablet_bootstrap.cc:492] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:26.597188 13403 raft_consensus.cc:2468] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 0.
I20260709 13:20:26.597959 13618 ts_tablet_manager.cc:1403] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.138s	user 0.047s	sys 0.033s
I20260709 13:20:26.598702 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a4a456b852a43cbaefa6af8ca085ac6" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:26.599453 13330 raft_consensus.cc:3060] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.604928 13329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b39e10afea4f3aa6474ca5b12f5d4f" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:26.605490 13618 raft_consensus.cc:359] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.606081 13477 raft_consensus.cc:2468] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 1.
I20260709 13:20:26.606356 13618 raft_consensus.cc:385] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.606712 13618 raft_consensus.cc:740] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.607479 13618 consensus_queue.cc:260] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.607846 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a4a456b852a43cbaefa6af8ca085ac6" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:26.608657 13403 raft_consensus.cc:3060] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.609304 13329 raft_consensus.cc:3060] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.614686 13621 tablet_bootstrap.cc:492] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:26.615235 13621 ts_tablet_manager.cc:1403] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.005s
I20260709 13:20:26.612042 13618 ts_tablet_manager.cc:1434] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:20:26.617663 13648 raft_consensus.cc:493] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.618743 13618 tablet_bootstrap.cc:492] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:26.618366 13648 raft_consensus.cc:515] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.619155 13619 tablet_bootstrap.cc:492] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759: No bootstrap required, opened a new log
I20260709 13:20:26.619696 13619 ts_tablet_manager.cc:1403] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent bootstrapping tablet: real 0.118s	user 0.016s	sys 0.000s
I20260709 13:20:26.608665 13641 raft_consensus.cc:515] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.621065 13648 leader_election.cc:290] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:26.621737 13641 leader_election.cc:290] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:26.622622 13619 raft_consensus.cc:359] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.623371 13619 raft_consensus.cc:385] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.623646 13619 raft_consensus.cc:740] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.623824 13621 raft_consensus.cc:359] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.624679 13621 raft_consensus.cc:385] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.624423 13619 consensus_queue.cc:260] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.624752 13328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3135b8a2b7fb4bf193c6cfbd59a61a46" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
I20260709 13:20:26.625051 13621 raft_consensus.cc:740] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.626116 13621 consensus_queue.cc:260] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.626677 13619 ts_tablet_manager.cc:1434] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:26.628201 13404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3135b8a2b7fb4bf193c6cfbd59a61a46" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" is_pre_election: true
I20260709 13:20:26.622668 13403 raft_consensus.cc:2468] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 1.
I20260709 13:20:26.628957 13404 raft_consensus.cc:2468] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 0.
I20260709 13:20:26.631060 13580 leader_election.cc:290] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:26.628225 13621 ts_tablet_manager.cc:1434] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260709 13:20:26.633123 13621 tablet_bootstrap.cc:492] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3: Bootstrap starting.
I20260709 13:20:26.635010 13618 tablet_bootstrap.cc:654] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.624719 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b39e10afea4f3aa6474ca5b12f5d4f" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:26.636898 13328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699587f5d5914572a41c3d5623876e89" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:26.637916 13328 raft_consensus.cc:3060] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.641058 13621 tablet_bootstrap.cc:654] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.636963 13477 raft_consensus.cc:3060] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.658406 13618 tablet_bootstrap.cc:492] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:26.658670 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699587f5d5914572a41c3d5623876e89" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:26.659150 13618 ts_tablet_manager.cc:1403] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.013s
I20260709 13:20:26.659667 13403 raft_consensus.cc:3060] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.663108 13621 tablet_bootstrap.cc:492] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3: No bootstrap required, opened a new log
I20260709 13:20:26.662900 13618 raft_consensus.cc:359] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.663702 13621 ts_tablet_manager.cc:1403] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.004s
I20260709 13:20:26.663731 13618 raft_consensus.cc:385] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.664199 13618 raft_consensus.cc:740] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.665005 13618 consensus_queue.cc:260] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.666986 13621 raft_consensus.cc:359] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.667637 13618 ts_tablet_manager.cc:1434] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:20:26.667753 13621 raft_consensus.cc:385] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.668174 13621 raft_consensus.cc:740] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.668777 13618 tablet_bootstrap.cc:492] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:26.668999 13621 consensus_queue.cc:260] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.677546 13618 tablet_bootstrap.cc:654] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.680143 13621 ts_tablet_manager.cc:1434] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:20:26.680008 13445 leader_election.cc:304] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:26.681510 13641 raft_consensus.cc:2804] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.682099 13641 raft_consensus.cc:697] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Becoming Leader. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:26.683157 13641 consensus_queue.cc:237] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.684011 13330 raft_consensus.cc:2468] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 1.
I20260709 13:20:26.596814 13604 leader_election.cc:290] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:26.688613 13445 leader_election.cc:304] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:26.691432 13648 raft_consensus.cc:2804] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.691749 13580 raft_consensus.cc:493] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.692025 13648 raft_consensus.cc:493] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.692387 13580 raft_consensus.cc:515] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.692698 13648 raft_consensus.cc:3060] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.694788 13580 leader_election.cc:290] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:26.696108 13479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf6e878e39844f7b4b2ab2f74f1af53" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
I20260709 13:20:26.696862 13479 raft_consensus.cc:2468] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 0.
I20260709 13:20:26.698227 13370 leader_election.cc:304] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:26.699108 13403 raft_consensus.cc:2468] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 1.
I20260709 13:20:26.699370 13580 raft_consensus.cc:2804] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.698259 13329 raft_consensus.cc:2468] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 1.
I20260709 13:20:26.699951 13580 raft_consensus.cc:493] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.700464 13580 raft_consensus.cc:3060] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.703187 13328 raft_consensus.cc:2468] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 1.
I20260709 13:20:26.705211 13477 raft_consensus.cc:2468] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 1.
I20260709 13:20:26.706122 13371 leader_election.cc:304] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:26.707705 13650 raft_consensus.cc:2804] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.708463 13650 raft_consensus.cc:697] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Becoming Leader. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:26.708050 13225 catalog_manager.cc:5697] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65). New cstate: current_term: 1 leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:26.709786 13650 consensus_queue.cc:237] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.704958 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf6e878e39844f7b4b2ab2f74f1af53" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
W20260709 13:20:26.699312 13445 leader_election.cc:343] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.742274 13580 raft_consensus.cc:515] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.743818 13445 leader_election.cc:304] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:26.745170 13641 raft_consensus.cc:2804] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.746479 13641 raft_consensus.cc:697] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Becoming Leader. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:26.747830 13641 consensus_queue.cc:237] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.753904 13580 leader_election.cc:290] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:26.754181 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf6e878e39844f7b4b2ab2f74f1af53" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:26.754954 13477 raft_consensus.cc:3060] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.760910 13618 tablet_bootstrap.cc:492] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:26.752965 13648 raft_consensus.cc:515] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.762101 13618 ts_tablet_manager.cc:1403] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.094s	user 0.040s	sys 0.023s
I20260709 13:20:26.763520 13648 leader_election.cc:290] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:26.765148 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3135b8a2b7fb4bf193c6cfbd59a61a46" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:26.765414 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3135b8a2b7fb4bf193c6cfbd59a61a46" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:26.765787 13330 raft_consensus.cc:3060] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.765604 13618 raft_consensus.cc:359] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.766178 13403 raft_consensus.cc:3060] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.766553 13618 raft_consensus.cc:385] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.766916 13618 raft_consensus.cc:740] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.767887 13618 consensus_queue.cc:260] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
W20260709 13:20:26.761420 13371 leader_election.cc:343] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.770140 13618 ts_tablet_manager.cc:1434] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:26.771150 13618 tablet_bootstrap.cc:492] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122: Bootstrap starting.
I20260709 13:20:26.771299 13329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf6e878e39844f7b4b2ab2f74f1af53" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:26.774374 13330 raft_consensus.cc:2468] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 1.
W20260709 13:20:26.776964 13371 leader_election.cc:343] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.777715 13445 leader_election.cc:304] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:26.779623 13403 raft_consensus.cc:2468] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 1.
I20260709 13:20:26.782161 13641 raft_consensus.cc:2804] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.782948 13641 raft_consensus.cc:697] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Becoming Leader. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:26.783854 13641 consensus_queue.cc:237] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.784768 13618 tablet_bootstrap.cc:654] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.787839 13225 catalog_manager.cc:5697] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:26.793294 13477 raft_consensus.cc:2468] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 1.
I20260709 13:20:26.808145 13618 tablet_bootstrap.cc:492] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122: No bootstrap required, opened a new log
I20260709 13:20:26.808813 13618 ts_tablet_manager.cc:1403] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.013s
I20260709 13:20:26.811823 13618 raft_consensus.cc:359] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.812551 13618 raft_consensus.cc:385] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.812846 13618 raft_consensus.cc:740] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.813548 13618 consensus_queue.cc:260] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.813962 13370 leader_election.cc:304] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: cc1ec065bcaa4dcaa2ec70061c146122
I20260709 13:20:26.815379 13580 raft_consensus.cc:2804] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.815758 13618 ts_tablet_manager.cc:1434] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:20:26.815944 13580 raft_consensus.cc:697] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Becoming Leader. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:26.816990 13580 consensus_queue.cc:237] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.817121 13226 catalog_manager.cc:5697] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:26.819233 13226 catalog_manager.cc:5697] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:26.832054 13228 catalog_manager.cc:5697] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:26.836778 13641 consensus_queue.cc:1048] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:26.853499 13648 consensus_queue.cc:1048] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:26.857190 13227 catalog_manager.cc:5697] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:26.974311 13580 raft_consensus.cc:493] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.974774 13580 raft_consensus.cc:515] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:26.975733 13660 consensus_queue.cc:1048] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:26.976724 13580 leader_election.cc:290] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:26.977970 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19cb4f740e82464a8c3f94974d85c467" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
I20260709 13:20:26.977937 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19cb4f740e82464a8c3f94974d85c467" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" is_pre_election: true
I20260709 13:20:26.978776 13477 raft_consensus.cc:2468] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 0.
I20260709 13:20:26.978817 13330 raft_consensus.cc:2468] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 0.
I20260709 13:20:26.979907 13403 raft_consensus.cc:3060] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.980208 13370 leader_election.cc:304] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:26.981698 13660 raft_consensus.cc:2804] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.982167 13660 raft_consensus.cc:493] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.982579 13660 raft_consensus.cc:3060] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.996567 13632 consensus_queue.cc:1048] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:26.994318 13660 raft_consensus.cc:515] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.001111 13479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19cb4f740e82464a8c3f94974d85c467" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:27.001757 13479 raft_consensus.cc:3060] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:27.002811 13660 leader_election.cc:290] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:27.004415 13329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19cb4f740e82464a8c3f94974d85c467" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:27.005112 13329 raft_consensus.cc:3060] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:27.007918 13647 consensus_queue.cc:1048] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:27.009491 13479 raft_consensus.cc:2468] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 1.
I20260709 13:20:27.010973 13370 leader_election.cc:304] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:27.013656 13329 raft_consensus.cc:2468] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 1.
I20260709 13:20:27.014642 13632 raft_consensus.cc:2804] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:27.015201 13632 raft_consensus.cc:697] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Becoming Leader. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:27.015944 13632 consensus_queue.cc:237] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.030118 13639 consensus_queue.cc:1048] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.037317 13228 catalog_manager.cc:5697] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:27.044523 13276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:27.086784 13648 consensus_queue.cc:1048] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:27.093544 13639 raft_consensus.cc:493] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.094117 13639 raft_consensus.cc:515] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.098460 13479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf6e878e39844f7b4b2ab2f74f1af53" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759" is_pre_election: true
I20260709 13:20:27.099380 13479 raft_consensus.cc:2393] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc1ec065bcaa4dcaa2ec70061c146122 in current term 1: Already voted for candidate ce954fb530b1486ab6d791f2ce7de4e3 in this term.
I20260709 13:20:27.100345 13604 consensus_queue.cc:1048] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.101641 13639 leader_election.cc:290] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:27.102141 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf6e878e39844f7b4b2ab2f74f1af53" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" is_pre_election: true
I20260709 13:20:27.104204 13296 leader_election.cc:304] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122; no voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3
I20260709 13:20:27.105893 13639 raft_consensus.cc:3060] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:27.113770 13639 raft_consensus.cc:2749] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:27.133615 13641 consensus_queue.cc:1048] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.135994 13641 consensus_queue.cc:1048] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.218257 13641 consensus_queue.cc:1048] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.229424 13604 consensus_queue.cc:1048] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.266214 13650 consensus_queue.cc:1048] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.270434 13632 consensus_queue.cc:1048] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.283620 13632 consensus_queue.cc:1048] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.286321 13650 consensus_queue.cc:1048] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:27.306524 13477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0b290df474a492db4a6f3f4fad3c6c7"
dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
mode: GRACEFUL
new_leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
 from {username='slave'} at 127.0.0.1:50502
I20260709 13:20:27.307199 13477 raft_consensus.cc:606] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Received request to transfer leadership to TS cc1ec065bcaa4dcaa2ec70061c146122
I20260709 13:20:27.315450 13403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64148c1248744360aac836cae6721a49"
dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
mode: GRACEFUL
new_leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
 from {username='slave'} at 127.0.0.1:37482
I20260709 13:20:27.315959 13403 raft_consensus.cc:606] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Received request to transfer leadership to TS cc1ec065bcaa4dcaa2ec70061c146122
I20260709 13:20:27.321384 13477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a4a456b852a43cbaefa6af8ca085ac6"
dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
mode: GRACEFUL
new_leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
 from {username='slave'} at 127.0.0.1:50502
I20260709 13:20:27.321866 13477 raft_consensus.cc:606] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Received request to transfer leadership to TS cc1ec065bcaa4dcaa2ec70061c146122
I20260709 13:20:27.327436 13477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3135b8a2b7fb4bf193c6cfbd59a61a46"
dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
mode: GRACEFUL
new_leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
 from {username='slave'} at 127.0.0.1:50502
I20260709 13:20:27.327989 13477 raft_consensus.cc:606] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Received request to transfer leadership to TS ce954fb530b1486ab6d791f2ce7de4e3
I20260709 13:20:27.333004 13477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "699587f5d5914572a41c3d5623876e89"
dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
mode: GRACEFUL
new_leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
 from {username='slave'} at 127.0.0.1:50502
I20260709 13:20:27.333544 13477 raft_consensus.cc:606] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Received request to transfer leadership to TS ce954fb530b1486ab6d791f2ce7de4e3
I20260709 13:20:27.343441 13403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b39e10afea4f3aa6474ca5b12f5d4f"
dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
mode: GRACEFUL
new_leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
 from {username='slave'} at 127.0.0.1:37482
I20260709 13:20:27.343954 13403 raft_consensus.cc:606] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Received request to transfer leadership to TS 7e10c77aaefa4ca282e71044a2c0f759
I20260709 13:20:27.511587 13650 raft_consensus.cc:993] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3: : Instructing follower cc1ec065bcaa4dcaa2ec70061c146122 to start an election
I20260709 13:20:27.512130 13660 raft_consensus.cc:1081] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Signalling peer cc1ec065bcaa4dcaa2ec70061c146122 to start an election
I20260709 13:20:27.514127 13330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64148c1248744360aac836cae6721a49"
dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
 from {username='slave'} at 127.0.0.1:39334
I20260709 13:20:27.514700 13330 raft_consensus.cc:493] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:27.515084 13330 raft_consensus.cc:3060] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.520077 13330 raft_consensus.cc:515] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.521755 13330 leader_election.cc:290] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 2 election: Requested vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:27.522632 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64148c1248744360aac836cae6721a49" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:27.522819 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64148c1248744360aac836cae6721a49" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:27.523262 13403 raft_consensus.cc:3055] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:27.523387 13477 raft_consensus.cc:3060] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.523669 13403 raft_consensus.cc:740] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:27.524582 13403 consensus_queue.cc:260] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.525673 13403 raft_consensus.cc:3060] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.528810 13477 raft_consensus.cc:2468] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 2.
I20260709 13:20:27.530105 13295 leader_election.cc:304] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:27.530956 13647 raft_consensus.cc:2804] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:27.531360 13647 raft_consensus.cc:697] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Becoming Leader. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:27.531490 13403 raft_consensus.cc:2468] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 2.
I20260709 13:20:27.532198 13647 consensus_queue.cc:237] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.539146 13228 catalog_manager.cc:5697] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 reported cstate change: term changed from 1 to 2, leader changed from ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66) to cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:27.542893 13660 consensus_queue.cc:1048] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.556187 13580 consensus_queue.cc:1048] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.618279 13648 raft_consensus.cc:993] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759: : Instructing follower ce954fb530b1486ab6d791f2ce7de4e3 to start an election
I20260709 13:20:27.618867 13642 raft_consensus.cc:1081] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Signalling peer ce954fb530b1486ab6d791f2ce7de4e3 to start an election
I20260709 13:20:27.620786 13403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "699587f5d5914572a41c3d5623876e89"
dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
 from {username='slave'} at 127.0.0.1:37464
I20260709 13:20:27.621447 13403 raft_consensus.cc:493] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:27.621846 13403 raft_consensus.cc:3060] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.626571 13403 raft_consensus.cc:515] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.628005 13403 leader_election.cc:290] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 2 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:27.629213 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699587f5d5914572a41c3d5623876e89" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:27.629328 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699587f5d5914572a41c3d5623876e89" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:27.629783 13477 raft_consensus.cc:3055] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:27.630141 13477 raft_consensus.cc:740] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:27.629944 13330 raft_consensus.cc:3060] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.630986 13477 consensus_queue.cc:260] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.631891 13477 raft_consensus.cc:3060] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.635243 13330 raft_consensus.cc:2468] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 2.
I20260709 13:20:27.636379 13371 leader_election.cc:304] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:27.636741 13477 raft_consensus.cc:2468] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 2.
I20260709 13:20:27.637115 13580 raft_consensus.cc:2804] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:27.637595 13580 raft_consensus.cc:697] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 LEADER]: Becoming Leader. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:27.638293 13580 consensus_queue.cc:237] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.644599 13227 catalog_manager.cc:5697] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 reported cstate change: term changed from 1 to 2, leader changed from 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67) to ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:27.694132 13580 raft_consensus.cc:993] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3: : Instructing follower 7e10c77aaefa4ca282e71044a2c0f759 to start an election
I20260709 13:20:27.694737 13660 raft_consensus.cc:1081] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Signalling peer 7e10c77aaefa4ca282e71044a2c0f759 to start an election
I20260709 13:20:27.696645 13477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1b39e10afea4f3aa6474ca5b12f5d4f"
dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
 from {username='slave'} at 127.0.0.1:50476
I20260709 13:20:27.697211 13477 raft_consensus.cc:493] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:27.697582 13477 raft_consensus.cc:3060] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.702521 13648 raft_consensus.cc:993] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759: : Instructing follower cc1ec065bcaa4dcaa2ec70061c146122 to start an election
I20260709 13:20:27.703090 13642 raft_consensus.cc:1081] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Signalling peer cc1ec065bcaa4dcaa2ec70061c146122 to start an election
I20260709 13:20:27.703243 13477 raft_consensus.cc:515] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.704802 13330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a4a456b852a43cbaefa6af8ca085ac6"
dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
 from {username='slave'} at 127.0.0.1:39320
I20260709 13:20:27.705161 13477 leader_election.cc:290] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 2 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:27.705452 13330 raft_consensus.cc:493] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:27.705956 13330 raft_consensus.cc:3060] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.706322 13403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b39e10afea4f3aa6474ca5b12f5d4f" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:27.706921 13403 raft_consensus.cc:3055] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:27.707213 13403 raft_consensus.cc:740] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:27.707369 13328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b39e10afea4f3aa6474ca5b12f5d4f" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:27.707990 13328 raft_consensus.cc:3060] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.707957 13403 consensus_queue.cc:260] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.709436 13403 raft_consensus.cc:3060] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.713361 13330 raft_consensus.cc:515] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.714157 13328 raft_consensus.cc:2468] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 2.
I20260709 13:20:27.715314 13445 leader_election.cc:304] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:27.716060 13404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a4a456b852a43cbaefa6af8ca085ac6" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:27.716301 13330 leader_election.cc:290] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 2 election: Requested vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:27.716753 13404 raft_consensus.cc:3060] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.716188 13642 raft_consensus.cc:2804] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:27.718480 13642 raft_consensus.cc:697] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 LEADER]: Becoming Leader. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:27.719511 13642 consensus_queue.cc:237] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.720835 13479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a4a456b852a43cbaefa6af8ca085ac6" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:27.721481 13479 raft_consensus.cc:3055] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:27.721807 13479 raft_consensus.cc:740] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:27.722671 13479 consensus_queue.cc:260] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.724036 13479 raft_consensus.cc:3060] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.721815 13403 raft_consensus.cc:2468] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 2.
I20260709 13:20:27.731002 13404 raft_consensus.cc:2468] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 2.
I20260709 13:20:27.731628 13479 raft_consensus.cc:2468] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 2.
I20260709 13:20:27.730957 13227 catalog_manager.cc:5697] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 reported cstate change: term changed from 1 to 2, leader changed from ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66) to 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:27.732343 13296 leader_election.cc:304] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:27.733389 13648 raft_consensus.cc:993] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759: : Instructing follower ce954fb530b1486ab6d791f2ce7de4e3 to start an election
I20260709 13:20:27.733805 13647 raft_consensus.cc:2804] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:27.733897 13604 raft_consensus.cc:1081] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Signalling peer ce954fb530b1486ab6d791f2ce7de4e3 to start an election
I20260709 13:20:27.734457 13647 raft_consensus.cc:697] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Becoming Leader. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:27.735384 13647 consensus_queue.cc:237] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.736624 13403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3135b8a2b7fb4bf193c6cfbd59a61a46"
dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
 from {username='slave'} at 127.0.0.1:37464
I20260709 13:20:27.737308 13403 raft_consensus.cc:493] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:27.737694 13403 raft_consensus.cc:3060] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.744062 13227 catalog_manager.cc:5697] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 reported cstate change: term changed from 1 to 2, leader changed from 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67) to cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:27.744745 13403 raft_consensus.cc:515] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.746842 13403 leader_election.cc:290] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 2 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:27.747759 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3135b8a2b7fb4bf193c6cfbd59a61a46" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:27.748353 13330 raft_consensus.cc:3060] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.749027 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3135b8a2b7fb4bf193c6cfbd59a61a46" candidate_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:27.749980 13477 raft_consensus.cc:3055] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:27.750385 13477 raft_consensus.cc:740] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:27.751233 13477 consensus_queue.cc:260] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.752451 13477 raft_consensus.cc:3060] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.755559 13648 raft_consensus.cc:993] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759: : Instructing follower cc1ec065bcaa4dcaa2ec70061c146122 to start an election
I20260709 13:20:27.756093 13604 raft_consensus.cc:1081] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Signalling peer cc1ec065bcaa4dcaa2ec70061c146122 to start an election
I20260709 13:20:27.756228 13330 raft_consensus.cc:2468] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 2.
I20260709 13:20:27.757573 13371 leader_election.cc:304] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:27.758446 13660 raft_consensus.cc:2804] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:27.758916 13660 raft_consensus.cc:697] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 LEADER]: Becoming Leader. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:27.759716 13660 consensus_queue.cc:237] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.760278 13477 raft_consensus.cc:2468] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce954fb530b1486ab6d791f2ce7de4e3 in term 2.
I20260709 13:20:27.761989 13330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0b290df474a492db4a6f3f4fad3c6c7"
dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
 from {username='slave'} at 127.0.0.1:39320
I20260709 13:20:27.762784 13330 raft_consensus.cc:493] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:27.763219 13330 raft_consensus.cc:3060] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.769421 13330 raft_consensus.cc:515] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.769404 13227 catalog_manager.cc:5697] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 reported cstate change: term changed from 1 to 2, leader changed from 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67) to ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:27.771322 13330 leader_election.cc:290] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 2 election: Requested vote from peers ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003), 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67:33517)
I20260709 13:20:27.772277 13404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b290df474a492db4a6f3f4fad3c6c7" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:27.772471 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b290df474a492db4a6f3f4fad3c6c7" candidate_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
I20260709 13:20:27.772964 13404 raft_consensus.cc:3060] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.773138 13477 raft_consensus.cc:3055] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:27.773612 13477 raft_consensus.cc:740] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:27.774412 13477 consensus_queue.cc:260] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.776612 13477 raft_consensus.cc:3060] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.781574 13404 raft_consensus.cc:2468] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 2.
I20260709 13:20:27.782781 13296 leader_election.cc:304] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc1ec065bcaa4dcaa2ec70061c146122, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:27.783680 13647 raft_consensus.cc:2804] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:27.783890 13477 raft_consensus.cc:2468] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1ec065bcaa4dcaa2ec70061c146122 in term 2.
I20260709 13:20:27.784204 13647 raft_consensus.cc:697] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Becoming Leader. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:27.785176 13647 consensus_queue.cc:237] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:27.792448 13227 catalog_manager.cc:5697] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 reported cstate change: term changed from 1 to 2, leader changed from 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67) to cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65). New cstate: current_term: 2 leader_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:28.013707 13403 raft_consensus.cc:1275] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Refusing update from remote peer cc1ec065bcaa4dcaa2ec70061c146122: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.015096 13594 consensus_queue.cc:1048] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:28.025066 13477 raft_consensus.cc:1275] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Refusing update from remote peer cc1ec065bcaa4dcaa2ec70061c146122: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.027004 13647 consensus_queue.cc:1048] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:28.159408 13477 raft_consensus.cc:1275] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Refusing update from remote peer cc1ec065bcaa4dcaa2ec70061c146122: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.160722 13647 consensus_queue.cc:1048] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:28.170132 13403 raft_consensus.cc:1275] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Refusing update from remote peer cc1ec065bcaa4dcaa2ec70061c146122: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.173646 13594 consensus_queue.cc:1048] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:28.173311 13477 raft_consensus.cc:1275] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Refusing update from remote peer cc1ec065bcaa4dcaa2ec70061c146122: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.178086 13695 consensus_queue.cc:1048] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:28.197332 13403 raft_consensus.cc:1275] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Refusing update from remote peer cc1ec065bcaa4dcaa2ec70061c146122: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.199970 13696 consensus_queue.cc:1048] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:28.240188 13479 raft_consensus.cc:1275] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Refusing update from remote peer ce954fb530b1486ab6d791f2ce7de4e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.241600 13650 consensus_queue.cc:1048] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:28.251327 13330 raft_consensus.cc:1275] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Refusing update from remote peer ce954fb530b1486ab6d791f2ce7de4e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.253599 13650 consensus_queue.cc:1048] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:28.327539 13330 raft_consensus.cc:1275] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Refusing update from remote peer ce954fb530b1486ab6d791f2ce7de4e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.329104 13650 consensus_queue.cc:1048] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:28.338477 13479 raft_consensus.cc:1275] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Refusing update from remote peer ce954fb530b1486ab6d791f2ce7de4e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.341216 13701 consensus_queue.cc:1048] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:28.345562 13328 raft_consensus.cc:1275] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Refusing update from remote peer 7e10c77aaefa4ca282e71044a2c0f759: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.348212 13403 raft_consensus.cc:1275] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Refusing update from remote peer 7e10c77aaefa4ca282e71044a2c0f759: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.348116 13604 consensus_queue.cc:1048] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:28.349817 13604 consensus_queue.cc:1048] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:30.347698 13228 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49142:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:20:30.370092 13228 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49142:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:20:30.419780  2025 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:20:30.514237 13371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:40967, user_credentials={real_user=slave}} blocked reactor thread for 64241.6us
I20260709 13:20:30.641657 13766 tablet.cc:1724] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:30.649708 13754 log.cc:927] Time spent T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:20:30.672907 13748 log.cc:927] Time spent T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:20:30.682768 13767 tablet.cc:1724] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.682262 13768 tablet.cc:1724] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:30.688263 13431 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:3cf6e878e39844f7b4b2ab2f74f1af53)
W20260709 13:20:30.721139 13296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:34003, user_credentials={real_user=slave}} blocked reactor thread for 78896.5us
W20260709 13:20:30.718945 13751 log.cc:927] Time spent T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759: Append to log took a long time: real 0.119s	user 0.003s	sys 0.000s
I20260709 13:20:30.736850 13403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19cb4f740e82464a8c3f94974d85c467"
dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
mode: GRACEFUL
new_leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
 from {username='slave'} at 127.0.0.1:37486
I20260709 13:20:30.737546 13403 raft_consensus.cc:606] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Received request to transfer leadership to TS 7e10c77aaefa4ca282e71044a2c0f759
I20260709 13:20:30.736347 13774 tablet.cc:1724] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.740213 13776 tablet.cc:1724] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:30.731168 13763 log.cc:927] Time spent T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
W20260709 13:20:30.756276 13431 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:3cf6e878e39844f7b4b2ab2f74f1af53)
I20260709 13:20:30.757558 13769 tablet.cc:1724] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:30.762247 13431 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:3cf6e878e39844f7b4b2ab2f74f1af53)
I20260709 13:20:30.768180 13777 tablet.cc:1724] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.793895 13773 tablet.cc:1724] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:30.819133 13296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:34003, user_credentials={real_user=slave}} blocked reactor thread for 88310.5us
W20260709 13:20:30.826287 13370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:33517, user_credentials={real_user=slave}} blocked reactor thread for 81667.2us
I20260709 13:20:30.822041 13783 tablet.cc:1724] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.831081 13778 tablet.cc:1724] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:30.836064 13295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:33517, user_credentials={real_user=slave}} blocked reactor thread for 74407.7us
I20260709 13:20:30.863715 13744 raft_consensus.cc:993] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3: : Instructing follower 7e10c77aaefa4ca282e71044a2c0f759 to start an election
I20260709 13:20:30.864234 13744 raft_consensus.cc:1081] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Signalling peer 7e10c77aaefa4ca282e71044a2c0f759 to start an election
I20260709 13:20:30.885255 13774 tablet.cc:1724] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.901983 13783 tablet.cc:1724] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.919065 13767 tablet.cc:1724] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.914105 13471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19cb4f740e82464a8c3f94974d85c467"
dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
 from {username='slave'} at 127.0.0.1:50476
I20260709 13:20:30.932238 13471 raft_consensus.cc:493] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:30.932749 13471 raft_consensus.cc:3060] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:30.934501 13773 tablet.cc:1724] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.926275 13769 tablet.cc:1724] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.873963 13768 tablet.cc:1724] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.925256 13782 tablet.cc:1724] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.922221 13781 tablet.cc:1724] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.918081 13776 tablet.cc:1724] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.948012 13777 tablet.cc:1724] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.955281 13774 tablet.cc:1724] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.943133 13471 raft_consensus.cc:515] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:30.966411 13768 tablet.cc:1724] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.972402 13330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19cb4f740e82464a8c3f94974d85c467" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:30.973011 13330 raft_consensus.cc:3060] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:30.974925 13402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19cb4f740e82464a8c3f94974d85c467" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:30.975688 13402 raft_consensus.cc:3055] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:30.976171 13402 raft_consensus.cc:740] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:30.977094 13402 consensus_queue.cc:260] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:30.983804 13402 raft_consensus.cc:3060] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:30.976424 13774 tablet.cc:1724] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.989825 13327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63767942a864468b9b92f958327cd29e"
dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
mode: GRACEFUL
new_leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
 from {username='slave'} at 127.0.0.1:55560
I20260709 13:20:30.990553 13327 raft_consensus.cc:606] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Received request to transfer leadership to TS 7e10c77aaefa4ca282e71044a2c0f759
I20260709 13:20:30.992746  2025 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:20:30.992491 13783 tablet.cc:1724] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:31.000160  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:30.982299 13778 tablet.cc:1724] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.969728 13471 leader_election.cc:290] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 2 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:30.969319 13766 tablet.cc:1724] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:31.014519 13402 raft_consensus.cc:2468] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 2.
I20260709 13:20:31.022632 13445 leader_election.cc:304] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:30.996098 13767 tablet.cc:1724] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:31.023687 13708 raft_consensus.cc:2804] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:31.024205 13708 raft_consensus.cc:697] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 LEADER]: Becoming Leader. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:30.982833 13330 raft_consensus.cc:2468] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 2.
I20260709 13:20:31.024988 13327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f66ce72872a4a239fd486c1163436f8"
dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
mode: GRACEFUL
new_leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
 from {username='slave'} at 127.0.0.1:55560
I20260709 13:20:31.025698 13327 raft_consensus.cc:606] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Received request to transfer leadership to TS 7e10c77aaefa4ca282e71044a2c0f759
I20260709 13:20:31.025044 13708 consensus_queue.cc:237] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:31.034973 13402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5df601bbb544e56bf2bab6b83e6eefa"
dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
mode: GRACEFUL
new_leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
 from {username='slave'} at 127.0.0.1:37486
I20260709 13:20:31.035600 13402 raft_consensus.cc:606] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 LEADER]: Received request to transfer leadership to TS 7e10c77aaefa4ca282e71044a2c0f759
I20260709 13:20:31.037518  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:31.038043  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:31.050731 13227 catalog_manager.cc:5697] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 reported cstate change: term changed from 1 to 2, leader changed from ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66) to 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:31.056262 13228 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a: soft_deleted_table [id=0e15067884794d38a717f45522d45d22] alter complete (version 1)
I20260709 13:20:31.074720 13759 raft_consensus.cc:993] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122: : Instructing follower 7e10c77aaefa4ca282e71044a2c0f759 to start an election
I20260709 13:20:31.075454 13759 raft_consensus.cc:1081] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Signalling peer 7e10c77aaefa4ca282e71044a2c0f759 to start an election
I20260709 13:20:31.077494 13471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f66ce72872a4a239fd486c1163436f8"
dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
 from {username='slave'} at 127.0.0.1:50490
I20260709 13:20:31.078045 13471 raft_consensus.cc:493] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:31.078419 13471 raft_consensus.cc:3060] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:31.083796 13471 raft_consensus.cc:515] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:31.085446 13471 leader_election.cc:290] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 3 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:31.086374 13327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f66ce72872a4a239fd486c1163436f8" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:31.086751 13402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f66ce72872a4a239fd486c1163436f8" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:31.087095 13327 raft_consensus.cc:3055] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:31.087355 13402 raft_consensus.cc:3060] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:31.087469 13327 raft_consensus.cc:740] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:31.088400 13327 consensus_queue.cc:260] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:31.089895 13327 raft_consensus.cc:3060] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:31.096002 13402 raft_consensus.cc:2468] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 3.
I20260709 13:20:31.097383 13445 leader_election.cc:304] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:31.097571 13327 raft_consensus.cc:2468] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 3.
I20260709 13:20:31.098129 13708 raft_consensus.cc:2804] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:31.098671 13708 raft_consensus.cc:697] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 3 LEADER]: Becoming Leader. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:31.099592 13708 consensus_queue.cc:237] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:31.108469 13227 catalog_manager.cc:5697] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 reported cstate change: term changed from 2 to 3, leader changed from cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65) to 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67). New cstate: current_term: 3 leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:31.207798 13740 raft_consensus.cc:993] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3: : Instructing follower 7e10c77aaefa4ca282e71044a2c0f759 to start an election
I20260709 13:20:31.208490 13710 raft_consensus.cc:1081] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 LEADER]: Signalling peer 7e10c77aaefa4ca282e71044a2c0f759 to start an election
I20260709 13:20:31.210264 13472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5df601bbb544e56bf2bab6b83e6eefa"
dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
 from {username='slave'} at 127.0.0.1:50476
I20260709 13:20:31.210772 13472 raft_consensus.cc:493] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:31.211126 13472 raft_consensus.cc:3060] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:31.217463 13472 raft_consensus.cc:515] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:31.219353 13472 leader_election.cc:290] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 3 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:31.220387 13402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5df601bbb544e56bf2bab6b83e6eefa" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:31.220201 13327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5df601bbb544e56bf2bab6b83e6eefa" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:31.221169 13402 raft_consensus.cc:3055] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:31.221215 13327 raft_consensus.cc:3060] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:31.221676 13402 raft_consensus.cc:740] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce954fb530b1486ab6d791f2ce7de4e3, State: Running, Role: LEADER
I20260709 13:20:31.222772 13402 consensus_queue.cc:260] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:31.224097 13402 raft_consensus.cc:3060] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:31.229279 13327 raft_consensus.cc:2468] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 3.
I20260709 13:20:31.230532 13445 leader_election.cc:304] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, cc1ec065bcaa4dcaa2ec70061c146122; no voters: 
I20260709 13:20:31.231346 13708 raft_consensus.cc:2804] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:31.231451 13402 raft_consensus.cc:2468] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 3.
I20260709 13:20:31.231794 13708 raft_consensus.cc:697] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 3 LEADER]: Becoming Leader. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:31.233827 13708 consensus_queue.cc:237] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:31.241307 13227 catalog_manager.cc:5697] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 reported cstate change: term changed from 2 to 3, leader changed from ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66) to 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67). New cstate: current_term: 3 leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:31.371461 13784 raft_consensus.cc:993] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122: : Instructing follower 7e10c77aaefa4ca282e71044a2c0f759 to start an election
I20260709 13:20:31.371886 13759 raft_consensus.cc:1081] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Signalling peer 7e10c77aaefa4ca282e71044a2c0f759 to start an election
I20260709 13:20:31.373498 13471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63767942a864468b9b92f958327cd29e"
dest_uuid: "7e10c77aaefa4ca282e71044a2c0f759"
 from {username='slave'} at 127.0.0.1:50490
I20260709 13:20:31.373993 13471 raft_consensus.cc:493] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:31.374343 13471 raft_consensus.cc:3060] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:31.380805 13471 raft_consensus.cc:515] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:31.383090 13471 leader_election.cc:290] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 2 election: Requested vote from peers cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65:40967), ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003)
I20260709 13:20:31.383649 13327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63767942a864468b9b92f958327cd29e" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "cc1ec065bcaa4dcaa2ec70061c146122"
I20260709 13:20:31.384208 13402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63767942a864468b9b92f958327cd29e" candidate_uuid: "7e10c77aaefa4ca282e71044a2c0f759" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ce954fb530b1486ab6d791f2ce7de4e3"
I20260709 13:20:31.384338 13327 raft_consensus.cc:3055] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:31.384939 13327 raft_consensus.cc:740] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc1ec065bcaa4dcaa2ec70061c146122, State: Running, Role: LEADER
I20260709 13:20:31.385011 13402 raft_consensus.cc:3060] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:31.386119 13327 consensus_queue.cc:260] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:31.387666 13327 raft_consensus.cc:3060] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:31.393942 13402 raft_consensus.cc:2468] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 2.
I20260709 13:20:31.395404 13445 leader_election.cc:304] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e10c77aaefa4ca282e71044a2c0f759, ce954fb530b1486ab6d791f2ce7de4e3; no voters: 
I20260709 13:20:31.396281 13327 raft_consensus.cc:2468] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e10c77aaefa4ca282e71044a2c0f759 in term 2.
I20260709 13:20:31.396276 13708 raft_consensus.cc:2804] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:31.396963 13708 raft_consensus.cc:697] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 LEADER]: Becoming Leader. State: Replica: 7e10c77aaefa4ca282e71044a2c0f759, State: Running, Role: LEADER
I20260709 13:20:31.397815 13708 consensus_queue.cc:237] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } }
I20260709 13:20:31.408656 13227 catalog_manager.cc:5697] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 reported cstate change: term changed from 1 to 2, leader changed from cc1ec065bcaa4dcaa2ec70061c146122 (127.1.250.65) to 7e10c77aaefa4ca282e71044a2c0f759 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "7e10c77aaefa4ca282e71044a2c0f759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e10c77aaefa4ca282e71044a2c0f759" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 33517 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:31.429473 13402 raft_consensus.cc:1275] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Refusing update from remote peer 7e10c77aaefa4ca282e71044a2c0f759: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:20:31.430909 13708 consensus_queue.cc:1048] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:31.444679 13327 raft_consensus.cc:1275] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Refusing update from remote peer 7e10c77aaefa4ca282e71044a2c0f759: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:20:31.447806 13795 consensus_queue.cc:1048] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:31.656941 13327 raft_consensus.cc:1275] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 3 FOLLOWER]: Refusing update from remote peer 7e10c77aaefa4ca282e71044a2c0f759: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:31.658394 13795 consensus_queue.cc:1048] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:31.668913 13402 raft_consensus.cc:1275] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [term 3 FOLLOWER]: Refusing update from remote peer 7e10c77aaefa4ca282e71044a2c0f759: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:31.670653 13795 consensus_queue.cc:1048] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:31.707033 13402 raft_consensus.cc:1275] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 3 FOLLOWER]: Refusing update from remote peer 7e10c77aaefa4ca282e71044a2c0f759: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:31.708415 13795 consensus_queue.cc:1048] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:31.718268 13327 raft_consensus.cc:1275] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 3 FOLLOWER]: Refusing update from remote peer 7e10c77aaefa4ca282e71044a2c0f759: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:31.720662 13795 consensus_queue.cc:1048] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:31.895257 13402 raft_consensus.cc:1275] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Refusing update from remote peer 7e10c77aaefa4ca282e71044a2c0f759: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:20:31.896834 13795 consensus_queue.cc:1048] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce954fb530b1486ab6d791f2ce7de4e3" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:31.904611 13327 raft_consensus.cc:1275] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Refusing update from remote peer 7e10c77aaefa4ca282e71044a2c0f759: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:20:31.906080 13708 consensus_queue.cc:1048] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1ec065bcaa4dcaa2ec70061c146122" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 40967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:32.102612  2025 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:20:32.109941  2025 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:20:32.110562  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:32.116686  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:20:32.117164  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:33.355505  2025 tablet_server.cc:179] TabletServer@127.1.250.65:0 shutting down...
I20260709 13:20:33.385860  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:33.386739  2025 tablet_replica.cc:333] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.387547  2025 raft_consensus.cc:2243] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.388019  2025 raft_consensus.cc:2272] T 19cb4f740e82464a8c3f94974d85c467 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.390040  2025 tablet_replica.cc:333] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.390602  2025 raft_consensus.cc:2243] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.391005  2025 raft_consensus.cc:2272] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.392715  2025 tablet_replica.cc:333] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.393324  2025 raft_consensus.cc:2243] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.393707  2025 raft_consensus.cc:2272] T c1b39e10afea4f3aa6474ca5b12f5d4f P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.395416  2025 tablet_replica.cc:333] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.395936  2025 raft_consensus.cc:2243] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.396323  2025 raft_consensus.cc:2272] T 3cf6e878e39844f7b4b2ab2f74f1af53 P cc1ec065bcaa4dcaa2ec70061c146122 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.398159  2025 tablet_replica.cc:333] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.398680  2025 raft_consensus.cc:2243] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.399035  2025 raft_consensus.cc:2272] T 699587f5d5914572a41c3d5623876e89 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.400817  2025 tablet_replica.cc:333] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.401443  2025 raft_consensus.cc:2243] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.401808  2025 raft_consensus.cc:2272] T 63767942a864468b9b92f958327cd29e P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.403607  2025 tablet_replica.cc:333] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.404129  2025 raft_consensus.cc:2243] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.404503  2025 raft_consensus.cc:2272] T 6f66ce72872a4a239fd486c1163436f8 P cc1ec065bcaa4dcaa2ec70061c146122 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.406518  2025 tablet_replica.cc:333] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.407038  2025 raft_consensus.cc:2243] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.407441  2025 raft_consensus.cc:2272] T 92c9aeccadd4498da1f0e880c9b63864 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.409449  2025 tablet_replica.cc:333] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.409968  2025 raft_consensus.cc:2243] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.410816  2025 raft_consensus.cc:2272] T 6a4a456b852a43cbaefa6af8ca085ac6 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.412750  2025 tablet_replica.cc:333] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.413617  2025 raft_consensus.cc:2243] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.414657  2025 raft_consensus.cc:2272] T d0b290df474a492db4a6f3f4fad3c6c7 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.416564  2025 tablet_replica.cc:333] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.417115  2025 raft_consensus.cc:2243] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.417629  2025 raft_consensus.cc:2272] T a3b4d9d0e7894d3fb39494067103dcfa P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.420024  2025 tablet_replica.cc:333] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.420622  2025 raft_consensus.cc:2243] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.421022  2025 raft_consensus.cc:2272] T e5df601bbb544e56bf2bab6b83e6eefa P cc1ec065bcaa4dcaa2ec70061c146122 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.423094  2025 tablet_replica.cc:333] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.423573  2025 raft_consensus.cc:2243] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.423962  2025 raft_consensus.cc:2272] T 0a92e3bed61c42038559ef6437c26524 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.426040  2025 tablet_replica.cc:333] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.426512  2025 raft_consensus.cc:2243] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.427240  2025 raft_consensus.cc:2272] T 64148c1248744360aac836cae6721a49 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.429035  2025 tablet_replica.cc:333] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.429577  2025 raft_consensus.cc:2243] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.430306  2025 raft_consensus.cc:2272] T 1dc56481aa6146eda2ef7d0202cb3e18 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.432265  2025 tablet_replica.cc:333] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.432780  2025 raft_consensus.cc:2243] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.433205  2025 raft_consensus.cc:2272] T 9270b20602874b468e7a2e81aa8a7634 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.435274  2025 tablet_replica.cc:333] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.436018  2025 raft_consensus.cc:2243] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.436967  2025 raft_consensus.cc:2272] T 274bd992d2474f4a97baf74cd6c15f60 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.439390  2025 tablet_replica.cc:333] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122: stopping tablet replica
I20260709 13:20:33.439913  2025 raft_consensus.cc:2243] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.440735  2025 raft_consensus.cc:2272] T e77725ae01e740148beb2ff3260cabc9 P cc1ec065bcaa4dcaa2ec70061c146122 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.481415  2025 tablet_server.cc:196] TabletServer@127.1.250.65:0 shutdown complete.
I20260709 13:20:33.523859  2025 tablet_server.cc:179] TabletServer@127.1.250.66:0 shutting down...
I20260709 13:20:33.555548  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:33.556396  2025 tablet_replica.cc:333] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.557389  2025 raft_consensus.cc:2243] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.558072  2025 raft_consensus.cc:2272] T 63767942a864468b9b92f958327cd29e P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.560003  2025 tablet_replica.cc:333] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.560529  2025 raft_consensus.cc:2243] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.560936  2025 raft_consensus.cc:2272] T 19cb4f740e82464a8c3f94974d85c467 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.562794  2025 tablet_replica.cc:333] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.563301  2025 raft_consensus.cc:2243] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.564093  2025 raft_consensus.cc:2272] T 3cf6e878e39844f7b4b2ab2f74f1af53 P ce954fb530b1486ab6d791f2ce7de4e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.566012  2025 tablet_replica.cc:333] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.566522  2025 raft_consensus.cc:2243] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.567224  2025 raft_consensus.cc:2272] T 699587f5d5914572a41c3d5623876e89 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.569065  2025 tablet_replica.cc:333] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.569679  2025 raft_consensus.cc:2243] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.570067  2025 raft_consensus.cc:2272] T d0b290df474a492db4a6f3f4fad3c6c7 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.571805  2025 tablet_replica.cc:333] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.572335  2025 raft_consensus.cc:2243] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.572793  2025 raft_consensus.cc:2272] T c1b39e10afea4f3aa6474ca5b12f5d4f P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.574628  2025 tablet_replica.cc:333] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.575287  2025 raft_consensus.cc:2243] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.576180  2025 raft_consensus.cc:2272] T 9270b20602874b468e7a2e81aa8a7634 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.578711  2025 tablet_replica.cc:333] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.579227  2025 raft_consensus.cc:2243] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.579629  2025 raft_consensus.cc:2272] T 1dc56481aa6146eda2ef7d0202cb3e18 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.582168  2025 tablet_replica.cc:333] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.582695  2025 raft_consensus.cc:2243] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.583104  2025 raft_consensus.cc:2272] T 64148c1248744360aac836cae6721a49 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.584847  2025 tablet_replica.cc:333] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.585469  2025 raft_consensus.cc:2243] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.586211  2025 raft_consensus.cc:2272] T a3b4d9d0e7894d3fb39494067103dcfa P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.588195  2025 tablet_replica.cc:333] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.588690  2025 raft_consensus.cc:2243] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.589063  2025 raft_consensus.cc:2272] T 6a4a456b852a43cbaefa6af8ca085ac6 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.590822  2025 tablet_replica.cc:333] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.591445  2025 raft_consensus.cc:2243] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.591836  2025 raft_consensus.cc:2272] T 6f66ce72872a4a239fd486c1163436f8 P ce954fb530b1486ab6d791f2ce7de4e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.593708  2025 tablet_replica.cc:333] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.594434  2025 raft_consensus.cc:2243] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.594882  2025 raft_consensus.cc:2272] T 92c9aeccadd4498da1f0e880c9b63864 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.596781  2025 tablet_replica.cc:333] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.597385  2025 raft_consensus.cc:2243] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.598167  2025 raft_consensus.cc:2272] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.599843  2025 tablet_replica.cc:333] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.600279  2025 raft_consensus.cc:2243] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.600666  2025 raft_consensus.cc:2272] T 274bd992d2474f4a97baf74cd6c15f60 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.602646  2025 tablet_replica.cc:333] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.603118  2025 raft_consensus.cc:2243] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.603535  2025 raft_consensus.cc:2272] T e5df601bbb544e56bf2bab6b83e6eefa P ce954fb530b1486ab6d791f2ce7de4e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.605376  2025 tablet_replica.cc:333] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.605795  2025 raft_consensus.cc:2243] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.606577  2025 raft_consensus.cc:2272] T 0a92e3bed61c42038559ef6437c26524 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.608431  2025 tablet_replica.cc:333] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3: stopping tablet replica
I20260709 13:20:33.608824  2025 raft_consensus.cc:2243] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.609326  2025 raft_consensus.cc:2272] T e77725ae01e740148beb2ff3260cabc9 P ce954fb530b1486ab6d791f2ce7de4e3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:33.623976 13259 debug-util.cc:398] Leaking SignalData structure 0x7b0800176520 after lost signal to thread 2028
W20260709 13:20:33.625233 13259 debug-util.cc:398] Leaking SignalData structure 0x7b08001eb680 after lost signal to thread 13262
W20260709 13:20:33.627022 13259 debug-util.cc:398] Leaking SignalData structure 0x7b080029b9e0 after lost signal to thread 13429
W20260709 13:20:33.627979 13259 debug-util.cc:398] Leaking SignalData structure 0x7b0800159060 after lost signal to thread 13503
I20260709 13:20:33.651666  2025 tablet_server.cc:196] TabletServer@127.1.250.66:0 shutdown complete.
I20260709 13:20:33.688300  2025 tablet_server.cc:179] TabletServer@127.1.250.67:0 shutting down...
W20260709 13:20:33.689564 13445 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.250.66:34003: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260709 13:20:33.694897 13445 consensus_peers.cc:597] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 -> Peer ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003): Couldn't send request to peer ce954fb530b1486ab6d791f2ce7de4e3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:34003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:33.721411  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:33.722311  2025 tablet_replica.cc:333] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.723299  2025 raft_consensus.cc:2243] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.724390  2025 raft_consensus.cc:2272] T 19cb4f740e82464a8c3f94974d85c467 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.726398  2025 tablet_replica.cc:333] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.726992  2025 raft_consensus.cc:2243] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.727764  2025 raft_consensus.cc:2272] T c1b39e10afea4f3aa6474ca5b12f5d4f P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.729970  2025 tablet_replica.cc:333] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.730727  2025 raft_consensus.cc:2243] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.731267  2025 raft_consensus.cc:2272] T 3cf6e878e39844f7b4b2ab2f74f1af53 P 7e10c77aaefa4ca282e71044a2c0f759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.733487  2025 tablet_replica.cc:333] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.734090  2025 raft_consensus.cc:2243] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.734606  2025 raft_consensus.cc:2272] T 699587f5d5914572a41c3d5623876e89 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:33.734850 13445 consensus_peers.cc:597] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 -> Peer ce954fb530b1486ab6d791f2ce7de4e3 (127.1.250.66:34003): Couldn't send request to peer ce954fb530b1486ab6d791f2ce7de4e3. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:34003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:33.736780  2025 tablet_replica.cc:333] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.737488  2025 raft_consensus.cc:2243] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.737952  2025 raft_consensus.cc:2272] T 3135b8a2b7fb4bf193c6cfbd59a61a46 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.740126  2025 tablet_replica.cc:333] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.740731  2025 raft_consensus.cc:2243] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.741555  2025 raft_consensus.cc:2272] T 63767942a864468b9b92f958327cd29e P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.743399  2025 tablet_replica.cc:333] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.744092  2025 raft_consensus.cc:2243] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.744555  2025 raft_consensus.cc:2272] T d0b290df474a492db4a6f3f4fad3c6c7 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.746806  2025 tablet_replica.cc:333] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.747390  2025 raft_consensus.cc:2243] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.747848  2025 raft_consensus.cc:2272] T a3b4d9d0e7894d3fb39494067103dcfa P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.750480  2025 tablet_replica.cc:333] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.751088  2025 raft_consensus.cc:2243] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.751832  2025 raft_consensus.cc:2272] T 6a4a456b852a43cbaefa6af8ca085ac6 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.753978  2025 tablet_replica.cc:333] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.754590  2025 raft_consensus.cc:2243] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.755528  2025 raft_consensus.cc:2272] T 6f66ce72872a4a239fd486c1163436f8 P 7e10c77aaefa4ca282e71044a2c0f759 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.758072  2025 tablet_replica.cc:333] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.758728  2025 raft_consensus.cc:2243] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.759565  2025 raft_consensus.cc:2272] T 92c9aeccadd4498da1f0e880c9b63864 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.761736  2025 tablet_replica.cc:333] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.762281  2025 raft_consensus.cc:2243] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.762799  2025 raft_consensus.cc:2272] T 64148c1248744360aac836cae6721a49 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.764561  2025 tablet_replica.cc:333] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.765141  2025 raft_consensus.cc:2243] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.765601  2025 raft_consensus.cc:2272] T 9270b20602874b468e7a2e81aa8a7634 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.768005  2025 tablet_replica.cc:333] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.768610  2025 raft_consensus.cc:2243] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.769114  2025 raft_consensus.cc:2272] T 1dc56481aa6146eda2ef7d0202cb3e18 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.771922  2025 tablet_replica.cc:333] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.772477  2025 raft_consensus.cc:2243] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.773319  2025 raft_consensus.cc:2272] T e5df601bbb544e56bf2bab6b83e6eefa P 7e10c77aaefa4ca282e71044a2c0f759 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.775323  2025 tablet_replica.cc:333] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.775876  2025 raft_consensus.cc:2243] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.776331  2025 raft_consensus.cc:2272] T 0a92e3bed61c42038559ef6437c26524 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.778789  2025 tablet_replica.cc:333] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.779309  2025 raft_consensus.cc:2243] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.779791  2025 raft_consensus.cc:2272] T 274bd992d2474f4a97baf74cd6c15f60 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.781950  2025 tablet_replica.cc:333] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759: stopping tablet replica
I20260709 13:20:33.782408  2025 raft_consensus.cc:2243] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.783070  2025 raft_consensus.cc:2272] T e77725ae01e740148beb2ff3260cabc9 P 7e10c77aaefa4ca282e71044a2c0f759 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.838963  2025 tablet_server.cc:196] TabletServer@127.1.250.67:0 shutdown complete.
I20260709 13:20:33.896610  2025 master.cc:562] Master@127.1.250.126:37373 shutting down...
I20260709 13:20:33.932911  2025 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.933604  2025 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.933969  2025 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0d95385a17ae44959415021aef51ec3a: stopping tablet replica
W20260709 13:20:34.952840  2025 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 13259)
W20260709 13:20:35.953579  2025 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 13259)
I20260709 13:20:36.471370  2025 master.cc:584] Master@127.1.250.126:37373 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (15743 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:20:36.565265  2025 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.250.126:36751
I20260709 13:20:36.566535  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:36.572634 13815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:36.572961 13816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:36.574057 13818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:36.575198  2025 server_base.cc:1061] running on GCE node
I20260709 13:20:36.576174  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:36.576370  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:36.576484  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603236576474 us; error 0 us; skew 500 ppm
I20260709 13:20:36.576948  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:36.579504  2025 webserver.cc:533] Webserver started at http://127.1.250.126:44293/ using document root <none> and password file <none>
I20260709 13:20:36.580056  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:36.580281  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:36.580552  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:36.582165  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/master-0-root/instance:
uuid: "51eef8e846484bcaa52f2f0dcbca519c"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-g4pn"
I20260709 13:20:36.587268  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:20:36.591406 13823 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.592448  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:20:36.592731  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/master-0-root
uuid: "51eef8e846484bcaa52f2f0dcbca519c"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-g4pn"
I20260709 13:20:36.592983  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:36.615433  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:36.616742  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:36.662547  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.126:36751
I20260709 13:20:36.662612 13874 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.126:36751 every 8 connection(s)
I20260709 13:20:36.667030 13875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.685993 13875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c: Bootstrap starting.
I20260709 13:20:36.692468 13875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.698032 13875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c: No bootstrap required, opened a new log
I20260709 13:20:36.700680 13875 raft_consensus.cc:359] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eef8e846484bcaa52f2f0dcbca519c" member_type: VOTER }
I20260709 13:20:36.701321 13875 raft_consensus.cc:385] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.701532 13875 raft_consensus.cc:740] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51eef8e846484bcaa52f2f0dcbca519c, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.702132 13875 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eef8e846484bcaa52f2f0dcbca519c" member_type: VOTER }
I20260709 13:20:36.702629 13875 raft_consensus.cc:399] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:36.702881 13875 raft_consensus.cc:493] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:36.703131 13875 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.708983 13875 raft_consensus.cc:515] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eef8e846484bcaa52f2f0dcbca519c" member_type: VOTER }
I20260709 13:20:36.709565 13875 leader_election.cc:304] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51eef8e846484bcaa52f2f0dcbca519c; no voters: 
I20260709 13:20:36.710948 13875 leader_election.cc:290] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:36.711421 13878 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:36.713023 13878 raft_consensus.cc:697] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [term 1 LEADER]: Becoming Leader. State: Replica: 51eef8e846484bcaa52f2f0dcbca519c, State: Running, Role: LEADER
I20260709 13:20:36.713825 13878 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eef8e846484bcaa52f2f0dcbca519c" member_type: VOTER }
I20260709 13:20:36.714390 13875 sys_catalog.cc:565] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:36.720717 13879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51eef8e846484bcaa52f2f0dcbca519c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eef8e846484bcaa52f2f0dcbca519c" member_type: VOTER } }
I20260709 13:20:36.721570 13879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:36.721356 13880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51eef8e846484bcaa52f2f0dcbca519c. Latest consensus state: current_term: 1 leader_uuid: "51eef8e846484bcaa52f2f0dcbca519c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eef8e846484bcaa52f2f0dcbca519c" member_type: VOTER } }
I20260709 13:20:36.722100 13880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:36.723970 13886 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:36.729974 13886 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:36.732545  2025 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:36.739629 13886 catalog_manager.cc:1383] Generated new cluster ID: bf6a4bf0b1a34c1786f198dd53125fd2
I20260709 13:20:36.739943 13886 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:36.756749 13886 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:36.759107 13886 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:36.779984 13886 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c: Generated new TSK 0
I20260709 13:20:36.780637 13886 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:36.799409  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:36.808216 13896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:36.809144 13897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:36.815071  2025 server_base.cc:1061] running on GCE node
W20260709 13:20:36.819717 13899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:36.821391  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:36.821678  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:36.821923  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603236821898 us; error 0 us; skew 500 ppm
I20260709 13:20:36.822880  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:36.826107  2025 webserver.cc:533] Webserver started at http://127.1.250.65:32887/ using document root <none> and password file <none>
I20260709 13:20:36.826678  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:36.826879  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:36.827198  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:36.828620  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/ts-0-root/instance:
uuid: "9fd8162413804fe29717f0e0fb2f288b"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-g4pn"
I20260709 13:20:36.834848  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:36.839190 13904 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.840183  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:20:36.840471  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/ts-0-root
uuid: "9fd8162413804fe29717f0e0fb2f288b"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-g4pn"
I20260709 13:20:36.840749  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:36.854341  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:36.856148  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:36.857838  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:36.860353  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:36.860540  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.860858  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:36.861034  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.915632  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.65:41903
I20260709 13:20:36.915752 13966 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.65:41903 every 8 connection(s)
I20260709 13:20:36.921859  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:36.930194 13971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:36.932210 13972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:36.937284  2025 server_base.cc:1061] running on GCE node
W20260709 13:20:36.938695 13974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:36.939939  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:36.940254  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:36.940480  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603236940459 us; error 0 us; skew 500 ppm
I20260709 13:20:36.940914 13967 heartbeater.cc:344] Connected to a master server at 127.1.250.126:36751
I20260709 13:20:36.941183  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:36.941411 13967 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:36.942584 13967 heartbeater.cc:507] Master 127.1.250.126:36751 requested a full tablet report, sending...
I20260709 13:20:36.944267  2025 webserver.cc:533] Webserver started at http://127.1.250.66:43917/ using document root <none> and password file <none>
I20260709 13:20:36.944957  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:36.945204  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:36.945513  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:36.945565 13840 ts_manager.cc:194] Registered new tserver with Master: 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903)
I20260709 13:20:36.946946  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/ts-1-root/instance:
uuid: "5cf4c3c457844a8c8d0c825d6d707188"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-g4pn"
I20260709 13:20:36.947918 13840 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43876
I20260709 13:20:36.952250  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 13:20:36.956607 13979 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.957662  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:20:36.957989  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/ts-1-root
uuid: "5cf4c3c457844a8c8d0c825d6d707188"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-g4pn"
I20260709 13:20:36.958297  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:36.978540  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:36.979945  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:36.981676  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:36.984103  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:36.984351  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.984604  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:36.984791  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:37.035676  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.66:33499
I20260709 13:20:37.035820 14041 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.66:33499 every 8 connection(s)
I20260709 13:20:37.041271  2025 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:37.050658 14045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:37.052424 14046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:37.056285  2025 server_base.cc:1061] running on GCE node
W20260709 13:20:37.057197 14048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:37.057842 14042 heartbeater.cc:344] Connected to a master server at 127.1.250.126:36751
I20260709 13:20:37.058384 14042 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:37.058553  2025 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:37.058858  2025 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:37.059038  2025 hybrid_clock.cc:648] HybridClock initialized: now 1783603237059023 us; error 0 us; skew 500 ppm
I20260709 13:20:37.059397 14042 heartbeater.cc:507] Master 127.1.250.126:36751 requested a full tablet report, sending...
I20260709 13:20:37.059719  2025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:37.061998 13840 ts_manager.cc:194] Registered new tserver with Master: 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:37.063015  2025 webserver.cc:533] Webserver started at http://127.1.250.67:37727/ using document root <none> and password file <none>
I20260709 13:20:37.063621  2025 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:37.063853  2025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:37.063774 13840 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43878
I20260709 13:20:37.064431  2025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:37.065932  2025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/ts-2-root/instance:
uuid: "a308a1dc4fe94728bd0f56413fb14987"
format_stamp: "Formatted at 2026-07-09 13:20:37 on dist-test-slave-g4pn"
I20260709 13:20:37.070839  2025 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:20:37.075668 14053 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:37.076723  2025 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:20:37.077174  2025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/ts-2-root
uuid: "a308a1dc4fe94728bd0f56413fb14987"
format_stamp: "Formatted at 2026-07-09 13:20:37 on dist-test-slave-g4pn"
I20260709 13:20:37.077559  2025 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQf3fUo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602894180814-2025-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:37.090435  2025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:37.091758  2025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:37.093175  2025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:37.095660  2025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:37.095904  2025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:37.096155  2025 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:37.096511  2025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:37.146828  2025 rpc_server.cc:307] RPC server started. Bound to: 127.1.250.67:46111
I20260709 13:20:37.146981 14115 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.250.67:46111 every 8 connection(s)
I20260709 13:20:37.163552 14116 heartbeater.cc:344] Connected to a master server at 127.1.250.126:36751
I20260709 13:20:37.164165 14116 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:37.165613 14116 heartbeater.cc:507] Master 127.1.250.126:36751 requested a full tablet report, sending...
I20260709 13:20:37.167790 13840 ts_manager.cc:194] Registered new tserver with Master: a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:37.167891  2025 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017812793s
I20260709 13:20:37.169557 13840 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43886
I20260709 13:20:37.199150 13840 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43902:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:37.202302 13840 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:37.294677 14081 tablet_service.cc:1511] Processing CreateTablet for tablet 9297ad2180a543fdbb0a6546b011bd77 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:37.296482 14081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9297ad2180a543fdbb0a6546b011bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.297003 14007 tablet_service.cc:1511] Processing CreateTablet for tablet 9297ad2180a543fdbb0a6546b011bd77 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:37.298539 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9297ad2180a543fdbb0a6546b011bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.298219 14079 tablet_service.cc:1511] Processing CreateTablet for tablet 5537ebb7b20747ea8fd6d1601a6e55c9 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:37.300072 14079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5537ebb7b20747ea8fd6d1601a6e55c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.302426 14006 tablet_service.cc:1511] Processing CreateTablet for tablet 9c361298644c46a8b929ba18dc463a27 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:37.303957 14006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c361298644c46a8b929ba18dc463a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.306376 14005 tablet_service.cc:1511] Processing CreateTablet for tablet 5537ebb7b20747ea8fd6d1601a6e55c9 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:37.306595 14080 tablet_service.cc:1511] Processing CreateTablet for tablet 9c361298644c46a8b929ba18dc463a27 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:37.307861 14005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5537ebb7b20747ea8fd6d1601a6e55c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.308369 14080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c361298644c46a8b929ba18dc463a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.310478 14004 tablet_service.cc:1511] Processing CreateTablet for tablet bfca25342f2b45188d85d07a53b333ed (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:37.311383 14003 tablet_service.cc:1511] Processing CreateTablet for tablet b6002321e89f4925808b3d1110305308 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:37.312032 14004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfca25342f2b45188d85d07a53b333ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.313918 14075 tablet_service.cc:1511] Processing CreateTablet for tablet b589e88d96c048bea4491addeedd7ee4 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:37.315111 14002 tablet_service.cc:1511] Processing CreateTablet for tablet 909e41a091f7440fa9c5fff3cefc005d (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:37.312968 14003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6002321e89f4925808b3d1110305308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.313910 14078 tablet_service.cc:1511] Processing CreateTablet for tablet bfca25342f2b45188d85d07a53b333ed (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:37.316601 14002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 909e41a091f7440fa9c5fff3cefc005d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.317333 14075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b589e88d96c048bea4491addeedd7ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.317446 14076 tablet_service.cc:1511] Processing CreateTablet for tablet 909e41a091f7440fa9c5fff3cefc005d (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:37.319186 14076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 909e41a091f7440fa9c5fff3cefc005d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.319952 14078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfca25342f2b45188d85d07a53b333ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.321789 14001 tablet_service.cc:1511] Processing CreateTablet for tablet b589e88d96c048bea4491addeedd7ee4 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:37.323390 14001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b589e88d96c048bea4491addeedd7ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.326643 14000 tablet_service.cc:1511] Processing CreateTablet for tablet 619db8da711b4208b7e35e961f307e4d (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:37.328476 14000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619db8da711b4208b7e35e961f307e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.315397 14077 tablet_service.cc:1511] Processing CreateTablet for tablet b6002321e89f4925808b3d1110305308 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:37.330338 14077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6002321e89f4925808b3d1110305308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.348102 14074 tablet_service.cc:1511] Processing CreateTablet for tablet 619db8da711b4208b7e35e961f307e4d (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:37.349675 14074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619db8da711b4208b7e35e961f307e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.360960 13932 tablet_service.cc:1511] Processing CreateTablet for tablet 9297ad2180a543fdbb0a6546b011bd77 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:37.362633 13932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9297ad2180a543fdbb0a6546b011bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.364459 13999 tablet_service.cc:1511] Processing CreateTablet for tablet edc94be6c3e346598944c6f19db99795 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:37.366094 13999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc94be6c3e346598944c6f19db99795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.371441 13931 tablet_service.cc:1511] Processing CreateTablet for tablet 9c361298644c46a8b929ba18dc463a27 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:37.374176 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c361298644c46a8b929ba18dc463a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.376696 14073 tablet_service.cc:1511] Processing CreateTablet for tablet edc94be6c3e346598944c6f19db99795 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:37.378255 14073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc94be6c3e346598944c6f19db99795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.392009 13930 tablet_service.cc:1511] Processing CreateTablet for tablet 5537ebb7b20747ea8fd6d1601a6e55c9 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:37.394730 13930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5537ebb7b20747ea8fd6d1601a6e55c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.407919 13929 tablet_service.cc:1511] Processing CreateTablet for tablet bfca25342f2b45188d85d07a53b333ed (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:37.410547 13929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfca25342f2b45188d85d07a53b333ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.439600 13928 tablet_service.cc:1511] Processing CreateTablet for tablet b6002321e89f4925808b3d1110305308 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:37.462046 13928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6002321e89f4925808b3d1110305308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.476338 14130 tablet_bootstrap.cc:492] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:37.479221 13927 tablet_service.cc:1511] Processing CreateTablet for tablet 909e41a091f7440fa9c5fff3cefc005d (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:37.481312 13927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 909e41a091f7440fa9c5fff3cefc005d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.489369 14130 tablet_bootstrap.cc:654] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.510759 13926 tablet_service.cc:1511] Processing CreateTablet for tablet b589e88d96c048bea4491addeedd7ee4 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:37.517287 14131 tablet_bootstrap.cc:492] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:37.524696 14131 tablet_bootstrap.cc:654] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.513142 13926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b589e88d96c048bea4491addeedd7ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.531788 13931 tablet_service.cc:1511] Processing CreateTablet for tablet edc94be6c3e346598944c6f19db99795 (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:37.533317 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc94be6c3e346598944c6f19db99795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.538190 13929 tablet_service.cc:1511] Processing CreateTablet for tablet 619db8da711b4208b7e35e961f307e4d (DEFAULT_TABLE table=test-workload [id=1f59126921f749b38345749e097808f2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:37.540225 13929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619db8da711b4208b7e35e961f307e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.543931 14133 tablet_bootstrap.cc:492] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:37.548899 14130 tablet_bootstrap.cc:492] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:37.555294 14130 ts_tablet_manager.cc:1403] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.079s	user 0.022s	sys 0.017s
I20260709 13:20:37.557922 14130 raft_consensus.cc:359] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
I20260709 13:20:37.558756 14130 raft_consensus.cc:385] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.559116 14130 raft_consensus.cc:740] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.560262 14130 consensus_queue.cc:260] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
I20260709 13:20:37.566711 14042 heartbeater.cc:499] Master 127.1.250.126:36751 was elected leader, sending a full tablet report...
I20260709 13:20:37.567337 14130 ts_tablet_manager.cc:1434] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.002s
I20260709 13:20:37.568295 14131 tablet_bootstrap.cc:492] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:37.568904 14131 ts_tablet_manager.cc:1403] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.004s
I20260709 13:20:37.568919 14130 tablet_bootstrap.cc:492] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:37.568991 14133 tablet_bootstrap.cc:654] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.572429 14131 raft_consensus.cc:359] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.573444 14131 raft_consensus.cc:385] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.573814 14131 raft_consensus.cc:740] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.575124 14131 consensus_queue.cc:260] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.580449 14130 tablet_bootstrap.cc:654] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.586570 14131 ts_tablet_manager.cc:1434] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.003s
I20260709 13:20:37.587598 14116 heartbeater.cc:499] Master 127.1.250.126:36751 was elected leader, sending a full tablet report...
I20260709 13:20:37.590762 14133 tablet_bootstrap.cc:492] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:37.591775 14133 ts_tablet_manager.cc:1403] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.012s
I20260709 13:20:37.594530 14131 tablet_bootstrap.cc:492] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:37.597023 14133 raft_consensus.cc:359] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.598518 14133 raft_consensus.cc:385] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.598978 14133 raft_consensus.cc:740] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.600754 14133 consensus_queue.cc:260] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.604873 14131 tablet_bootstrap.cc:654] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.607209 13967 heartbeater.cc:499] Master 127.1.250.126:36751 was elected leader, sending a full tablet report...
I20260709 13:20:37.607875 14133 ts_tablet_manager.cc:1434] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.007s
I20260709 13:20:37.609113 14133 tablet_bootstrap.cc:492] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:37.614907 14130 tablet_bootstrap.cc:492] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:37.615638 14130 ts_tablet_manager.cc:1403] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.019s
I20260709 13:20:37.617461 14131 tablet_bootstrap.cc:492] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:37.617511 14135 raft_consensus.cc:493] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.617866 14133 tablet_bootstrap.cc:654] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.618274 14131 ts_tablet_manager.cc:1403] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.012s
I20260709 13:20:37.618206 14135 raft_consensus.cc:515] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
I20260709 13:20:37.618894 14130 raft_consensus.cc:359] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.619791 14130 raft_consensus.cc:385] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.620216 14130 raft_consensus.cc:740] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.621241 14130 consensus_queue.cc:260] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.622109 14131 raft_consensus.cc:359] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.622903 14131 raft_consensus.cc:385] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.623207 14131 raft_consensus.cc:740] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.624130 14131 consensus_queue.cc:260] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.626639 14131 ts_tablet_manager.cc:1434] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:20:37.627354 14135 leader_election.cc:290] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111), 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903)
I20260709 13:20:37.627817 14131 tablet_bootstrap.cc:492] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:37.636337 14131 tablet_bootstrap.cc:654] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.650025 14131 tablet_bootstrap.cc:492] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:37.650662 14131 ts_tablet_manager.cc:1403] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.008s
W20260709 13:20:37.651557 14117 tablet.cc:2406] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:20:37.654119 14131 raft_consensus.cc:359] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
I20260709 13:20:37.655330 14131 raft_consensus.cc:385] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.655681 14131 raft_consensus.cc:740] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.656693 14131 consensus_queue.cc:260] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
I20260709 13:20:37.659400 14131 ts_tablet_manager.cc:1434] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:37.660610 14131 tablet_bootstrap.cc:492] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:37.668221 14131 tablet_bootstrap.cc:654] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.668478 14130 ts_tablet_manager.cc:1434] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.052s	user 0.019s	sys 0.024s
I20260709 13:20:37.672860 14130 tablet_bootstrap.cc:492] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:37.680760 14131 tablet_bootstrap.cc:492] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:37.681710 14131 ts_tablet_manager.cc:1403] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 13:20:37.686136 14130 tablet_bootstrap.cc:654] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.691495 14131 raft_consensus.cc:359] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.692384 14131 raft_consensus.cc:385] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.692726 14131 raft_consensus.cc:740] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.693625 14131 consensus_queue.cc:260] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.696422 14131 ts_tablet_manager.cc:1434] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:20:37.697782 14131 tablet_bootstrap.cc:492] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:37.699025 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9297ad2180a543fdbb0a6546b011bd77" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:37.699860 14091 raft_consensus.cc:2468] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 0.
I20260709 13:20:37.701778 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9297ad2180a543fdbb0a6546b011bd77" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:37.702696 14133 tablet_bootstrap.cc:492] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:37.703261 14133 ts_tablet_manager.cc:1403] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.094s	user 0.025s	sys 0.049s
I20260709 13:20:37.703953 13980 leader_election.cc:304] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:37.705446 14143 raft_consensus.cc:2804] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.705909 14143 raft_consensus.cc:493] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.706228 14143 raft_consensus.cc:3060] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.707535 14131 tablet_bootstrap.cc:654] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.707284 14133 raft_consensus.cc:359] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.708127 14133 raft_consensus.cc:385] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.708451 14133 raft_consensus.cc:740] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
W20260709 13:20:37.709607 13980 leader_election.cc:343] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.709800 14133 consensus_queue.cc:260] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.717468 14133 ts_tablet_manager.cc:1434] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:20:37.719286 14133 tablet_bootstrap.cc:492] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
W20260709 13:20:37.726845 13888 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:37.727289 14130 tablet_bootstrap.cc:492] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:37.727962 14130 ts_tablet_manager.cc:1403] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.055s	user 0.020s	sys 0.023s
I20260709 13:20:37.728134 14133 tablet_bootstrap.cc:654] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.730510 14131 tablet_bootstrap.cc:492] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:37.730682 14139 raft_consensus.cc:493] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.731467 14131 ts_tablet_manager.cc:1403] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.008s
I20260709 13:20:37.731616 14130 raft_consensus.cc:359] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.732641 14130 raft_consensus.cc:385] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.732978 14130 raft_consensus.cc:740] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.733844 14130 consensus_queue.cc:260] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.735280 14131 raft_consensus.cc:359] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.736248 14131 raft_consensus.cc:385] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.736609 14131 raft_consensus.cc:740] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.737740 14131 consensus_queue.cc:260] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.739051 14130 ts_tablet_manager.cc:1434] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:20:37.740187 14130 tablet_bootstrap.cc:492] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:37.740476 14131 ts_tablet_manager.cc:1434] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:20:37.741876 14131 tablet_bootstrap.cc:492] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:37.731493 14139 raft_consensus.cc:515] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.747874 14130 tablet_bootstrap.cc:654] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.748426 14139 leader_election.cc:290] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:37.749034 14137 raft_consensus.cc:493] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.756598 14137 raft_consensus.cc:515] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.750468 14131 tablet_bootstrap.cc:654] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.754770 14130 tablet_bootstrap.cc:492] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:37.760437 14130 ts_tablet_manager.cc:1403] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.002s
I20260709 13:20:37.763242 14137 leader_election.cc:290] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:37.766350 14131 tablet_bootstrap.cc:492] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:37.767017 14131 ts_tablet_manager.cc:1403] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.003s
I20260709 13:20:37.767261 14133 tablet_bootstrap.cc:492] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:37.767840 14133 ts_tablet_manager.cc:1403] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.017s
I20260709 13:20:37.771322 14133 raft_consensus.cc:359] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.771682 14131 raft_consensus.cc:359] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.762823 14143 raft_consensus.cc:515] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
I20260709 13:20:37.772567 14131 raft_consensus.cc:385] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.773046 14131 raft_consensus.cc:740] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.774042 14131 consensus_queue.cc:260] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.775547 14139 raft_consensus.cc:493] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.776084 14139 raft_consensus.cc:515] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.776733 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9297ad2180a543fdbb0a6546b011bd77" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:37.777155 14131 ts_tablet_manager.cc:1434] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.006s
I20260709 13:20:37.774868 14143 leader_election.cc:290] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Requested vote from peers a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111), 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903)
W20260709 13:20:37.778275 13980 leader_election.cc:343] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.778338 14131 tablet_bootstrap.cc:492] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:37.778394 14139 leader_election.cc:290] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:37.772230 14133 raft_consensus.cc:385] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.763742 14130 raft_consensus.cc:359] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.779657 14133 raft_consensus.cc:740] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.779449 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9297ad2180a543fdbb0a6546b011bd77" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:37.779820 14130 raft_consensus.cc:385] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.780695 14130 raft_consensus.cc:740] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.781023 14091 raft_consensus.cc:3060] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.780952 14133 consensus_queue.cc:260] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.781699 14130 consensus_queue.cc:260] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.786067 14133 ts_tablet_manager.cc:1434] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:20:37.788136 14130 ts_tablet_manager.cc:1434] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:20:37.790151 14133 tablet_bootstrap.cc:492] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:37.798167 14091 raft_consensus.cc:2468] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 1.
I20260709 13:20:37.799829 13980 leader_election.cc:304] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:37.800638 14133 tablet_bootstrap.cc:654] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.801203 14143 raft_consensus.cc:2804] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.801776 14143 raft_consensus.cc:697] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Becoming Leader. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:37.802698 14143 consensus_queue.cc:237] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
I20260709 13:20:37.805855 14130 tablet_bootstrap.cc:492] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:37.807209 14131 tablet_bootstrap.cc:654] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.813563 14133 tablet_bootstrap.cc:492] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:37.814540 14133 ts_tablet_manager.cc:1403] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.005s
I20260709 13:20:37.823840 14133 raft_consensus.cc:359] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
I20260709 13:20:37.825037 14133 raft_consensus.cc:385] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.825515 14133 raft_consensus.cc:740] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.825857 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfca25342f2b45188d85d07a53b333ed" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:37.826830 14133 consensus_queue.cc:260] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
W20260709 13:20:37.828778 13905 leader_election.cc:343] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.829702 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c361298644c46a8b929ba18dc463a27" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:37.830487 14017 raft_consensus.cc:2468] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 0.
I20260709 13:20:37.832379 13905 leader_election.cc:304] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b; no voters: 
I20260709 13:20:37.833691 14139 raft_consensus.cc:2804] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.834092 14139 raft_consensus.cc:493] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.834473 14139 raft_consensus.cc:3060] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.840070 14133 ts_tablet_manager.cc:1434] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 13:20:37.840476 14130 tablet_bootstrap.cc:654] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.841811 14131 tablet_bootstrap.cc:492] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:37.845495 14131 ts_tablet_manager.cc:1403] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.014s
I20260709 13:20:37.844619 14139 raft_consensus.cc:515] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.848695 14131 raft_consensus.cc:359] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.843390 14133 tablet_bootstrap.cc:492] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:37.856269 14130 tablet_bootstrap.cc:492] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:37.857185 14130 ts_tablet_manager.cc:1403] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.004s
I20260709 13:20:37.860926 14130 raft_consensus.cc:359] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.861896 14130 raft_consensus.cc:385] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.862367 14130 raft_consensus.cc:740] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.862805 14133 tablet_bootstrap.cc:654] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.863555 14130 consensus_queue.cc:260] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.866701 14131 raft_consensus.cc:385] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.865295 13839 catalog_manager.cc:5697] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.867122 14131 raft_consensus.cc:740] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.868750 14131 consensus_queue.cc:260] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.873308 14131 ts_tablet_manager.cc:1434] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 13:20:37.874279 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c361298644c46a8b929ba18dc463a27" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:37.875037 14017 raft_consensus.cc:3060] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.875065 14131 tablet_bootstrap.cc:492] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:37.886821 14139 leader_election.cc:290] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 election: Requested vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:37.866971 14130 ts_tablet_manager.cc:1434] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:20:37.888994 14017 raft_consensus.cc:2468] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 1.
I20260709 13:20:37.890323 14130 tablet_bootstrap.cc:492] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:37.890493 13905 leader_election.cc:304] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b; no voters: 
I20260709 13:20:37.893265 14139 raft_consensus.cc:2804] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.893926 14139 raft_consensus.cc:697] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [term 1 LEADER]: Becoming Leader. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Running, Role: LEADER
I20260709 13:20:37.898332 14139 consensus_queue.cc:237] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.888232 14131 tablet_bootstrap.cc:654] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.919279 14130 tablet_bootstrap.cc:654] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.926970 14137 raft_consensus.cc:493] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.927644 14137 raft_consensus.cc:515] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.929972 14137 leader_election.cc:290] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:37.930716 14137 raft_consensus.cc:493] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.931178 14137 raft_consensus.cc:515] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.935137 14137 leader_election.cc:290] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:37.937551 14143 raft_consensus.cc:493] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.938534 14143 raft_consensus.cc:515] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.939546 14133 tablet_bootstrap.cc:492] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:37.940276 14133 ts_tablet_manager.cc:1403] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.097s	user 0.026s	sys 0.041s
I20260709 13:20:37.942500 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5537ebb7b20747ea8fd6d1601a6e55c9" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:37.944471 14133 raft_consensus.cc:359] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.945262 13942 raft_consensus.cc:2468] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 0.
I20260709 13:20:37.947140 13980 leader_election.cc:304] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b; no voters: 
I20260709 13:20:37.947883 14133 raft_consensus.cc:385] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.948292 14133 raft_consensus.cc:740] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.948683 14135 raft_consensus.cc:2804] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.949110 14135 raft_consensus.cc:493] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.949479 14135 raft_consensus.cc:3060] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.949280 14133 consensus_queue.cc:260] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.952845 14133 ts_tablet_manager.cc:1434] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:20:37.954078 14133 tablet_bootstrap.cc:492] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:37.953939 14143 leader_election.cc:290] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:37.957342 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5537ebb7b20747ea8fd6d1601a6e55c9" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:37.958179 14091 raft_consensus.cc:2468] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 0.
I20260709 13:20:37.973268 14143 raft_consensus.cc:493] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.974165 14133 tablet_bootstrap.cc:654] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.975052 14137 raft_consensus.cc:493] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.974609 14143 raft_consensus.cc:515] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.975636 14137 raft_consensus.cc:515] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:37.978085 14137 leader_election.cc:290] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:37.994174 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619db8da711b4208b7e35e961f307e4d" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:37.995559 13840 catalog_manager.cc:5697] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65). New cstate: current_term: 1 leader_uuid: "9fd8162413804fe29717f0e0fb2f288b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:38.001313 13980 leader_election.cc:343] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:38.004730 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619db8da711b4208b7e35e961f307e4d" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:38.010213 14091 raft_consensus.cc:2468] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 0.
I20260709 13:20:38.012306 13980 leader_election.cc:304] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:38.019094 14171 raft_consensus.cc:2804] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:38.019635 14171 raft_consensus.cc:493] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.021196 14143 leader_election.cc:290] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:38.019980 14171 raft_consensus.cc:3060] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.030807 14133 tablet_bootstrap.cc:492] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:38.031828 14133 ts_tablet_manager.cc:1403] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.026s
I20260709 13:20:38.032074 14131 tablet_bootstrap.cc:492] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:38.032737 14131 ts_tablet_manager.cc:1403] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.158s	user 0.029s	sys 0.082s
I20260709 13:20:38.024993 14135 raft_consensus.cc:515] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.037437 14167 raft_consensus.cc:493] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.038444 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfca25342f2b45188d85d07a53b333ed" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:38.038609 14139 raft_consensus.cc:493] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.039194 14091 raft_consensus.cc:2468] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 0.
I20260709 13:20:38.039244 14139 raft_consensus.cc:515] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
I20260709 13:20:38.040309 14131 raft_consensus.cc:359] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.040822 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c361298644c46a8b929ba18dc463a27" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:38.041224 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5537ebb7b20747ea8fd6d1601a6e55c9" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:38.041900 13942 raft_consensus.cc:3060] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.042472 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c361298644c46a8b929ba18dc463a27" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:38.045511 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9297ad2180a543fdbb0a6546b011bd77" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:38.045825 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "909e41a091f7440fa9c5fff3cefc005d" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:38.046312 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9297ad2180a543fdbb0a6546b011bd77" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:38.047083 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6002321e89f4925808b3d1110305308" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:38.047706 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6002321e89f4925808b3d1110305308" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:38.047850 13940 raft_consensus.cc:2468] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 0.
I20260709 13:20:38.048280 13905 leader_election.cc:304] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:38.049175 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619db8da711b4208b7e35e961f307e4d" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:38.049736 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619db8da711b4208b7e35e961f307e4d" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:38.050302 14163 raft_consensus.cc:2804] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:38.050483 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfca25342f2b45188d85d07a53b333ed" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:38.041828 14139 leader_election.cc:290] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:38.049207 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "909e41a091f7440fa9c5fff3cefc005d" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:38.052557 14090 raft_consensus.cc:2393] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd8162413804fe29717f0e0fb2f288b in current term 1: Already voted for candidate 5cf4c3c457844a8c8d0c825d6d707188 in this term.
I20260709 13:20:38.038347 14167 raft_consensus.cc:515] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.050805 14163 raft_consensus.cc:493] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.051409 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfca25342f2b45188d85d07a53b333ed" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:38.053550 14163 raft_consensus.cc:3060] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.055647 13905 leader_election.cc:304] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b; no voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987
I20260709 13:20:38.056634 14139 raft_consensus.cc:3060] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:38.057503 14054 leader_election.cc:343] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:38.058176 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5537ebb7b20747ea8fd6d1601a6e55c9" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
W20260709 13:20:38.058283 14054 leader_election.cc:343] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:38.059026 14090 raft_consensus.cc:3060] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:38.059238 14054 leader_election.cc:343] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:38.060043 14054 leader_election.cc:304] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:38.060868 14137 raft_consensus.cc:2804] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:20:38.061287 14054 leader_election.cc:343] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:38.061287 14137 raft_consensus.cc:493] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.062342 14137 raft_consensus.cc:3060] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.063267 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c361298644c46a8b929ba18dc463a27" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:38.063757 14133 raft_consensus.cc:359] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.041059 14131 raft_consensus.cc:385] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:38.066044 13942 raft_consensus.cc:2468] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 1.
I20260709 13:20:38.066244 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c361298644c46a8b929ba18dc463a27" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:38.066498 14135 leader_election.cc:290] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:38.072431 14013 raft_consensus.cc:2393] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a308a1dc4fe94728bd0f56413fb14987 in current term 1: Already voted for candidate 9fd8162413804fe29717f0e0fb2f288b in this term.
I20260709 13:20:38.060861 14091 raft_consensus.cc:2468] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 0.
I20260709 13:20:38.071688 14090 raft_consensus.cc:2468] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 1.
I20260709 13:20:38.065058 14163 raft_consensus.cc:515] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.072875 13980 leader_election.cc:304] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b; no voters: 
I20260709 13:20:38.075011 13938 raft_consensus.cc:2393] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a308a1dc4fe94728bd0f56413fb14987 in current term 1: Already voted for candidate 9fd8162413804fe29717f0e0fb2f288b in this term.
I20260709 13:20:38.073932 14054 leader_election.cc:304] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a308a1dc4fe94728bd0f56413fb14987; no voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:38.071786 14133 raft_consensus.cc:385] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:38.076872 14135 raft_consensus.cc:2804] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:38.062358 14167 leader_election.cc:290] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:38.077589 14133 raft_consensus.cc:740] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:38.078058 14054 leader_election.cc:304] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a308a1dc4fe94728bd0f56413fb14987; no voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:38.078675 14135 raft_consensus.cc:697] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Becoming Leader. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:38.076959 14173 raft_consensus.cc:3060] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.079559 14167 raft_consensus.cc:3060] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.079934 14135 consensus_queue.cc:237] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.068694 14171 raft_consensus.cc:515] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.081835 14014 raft_consensus.cc:2393] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a308a1dc4fe94728bd0f56413fb14987 in current term 1: Already voted for candidate 5cf4c3c457844a8c8d0c825d6d707188 in this term.
I20260709 13:20:38.081020 14137 raft_consensus.cc:515] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.071834 14131 raft_consensus.cc:740] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:38.078845 14130 tablet_bootstrap.cc:492] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:38.085945 14130 ts_tablet_manager.cc:1403] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.196s	user 0.011s	sys 0.014s
I20260709 13:20:38.079017 14133 consensus_queue.cc:260] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.086565 14054 leader_election.cc:304] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a308a1dc4fe94728bd0f56413fb14987; no voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:38.087112 13941 raft_consensus.cc:2468] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 0.
I20260709 13:20:38.087579 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfca25342f2b45188d85d07a53b333ed" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:38.085980 14131 consensus_queue.cc:260] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.088397 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619db8da711b4208b7e35e961f307e4d" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
W20260709 13:20:38.089473 13905 leader_election.cc:343] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:38.071733 14139 raft_consensus.cc:2749] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:38.090350 14163 leader_election.cc:290] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 election: Requested vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
W20260709 13:20:38.090406 13980 leader_election.cc:343] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:38.092912 14171 leader_election.cc:290] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:38.098281 14133 ts_tablet_manager.cc:1434] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.066s	user 0.016s	sys 0.001s
I20260709 13:20:38.094399 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619db8da711b4208b7e35e961f307e4d" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:38.102486 14090 raft_consensus.cc:3060] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.104751 14130 raft_consensus.cc:359] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.105643 14130 raft_consensus.cc:385] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:38.105965 14130 raft_consensus.cc:740] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:38.107267 14130 consensus_queue.cc:260] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.108632 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6002321e89f4925808b3d1110305308" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:38.110008 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfca25342f2b45188d85d07a53b333ed" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:38.110144 14173 raft_consensus.cc:2749] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:38.111646 13938 raft_consensus.cc:3060] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.113276 13839 catalog_manager.cc:5697] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.110744 14054 leader_election.cc:304] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:38.099846 14133 tablet_bootstrap.cc:492] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:38.118361 14167 raft_consensus.cc:2749] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:38.121577 14090 raft_consensus.cc:2468] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 1.
I20260709 13:20:38.122337 14173 raft_consensus.cc:2749] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:38.125741 13980 leader_election.cc:304] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:38.127259 14171 raft_consensus.cc:2804] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:38.127806 14171 raft_consensus.cc:697] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Becoming Leader. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:38.128702 14171 consensus_queue.cc:237] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.129347 14176 raft_consensus.cc:2804] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:38.131009 14176 raft_consensus.cc:493] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.131461 14176 raft_consensus.cc:3060] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.132382 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6002321e89f4925808b3d1110305308" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:38.125257 14137 leader_election.cc:290] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:38.134310 14130 ts_tablet_manager.cc:1434] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.002s
I20260709 13:20:38.135458 14130 tablet_bootstrap.cc:492] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
W20260709 13:20:38.135779 14054 leader_election.cc:343] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:38.137974 14135 raft_consensus.cc:493] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.138684 14135 raft_consensus.cc:515] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.148082 14133 tablet_bootstrap.cc:654] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:38.141234 14135 leader_election.cc:290] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:38.151227 14131 ts_tablet_manager.cc:1434] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.012s
I20260709 13:20:38.147990 14091 raft_consensus.cc:2468] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 1.
I20260709 13:20:38.152580 14131 tablet_bootstrap.cc:492] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:38.154173 13905 leader_election.cc:304] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:38.155547 14175 raft_consensus.cc:2804] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:38.156119 14175 raft_consensus.cc:697] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [term 1 LEADER]: Becoming Leader. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Running, Role: LEADER
I20260709 13:20:38.157155 14175 consensus_queue.cc:237] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.160518 14130 tablet_bootstrap.cc:654] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:38.149596 14176 raft_consensus.cc:515] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.161499 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc94be6c3e346598944c6f19db99795" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:38.163348 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc94be6c3e346598944c6f19db99795" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:38.160530 13938 raft_consensus.cc:2468] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 1.
I20260709 13:20:38.165877 14090 raft_consensus.cc:2468] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 0.
I20260709 13:20:38.166767 14054 leader_election.cc:304] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:38.167805 14173 raft_consensus.cc:2804] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:38.168324 14173 raft_consensus.cc:697] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Leader. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:38.169498 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "909e41a091f7440fa9c5fff3cefc005d" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:38.169860 14176 leader_election.cc:290] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:38.170179 13941 raft_consensus.cc:3060] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.170187 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "909e41a091f7440fa9c5fff3cefc005d" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
W20260709 13:20:38.175254 14054 leader_election.cc:343] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:38.169198 14173 consensus_queue.cc:237] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.168980 13840 catalog_manager.cc:5697] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.184485 14131 tablet_bootstrap.cc:654] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:38.189733 14133 tablet_bootstrap.cc:492] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:38.190549 14133 ts_tablet_manager.cc:1403] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.091s	user 0.024s	sys 0.005s
I20260709 13:20:38.197918 14133 raft_consensus.cc:359] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.199746 14133 raft_consensus.cc:385] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:38.200248 14133 raft_consensus.cc:740] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
W20260709 13:20:38.200634 13980 leader_election.cc:343] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:38.203068 13980 leader_election.cc:304] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:38.205041 14179 raft_consensus.cc:2804] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:38.205646 14179 raft_consensus.cc:493] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.206063 14179 raft_consensus.cc:3060] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.213858 14133 consensus_queue.cc:260] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.222743 14133 ts_tablet_manager.cc:1434] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:20:38.222815 13840 catalog_manager.cc:5697] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65). New cstate: current_term: 1 leader_uuid: "9fd8162413804fe29717f0e0fb2f288b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.223969 14133 tablet_bootstrap.cc:492] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:38.231089 14131 tablet_bootstrap.cc:492] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:38.231765 14130 tablet_bootstrap.cc:492] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:38.231884 14131 ts_tablet_manager.cc:1403] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.080s	user 0.020s	sys 0.017s
I20260709 13:20:38.232455 14130 ts_tablet_manager.cc:1403] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.097s	user 0.027s	sys 0.027s
I20260709 13:20:38.233021 14133 tablet_bootstrap.cc:654] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:38.234664 14179 raft_consensus.cc:515] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.237653 14179 leader_election.cc:290] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:38.239138 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc94be6c3e346598944c6f19db99795" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:38.239627 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc94be6c3e346598944c6f19db99795" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:38.240242 14090 raft_consensus.cc:3060] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.240306 14131 raft_consensus.cc:359] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
W20260709 13:20:38.240878 13980 leader_election.cc:343] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:38.241223 14131 raft_consensus.cc:385] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:38.241560 14131 raft_consensus.cc:740] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:38.242323 14131 consensus_queue.cc:260] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.243333 13941 raft_consensus.cc:2468] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 1.
I20260709 13:20:38.244637 14131 ts_tablet_manager.cc:1434] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:20:38.244732 14054 leader_election.cc:304] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:38.245740 14137 raft_consensus.cc:2804] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:38.246233 14137 raft_consensus.cc:697] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Leader. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:38.247068 14137 consensus_queue.cc:237] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.249509 14090 raft_consensus.cc:2468] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 1.
I20260709 13:20:38.248374 14130 raft_consensus.cc:359] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.254653 13980 leader_election.cc:304] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:38.255751 14179 raft_consensus.cc:2804] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:38.256287 14179 raft_consensus.cc:697] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Becoming Leader. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:38.254755 14130 raft_consensus.cc:385] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:38.257298 14130 raft_consensus.cc:740] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:38.257156 14179 consensus_queue.cc:237] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.258260 14130 consensus_queue.cc:260] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.259837 13840 catalog_manager.cc:5697] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 reported cstate change: term changed from 0 to 1, leader changed from <none> to a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "a308a1dc4fe94728bd0f56413fb14987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.261955 14130 ts_tablet_manager.cc:1434] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.003s
I20260709 13:20:38.263621 14130 tablet_bootstrap.cc:492] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:38.274926 14130 tablet_bootstrap.cc:654] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:38.278776 13839 catalog_manager.cc:5697] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.281729 14130 tablet_bootstrap.cc:492] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:38.286711 14133 tablet_bootstrap.cc:492] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:38.287263 14137 raft_consensus.cc:493] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.287273 14130 ts_tablet_manager.cc:1403] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 13:20:38.287400 14133 ts_tablet_manager.cc:1403] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.005s
I20260709 13:20:38.288050 14137 raft_consensus.cc:515] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.290335 14137 leader_election.cc:290] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:38.290052 13840 catalog_manager.cc:5697] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 reported cstate change: term changed from 0 to 1, leader changed from <none> to a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "a308a1dc4fe94728bd0f56413fb14987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.290894 14133 raft_consensus.cc:359] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.291548 14133 raft_consensus.cc:385] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:38.291635 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b589e88d96c048bea4491addeedd7ee4" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:38.291857 14133 raft_consensus.cc:740] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:38.292119 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b589e88d96c048bea4491addeedd7ee4" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:38.292830 13941 raft_consensus.cc:2468] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 0.
I20260709 13:20:38.293398 14133 consensus_queue.cc:260] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
W20260709 13:20:38.294216 14054 leader_election.cc:343] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:38.295504 14133 ts_tablet_manager.cc:1434] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:38.295737 14054 leader_election.cc:304] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:38.297101 14133 tablet_bootstrap.cc:492] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:38.297915 14130 raft_consensus.cc:359] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.298815 14130 raft_consensus.cc:385] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:38.299216 14130 raft_consensus.cc:740] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:38.299963 14130 consensus_queue.cc:260] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.301263 14137 raft_consensus.cc:2804] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:38.301741 14137 raft_consensus.cc:493] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.302081 14137 raft_consensus.cc:3060] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.303615 14133 tablet_bootstrap.cc:654] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:38.312062 14130 ts_tablet_manager.cc:1434] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:20:38.313211 14133 tablet_bootstrap.cc:492] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:38.313390 14130 tablet_bootstrap.cc:492] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:38.313771 14133 ts_tablet_manager.cc:1403] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 13:20:38.315582 14171 consensus_queue.cc:1048] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.317010 14133 raft_consensus.cc:359] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.317770 14133 raft_consensus.cc:385] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:38.318042 14133 raft_consensus.cc:740] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:38.318168 14175 consensus_queue.cc:1048] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.319005 14133 consensus_queue.cc:260] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.321650 14133 ts_tablet_manager.cc:1434] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:20:38.323060 14137 raft_consensus.cc:515] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.325065 14171 consensus_queue.cc:1048] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.326520 14137 leader_election.cc:290] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:38.327828 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b589e88d96c048bea4491addeedd7ee4" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:38.328871 14130 tablet_bootstrap.cc:654] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:38.329705 14054 leader_election.cc:343] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:38.330567 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b589e88d96c048bea4491addeedd7ee4" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:38.331785 13941 raft_consensus.cc:3060] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.343391 13941 raft_consensus.cc:2468] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 1.
I20260709 13:20:38.344763 14054 leader_election.cc:304] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:38.345693 14137 raft_consensus.cc:2804] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:38.346344 14137 raft_consensus.cc:697] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Leader. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:38.347294 14137 consensus_queue.cc:237] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.378993 14175 consensus_queue.cc:1048] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.389472 14175 raft_consensus.cc:493] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.390110 14175 raft_consensus.cc:515] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.393224 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc94be6c3e346598944c6f19db99795" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:38.395140 14139 raft_consensus.cc:493] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.395751 14139 raft_consensus.cc:515] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.398900 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619db8da711b4208b7e35e961f307e4d" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:38.402864 14139 leader_election.cc:290] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:38.403216 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619db8da711b4208b7e35e961f307e4d" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:38.404395 14090 raft_consensus.cc:2393] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd8162413804fe29717f0e0fb2f288b in current term 1: Already voted for candidate 5cf4c3c457844a8c8d0c825d6d707188 in this term.
I20260709 13:20:38.405453 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc94be6c3e346598944c6f19db99795" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:38.406421 14089 raft_consensus.cc:2393] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd8162413804fe29717f0e0fb2f288b in current term 1: Already voted for candidate 5cf4c3c457844a8c8d0c825d6d707188 in this term.
I20260709 13:20:38.407855 13905 leader_election.cc:304] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b; no voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987
I20260709 13:20:38.409256 13905 leader_election.cc:304] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b; no voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987
I20260709 13:20:38.410090 14163 raft_consensus.cc:3060] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.416113 14179 raft_consensus.cc:493] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.416949 14179 raft_consensus.cc:515] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.419198 14179 leader_election.cc:290] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:38.421878 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfca25342f2b45188d85d07a53b333ed" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:38.424052 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfca25342f2b45188d85d07a53b333ed" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:38.424979 14089 raft_consensus.cc:2393] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cf4c3c457844a8c8d0c825d6d707188 in current term 1: Already voted for candidate 9fd8162413804fe29717f0e0fb2f288b in this term.
I20260709 13:20:38.425045 14139 raft_consensus.cc:3060] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.426466 13980 leader_election.cc:304] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188; no voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987
I20260709 13:20:38.427522 14175 leader_election.cc:290] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:38.427829 14179 raft_consensus.cc:3060] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.426115 13837 catalog_manager.cc:5697] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 reported cstate change: term changed from 0 to 1, leader changed from <none> to a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "a308a1dc4fe94728bd0f56413fb14987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.438500 14179 raft_consensus.cc:2749] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:38.428923 14163 raft_consensus.cc:2749] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:38.440493 14139 raft_consensus.cc:2749] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:38.440912 14130 tablet_bootstrap.cc:492] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:38.441464 14130 ts_tablet_manager.cc:1403] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.128s	user 0.029s	sys 0.044s
I20260709 13:20:38.443964 14130 raft_consensus.cc:359] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.445585 14130 raft_consensus.cc:385] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:38.445840 14130 raft_consensus.cc:740] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:38.446535 14130 consensus_queue.cc:260] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.448609 14130 ts_tablet_manager.cc:1434] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:20:38.509413 14179 consensus_queue.cc:1048] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.520539 14135 consensus_queue.cc:1048] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.525662 14179 consensus_queue.cc:1048] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.538642 14179 consensus_queue.cc:1048] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.597853 14014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9297ad2180a543fdbb0a6546b011bd77"
dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
mode: GRACEFUL
new_leader_uuid: "9fd8162413804fe29717f0e0fb2f288b"
 from {username='slave'} at 127.0.0.1:44308
I20260709 13:20:38.598546 14014 raft_consensus.cc:606] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Received request to transfer leadership to TS 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:38.608027 14014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5537ebb7b20747ea8fd6d1601a6e55c9"
dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
mode: GRACEFUL
new_leader_uuid: "9fd8162413804fe29717f0e0fb2f288b"
 from {username='slave'} at 127.0.0.1:44308
I20260709 13:20:38.608681 14014 raft_consensus.cc:606] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Received request to transfer leadership to TS 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:38.626979 14089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6002321e89f4925808b3d1110305308"
dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
mode: GRACEFUL
new_leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
 from {username='slave'} at 127.0.0.1:45824
I20260709 13:20:38.627640 14089 raft_consensus.cc:606] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Received request to transfer leadership to TS 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:38.633755 14089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "909e41a091f7440fa9c5fff3cefc005d"
dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
mode: GRACEFUL
new_leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
 from {username='slave'} at 127.0.0.1:45824
I20260709 13:20:38.634318 14089 raft_consensus.cc:606] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Received request to transfer leadership to TS 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:38.639926 14089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b589e88d96c048bea4491addeedd7ee4"
dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
mode: GRACEFUL
new_leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
 from {username='slave'} at 127.0.0.1:45824
I20260709 13:20:38.640504 14089 raft_consensus.cc:606] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Received request to transfer leadership to TS 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:38.649833 14014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edc94be6c3e346598944c6f19db99795"
dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
mode: GRACEFUL
new_leader_uuid: "a308a1dc4fe94728bd0f56413fb14987"
 from {username='slave'} at 127.0.0.1:44308
I20260709 13:20:38.650391 14014 raft_consensus.cc:606] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Received request to transfer leadership to TS a308a1dc4fe94728bd0f56413fb14987
I20260709 13:20:38.651355 14013 raft_consensus.cc:3060] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.659600 14137 consensus_queue.cc:1048] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.669775 14173 raft_consensus.cc:993] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987: : Instructing follower 5cf4c3c457844a8c8d0c825d6d707188 to start an election
I20260709 13:20:38.670356 14176 raft_consensus.cc:1081] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Signalling peer 5cf4c3c457844a8c8d0c825d6d707188 to start an election
I20260709 13:20:38.672201 14014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "909e41a091f7440fa9c5fff3cefc005d"
dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
 from {username='slave'} at 127.0.0.1:44292
I20260709 13:20:38.674631 14014 raft_consensus.cc:493] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.675094 14014 raft_consensus.cc:3060] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.678782 14176 consensus_queue.cc:1048] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.680629 14139 consensus_queue.cc:1048] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.683214 14014 raft_consensus.cc:515] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.687552 14014 leader_election.cc:290] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:38.689047 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "909e41a091f7440fa9c5fff3cefc005d" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:38.689321 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "909e41a091f7440fa9c5fff3cefc005d" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:38.689816 14089 raft_consensus.cc:3055] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:38.690307 14089 raft_consensus.cc:740] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:38.691336 14089 consensus_queue.cc:260] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.692366 14089 raft_consensus.cc:3060] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.694876 14179 consensus_queue.cc:1048] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.703064 14089 raft_consensus.cc:2468] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 2.
I20260709 13:20:38.704283 14139 consensus_queue.cc:1048] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.704631 13980 leader_election.cc:304] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:38.706307 14143 raft_consensus.cc:2804] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:38.706943 14143 raft_consensus.cc:697] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 LEADER]: Becoming Leader. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:38.708050 14143 consensus_queue.cc:237] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.718353 14135 raft_consensus.cc:493] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.718900 14135 raft_consensus.cc:515] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.722692 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6002321e89f4925808b3d1110305308" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:38.723650 13938 raft_consensus.cc:2393] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cf4c3c457844a8c8d0c825d6d707188 in current term 1: Already voted for candidate a308a1dc4fe94728bd0f56413fb14987 in this term.
I20260709 13:20:38.726222 14135 leader_election.cc:290] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:38.726945 14135 consensus_queue.cc:1048] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.730131 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6002321e89f4925808b3d1110305308" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:38.732007 13980 leader_election.cc:304] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188; no voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987
I20260709 13:20:38.738076 14015 raft_consensus.cc:3060] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.739161 13840 catalog_manager.cc:5697] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 reported cstate change: term changed from 1 to 2, leader changed from a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67) to 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.747584 14179 raft_consensus.cc:993] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188: : Instructing follower a308a1dc4fe94728bd0f56413fb14987 to start an election
I20260709 13:20:38.748153 14179 raft_consensus.cc:1081] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Signalling peer a308a1dc4fe94728bd0f56413fb14987 to start an election
I20260709 13:20:38.750089 14090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edc94be6c3e346598944c6f19db99795"
dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
 from {username='slave'} at 127.0.0.1:45812
I20260709 13:20:38.750656 14090 raft_consensus.cc:493] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.751014 14090 raft_consensus.cc:3060] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.761122 14135 raft_consensus.cc:2749] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:38.761955 14176 consensus_queue.cc:1048] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.762382 14090 raft_consensus.cc:515] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.764631 14090 leader_election.cc:290] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:38.766207 14015 raft_consensus.cc:3060] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.765997 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc94be6c3e346598944c6f19db99795" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:38.766959 13942 raft_consensus.cc:3060] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.766978 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc94be6c3e346598944c6f19db99795" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:38.767814 14014 raft_consensus.cc:3055] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:38.768232 14014 raft_consensus.cc:740] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:38.769120 14014 consensus_queue.cc:260] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.770529 14014 raft_consensus.cc:3060] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.771759 14137 raft_consensus.cc:993] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987: : Instructing follower 5cf4c3c457844a8c8d0c825d6d707188 to start an election
I20260709 13:20:38.772408 14137 raft_consensus.cc:1081] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Signalling peer 5cf4c3c457844a8c8d0c825d6d707188 to start an election
I20260709 13:20:38.775832 14017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6002321e89f4925808b3d1110305308"
dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
 from {username='slave'} at 127.0.0.1:44292
I20260709 13:20:38.776436 14017 raft_consensus.cc:493] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.776832 14017 raft_consensus.cc:3060] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.777752 14137 consensus_queue.cc:1048] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.784930 13942 raft_consensus.cc:2468] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 2.
I20260709 13:20:38.786157 14017 raft_consensus.cc:515] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.786475 14054 leader_election.cc:304] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:38.787362 14013 raft_consensus.cc:1240] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Rejecting Update request from peer a308a1dc4fe94728bd0f56413fb14987 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:38.788066 14137 raft_consensus.cc:2804] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:38.788978 14137 raft_consensus.cc:697] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [term 2 LEADER]: Becoming Leader. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:38.790119 14173 consensus_queue.cc:1059] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.801434 14014 raft_consensus.cc:2468] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 2.
I20260709 13:20:38.803306 14137 consensus_queue.cc:237] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.803956 14173 consensus_queue.cc:1048] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.806731 14137 raft_consensus.cc:3055] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:38.807106 14137 raft_consensus.cc:740] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:38.799599 14017 leader_election.cc:290] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:38.794108 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6002321e89f4925808b3d1110305308" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:38.807955 14137 consensus_queue.cc:260] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.808300 13938 raft_consensus.cc:3060] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.808974 14137 raft_consensus.cc:3060] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:38.811049 14176 consensus_queue.cc:1175] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9fd8162413804fe29717f0e0fb2f288b" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:20:38.799023 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6002321e89f4925808b3d1110305308" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:38.814343 13839 catalog_manager.cc:5697] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 reported cstate change: term changed from 1 to 2, leader changed from 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66) to a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "a308a1dc4fe94728bd0f56413fb14987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.823572 13938 raft_consensus.cc:2468] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 2.
I20260709 13:20:38.825259 13980 leader_election.cc:304] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b; no voters: 
I20260709 13:20:38.826999 14090 raft_consensus.cc:2468] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 2.
I20260709 13:20:38.827852 14135 raft_consensus.cc:2804] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:38.828416 14135 raft_consensus.cc:697] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 LEADER]: Becoming Leader. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:38.829289 14135 consensus_queue.cc:237] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.832391 14176 raft_consensus.cc:993] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987: : Instructing follower 5cf4c3c457844a8c8d0c825d6d707188 to start an election
I20260709 13:20:38.833199 14137 raft_consensus.cc:1081] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Signalling peer 5cf4c3c457844a8c8d0c825d6d707188 to start an election
I20260709 13:20:38.835484 14014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b589e88d96c048bea4491addeedd7ee4"
dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
 from {username='slave'} at 127.0.0.1:44292
I20260709 13:20:38.836069 14014 raft_consensus.cc:493] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.836570 14014 raft_consensus.cc:3060] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.839473 14137 consensus_queue.cc:1048] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.843353 14014 raft_consensus.cc:515] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.844550 14017 raft_consensus.cc:1240] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Rejecting Update request from peer a308a1dc4fe94728bd0f56413fb14987 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:38.848857 14014 leader_election.cc:290] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:38.850195 13839 catalog_manager.cc:5697] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 reported cstate change: term changed from 1 to 2, leader changed from a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67) to 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.850816 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b589e88d96c048bea4491addeedd7ee4" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:38.851580 13942 raft_consensus.cc:3060] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.853057 14173 consensus_queue.cc:1059] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.854068 14137 raft_consensus.cc:3055] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:38.854557 14137 raft_consensus.cc:740] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:38.855530 14137 consensus_queue.cc:260] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.856824 14137 raft_consensus.cc:3060] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.858651 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b589e88d96c048bea4491addeedd7ee4" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:38.861392 13942 raft_consensus.cc:2468] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 2.
I20260709 13:20:38.862916 13980 leader_election.cc:304] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b; no voters: 
I20260709 13:20:38.863897 14135 raft_consensus.cc:2804] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:38.864487 14135 raft_consensus.cc:697] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 LEADER]: Becoming Leader. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:38.865528 14135 consensus_queue.cc:237] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:38.871770 14090 raft_consensus.cc:2468] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 2.
I20260709 13:20:38.875782 13839 catalog_manager.cc:5697] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 reported cstate change: term changed from 1 to 2, leader changed from a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67) to 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.949693 14143 raft_consensus.cc:993] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188: : Instructing follower 9fd8162413804fe29717f0e0fb2f288b to start an election
I20260709 13:20:38.950241 14135 raft_consensus.cc:1081] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Signalling peer 9fd8162413804fe29717f0e0fb2f288b to start an election
I20260709 13:20:38.952198 13942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9297ad2180a543fdbb0a6546b011bd77"
dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
 from {username='slave'} at 127.0.0.1:48506
I20260709 13:20:38.952723 13942 raft_consensus.cc:493] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.953039 13942 raft_consensus.cc:3060] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.958601 13942 raft_consensus.cc:515] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
I20260709 13:20:38.960891 13942 leader_election.cc:290] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 2 election: Requested vote from peers a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:38.962003 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9297ad2180a543fdbb0a6546b011bd77" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:38.961724 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9297ad2180a543fdbb0a6546b011bd77" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:38.962642 14014 raft_consensus.cc:3055] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:38.962883 14090 raft_consensus.cc:3060] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.962992 14014 raft_consensus.cc:740] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:38.964274 14014 consensus_queue.cc:260] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
I20260709 13:20:38.965368 14014 raft_consensus.cc:3060] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.969806 14090 raft_consensus.cc:2468] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 2.
I20260709 13:20:38.971449 13905 leader_election.cc:304] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:38.970610 14014 raft_consensus.cc:2468] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 2.
I20260709 13:20:38.972386 14139 raft_consensus.cc:2804] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:38.972899 14139 raft_consensus.cc:697] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 2 LEADER]: Becoming Leader. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Running, Role: LEADER
I20260709 13:20:38.974242 14139 consensus_queue.cc:237] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
I20260709 13:20:38.981305 13839 catalog_manager.cc:5697] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b reported cstate change: term changed from 1 to 2, leader changed from 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66) to 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65). New cstate: current_term: 2 leader_uuid: "9fd8162413804fe29717f0e0fb2f288b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:39.060218 14135 raft_consensus.cc:993] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188: : Instructing follower 9fd8162413804fe29717f0e0fb2f288b to start an election
I20260709 13:20:39.060853 14179 raft_consensus.cc:1081] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Signalling peer 9fd8162413804fe29717f0e0fb2f288b to start an election
I20260709 13:20:39.062461 13942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5537ebb7b20747ea8fd6d1601a6e55c9"
dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
 from {username='slave'} at 127.0.0.1:48506
I20260709 13:20:39.063004 13942 raft_consensus.cc:493] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:39.063277 13942 raft_consensus.cc:3060] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:39.068667 13942 raft_consensus.cc:515] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:39.070672 13942 leader_election.cc:290] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 2 election: Requested vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:39.071481 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5537ebb7b20747ea8fd6d1601a6e55c9" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:39.072219 14014 raft_consensus.cc:3055] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:39.072502 14014 raft_consensus.cc:740] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:39.072234 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5537ebb7b20747ea8fd6d1601a6e55c9" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:39.073268 14090 raft_consensus.cc:3060] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:39.073426 14014 consensus_queue.cc:260] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:39.074595 14014 raft_consensus.cc:3060] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:39.079752 14090 raft_consensus.cc:2468] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 2.
I20260709 13:20:39.081135 14014 raft_consensus.cc:2468] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 2.
I20260709 13:20:39.081236 13905 leader_election.cc:304] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:39.082592 14139 raft_consensus.cc:2804] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:39.083135 14139 raft_consensus.cc:697] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [term 2 LEADER]: Becoming Leader. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Running, Role: LEADER
I20260709 13:20:39.083932 14139 consensus_queue.cc:237] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:39.090242 13839 catalog_manager.cc:5697] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b reported cstate change: term changed from 1 to 2, leader changed from 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66) to 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65). New cstate: current_term: 2 leader_uuid: "9fd8162413804fe29717f0e0fb2f288b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:39.205896 14014 raft_consensus.cc:1275] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Refusing update from remote peer a308a1dc4fe94728bd0f56413fb14987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.207399 14137 consensus_queue.cc:1048] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:39.215794 13942 raft_consensus.cc:1275] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Refusing update from remote peer a308a1dc4fe94728bd0f56413fb14987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.217743 14173 consensus_queue.cc:1048] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:39.226920 14090 raft_consensus.cc:1275] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Refusing update from remote peer 5cf4c3c457844a8c8d0c825d6d707188: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.228333 14179 consensus_queue.cc:1048] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:39.237263 13942 raft_consensus.cc:3060] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:39.248999 13942 raft_consensus.cc:1275] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Refusing update from remote peer 5cf4c3c457844a8c8d0c825d6d707188: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.250756 14179 consensus_queue.cc:1048] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:39.299208 14090 raft_consensus.cc:1275] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Refusing update from remote peer 5cf4c3c457844a8c8d0c825d6d707188: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.300647 14179 consensus_queue.cc:1048] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:39.309935 13942 raft_consensus.cc:1275] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Refusing update from remote peer 5cf4c3c457844a8c8d0c825d6d707188: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.311767 14143 consensus_queue.cc:1048] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:39.400738 14090 raft_consensus.cc:1275] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Refusing update from remote peer 5cf4c3c457844a8c8d0c825d6d707188: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.402310 14143 consensus_queue.cc:1048] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:39.412979 13942 raft_consensus.cc:1275] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Refusing update from remote peer 5cf4c3c457844a8c8d0c825d6d707188: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.415036 14179 consensus_queue.cc:1048] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:39.531646 14090 raft_consensus.cc:1275] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Refusing update from remote peer 9fd8162413804fe29717f0e0fb2f288b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.533747 14139 consensus_queue.cc:1048] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:39.544627 14014 raft_consensus.cc:1275] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Refusing update from remote peer 9fd8162413804fe29717f0e0fb2f288b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.546739 14175 consensus_queue.cc:1048] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:39.576009 14090 raft_consensus.cc:1275] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Refusing update from remote peer 9fd8162413804fe29717f0e0fb2f288b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.577520 14175 consensus_queue.cc:1048] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:39.587373 14014 raft_consensus.cc:1275] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Refusing update from remote peer 9fd8162413804fe29717f0e0fb2f288b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.588908 14163 consensus_queue.cc:1048] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:41.681365 13837 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50908:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:41.683501 13837 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:41.735357 13929 tablet_service.cc:1511] Processing CreateTablet for tablet 693673e936cd487db2af6d8d4fdbdfb4 (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:41.736701 13929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 693673e936cd487db2af6d8d4fdbdfb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.737663 14075 tablet_service.cc:1511] Processing CreateTablet for tablet 693673e936cd487db2af6d8d4fdbdfb4 (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:41.736328 14001 tablet_service.cc:1511] Processing CreateTablet for tablet 693673e936cd487db2af6d8d4fdbdfb4 (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:41.738965 14075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 693673e936cd487db2af6d8d4fdbdfb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.739118 13931 tablet_service.cc:1511] Processing CreateTablet for tablet 6819bd7e812040d49a50c6e7a981a899 (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:41.738965 14001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 693673e936cd487db2af6d8d4fdbdfb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.740407 14002 tablet_service.cc:1511] Processing CreateTablet for tablet 6819bd7e812040d49a50c6e7a981a899 (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:41.741786 14002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6819bd7e812040d49a50c6e7a981a899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.745328 14073 tablet_service.cc:1511] Processing CreateTablet for tablet 6819bd7e812040d49a50c6e7a981a899 (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:41.746763 14073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6819bd7e812040d49a50c6e7a981a899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.751847 13927 tablet_service.cc:1511] Processing CreateTablet for tablet d4d5f3e13d37415f88d3fc6dcbd08cdf (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:41.752130 14003 tablet_service.cc:1511] Processing CreateTablet for tablet 75238bd7c9674881bbb2c98ed4996118 (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:41.752521 13926 tablet_service.cc:1511] Processing CreateTablet for tablet 75238bd7c9674881bbb2c98ed4996118 (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:41.753521 14003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75238bd7c9674881bbb2c98ed4996118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.754526 14004 tablet_service.cc:1511] Processing CreateTablet for tablet d4d5f3e13d37415f88d3fc6dcbd08cdf (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:41.755813 14004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4d5f3e13d37415f88d3fc6dcbd08cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.740473 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6819bd7e812040d49a50c6e7a981a899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.757817 13927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4d5f3e13d37415f88d3fc6dcbd08cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.761883 13926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75238bd7c9674881bbb2c98ed4996118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.764818 14079 tablet_service.cc:1511] Processing CreateTablet for tablet 75238bd7c9674881bbb2c98ed4996118 (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:41.767364 14079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75238bd7c9674881bbb2c98ed4996118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.768280 13928 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe313cc914f4030955e026bcaacc19c (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:41.769624 13928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe313cc914f4030955e026bcaacc19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.774235 14007 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe313cc914f4030955e026bcaacc19c (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:41.775657 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe313cc914f4030955e026bcaacc19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.778699 14074 tablet_service.cc:1511] Processing CreateTablet for tablet d4d5f3e13d37415f88d3fc6dcbd08cdf (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:41.780124 14074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4d5f3e13d37415f88d3fc6dcbd08cdf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:20:41.787175 13888 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:41.795671 13932 tablet_service.cc:1511] Processing CreateTablet for tablet 101dfdd2225b41e4888d561ae59e5e6d (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:41.797065 13930 tablet_service.cc:1511] Processing CreateTablet for tablet 115a6800c73f40b892541c9f0f53eff3 (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:41.798061 14006 tablet_service.cc:1511] Processing CreateTablet for tablet 101dfdd2225b41e4888d561ae59e5e6d (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:41.799398 14006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 101dfdd2225b41e4888d561ae59e5e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.799750 14005 tablet_service.cc:1511] Processing CreateTablet for tablet 290a2cb6c7174c9ca338b70d16c001fc (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:41.799901 13925 tablet_service.cc:1511] Processing CreateTablet for tablet 290a2cb6c7174c9ca338b70d16c001fc (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:41.801035 14005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290a2cb6c7174c9ca338b70d16c001fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.802088 14000 tablet_service.cc:1511] Processing CreateTablet for tablet 115a6800c73f40b892541c9f0f53eff3 (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:41.803225 14077 tablet_service.cc:1511] Processing CreateTablet for tablet 115a6800c73f40b892541c9f0f53eff3 (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:41.803383 13932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 101dfdd2225b41e4888d561ae59e5e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.904007 14077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115a6800c73f40b892541c9f0f53eff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.802909 14076 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe313cc914f4030955e026bcaacc19c (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:41.906314 14076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe313cc914f4030955e026bcaacc19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.905179 13925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290a2cb6c7174c9ca338b70d16c001fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.806274 14000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115a6800c73f40b892541c9f0f53eff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.910071 13930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115a6800c73f40b892541c9f0f53eff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.910980 14079 tablet_service.cc:1511] Processing CreateTablet for tablet 290a2cb6c7174c9ca338b70d16c001fc (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:41.912838 14079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290a2cb6c7174c9ca338b70d16c001fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.913344 14080 tablet_service.cc:1511] Processing CreateTablet for tablet 294d47ad12ee4bfcb7b4511b08cb4756 (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:41.914086 13999 tablet_service.cc:1511] Processing CreateTablet for tablet 294d47ad12ee4bfcb7b4511b08cb4756 (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:41.914621 14080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 294d47ad12ee4bfcb7b4511b08cb4756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.915378 13999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 294d47ad12ee4bfcb7b4511b08cb4756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.917692 13931 tablet_service.cc:1511] Processing CreateTablet for tablet 294d47ad12ee4bfcb7b4511b08cb4756 (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:41.919018 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 294d47ad12ee4bfcb7b4511b08cb4756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.803996 14078 tablet_service.cc:1511] Processing CreateTablet for tablet 101dfdd2225b41e4888d561ae59e5e6d (DEFAULT_TABLE table=soft_deleted_table [id=74a63febe21942668b46e37b704d8343]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:41.923528 14078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 101dfdd2225b41e4888d561ae59e5e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.906708 14241 tablet_bootstrap.cc:492] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:41.930482 14242 tablet_bootstrap.cc:492] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:41.953655 14240 tablet_bootstrap.cc:492] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:41.973300 14242 tablet_bootstrap.cc:654] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.977360 14241 tablet_bootstrap.cc:654] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.991529 14240 tablet_bootstrap.cc:654] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.032533 14242 tablet_bootstrap.cc:492] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:42.033141 14242 ts_tablet_manager.cc:1403] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.103s	user 0.007s	sys 0.012s
I20260709 13:20:42.035532 14240 tablet_bootstrap.cc:492] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:42.036217 14240 ts_tablet_manager.cc:1403] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.021s
I20260709 13:20:42.036382 14241 tablet_bootstrap.cc:492] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:42.036885 14241 ts_tablet_manager.cc:1403] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.133s	user 0.006s	sys 0.011s
I20260709 13:20:42.037111 14242 raft_consensus.cc:359] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.037951 14242 raft_consensus.cc:385] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.038250 14242 raft_consensus.cc:740] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.039044 14242 consensus_queue.cc:260] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.039279 14241 raft_consensus.cc:359] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.039909 14241 raft_consensus.cc:385] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.040205 14241 raft_consensus.cc:740] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.040127 14240 raft_consensus.cc:359] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.041345 14240 raft_consensus.cc:385] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.041715 14242 ts_tablet_manager.cc:1434] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:20:42.041435 14241 consensus_queue.cc:260] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.041741 14240 raft_consensus.cc:740] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.043025 14242 tablet_bootstrap.cc:492] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:42.044615 14241 ts_tablet_manager.cc:1434] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:42.045944 14241 tablet_bootstrap.cc:492] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:42.049393 14240 consensus_queue.cc:260] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.053443 14240 ts_tablet_manager.cc:1434] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:20:42.054620 14240 tablet_bootstrap.cc:492] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:42.054864 14242 tablet_bootstrap.cc:654] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.065426 14240 tablet_bootstrap.cc:654] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.066892 14242 tablet_bootstrap.cc:492] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:42.067481 14242 ts_tablet_manager.cc:1403] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.009s
I20260709 13:20:42.069059 14241 tablet_bootstrap.cc:654] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.071440 14242 raft_consensus.cc:359] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.072479 14242 raft_consensus.cc:385] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.072861 14242 raft_consensus.cc:740] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.074025 14242 consensus_queue.cc:260] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.077239 14242 ts_tablet_manager.cc:1434] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:20:42.079484 14242 tablet_bootstrap.cc:492] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:42.080516 14240 tablet_bootstrap.cc:492] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:42.081210 14240 ts_tablet_manager.cc:1403] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.010s
I20260709 13:20:42.084589 14240 raft_consensus.cc:359] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.085418 14240 raft_consensus.cc:385] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.085747 14240 raft_consensus.cc:740] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.086467 14242 tablet_bootstrap.cc:654] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.086758 14240 consensus_queue.cc:260] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.089524 14240 ts_tablet_manager.cc:1434] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:20:42.090855 14240 tablet_bootstrap.cc:492] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:42.095312 14241 tablet_bootstrap.cc:492] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:42.095935 14241 ts_tablet_manager.cc:1403] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.016s
I20260709 13:20:42.098505 14240 tablet_bootstrap.cc:654] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.100247 14241 raft_consensus.cc:359] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.101060 14241 raft_consensus.cc:385] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.101384 14241 raft_consensus.cc:740] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.102252 14241 consensus_queue.cc:260] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.106500 14241 ts_tablet_manager.cc:1434] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:20:42.108353 14241 tablet_bootstrap.cc:492] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:42.106655 14242 tablet_bootstrap.cc:492] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:42.111367 14242 ts_tablet_manager.cc:1403] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.001s
I20260709 13:20:42.112968 14240 tablet_bootstrap.cc:492] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:42.113605 14240 ts_tablet_manager.cc:1403] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:20:42.114559 14242 raft_consensus.cc:359] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.115409 14242 raft_consensus.cc:385] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.115428 14241 tablet_bootstrap.cc:654] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.115971 14242 raft_consensus.cc:740] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.116819 14242 consensus_queue.cc:260] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.117417 14240 raft_consensus.cc:359] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.118240 14240 raft_consensus.cc:385] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.118525 14240 raft_consensus.cc:740] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.119514 14240 consensus_queue.cc:260] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.120216 14135 raft_consensus.cc:493] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.122694 14240 ts_tablet_manager.cc:1434] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:20:42.120731 14135 raft_consensus.cc:515] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.124099 14240 tablet_bootstrap.cc:492] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:42.125718 14135 leader_election.cc:290] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:42.119746 14242 ts_tablet_manager.cc:1434] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:42.127231 14242 tablet_bootstrap.cc:492] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:42.127269 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290a2cb6c7174c9ca338b70d16c001fc" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:42.128053 14241 tablet_bootstrap.cc:492] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:42.128594 14241 ts_tablet_manager.cc:1403] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.009s
I20260709 13:20:42.128840 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290a2cb6c7174c9ca338b70d16c001fc" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
W20260709 13:20:42.130811 13980 leader_election.cc:343] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:42.131512 13980 leader_election.cc:343] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:42.131932 13980 leader_election.cc:304] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188; no voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987
I20260709 13:20:42.132135 14241 raft_consensus.cc:359] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.132891 14241 raft_consensus.cc:385] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.133141 14135 raft_consensus.cc:2749] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:42.133203 14241 raft_consensus.cc:740] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.134351 14241 consensus_queue.cc:260] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.135897 14242 tablet_bootstrap.cc:654] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.137243 14241 ts_tablet_manager.cc:1434] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.002s
I20260709 13:20:42.138441 14241 tablet_bootstrap.cc:492] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:42.140367 14240 tablet_bootstrap.cc:654] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.146518 14241 tablet_bootstrap.cc:654] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.153286 14242 tablet_bootstrap.cc:492] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:42.153970 14242 ts_tablet_manager.cc:1403] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.015s
I20260709 13:20:42.157361 14242 raft_consensus.cc:359] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.158100 14242 raft_consensus.cc:385] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.158190 14240 tablet_bootstrap.cc:492] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:42.158463 14242 raft_consensus.cc:740] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.158972 14240 ts_tablet_manager.cc:1403] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.007s
I20260709 13:20:42.159297 14242 consensus_queue.cc:260] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.163471 14240 raft_consensus.cc:359] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.164642 14240 raft_consensus.cc:385] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.165123 14240 raft_consensus.cc:740] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.166249 14240 consensus_queue.cc:260] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.168550 14242 ts_tablet_manager.cc:1434] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:20:42.169188 14240 ts_tablet_manager.cc:1434] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:20:42.169756 14242 tablet_bootstrap.cc:492] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:42.170270 14240 tablet_bootstrap.cc:492] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:42.179571 14240 tablet_bootstrap.cc:654] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.183807 14241 tablet_bootstrap.cc:492] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:42.184350 14241 ts_tablet_manager.cc:1403] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.010s
I20260709 13:20:42.184656 14242 tablet_bootstrap.cc:654] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.185590 14240 tablet_bootstrap.cc:492] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:42.186051 14240 ts_tablet_manager.cc:1403] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:20:42.187588 14241 raft_consensus.cc:359] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.188409 14241 raft_consensus.cc:385] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.188673 14241 raft_consensus.cc:740] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.189620 14241 consensus_queue.cc:260] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.188567 14240 raft_consensus.cc:359] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.190322 14242 tablet_bootstrap.cc:492] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:42.190618 14240 raft_consensus.cc:385] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.191036 14240 raft_consensus.cc:740] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.191179 14242 ts_tablet_manager.cc:1403] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.001s
I20260709 13:20:42.192087 14241 ts_tablet_manager.cc:1434] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:20:42.191941 14240 consensus_queue.cc:260] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.193221 14241 tablet_bootstrap.cc:492] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:42.194507 14240 ts_tablet_manager.cc:1434] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:42.194370 14242 raft_consensus.cc:359] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.195148 14242 raft_consensus.cc:385] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.195475 14242 raft_consensus.cc:740] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.195600 14240 tablet_bootstrap.cc:492] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:42.196300 14242 consensus_queue.cc:260] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.198949 14242 ts_tablet_manager.cc:1434] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:42.199968 14242 tablet_bootstrap.cc:492] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:42.201217 14241 tablet_bootstrap.cc:654] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.207223 14240 tablet_bootstrap.cc:654] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.207672 14242 tablet_bootstrap.cc:654] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.214926 14241 tablet_bootstrap.cc:492] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:42.215612 14241 ts_tablet_manager.cc:1403] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 13:20:42.218623 14242 tablet_bootstrap.cc:492] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:42.219228 14242 ts_tablet_manager.cc:1403] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:20:42.218992 14241 raft_consensus.cc:359] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.219769 14241 raft_consensus.cc:385] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.220115 14241 raft_consensus.cc:740] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.220996 14241 consensus_queue.cc:260] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.222440 14242 raft_consensus.cc:359] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.223218 14242 raft_consensus.cc:385] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.223505 14242 raft_consensus.cc:740] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.223821 14241 ts_tablet_manager.cc:1434] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 13:20:42.224925 14241 tablet_bootstrap.cc:492] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:42.224478 14242 consensus_queue.cc:260] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.227074 14242 ts_tablet_manager.cc:1434] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:20:42.228153 14242 tablet_bootstrap.cc:492] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:42.242739 14228 raft_consensus.cc:493] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.243531 14228 raft_consensus.cc:515] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.284970 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75238bd7c9674881bbb2c98ed4996118" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:42.285404 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75238bd7c9674881bbb2c98ed4996118" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
W20260709 13:20:42.287763 14054 leader_election.cc:343] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:42.288472 14228 leader_election.cc:290] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:42.288717 14135 raft_consensus.cc:493] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.289475 14242 tablet_bootstrap.cc:654] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.289377 14135 raft_consensus.cc:515] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.291172 14240 tablet_bootstrap.cc:492] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
W20260709 13:20:42.291091 14054 leader_election.cc:343] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:42.291786 14240 ts_tablet_manager.cc:1403] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.096s	user 0.018s	sys 0.039s
I20260709 13:20:42.291690 14054 leader_election.cc:304] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a308a1dc4fe94728bd0f56413fb14987; no voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:42.292841 14228 raft_consensus.cc:2749] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:42.295423 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101dfdd2225b41e4888d561ae59e5e6d" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:42.296752 14240 raft_consensus.cc:359] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.297564 14240 raft_consensus.cc:385] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:20:42.297387 13980 leader_election.cc:343] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:42.292644 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101dfdd2225b41e4888d561ae59e5e6d" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:42.298074 14135 leader_election.cc:290] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:42.298910 14240 raft_consensus.cc:740] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
W20260709 13:20:42.299223 13980 leader_election.cc:343] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:42.299760 13980 leader_election.cc:304] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188; no voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987
I20260709 13:20:42.300487 14135 raft_consensus.cc:2749] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:42.300113 14240 consensus_queue.cc:260] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.302699 14240 ts_tablet_manager.cc:1434] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:20:42.302963 14242 tablet_bootstrap.cc:492] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:42.303507 14242 ts_tablet_manager.cc:1403] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.017s
I20260709 13:20:42.303735 14240 tablet_bootstrap.cc:492] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:42.306481 14242 raft_consensus.cc:359] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.307232 14242 raft_consensus.cc:385] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.307521 14242 raft_consensus.cc:740] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.308372 14242 consensus_queue.cc:260] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.310837 14242 ts_tablet_manager.cc:1434] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:42.311794 14242 tablet_bootstrap.cc:492] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:42.313274 14241 tablet_bootstrap.cc:654] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.317627 14242 tablet_bootstrap.cc:654] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.317931 14240 tablet_bootstrap.cc:654] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.324314 14242 tablet_bootstrap.cc:492] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:42.324756 14242 ts_tablet_manager.cc:1403] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:20:42.326182 14241 tablet_bootstrap.cc:492] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:42.326676 14241 ts_tablet_manager.cc:1403] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.102s	user 0.008s	sys 0.011s
I20260709 13:20:42.327359 14242 raft_consensus.cc:359] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.327922 14242 raft_consensus.cc:385] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.328146 14242 raft_consensus.cc:740] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.328166 14240 tablet_bootstrap.cc:492] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:42.328794 14240 ts_tablet_manager.cc:1403] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.006s
I20260709 13:20:42.328876 14242 consensus_queue.cc:260] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.330940 14242 ts_tablet_manager.cc:1434] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:20:42.332072 14242 tablet_bootstrap.cc:492] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188: Bootstrap starting.
I20260709 13:20:42.331974 14240 raft_consensus.cc:359] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.332906 14240 raft_consensus.cc:385] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.333405 14240 raft_consensus.cc:740] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.334368 14240 consensus_queue.cc:260] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.336978 14240 ts_tablet_manager.cc:1434] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:20:42.338145 14240 tablet_bootstrap.cc:492] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:42.338218 14242 tablet_bootstrap.cc:654] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.341013 14241 raft_consensus.cc:359] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.341940 14241 raft_consensus.cc:385] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.342283 14241 raft_consensus.cc:740] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.343376 14241 consensus_queue.cc:260] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.345834 14241 ts_tablet_manager.cc:1434] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 13:20:42.345870 14240 tablet_bootstrap.cc:654] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.346900 14243 raft_consensus.cc:493] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.347455 14243 raft_consensus.cc:515] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.349386 14241 tablet_bootstrap.cc:492] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:42.349604 14243 leader_election.cc:290] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:42.349586 14242 tablet_bootstrap.cc:492] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188: No bootstrap required, opened a new log
I20260709 13:20:42.350574 14242 ts_tablet_manager.cc:1403] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:20:42.351078 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d5f3e13d37415f88d3fc6dcbd08cdf" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:42.351765 14089 raft_consensus.cc:2468] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 0.
I20260709 13:20:42.353191 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d5f3e13d37415f88d3fc6dcbd08cdf" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:42.353412 14242 raft_consensus.cc:359] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.353854 14014 raft_consensus.cc:2468] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 0.
I20260709 13:20:42.354076 14242 raft_consensus.cc:385] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.354368 14242 raft_consensus.cc:740] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.355069 14242 consensus_queue.cc:260] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.355726 13905 leader_election.cc:304] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b; no voters: 
I20260709 13:20:42.356601 14242 ts_tablet_manager.cc:1434] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:20:42.357285 14163 raft_consensus.cc:2804] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:42.357599 14163 raft_consensus.cc:493] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.357808 14163 raft_consensus.cc:3060] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.358338 14241 tablet_bootstrap.cc:654] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.369601 14229 raft_consensus.cc:493] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.370250 14229 raft_consensus.cc:515] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.372594 14228 raft_consensus.cc:493] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.373253 14228 raft_consensus.cc:515] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.374143 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115a6800c73f40b892541c9f0f53eff3" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:42.374833 13942 raft_consensus.cc:2468] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 0.
I20260709 13:20:42.375415 14228 leader_election.cc:290] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:42.369616 14135 raft_consensus.cc:493] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.376928 14135 raft_consensus.cc:515] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.378238 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6819bd7e812040d49a50c6e7a981a899" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:42.378943 14135 leader_election.cc:290] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:42.379423 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6819bd7e812040d49a50c6e7a981a899" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:42.380074 13942 raft_consensus.cc:2468] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 0.
I20260709 13:20:42.380537 13980 leader_election.cc:304] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b; no voters: 
I20260709 13:20:42.381366 14054 leader_election.cc:304] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:42.382102 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75238bd7c9674881bbb2c98ed4996118" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:42.372596 14229 leader_election.cc:290] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:42.383423 14229 raft_consensus.cc:2804] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:42.383780 14229 raft_consensus.cc:493] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.384101 14229 raft_consensus.cc:3060] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.382737 14090 raft_consensus.cc:2468] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 0.
I20260709 13:20:42.384850 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75238bd7c9674881bbb2c98ed4996118" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:42.385494 13942 raft_consensus.cc:2468] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 0.
I20260709 13:20:42.384007 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115a6800c73f40b892541c9f0f53eff3" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:42.386242 14089 raft_consensus.cc:2468] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 0.
I20260709 13:20:42.387838 13980 leader_election.cc:304] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b; no voters: 
I20260709 13:20:42.388653 14135 raft_consensus.cc:2804] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:42.389109 14135 raft_consensus.cc:493] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.389536 14135 raft_consensus.cc:3060] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.389983 14243 raft_consensus.cc:493] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.390532 14243 raft_consensus.cc:515] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.392571 14243 leader_election.cc:290] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:42.393268 14228 raft_consensus.cc:2804] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:42.393709 14228 raft_consensus.cc:493] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.394055 14228 raft_consensus.cc:3060] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.397838 14135 raft_consensus.cc:515] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.399771 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115a6800c73f40b892541c9f0f53eff3" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:42.401432 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115a6800c73f40b892541c9f0f53eff3" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:42.402086 14089 raft_consensus.cc:2468] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 0.
I20260709 13:20:42.403196 14135 leader_election.cc:290] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:42.378913 14014 raft_consensus.cc:2468] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 0.
I20260709 13:20:42.407078 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75238bd7c9674881bbb2c98ed4996118" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:42.407649 13942 raft_consensus.cc:3060] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.414239 13905 leader_election.cc:304] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:42.414764 14269 raft_consensus.cc:493] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.415860 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75238bd7c9674881bbb2c98ed4996118" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:42.416507 14090 raft_consensus.cc:3060] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.415985 14269 raft_consensus.cc:515] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.393013 14243 raft_consensus.cc:493] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.418402 14243 raft_consensus.cc:515] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.420414 14269 leader_election.cc:290] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:42.421180 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290a2cb6c7174c9ca338b70d16c001fc" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:42.422868 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290a2cb6c7174c9ca338b70d16c001fc" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:42.423219 14243 leader_election.cc:290] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:42.423054 13938 raft_consensus.cc:2468] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 0.
I20260709 13:20:42.423715 14014 raft_consensus.cc:2468] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 0.
I20260709 13:20:42.425046 14054 leader_election.cc:304] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:42.425554 13942 raft_consensus.cc:2468] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 1.
I20260709 13:20:42.427382 13980 leader_election.cc:304] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b; no voters: 
I20260709 13:20:42.429056 14270 raft_consensus.cc:2804] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:42.429540 14270 raft_consensus.cc:493] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.429998 14270 raft_consensus.cc:3060] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.431638 14090 raft_consensus.cc:2468] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 1.
I20260709 13:20:42.432812 14135 raft_consensus.cc:2804] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:42.435989 14135 raft_consensus.cc:697] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Becoming Leader. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:42.437003 14135 consensus_queue.cc:237] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.439815 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290a2cb6c7174c9ca338b70d16c001fc" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:42.435550 14163 raft_consensus.cc:515] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.439009 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290a2cb6c7174c9ca338b70d16c001fc" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:42.440778 14014 raft_consensus.cc:2468] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 0.
I20260709 13:20:42.443356 14163 leader_election.cc:290] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 election: Requested vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:42.448071 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d5f3e13d37415f88d3fc6dcbd08cdf" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:42.449288 14014 raft_consensus.cc:3060] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.447196 13905 leader_election.cc:304] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b; no voters: 
I20260709 13:20:42.423825 14243 raft_consensus.cc:2804] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:42.458545 14243 raft_consensus.cc:493] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.458990 14243 raft_consensus.cc:3060] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.463573 13840 catalog_manager.cc:5697] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.463737 14270 raft_consensus.cc:515] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.467201 14089 raft_consensus.cc:2393] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd8162413804fe29717f0e0fb2f288b in current term 1: Already voted for candidate a308a1dc4fe94728bd0f56413fb14987 in this term.
I20260709 13:20:42.467738 14228 raft_consensus.cc:515] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.468315 14163 raft_consensus.cc:2804] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:42.469710 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d5f3e13d37415f88d3fc6dcbd08cdf" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:42.469772 14163 raft_consensus.cc:493] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.470557 14090 raft_consensus.cc:3060] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.470574 14163 raft_consensus.cc:3060] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.475010 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290a2cb6c7174c9ca338b70d16c001fc" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:42.476234 14269 raft_consensus.cc:493] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.476857 14269 raft_consensus.cc:515] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.477290 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290a2cb6c7174c9ca338b70d16c001fc" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:42.478022 14015 raft_consensus.cc:3060] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.478166 14229 raft_consensus.cc:515] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.479377 14017 raft_consensus.cc:2393] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd8162413804fe29717f0e0fb2f288b in current term 1: Already voted for candidate 5cf4c3c457844a8c8d0c825d6d707188 in this term.
I20260709 13:20:42.479889 14269 leader_election.cc:290] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:42.480746 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe313cc914f4030955e026bcaacc19c" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:42.481244 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe313cc914f4030955e026bcaacc19c" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:42.481894 14017 raft_consensus.cc:2468] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 0.
W20260709 13:20:42.482329 14054 leader_election.cc:343] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:42.484395 14054 leader_election.cc:304] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:42.486450 14015 raft_consensus.cc:2468] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 1.
I20260709 13:20:42.486948 14269 raft_consensus.cc:2804] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:42.487453 14269 raft_consensus.cc:493] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:42.488843 13980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.250.65:41903, user_credentials={real_user=slave}} blocked reactor thread for 61550.5us
I20260709 13:20:42.487993 14054 leader_election.cc:304] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:42.489907 14228 leader_election.cc:290] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:42.490494 14228 raft_consensus.cc:493] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.490960 14278 raft_consensus.cc:2804] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:42.490934 14228 raft_consensus.cc:515] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.491575 14278 raft_consensus.cc:697] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Leader. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:42.492502 14278 consensus_queue.cc:237] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.493135 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6819bd7e812040d49a50c6e7a981a899" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:42.493927 13938 raft_consensus.cc:3060] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.494988 14014 raft_consensus.cc:2468] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 1.
I20260709 13:20:42.496158 13905 leader_election.cc:304] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b; no voters: 
I20260709 13:20:42.497020 14267 raft_consensus.cc:2804] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:42.488014 14229 leader_election.cc:290] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:42.488993 14269 raft_consensus.cc:3060] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.477339 14270 leader_election.cc:290] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:42.505400 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6819bd7e812040d49a50c6e7a981a899" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:42.506112 14015 raft_consensus.cc:3060] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.508080 14243 raft_consensus.cc:515] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.511461 14240 tablet_bootstrap.cc:492] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:42.509516 14228 leader_election.cc:290] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:42.512032 14240 ts_tablet_manager.cc:1403] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.174s	user 0.035s	sys 0.070s
I20260709 13:20:42.514066 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115a6800c73f40b892541c9f0f53eff3" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:42.511511 14241 tablet_bootstrap.cc:492] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:42.514577 14090 raft_consensus.cc:2468] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 1.
I20260709 13:20:42.514928 13941 raft_consensus.cc:2393] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cf4c3c457844a8c8d0c825d6d707188 in current term 1: Already voted for candidate 9fd8162413804fe29717f0e0fb2f288b in this term.
I20260709 13:20:42.514993 14241 ts_tablet_manager.cc:1403] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.166s	user 0.047s	sys 0.031s
I20260709 13:20:42.516222 14243 leader_election.cc:290] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 election: Requested vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:42.517062 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115a6800c73f40b892541c9f0f53eff3" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:42.519948 14090 raft_consensus.cc:3060] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.519673 14241 raft_consensus.cc:359] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.520533 14241 raft_consensus.cc:385] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.527194 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693673e936cd487db2af6d8d4fdbdfb4" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:42.528008 13941 raft_consensus.cc:2468] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 0.
I20260709 13:20:42.528149 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115a6800c73f40b892541c9f0f53eff3" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:42.529242 14014 raft_consensus.cc:2393] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd8162413804fe29717f0e0fb2f288b in current term 1: Already voted for candidate 5cf4c3c457844a8c8d0c825d6d707188 in this term.
I20260709 13:20:42.530200 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693673e936cd487db2af6d8d4fdbdfb4" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:42.503043 14163 raft_consensus.cc:515] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.530941 14017 raft_consensus.cc:2468] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 0.
I20260709 13:20:42.531379 13942 raft_consensus.cc:2393] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a308a1dc4fe94728bd0f56413fb14987 in current term 1: Already voted for candidate 9fd8162413804fe29717f0e0fb2f288b in this term.
I20260709 13:20:42.534735 14090 raft_consensus.cc:2468] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 1.
I20260709 13:20:42.535202 14054 leader_election.cc:304] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:42.535487 14163 leader_election.cc:290] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 election: Requested vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:42.535228 14240 raft_consensus.cc:359] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.536100 13980 leader_election.cc:304] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:42.536437 14228 raft_consensus.cc:2804] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:42.536993 14228 raft_consensus.cc:493] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.537194 14229 raft_consensus.cc:2804] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:42.537408 14228 raft_consensus.cc:3060] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.537822 14229 raft_consensus.cc:697] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Becoming Leader. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:42.537884 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290a2cb6c7174c9ca338b70d16c001fc" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:42.538856 14229 consensus_queue.cc:237] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.520872 14241 raft_consensus.cc:740] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.539208 14267 raft_consensus.cc:697] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [term 1 LEADER]: Becoming Leader. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Running, Role: LEADER
I20260709 13:20:42.541673 14267 consensus_queue.cc:237] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.536526 14240 raft_consensus.cc:385] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.544224 14240 raft_consensus.cc:740] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.545029 14240 consensus_queue.cc:260] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.547091 14228 raft_consensus.cc:515] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.538875 14017 raft_consensus.cc:2393] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd8162413804fe29717f0e0fb2f288b in current term 1: Already voted for candidate a308a1dc4fe94728bd0f56413fb14987 in this term.
I20260709 13:20:42.540198 14241 consensus_queue.cc:260] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.572248 14241 ts_tablet_manager.cc:1434] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.004s
I20260709 13:20:42.572312 14228 leader_election.cc:290] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:42.547461 14240 ts_tablet_manager.cc:1434] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:20:42.575063 14240 tablet_bootstrap.cc:492] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987: Bootstrap starting.
I20260709 13:20:42.558969 14269 raft_consensus.cc:515] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.565923 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115a6800c73f40b892541c9f0f53eff3" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:42.577623 14090 raft_consensus.cc:2393] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd8162413804fe29717f0e0fb2f288b in current term 1: Already voted for candidate 5cf4c3c457844a8c8d0c825d6d707188 in this term.
I20260709 13:20:42.553784 13938 raft_consensus.cc:2468] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 1.
I20260709 13:20:42.566357 13840 catalog_manager.cc:5697] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.578831 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693673e936cd487db2af6d8d4fdbdfb4" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:42.579684 14017 raft_consensus.cc:3060] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.573544 14241 tablet_bootstrap.cc:492] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:42.573589 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290a2cb6c7174c9ca338b70d16c001fc" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:42.577733 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693673e936cd487db2af6d8d4fdbdfb4" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:42.584493 13942 raft_consensus.cc:3060] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.590221 14240 tablet_bootstrap.cc:654] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.600211 14015 raft_consensus.cc:2468] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 1.
I20260709 13:20:42.601667 13905 leader_election.cc:304] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b; no voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987
I20260709 13:20:42.601917 14054 leader_election.cc:304] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:42.603220 14280 raft_consensus.cc:2749] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:42.603434 14229 raft_consensus.cc:493] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.604067 14229 raft_consensus.cc:515] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.604602 13905 leader_election.cc:304] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b; no voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987
I20260709 13:20:42.600770 14241 tablet_bootstrap.cc:654] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.605590 14163 raft_consensus.cc:2749] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:42.611521 13837 catalog_manager.cc:5697] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 reported cstate change: term changed from 0 to 1, leader changed from <none> to a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "a308a1dc4fe94728bd0f56413fb14987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:42.606918 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe313cc914f4030955e026bcaacc19c" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:42.607267 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe313cc914f4030955e026bcaacc19c" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:42.607602 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294d47ad12ee4bfcb7b4511b08cb4756" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:42.613504 13938 raft_consensus.cc:3060] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.610411 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294d47ad12ee4bfcb7b4511b08cb4756" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:42.606201 14278 raft_consensus.cc:2804] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:42.612869 14014 raft_consensus.cc:3060] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.615748 13839 catalog_manager.cc:5697] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65). New cstate: current_term: 1 leader_uuid: "9fd8162413804fe29717f0e0fb2f288b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.615967 14278 raft_consensus.cc:697] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Leader. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
W20260709 13:20:42.617554 13980 leader_election.cc:343] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:42.614977 14091 raft_consensus.cc:2468] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 0.
I20260709 13:20:42.619504 14278 consensus_queue.cc:237] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.623747 14240 tablet_bootstrap.cc:492] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987: No bootstrap required, opened a new log
I20260709 13:20:42.620829 13980 leader_election.cc:304] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:42.625521 14240 ts_tablet_manager.cc:1403] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.001s
I20260709 13:20:42.626736 14271 raft_consensus.cc:2804] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:42.605429 14269 leader_election.cc:290] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:42.627146 14271 raft_consensus.cc:493] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.627660 14271 raft_consensus.cc:3060] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.628973 14240 raft_consensus.cc:359] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.629820 14240 raft_consensus.cc:385] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.630115 14240 raft_consensus.cc:740] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.630878 14240 consensus_queue.cc:260] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.633193 14240 ts_tablet_manager.cc:1434] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:42.635394 14241 tablet_bootstrap.cc:492] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:42.635990 14241 ts_tablet_manager.cc:1403] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.004s
I20260709 13:20:42.637898 14229 leader_election.cc:290] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:42.637689 14271 raft_consensus.cc:515] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.639076 13942 raft_consensus.cc:2468] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 1.
I20260709 13:20:42.639096 14241 raft_consensus.cc:359] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.640131 14241 raft_consensus.cc:385] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.640462 14241 raft_consensus.cc:740] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.641214 14241 consensus_queue.cc:260] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.641746 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294d47ad12ee4bfcb7b4511b08cb4756" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:42.641847 14054 leader_election.cc:304] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:42.643342 14269 raft_consensus.cc:2804] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:20:42.643560 13980 leader_election.cc:343] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:42.644495 14241 ts_tablet_manager.cc:1434] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:42.644317 14014 raft_consensus.cc:2468] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 1.
I20260709 13:20:42.644222 14269 raft_consensus.cc:697] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Leader. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:42.645745 14241 tablet_bootstrap.cc:492] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b: Bootstrap starting.
I20260709 13:20:42.645700 14054 leader_election.cc:304] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:42.646220 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294d47ad12ee4bfcb7b4511b08cb4756" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:42.646625 14228 raft_consensus.cc:2804] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:42.603514 14017 raft_consensus.cc:2468] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 1.
I20260709 13:20:42.647033 14091 raft_consensus.cc:3060] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.647434 14228 raft_consensus.cc:697] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Leader. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:42.648368 14228 consensus_queue.cc:237] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.646170 14269 consensus_queue.cc:237] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.646397 14271 leader_election.cc:290] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:42.653101 14241 tablet_bootstrap.cc:654] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.656297 14091 raft_consensus.cc:2468] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 1.
I20260709 13:20:42.653172 13938 raft_consensus.cc:2468] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 1.
I20260709 13:20:42.658174 13980 leader_election.cc:304] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:42.660997 14271 raft_consensus.cc:2804] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:42.662717 14271 raft_consensus.cc:697] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Becoming Leader. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:42.663750 14271 consensus_queue.cc:237] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.665387 14241 tablet_bootstrap.cc:492] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b: No bootstrap required, opened a new log
I20260709 13:20:42.666122 14241 ts_tablet_manager.cc:1403] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.008s
I20260709 13:20:42.669070 14241 raft_consensus.cc:359] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.669860 14241 raft_consensus.cc:385] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.670184 14241 raft_consensus.cc:740] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.671044 14241 consensus_queue.cc:260] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.673348 14241 ts_tablet_manager.cc:1434] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:42.676424 13837 catalog_manager.cc:5697] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66). New cstate: current_term: 1 leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.685719 13839 catalog_manager.cc:5697] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 reported cstate change: term changed from 0 to 1, leader changed from <none> to a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "a308a1dc4fe94728bd0f56413fb14987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:42.700119 13840 catalog_manager.cc:5697] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 reported cstate change: term changed from 0 to 1, leader changed from <none> to a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "a308a1dc4fe94728bd0f56413fb14987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:42.701403 13840 catalog_manager.cc:5697] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 reported cstate change: term changed from 0 to 1, leader changed from <none> to a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "a308a1dc4fe94728bd0f56413fb14987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:42.792169 13888 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:42.826735 14278 raft_consensus.cc:493] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.827457 14278 raft_consensus.cc:515] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.829221 14278 leader_election.cc:290] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:42.829957 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101dfdd2225b41e4888d561ae59e5e6d" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b" is_pre_election: true
I20260709 13:20:42.830161 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101dfdd2225b41e4888d561ae59e5e6d" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:42.830572 13938 raft_consensus.cc:2468] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 0.
I20260709 13:20:42.830840 14017 raft_consensus.cc:2468] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 0.
I20260709 13:20:42.831579 14054 leader_election.cc:304] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:42.832252 14278 raft_consensus.cc:2804] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:42.832536 14278 raft_consensus.cc:493] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.832806 14278 raft_consensus.cc:3060] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.839146 14278 raft_consensus.cc:515] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.840956 14278 leader_election.cc:290] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:42.841833 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101dfdd2225b41e4888d561ae59e5e6d" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:42.842021 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101dfdd2225b41e4888d561ae59e5e6d" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:42.842536 13938 raft_consensus.cc:3060] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.842615 14017 raft_consensus.cc:3060] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.850091 13938 raft_consensus.cc:2468] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 1.
I20260709 13:20:42.850095 14017 raft_consensus.cc:2468] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 1.
I20260709 13:20:42.851529 14054 leader_election.cc:304] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:42.852239 14278 raft_consensus.cc:2804] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:42.852721 14278 raft_consensus.cc:697] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Leader. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:42.853526 14278 consensus_queue.cc:237] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:42.861055 13840 catalog_manager.cc:5697] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 reported cstate change: term changed from 0 to 1, leader changed from <none> to a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67). New cstate: current_term: 1 leader_uuid: "a308a1dc4fe94728bd0f56413fb14987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:42.868422 14271 consensus_queue.cc:1048] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.884537 14271 consensus_queue.cc:1048] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.956467 14278 consensus_queue.cc:1048] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.967813 14276 consensus_queue.cc:1048] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.971982 14272 consensus_queue.cc:1048] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:42.989562 14090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "693673e936cd487db2af6d8d4fdbdfb4"
dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
mode: GRACEFUL
new_leader_uuid: "9fd8162413804fe29717f0e0fb2f288b"
 from {username='slave'} at 127.0.0.1:45824
I20260709 13:20:42.990146 14090 raft_consensus.cc:606] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Received request to transfer leadership to TS 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:42.992585 14272 consensus_queue.cc:1048] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:43.000443 14090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6819bd7e812040d49a50c6e7a981a899"
dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
mode: GRACEFUL
new_leader_uuid: "9fd8162413804fe29717f0e0fb2f288b"
 from {username='slave'} at 127.0.0.1:45824
I20260709 13:20:43.001047 14090 raft_consensus.cc:606] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Received request to transfer leadership to TS 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:43.007567 14017 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75238bd7c9674881bbb2c98ed4996118"
dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
mode: GRACEFUL
new_leader_uuid: "9fd8162413804fe29717f0e0fb2f288b"
 from {username='slave'} at 127.0.0.1:44308
I20260709 13:20:43.008196 14017 raft_consensus.cc:606] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Received request to transfer leadership to TS 9fd8162413804fe29717f0e0fb2f288b
I20260709 13:20:43.016599 14090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fe313cc914f4030955e026bcaacc19c"
dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
mode: GRACEFUL
new_leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
 from {username='slave'} at 127.0.0.1:45824
I20260709 13:20:43.017213 14090 raft_consensus.cc:606] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Received request to transfer leadership to TS 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:43.022763 14090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "101dfdd2225b41e4888d561ae59e5e6d"
dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
mode: GRACEFUL
new_leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
 from {username='slave'} at 127.0.0.1:45824
I20260709 13:20:43.023257 14090 raft_consensus.cc:606] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Received request to transfer leadership to TS 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:43.023132 14276 consensus_queue.cc:1048] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:43.030025 14163 consensus_queue.cc:1048] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:43.035197 14090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "290a2cb6c7174c9ca338b70d16c001fc"
dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
mode: GRACEFUL
new_leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
 from {username='slave'} at 127.0.0.1:45824
I20260709 13:20:43.035976 14090 raft_consensus.cc:606] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Received request to transfer leadership to TS 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:43.042877 14014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "294d47ad12ee4bfcb7b4511b08cb4756"
dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
mode: GRACEFUL
new_leader_uuid: "a308a1dc4fe94728bd0f56413fb14987"
 from {username='slave'} at 127.0.0.1:44308
I20260709 13:20:43.043485 14014 raft_consensus.cc:606] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Received request to transfer leadership to TS a308a1dc4fe94728bd0f56413fb14987
I20260709 13:20:43.046741 14269 raft_consensus.cc:993] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987: : Instructing follower 9fd8162413804fe29717f0e0fb2f288b to start an election
I20260709 13:20:43.047225 14269 raft_consensus.cc:1081] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Signalling peer 9fd8162413804fe29717f0e0fb2f288b to start an election
I20260709 13:20:43.049368 13938 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6819bd7e812040d49a50c6e7a981a899"
dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
 from {username='slave'} at 127.0.0.1:48522
I20260709 13:20:43.049948 13938 raft_consensus.cc:493] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:43.050323 13938 raft_consensus.cc:3060] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.057289 14269 consensus_queue.cc:1048] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:43.059226 14163 consensus_queue.cc:1048] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:43.064949 13938 raft_consensus.cc:515] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.066728 13941 raft_consensus.cc:1240] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Rejecting Update request from peer a308a1dc4fe94728bd0f56413fb14987 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:43.069263 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6819bd7e812040d49a50c6e7a981a899" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:43.071416 14269 consensus_queue.cc:1059] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:43.072228 14269 raft_consensus.cc:3055] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:43.072549 14269 raft_consensus.cc:740] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:43.073401 14269 consensus_queue.cc:260] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.074329 14269 raft_consensus.cc:3060] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.076164 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6819bd7e812040d49a50c6e7a981a899" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:43.078147 13938 leader_election.cc:290] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 2 election: Requested vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:43.095091 14269 consensus_queue.cc:1048] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:43.101531 14091 raft_consensus.cc:2468] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 2.
I20260709 13:20:43.103595 13905 leader_election.cc:304] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:43.104451 14163 raft_consensus.cc:2804] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:43.104905 14163 raft_consensus.cc:697] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [term 2 LEADER]: Becoming Leader. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Running, Role: LEADER
I20260709 13:20:43.105756 14163 consensus_queue.cc:237] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.107318 14276 raft_consensus.cc:993] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987: : Instructing follower 5cf4c3c457844a8c8d0c825d6d707188 to start an election
I20260709 13:20:43.107897 14270 raft_consensus.cc:1081] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Signalling peer 5cf4c3c457844a8c8d0c825d6d707188 to start an election
I20260709 13:20:43.110201 14014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fe313cc914f4030955e026bcaacc19c"
dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
 from {username='slave'} at 127.0.0.1:44292
I20260709 13:20:43.111588 14014 raft_consensus.cc:493] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:43.111989 14014 raft_consensus.cc:3060] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.113067 14269 consensus_queue.cc:1048] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:43.116292 13837 catalog_manager.cc:5697] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b reported cstate change: term changed from 1 to 2, leader changed from a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67) to 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65). New cstate: current_term: 2 leader_uuid: "9fd8162413804fe29717f0e0fb2f288b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.122660 14014 raft_consensus.cc:515] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.125774 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe313cc914f4030955e026bcaacc19c" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:43.126403 13938 raft_consensus.cc:3060] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.126767 14014 leader_election.cc:290] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:43.127884 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe313cc914f4030955e026bcaacc19c" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:43.128595 14091 raft_consensus.cc:3055] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:43.128950 14091 raft_consensus.cc:740] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:43.129773 14091 consensus_queue.cc:260] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.131101 14091 raft_consensus.cc:3060] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.133811 13938 raft_consensus.cc:2468] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 2.
I20260709 13:20:43.135439 13980 leader_election.cc:304] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b; no voters: 
I20260709 13:20:43.136531 14271 raft_consensus.cc:2804] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:43.137017 14271 raft_consensus.cc:697] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 LEADER]: Becoming Leader. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:43.137902 14271 consensus_queue.cc:237] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.140167 14091 raft_consensus.cc:2468] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 2.
I20260709 13:20:43.141206 14163 raft_consensus.cc:493] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.141795 14163 raft_consensus.cc:515] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.143664 14163 leader_election.cc:290] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:43.144445 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294d47ad12ee4bfcb7b4511b08cb4756" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188" is_pre_election: true
I20260709 13:20:43.144750 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294d47ad12ee4bfcb7b4511b08cb4756" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a308a1dc4fe94728bd0f56413fb14987" is_pre_election: true
I20260709 13:20:43.145627 14091 raft_consensus.cc:2393] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd8162413804fe29717f0e0fb2f288b in current term 1: Already voted for candidate 5cf4c3c457844a8c8d0c825d6d707188 in this term.
I20260709 13:20:43.146657 13905 leader_election.cc:304] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b; no voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987
I20260709 13:20:43.147487 14163 raft_consensus.cc:3060] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:43.148123 13837 catalog_manager.cc:5697] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 reported cstate change: term changed from 1 to 2, leader changed from a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67) to 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.152978 14163 raft_consensus.cc:2749] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:43.161235 14271 consensus_queue.cc:1048] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:43.171563 14272 consensus_queue.cc:1048] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:43.182082 14272 raft_consensus.cc:993] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188: : Instructing follower a308a1dc4fe94728bd0f56413fb14987 to start an election
I20260709 13:20:43.182585 14229 raft_consensus.cc:1081] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Signalling peer a308a1dc4fe94728bd0f56413fb14987 to start an election
I20260709 13:20:43.184043 14091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "294d47ad12ee4bfcb7b4511b08cb4756"
dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
 from {username='slave'} at 127.0.0.1:45812
I20260709 13:20:43.184573 14091 raft_consensus.cc:493] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:43.184984 14091 raft_consensus.cc:3060] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.191104 14091 raft_consensus.cc:515] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.192754 14091 leader_election.cc:290] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:43.194442 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294d47ad12ee4bfcb7b4511b08cb4756" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:43.194226 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294d47ad12ee4bfcb7b4511b08cb4756" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:43.195062 14014 raft_consensus.cc:3055] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:43.195333 14014 raft_consensus.cc:740] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:43.195339 13938 raft_consensus.cc:3060] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.196233 14014 consensus_queue.cc:260] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.197497 14014 raft_consensus.cc:3060] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.202423 13938 raft_consensus.cc:2468] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 2.
I20260709 13:20:43.202534 14014 raft_consensus.cc:2468] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 2.
I20260709 13:20:43.203833 14054 leader_election.cc:304] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:43.204587 14269 raft_consensus.cc:2804] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:43.205030 14269 raft_consensus.cc:697] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [term 2 LEADER]: Becoming Leader. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:43.205847 14269 consensus_queue.cc:237] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.213377 13837 catalog_manager.cc:5697] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 reported cstate change: term changed from 1 to 2, leader changed from 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66) to a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67). New cstate: current_term: 2 leader_uuid: "a308a1dc4fe94728bd0f56413fb14987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:43.216933 14269 consensus_queue.cc:1048] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:43.223904 14276 raft_consensus.cc:993] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987: : Instructing follower 9fd8162413804fe29717f0e0fb2f288b to start an election
I20260709 13:20:43.224428 14270 raft_consensus.cc:1081] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Signalling peer 9fd8162413804fe29717f0e0fb2f288b to start an election
I20260709 13:20:43.226778 13941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "693673e936cd487db2af6d8d4fdbdfb4"
dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
 from {username='slave'} at 127.0.0.1:48522
I20260709 13:20:43.227355 13941 raft_consensus.cc:493] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:43.227727 13941 raft_consensus.cc:3060] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.232406 14269 consensus_queue.cc:1048] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:43.234741 13941 raft_consensus.cc:515] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.237865 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693673e936cd487db2af6d8d4fdbdfb4" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:43.238942 13938 raft_consensus.cc:1240] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Rejecting Update request from peer a308a1dc4fe94728bd0f56413fb14987 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:43.240984 13941 leader_election.cc:290] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 2 election: Requested vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:43.242129 14276 consensus_queue.cc:1059] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:43.242291 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693673e936cd487db2af6d8d4fdbdfb4" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:43.243129 14276 raft_consensus.cc:3055] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:43.243468 14276 raft_consensus.cc:740] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:43.244230 14276 consensus_queue.cc:260] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.245293 14276 raft_consensus.cc:3060] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.257344 14091 raft_consensus.cc:2468] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 2.
I20260709 13:20:43.258795 13905 leader_election.cc:304] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 5cf4c3c457844a8c8d0c825d6d707188
I20260709 13:20:43.259717 14163 raft_consensus.cc:2804] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:43.260278 14163 raft_consensus.cc:697] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [term 2 LEADER]: Becoming Leader. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Running, Role: LEADER
I20260709 13:20:43.261035 14163 consensus_queue.cc:237] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.268106 13837 catalog_manager.cc:5697] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b reported cstate change: term changed from 1 to 2, leader changed from a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67) to 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65). New cstate: current_term: 2 leader_uuid: "9fd8162413804fe29717f0e0fb2f288b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.277834 14276 consensus_queue.cc:1048] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:43.289330 14269 consensus_queue.cc:1048] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:43.301333 14269 raft_consensus.cc:993] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987: : Instructing follower 5cf4c3c457844a8c8d0c825d6d707188 to start an election
I20260709 13:20:43.301833 14276 raft_consensus.cc:1081] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Signalling peer 5cf4c3c457844a8c8d0c825d6d707188 to start an election
I20260709 13:20:43.303409 14017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "101dfdd2225b41e4888d561ae59e5e6d"
dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
 from {username='slave'} at 127.0.0.1:44292
I20260709 13:20:43.303992 14017 raft_consensus.cc:493] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:43.304306 14017 raft_consensus.cc:3060] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.309653 14017 raft_consensus.cc:515] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.311321 14017 leader_election.cc:290] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:43.312608 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101dfdd2225b41e4888d561ae59e5e6d" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:43.313192 13941 raft_consensus.cc:3060] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.313901 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101dfdd2225b41e4888d561ae59e5e6d" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:43.314512 14091 raft_consensus.cc:3055] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:43.314841 14091 raft_consensus.cc:740] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:43.315713 14091 consensus_queue.cc:260] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.317097 14091 raft_consensus.cc:3060] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.320708 13941 raft_consensus.cc:2468] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 2.
I20260709 13:20:43.321833 13980 leader_election.cc:304] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b; no voters: 
I20260709 13:20:43.322710 14229 raft_consensus.cc:2804] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:43.323179 14229 raft_consensus.cc:697] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 LEADER]: Becoming Leader. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:43.323930 14091 raft_consensus.cc:2468] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 2.
I20260709 13:20:43.323895 14229 consensus_queue.cc:237] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.330785 13839 catalog_manager.cc:5697] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 reported cstate change: term changed from 1 to 2, leader changed from a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67) to 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.403326 14271 raft_consensus.cc:993] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188: : Instructing follower 9fd8162413804fe29717f0e0fb2f288b to start an election
I20260709 13:20:43.403841 14272 raft_consensus.cc:1081] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Signalling peer 9fd8162413804fe29717f0e0fb2f288b to start an election
I20260709 13:20:43.405417 13941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75238bd7c9674881bbb2c98ed4996118"
dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
 from {username='slave'} at 127.0.0.1:48506
I20260709 13:20:43.405912 13941 raft_consensus.cc:493] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:43.406224 13941 raft_consensus.cc:3060] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.411425 13941 raft_consensus.cc:515] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.413321 13941 leader_election.cc:290] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 2 election: Requested vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:43.414311 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75238bd7c9674881bbb2c98ed4996118" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:43.414511 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75238bd7c9674881bbb2c98ed4996118" candidate_uuid: "9fd8162413804fe29717f0e0fb2f288b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:43.415041 14017 raft_consensus.cc:3055] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:43.415175 14091 raft_consensus.cc:3060] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.415462 14017 raft_consensus.cc:740] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:43.416654 14017 consensus_queue.cc:260] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.418032 14017 raft_consensus.cc:3060] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.421908 14091 raft_consensus.cc:2468] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 2.
I20260709 13:20:43.422957 13905 leader_election.cc:304] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:43.423659 14163 raft_consensus.cc:2804] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:43.423833 14017 raft_consensus.cc:2468] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd8162413804fe29717f0e0fb2f288b in term 2.
I20260709 13:20:43.424165 14163 raft_consensus.cc:697] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [term 2 LEADER]: Becoming Leader. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Running, Role: LEADER
I20260709 13:20:43.425065 14163 consensus_queue.cc:237] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.431376 13839 catalog_manager.cc:5697] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b reported cstate change: term changed from 1 to 2, leader changed from 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66) to 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65). New cstate: current_term: 2 leader_uuid: "9fd8162413804fe29717f0e0fb2f288b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.457448 14269 raft_consensus.cc:993] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987: : Instructing follower 5cf4c3c457844a8c8d0c825d6d707188 to start an election
I20260709 13:20:43.458065 14270 raft_consensus.cc:1081] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Signalling peer 5cf4c3c457844a8c8d0c825d6d707188 to start an election
I20260709 13:20:43.459748 14017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "290a2cb6c7174c9ca338b70d16c001fc"
dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
 from {username='slave'} at 127.0.0.1:44292
I20260709 13:20:43.460345 14017 raft_consensus.cc:493] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:43.460665 14017 raft_consensus.cc:3060] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.467262 14017 raft_consensus.cc:515] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.468786 14017 leader_election.cc:290] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67:46111)
I20260709 13:20:43.469695 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290a2cb6c7174c9ca338b70d16c001fc" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:43.469995 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290a2cb6c7174c9ca338b70d16c001fc" candidate_uuid: "5cf4c3c457844a8c8d0c825d6d707188" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
I20260709 13:20:43.470297 13941 raft_consensus.cc:3060] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.470712 14091 raft_consensus.cc:3055] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:43.471025 14091 raft_consensus.cc:740] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:43.471709 14091 consensus_queue.cc:260] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.472662 14091 raft_consensus.cc:3060] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.475863 13941 raft_consensus.cc:2468] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 2.
I20260709 13:20:43.476985 13980 leader_election.cc:304] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, 9fd8162413804fe29717f0e0fb2f288b; no voters: 
I20260709 13:20:43.477810 14272 raft_consensus.cc:2804] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:43.478216 14272 raft_consensus.cc:697] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 LEADER]: Becoming Leader. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:43.478276 14091 raft_consensus.cc:2468] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cf4c3c457844a8c8d0c825d6d707188 in term 2.
I20260709 13:20:43.479012 14272 consensus_queue.cc:237] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:43.485915 13839 catalog_manager.cc:5697] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 reported cstate change: term changed from 1 to 2, leader changed from a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67) to 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66). New cstate: current_term: 2 leader_uuid: "5cf4c3c457844a8c8d0c825d6d707188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.584416 14017 raft_consensus.cc:3060] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.590010 14017 raft_consensus.cc:1275] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Refusing update from remote peer 9fd8162413804fe29717f0e0fb2f288b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.591353 14163 consensus_queue.cc:1048] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.600165 14091 raft_consensus.cc:1275] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Refusing update from remote peer 9fd8162413804fe29717f0e0fb2f288b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.601544 14163 consensus_queue.cc:1048] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.611775 14017 raft_consensus.cc:1275] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Refusing update from remote peer a308a1dc4fe94728bd0f56413fb14987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.613040 14276 consensus_queue.cc:1048] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.619407 14091 raft_consensus.cc:1275] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Refusing update from remote peer 5cf4c3c457844a8c8d0c825d6d707188: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.621124 14272 consensus_queue.cc:1048] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.635500 13938 raft_consensus.cc:1275] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Refusing update from remote peer 5cf4c3c457844a8c8d0c825d6d707188: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.635521 13941 raft_consensus.cc:1275] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Refusing update from remote peer a308a1dc4fe94728bd0f56413fb14987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.638375 14272 consensus_queue.cc:1048] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.639109 14228 consensus_queue.cc:1048] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:43.763319 13938 raft_consensus.cc:1275] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Refusing update from remote peer 5cf4c3c457844a8c8d0c825d6d707188: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.764511 14314 consensus_queue.cc:1048] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.766999 14017 raft_consensus.cc:3060] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.774839 14017 raft_consensus.cc:1275] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Refusing update from remote peer 9fd8162413804fe29717f0e0fb2f288b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.776540 14163 consensus_queue.cc:1048] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.777758 14091 raft_consensus.cc:1275] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Refusing update from remote peer 5cf4c3c457844a8c8d0c825d6d707188: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.779382 14272 consensus_queue.cc:1048] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.786331 14090 raft_consensus.cc:1275] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Refusing update from remote peer 9fd8162413804fe29717f0e0fb2f288b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.787751 14280 consensus_queue.cc:1048] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.939119 14090 raft_consensus.cc:1275] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Refusing update from remote peer 9fd8162413804fe29717f0e0fb2f288b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.940368 14313 consensus_queue.cc:1048] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.949148 14017 raft_consensus.cc:1275] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Refusing update from remote peer 9fd8162413804fe29717f0e0fb2f288b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.950546 14163 consensus_queue.cc:1048] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.992895 14090 raft_consensus.cc:1275] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Refusing update from remote peer 5cf4c3c457844a8c8d0c825d6d707188: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.994239 14272 consensus_queue.cc:1048] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:44.003799 13938 raft_consensus.cc:1275] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Refusing update from remote peer 5cf4c3c457844a8c8d0c825d6d707188: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:44.005573 14271 consensus_queue.cc:1048] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:46.047451 13840 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50908:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:20:46.071740 13840 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50908:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:20:46.095602  2025 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:46.173069 13905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.67:46111, user_credentials={real_user=slave}} blocked reactor thread for 64890.5us
W20260709 13:20:46.358517 13980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41903, user_credentials={real_user=slave}} blocked reactor thread for 156906us
I20260709 13:20:46.442638 14361 tablet.cc:1724] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.443693 14366 tablet.cc:1724] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:46.502075 14360 log.cc:927] Time spent T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
I20260709 13:20:46.501538 14376 tablet.cc:1724] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:46.504283 14359 log.cc:927] Time spent T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:20:46.535132 14372 log.cc:927] Time spent T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 13:20:46.534266 14379 tablet.cc:1724] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:46.575198 14054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.65:41903, user_credentials={real_user=slave}} blocked reactor thread for 62074.6us
I20260709 13:20:46.575323 14366 tablet.cc:1724] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:46.612521 14371 log.cc:927] Time spent T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b: Append to log took a long time: real 0.165s	user 0.002s	sys 0.000s
W20260709 13:20:46.613008 14365 log.cc:927] Time spent T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987: Append to log took a long time: real 0.165s	user 0.003s	sys 0.000s
I20260709 13:20:46.548966 14378 tablet.cc:1724] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.612428 14382 tablet.cc:1724] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.617928 14377 tablet.cc:1724] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.624399 14381 tablet.cc:1724] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.630617 14387 tablet.cc:1724] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.638330 14389 tablet.cc:1724] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.654624 14385 tablet.cc:1724] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.678980 14379 tablet.cc:1724] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.685199 14016 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "909e41a091f7440fa9c5fff3cefc005d"
dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
mode: GRACEFUL
new_leader_uuid: "a308a1dc4fe94728bd0f56413fb14987"
 from {username='slave'} at 127.0.0.1:60128
I20260709 13:20:46.669799 14388 tablet.cc:1724] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.686129 14016 raft_consensus.cc:606] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 LEADER]: Received request to transfer leadership to TS a308a1dc4fe94728bd0f56413fb14987
I20260709 13:20:46.699023 14378 tablet.cc:1724] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.703172 14376 tablet.cc:1724] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.692667 14366 tablet.cc:1724] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.728073 14361 tablet.cc:1724] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.730731 14377 tablet.cc:1724] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:46.725685 14054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.250.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 101925us
I20260709 13:20:46.739835 14382 tablet.cc:1724] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.744673 14385 tablet.cc:1724] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.750466 14387 tablet.cc:1724] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.752517 14381 tablet.cc:1724] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.756633 14388 tablet.cc:1724] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.772971 14377 tablet.cc:1724] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.799957 14385 tablet.cc:1724] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.805315 14389 tablet.cc:1724] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.820240 13940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9297ad2180a543fdbb0a6546b011bd77"
dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
mode: GRACEFUL
new_leader_uuid: "a308a1dc4fe94728bd0f56413fb14987"
 from {username='slave'} at 127.0.0.1:51452
I20260709 13:20:46.820950 13940 raft_consensus.cc:606] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 2 LEADER]: Received request to transfer leadership to TS a308a1dc4fe94728bd0f56413fb14987
I20260709 13:20:46.825235  2025 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:46.825924  2025 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:46.837175 13837 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c: soft_deleted_table [id=74a63febe21942668b46e37b704d8343] alter complete (version 1)
I20260709 13:20:46.913695 14352 raft_consensus.cc:993] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188: : Instructing follower a308a1dc4fe94728bd0f56413fb14987 to start an election
I20260709 13:20:46.914350 14354 raft_consensus.cc:1081] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 LEADER]: Signalling peer a308a1dc4fe94728bd0f56413fb14987 to start an election
I20260709 13:20:46.916371 14085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "909e41a091f7440fa9c5fff3cefc005d"
dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
 from {username='slave'} at 127.0.0.1:45812
I20260709 13:20:46.917019 14085 raft_consensus.cc:493] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:46.917537 14085 raft_consensus.cc:3060] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:46.923964 14085 raft_consensus.cc:515] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:46.925689 14085 leader_election.cc:290] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 3 election: Requested vote from peers 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903), 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499)
I20260709 13:20:46.926677 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "909e41a091f7440fa9c5fff3cefc005d" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:46.926970 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "909e41a091f7440fa9c5fff3cefc005d" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:46.927520 14017 raft_consensus.cc:3055] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:46.927522 13940 raft_consensus.cc:3060] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:46.927968 14017 raft_consensus.cc:740] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5cf4c3c457844a8c8d0c825d6d707188, State: Running, Role: LEADER
I20260709 13:20:46.928891 14017 consensus_queue.cc:260] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:46.930344 14017 raft_consensus.cc:3060] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:46.936287 13940 raft_consensus.cc:2468] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 3.
I20260709 13:20:46.937814 14054 leader_election.cc:304] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd8162413804fe29717f0e0fb2f288b, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:46.938287 14017 raft_consensus.cc:2468] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 3.
I20260709 13:20:46.938860 14368 raft_consensus.cc:2804] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:46.939513 14368 raft_consensus.cc:697] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 3 LEADER]: Becoming Leader. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:46.940470 14368 consensus_queue.cc:237] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } }
I20260709 13:20:46.950544 13836 catalog_manager.cc:5697] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 reported cstate change: term changed from 2 to 3, leader changed from 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66) to a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67). New cstate: current_term: 3 leader_uuid: "a308a1dc4fe94728bd0f56413fb14987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.135257 14313 raft_consensus.cc:993] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b: : Instructing follower a308a1dc4fe94728bd0f56413fb14987 to start an election
I20260709 13:20:47.135805 14313 raft_consensus.cc:1081] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 2 LEADER]: Signalling peer a308a1dc4fe94728bd0f56413fb14987 to start an election
I20260709 13:20:47.137369 14085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9297ad2180a543fdbb0a6546b011bd77"
dest_uuid: "a308a1dc4fe94728bd0f56413fb14987"
 from {username='slave'} at 127.0.0.1:45822
I20260709 13:20:47.137879 14085 raft_consensus.cc:493] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:47.138203 14085 raft_consensus.cc:3060] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:47.143754 14085 raft_consensus.cc:515] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
I20260709 13:20:47.145465 14085 leader_election.cc:290] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 3 election: Requested vote from peers 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499), 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903)
I20260709 13:20:47.146535 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9297ad2180a543fdbb0a6546b011bd77" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5cf4c3c457844a8c8d0c825d6d707188"
I20260709 13:20:47.146543 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9297ad2180a543fdbb0a6546b011bd77" candidate_uuid: "a308a1dc4fe94728bd0f56413fb14987" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fd8162413804fe29717f0e0fb2f288b"
I20260709 13:20:47.147277 14016 raft_consensus.cc:3060] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:47.147408 13940 raft_consensus.cc:3055] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:47.147886 13940 raft_consensus.cc:740] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fd8162413804fe29717f0e0fb2f288b, State: Running, Role: LEADER
I20260709 13:20:47.148677 13940 consensus_queue.cc:260] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
I20260709 13:20:47.149843 13940 raft_consensus.cc:3060] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:47.153828 14016 raft_consensus.cc:2468] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 3.
I20260709 13:20:47.155223 14054 leader_election.cc:304] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cf4c3c457844a8c8d0c825d6d707188, a308a1dc4fe94728bd0f56413fb14987; no voters: 
I20260709 13:20:47.155937 13940 raft_consensus.cc:2468] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a308a1dc4fe94728bd0f56413fb14987 in term 3.
I20260709 13:20:47.156461 14368 raft_consensus.cc:2804] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:47.156980 14368 raft_consensus.cc:697] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 3 LEADER]: Becoming Leader. State: Replica: a308a1dc4fe94728bd0f56413fb14987, State: Running, Role: LEADER
I20260709 13:20:47.158087 14368 consensus_queue.cc:237] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } }
I20260709 13:20:47.168320 13836 catalog_manager.cc:5697] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 reported cstate change: term changed from 2 to 3, leader changed from 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65) to a308a1dc4fe94728bd0f56413fb14987 (127.1.250.67). New cstate: current_term: 3 leader_uuid: "a308a1dc4fe94728bd0f56413fb14987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a308a1dc4fe94728bd0f56413fb14987" member_type: VOTER last_known_addr { host: "127.1.250.67" port: 46111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:47.344465 13940 raft_consensus.cc:1275] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b [term 3 FOLLOWER]: Refusing update from remote peer a308a1dc4fe94728bd0f56413fb14987: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:47.345779 14368 consensus_queue.cc:1048] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:47.356731 14016 raft_consensus.cc:1275] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 3 FOLLOWER]: Refusing update from remote peer a308a1dc4fe94728bd0f56413fb14987: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:47.358551 14368 consensus_queue.cc:1048] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:47.718158 14016 raft_consensus.cc:1275] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 3 FOLLOWER]: Refusing update from remote peer a308a1dc4fe94728bd0f56413fb14987: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:47.719573 14368 consensus_queue.cc:1048] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cf4c3c457844a8c8d0c825d6d707188" member_type: VOTER last_known_addr { host: "127.1.250.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:47.722931 13940 raft_consensus.cc:1275] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 3 FOLLOWER]: Refusing update from remote peer a308a1dc4fe94728bd0f56413fb14987: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:47.724308 14368 consensus_queue.cc:1048] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd8162413804fe29717f0e0fb2f288b" member_type: VOTER last_known_addr { host: "127.1.250.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:47.892140  2025 tablet_server.cc:179] TabletServer@127.1.250.65:0 shutting down...
W20260709 13:20:47.895282 14054 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:20:47.908274 14054 consensus_peers.cc:597] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 -> Peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Couldn't send request to peer 9fd8162413804fe29717f0e0fb2f288b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:47.932554  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:47.933714  2025 tablet_replica.cc:333] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.935918  2025 raft_consensus.cc:2243] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.936510  2025 raft_consensus.cc:2272] T 294d47ad12ee4bfcb7b4511b08cb4756 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.940500  2025 tablet_replica.cc:333] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.941434  2025 raft_consensus.cc:2243] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.942039  2025 raft_consensus.cc:2272] T 101dfdd2225b41e4888d561ae59e5e6d P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.944404  2025 tablet_replica.cc:333] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.945298  2025 raft_consensus.cc:2243] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.945804  2025 raft_consensus.cc:2272] T 115a6800c73f40b892541c9f0f53eff3 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.948350  2025 tablet_replica.cc:333] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.949169  2025 raft_consensus.cc:2243] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.950098  2025 raft_consensus.cc:2272] T 693673e936cd487db2af6d8d4fdbdfb4 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.952428  2025 tablet_replica.cc:333] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.953111  2025 raft_consensus.cc:2243] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.953661  2025 raft_consensus.cc:2272] T b589e88d96c048bea4491addeedd7ee4 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.956851  2025 tablet_replica.cc:333] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.957744  2025 raft_consensus.cc:2243] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.958421  2025 raft_consensus.cc:2272] T 619db8da711b4208b7e35e961f307e4d P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.961231  2025 tablet_replica.cc:333] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.961830  2025 raft_consensus.cc:2243] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.962795  2025 raft_consensus.cc:2272] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.965000  2025 tablet_replica.cc:333] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.965641  2025 raft_consensus.cc:2243] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.966110  2025 raft_consensus.cc:2272] T 1fe313cc914f4030955e026bcaacc19c P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.968302  2025 tablet_replica.cc:333] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.968971  2025 raft_consensus.cc:2243] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.969477  2025 raft_consensus.cc:2272] T edc94be6c3e346598944c6f19db99795 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.971629  2025 tablet_replica.cc:333] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.972199  2025 raft_consensus.cc:2243] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.973131  2025 raft_consensus.cc:2272] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.975404  2025 tablet_replica.cc:333] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.976049  2025 raft_consensus.cc:2243] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.976596  2025 raft_consensus.cc:2272] T b6002321e89f4925808b3d1110305308 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.978861  2025 tablet_replica.cc:333] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.979547  2025 raft_consensus.cc:2243] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.980399  2025 raft_consensus.cc:2272] T 75238bd7c9674881bbb2c98ed4996118 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.982522  2025 tablet_replica.cc:333] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.983036  2025 raft_consensus.cc:2243] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.983831  2025 raft_consensus.cc:2272] T 6819bd7e812040d49a50c6e7a981a899 P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.986007  2025 tablet_replica.cc:333] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.986523  2025 raft_consensus.cc:2243] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.987360  2025 raft_consensus.cc:2272] T bfca25342f2b45188d85d07a53b333ed P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.990722  2025 tablet_replica.cc:333] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.991776  2025 raft_consensus.cc:2243] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:47.992295 14054 consensus_peers.cc:597] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 -> Peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Couldn't send request to peer 9fd8162413804fe29717f0e0fb2f288b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:47.992319  2025 raft_consensus.cc:2272] T 9297ad2180a543fdbb0a6546b011bd77 P 9fd8162413804fe29717f0e0fb2f288b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.995817  2025 tablet_replica.cc:333] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:47.996578  2025 raft_consensus.cc:2243] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.997398  2025 raft_consensus.cc:2272] T 909e41a091f7440fa9c5fff3cefc005d P 9fd8162413804fe29717f0e0fb2f288b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:48.002704 13980 consensus_peers.cc:597] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 -> Peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Couldn't send request to peer 9fd8162413804fe29717f0e0fb2f288b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.003011  2025 tablet_replica.cc:333] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:48.003844  2025 raft_consensus.cc:2243] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.004388  2025 raft_consensus.cc:2272] T 290a2cb6c7174c9ca338b70d16c001fc P 9fd8162413804fe29717f0e0fb2f288b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.007354  2025 tablet_replica.cc:333] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b: stopping tablet replica
I20260709 13:20:48.007933  2025 raft_consensus.cc:2243] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.008890  2025 raft_consensus.cc:2272] T 9c361298644c46a8b929ba18dc463a27 P 9fd8162413804fe29717f0e0fb2f288b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:48.037508 13980 consensus_peers.cc:597] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 -> Peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Couldn't send request to peer 9fd8162413804fe29717f0e0fb2f288b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.060150  2025 tablet_server.cc:196] TabletServer@127.1.250.65:0 shutdown complete.
I20260709 13:20:48.110764  2025 tablet_server.cc:179] TabletServer@127.1.250.66:0 shutting down...
I20260709 13:20:48.143694  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:48.144724  2025 tablet_replica.cc:333] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.145753  2025 raft_consensus.cc:2243] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.146778  2025 raft_consensus.cc:2272] T 115a6800c73f40b892541c9f0f53eff3 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:48.149499 14054 consensus_peers.cc:597] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 -> Peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Couldn't send request to peer 9fd8162413804fe29717f0e0fb2f288b. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.149595  2025 tablet_replica.cc:333] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.150970  2025 raft_consensus.cc:2243] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.151710  2025 raft_consensus.cc:2272] T 294d47ad12ee4bfcb7b4511b08cb4756 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.154496  2025 tablet_replica.cc:333] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.155603  2025 raft_consensus.cc:2243] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.156268  2025 raft_consensus.cc:2272] T 75238bd7c9674881bbb2c98ed4996118 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:48.156718 13980 consensus_peers.cc:597] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 -> Peer 9fd8162413804fe29717f0e0fb2f288b (127.1.250.65:41903): Couldn't send request to peer 9fd8162413804fe29717f0e0fb2f288b. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.65:41903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.159111  2025 tablet_replica.cc:333] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.159809  2025 raft_consensus.cc:2243] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.160284  2025 raft_consensus.cc:2272] T 6819bd7e812040d49a50c6e7a981a899 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.162523  2025 tablet_replica.cc:333] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.163189  2025 raft_consensus.cc:2243] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.163622  2025 raft_consensus.cc:2272] T d4d5f3e13d37415f88d3fc6dcbd08cdf P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.165891  2025 tablet_replica.cc:333] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.166453  2025 raft_consensus.cc:2243] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.166926  2025 raft_consensus.cc:2272] T 693673e936cd487db2af6d8d4fdbdfb4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.168994  2025 tablet_replica.cc:333] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.169601  2025 raft_consensus.cc:2243] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.170408  2025 raft_consensus.cc:2272] T 619db8da711b4208b7e35e961f307e4d P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.172452  2025 tablet_replica.cc:333] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.172992  2025 raft_consensus.cc:2243] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.173837  2025 raft_consensus.cc:2272] T b589e88d96c048bea4491addeedd7ee4 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.176399  2025 tablet_replica.cc:333] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.176918  2025 raft_consensus.cc:2243] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.177386  2025 raft_consensus.cc:2272] T 9c361298644c46a8b929ba18dc463a27 P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.179461  2025 tablet_replica.cc:333] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.180032  2025 raft_consensus.cc:2243] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.180882  2025 raft_consensus.cc:2272] T 290a2cb6c7174c9ca338b70d16c001fc P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.183624  2025 tablet_replica.cc:333] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.184124  2025 raft_consensus.cc:2243] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.184641  2025 raft_consensus.cc:2272] T 5537ebb7b20747ea8fd6d1601a6e55c9 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.187127  2025 tablet_replica.cc:333] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.187644  2025 raft_consensus.cc:2243] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.188413  2025 raft_consensus.cc:2272] T b6002321e89f4925808b3d1110305308 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.190517  2025 tablet_replica.cc:333] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.191045  2025 raft_consensus.cc:2243] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.191789  2025 raft_consensus.cc:2272] T 101dfdd2225b41e4888d561ae59e5e6d P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.193805  2025 tablet_replica.cc:333] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.194273  2025 raft_consensus.cc:2243] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.194684  2025 raft_consensus.cc:2272] T 909e41a091f7440fa9c5fff3cefc005d P 5cf4c3c457844a8c8d0c825d6d707188 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.197393  2025 tablet_replica.cc:333] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.198024  2025 raft_consensus.cc:2243] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.198849  2025 raft_consensus.cc:2272] T 1fe313cc914f4030955e026bcaacc19c P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.200899  2025 tablet_replica.cc:333] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.201422  2025 raft_consensus.cc:2243] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.201900  2025 raft_consensus.cc:2272] T edc94be6c3e346598944c6f19db99795 P 5cf4c3c457844a8c8d0c825d6d707188 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.203918  2025 tablet_replica.cc:333] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.204420  2025 raft_consensus.cc:2243] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.204844  2025 raft_consensus.cc:2272] T bfca25342f2b45188d85d07a53b333ed P 5cf4c3c457844a8c8d0c825d6d707188 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.206801  2025 tablet_replica.cc:333] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188: stopping tablet replica
I20260709 13:20:48.207293  2025 raft_consensus.cc:2243] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.207738  2025 raft_consensus.cc:2272] T 9297ad2180a543fdbb0a6546b011bd77 P 5cf4c3c457844a8c8d0c825d6d707188 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.250557  2025 tablet_server.cc:196] TabletServer@127.1.250.66:0 shutdown complete.
I20260709 13:20:48.286083  2025 tablet_server.cc:179] TabletServer@127.1.250.67:0 shutting down...
I20260709 13:20:48.317999  2025 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:48.318645  2025 tablet_replica.cc:333] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.319411  2025 raft_consensus.cc:2243] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.319950  2025 raft_consensus.cc:2272] T 101dfdd2225b41e4888d561ae59e5e6d P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.322127  2025 tablet_replica.cc:333] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.322736  2025 raft_consensus.cc:2243] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.323568  2025 raft_consensus.cc:2272] T 294d47ad12ee4bfcb7b4511b08cb4756 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.326050  2025 tablet_replica.cc:333] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.326634  2025 raft_consensus.cc:2243] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.327128  2025 raft_consensus.cc:2272] T 115a6800c73f40b892541c9f0f53eff3 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:48.329033 14054 consensus_peers.cc:597] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 -> Peer 5cf4c3c457844a8c8d0c825d6d707188 (127.1.250.66:33499): Couldn't send request to peer 5cf4c3c457844a8c8d0c825d6d707188. Status: Network error: Client connection negotiation failed: client connection to 127.1.250.66:33499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.329351  2025 tablet_replica.cc:333] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.330111  2025 raft_consensus.cc:2243] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.330560  2025 raft_consensus.cc:2272] T d4d5f3e13d37415f88d3fc6dcbd08cdf P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.332644  2025 tablet_replica.cc:333] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.333344  2025 raft_consensus.cc:2243] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.333810  2025 raft_consensus.cc:2272] T 6819bd7e812040d49a50c6e7a981a899 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.335862  2025 tablet_replica.cc:333] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.336460  2025 raft_consensus.cc:2243] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.336891  2025 raft_consensus.cc:2272] T 75238bd7c9674881bbb2c98ed4996118 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.338886  2025 tablet_replica.cc:333] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.339444  2025 raft_consensus.cc:2243] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.339892  2025 raft_consensus.cc:2272] T 693673e936cd487db2af6d8d4fdbdfb4 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.341931  2025 tablet_replica.cc:333] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.342507  2025 raft_consensus.cc:2243] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.342944  2025 raft_consensus.cc:2272] T 619db8da711b4208b7e35e961f307e4d P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.345043  2025 tablet_replica.cc:333] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.345742  2025 raft_consensus.cc:2243] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.346218  2025 raft_consensus.cc:2272] T b589e88d96c048bea4491addeedd7ee4 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.348277  2025 tablet_replica.cc:333] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.348832  2025 raft_consensus.cc:2243] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.349292  2025 raft_consensus.cc:2272] T 1fe313cc914f4030955e026bcaacc19c P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.351182  2025 tablet_replica.cc:333] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.351727  2025 raft_consensus.cc:2243] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.352559  2025 raft_consensus.cc:2272] T edc94be6c3e346598944c6f19db99795 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.354956  2025 tablet_replica.cc:333] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.355574  2025 raft_consensus.cc:2243] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.356132  2025 raft_consensus.cc:2272] T b6002321e89f4925808b3d1110305308 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.358449  2025 tablet_replica.cc:333] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.359148  2025 raft_consensus.cc:2243] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.359628  2025 raft_consensus.cc:2272] T 5537ebb7b20747ea8fd6d1601a6e55c9 P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.361792  2025 tablet_replica.cc:333] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.362303  2025 raft_consensus.cc:2243] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.363142  2025 raft_consensus.cc:2272] T 909e41a091f7440fa9c5fff3cefc005d P a308a1dc4fe94728bd0f56413fb14987 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.365551  2025 tablet_replica.cc:333] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.366086  2025 raft_consensus.cc:2243] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.366518  2025 raft_consensus.cc:2272] T bfca25342f2b45188d85d07a53b333ed P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.368614  2025 tablet_replica.cc:333] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.369154  2025 raft_consensus.cc:2243] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.370011  2025 raft_consensus.cc:2272] T 9297ad2180a543fdbb0a6546b011bd77 P a308a1dc4fe94728bd0f56413fb14987 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.372952  2025 tablet_replica.cc:333] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.373533  2025 raft_consensus.cc:2243] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.373996  2025 raft_consensus.cc:2272] T 290a2cb6c7174c9ca338b70d16c001fc P a308a1dc4fe94728bd0f56413fb14987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.375942  2025 tablet_replica.cc:333] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987: stopping tablet replica
I20260709 13:20:48.376603  2025 raft_consensus.cc:2243] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.377061  2025 raft_consensus.cc:2272] T 9c361298644c46a8b929ba18dc463a27 P a308a1dc4fe94728bd0f56413fb14987 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.418951  2025 tablet_server.cc:196] TabletServer@127.1.250.67:0 shutdown complete.
I20260709 13:20:48.454576  2025 master.cc:562] Master@127.1.250.126:36751 shutting down...
I20260709 13:20:48.475739  2025 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.476328  2025 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.476684  2025 tablet_replica.cc:333] T 00000000000000000000000000000000 P 51eef8e846484bcaa52f2f0dcbca519c: stopping tablet replica
I20260709 13:20:48.497509  2025 master.cc:584] Master@127.1.250.126:36751 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11988 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (27731 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (354197 ms total)
[  PASSED  ] 8 tests.
I20260709 13:20:48.556407  2025 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 378 messages since previous log ~17 seconds ago
I20260709 13:20:48.556615  2025 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 377 messages since previous log ~17 seconds ago
I20260709 13:20:48.556763  2025 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 374 messages since previous log ~17 seconds ago
I20260709 13:20:48.556923  2025 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:20:48.557066  2025 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:20:48.557291  2025 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 1 messages since previous log ~110 seconds ago
I20260709 13:20:48.557446  2025 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 9 messages since previous log ~184 seconds ago
I20260709 13:20:48.557637  2025 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 13:20:48.557904  2025 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
